2024-03-23T05:54:34.271 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-23T05:54:34.271 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} --name yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/orig.config.yaml 2024-03-23T05:54:34.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T05:54:34.422 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300 branch: wip-yuri11-testing-2024-03-21-0851-reef description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} email: yweinste@redhat.com first_in_suite: false job_id: '7617300' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri11-testing-2024-03-21-0851-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: false mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: 82316b04821a6c2c1d458a881920454bbadb8837 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 82316b04821a6c2c1d458a881920454bbadb8837 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri11-testing-2024-03-21-0851-reef sha1: 82316b04821a6c2c1d458a881920454bbadb8837 owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1919 sha1: 82316b04821a6c2c1d458a881920454bbadb8837 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri11-testing-2024-03-21-0851-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_82316b04821a6c2c1d458a881920454bbadb8837/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 82316b04821a6c2c1d458a881920454bbadb8837 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOIE+m5d5gJ9ejXRmMtymx5RlzM4GAGsrptPn422giAu2p9TfTzdvquQoKNZuiutzQhnKdfbOqpaQnwYPpSpKk= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6EUeBXM2SHebB8vY03X2DvVg1ilhcdNVWA+XcY3VpE765bfRcatHeM5kCe/R6uYTqUT1Tqao/GjgcmwT6wd5k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-22_13:15:24 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-23T05:54:34.422 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_82316b04821a6c2c1d458a881920454bbadb8837/qa; will attempt to use it 2024-03-23T05:54:34.423 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_82316b04821a6c2c1d458a881920454bbadb8837/qa/tasks 2024-03-23T05:54:34.423 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-23T05:54:34.425 INFO:teuthology.task.internal:Checking packages... 2024-03-23T05:54:34.448 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '82316b04821a6c2c1d458a881920454bbadb8837' 2024-03-23T05:54:34.448 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-23T05:54:34.448 INFO:teuthology.packaging:ref: None 2024-03-23T05:54:34.448 INFO:teuthology.packaging:tag: None 2024-03-23T05:54:34.449 INFO:teuthology.packaging:branch: wip-yuri11-testing-2024-03-21-0851-reef 2024-03-23T05:54:34.449 INFO:teuthology.packaging:sha1: 82316b04821a6c2c1d458a881920454bbadb8837 2024-03-23T05:54:34.449 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri11-testing-2024-03-21-0851-reef 2024-03-23T05:54:34.661 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-954.g82316b04 2024-03-23T05:54:34.662 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-23T05:54:34.669 INFO:teuthology.task.internal:no buildpackages task found 2024-03-23T05:54:34.670 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-23T05:54:34.695 INFO:teuthology.task.internal:Saving configuration 2024-03-23T05:54:34.712 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-23T05:54:34.726 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-23T05:54:34.751 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 05:49:31.952763', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOIE+m5d5gJ9ejXRmMtymx5RlzM4GAGsrptPn422giAu2p9TfTzdvquQoKNZuiutzQhnKdfbOqpaQnwYPpSpKk='} 2024-03-23T05:54:34.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 05:49:31.950968', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6EUeBXM2SHebB8vY03X2DvVg1ilhcdNVWA+XcY3VpE765bfRcatHeM5kCe/R6uYTqUT1Tqao/GjgcmwT6wd5k='} 2024-03-23T05:54:34.775 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-23T05:54:34.786 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-23T05:54:34.786 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-23T05:54:34.786 INFO:teuthology.run_tasks:Running task console_log... 2024-03-23T05:54:34.880 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff8143bd160>, signals=[15]) 2024-03-23T05:54:34.881 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-23T05:54:34.889 INFO:teuthology.task.internal:Opening connections... 2024-03-23T05:54:34.889 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T05:54:34.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T05:54:34.976 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T05:54:34.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T05:54:35.060 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-23T05:54:35.068 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-03-23T05:54:35.086 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-03-23T05:54:35.086 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-03-23T05:54:35.142 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-03-23T05:54:35.142 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-03-23T05:54:35.142 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-03-23T05:54:35.142 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-03-23T05:54:35.142 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-03-23T05:54:35.142 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-03-23T05:54:35.143 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T05:54:35.143 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-03-23T05:54:35.143 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-03-23T05:54:35.143 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T05:54:35.143 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-03-23T05:54:35.143 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T05:54:35.143 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T05:54:35.143 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T05:54:35.144 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-03-23T05:54:35.167 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-03-23T05:54:35.184 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-03-23T05:54:35.184 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T05:54:35.241 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T05:54:35.242 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-03-23T05:54:35.266 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-23T05:54:35.276 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-23T05:54:35.302 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-23T05:54:35.302 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-03-23T05:54:35.304 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-03-23T05:54:35.320 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-23T05:54:35.328 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-23T05:54:35.328 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-03-23T05:54:35.361 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-03-23T05:54:35.459 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-23T05:54:35.521 INFO:teuthology.run_tasks:Running task kernel... 2024-03-23T05:54:35.536 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-23T05:54:35.536 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-03-23T05:54:35.536 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-03-23T05:54:35.536 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-23T05:54:35.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T05:54:35.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-23T05:54:35.845 DEBUG:teuthology.task.kernel:sha1 for client.0 is 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T05:54:35.846 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5ec3e6e88b2e2783e09498588bb1f433ae9c8986"... 2024-03-23T05:54:35.846 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-03-23T05:54:35.862 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-361.el9.x86_64 2024-03-23T05:54:35.862 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T05:54:35.863 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-23T05:54:35.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum upgrade -y linux-firmware 2024-03-23T05:54:38.117 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-23T05:54:39.542 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-03-23T05:54:40.618 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-23T05:54:57.258 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-03-23T05:55:01.841 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.1 MB 00:01 2024-03-23T05:55:03.450 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-03-23T05:55:04.404 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-03-23T05:55:09.335 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-23T05:55:11.607 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 1 Package 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 375 M 2024-03-23T05:55:11.622 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-03-23T05:55:18.769 INFO:teuthology.orchestra.run.smithi073.stdout:linux-firmware-20240219-143.el9.noarch.rpm 52 MB/s | 375 MB 00:07 2024-03-23T05:55:18.770 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-03-23T05:55:18.770 INFO:teuthology.orchestra.run.smithi073.stdout:Total 52 MB/s | 375 MB 00:07 2024-03-23T05:55:18.771 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-03-23T05:55:18.854 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-03-23T05:55:18.854 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-03-23T05:55:21.298 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-03-23T05:55:21.298 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-03-23T05:55:27.680 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-03-23T05:55:27.910 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-23T05:55:28.001 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T05:55:29.439 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T05:55:29.439 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-23T05:55:29.856 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-23T05:55:29.856 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T05:55:29.857 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-03-23T05:55:29.857 INFO:teuthology.orchestra.run.smithi073.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-23T05:55:29.857 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T05:55:29.857 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-03-23T05:55:30.147 INFO:teuthology.task.kernel:Downloading kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.0... 2024-03-23T05:55:30.147 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5ec3e6e88b2e2783e09498588bb1f433ae9c8986 2024-03-23T05:55:30.293 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/ 2024-03-23T05:55:30.293 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-23T05:55:30.296 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi073.front.sepia.ceph.com to complete... 2024-03-23T05:55:41.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23 05:55:41 URL:https://4.chacra.ceph.com/r/kernel/testing/5ec3e6e88b2e2783e09498588bb1f433ae9c8986/centos/9/flavors/default/x86_64/kernel-6.8.0_g5ec3e6e88b2e-1.x86_64.rpm [336309687/336309687] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-23T05:55:41.891 INFO:teuthology.orchestra.run.smithi073.stderr:FINISHED --2024-03-23 05:55:41-- 2024-03-23T05:55:41.891 INFO:teuthology.orchestra.run.smithi073.stderr:Total wall clock time: 12s 2024-03-23T05:55:41.891 INFO:teuthology.orchestra.run.smithi073.stderr:Downloaded: 1 files, 321M in 11s (28.4 MB/s) 2024-03-23T05:55:41.893 INFO:teuthology.task.kernel:Installing kernel 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 on client.0... 2024-03-23T05:55:41.894 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-23T05:55:43.830 INFO:teuthology.orchestra.run.smithi073.stdout:Verifying... ######################################## 2024-03-23T05:55:43.901 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing... ######################################## 2024-03-23T05:55:43.982 INFO:teuthology.orchestra.run.smithi073.stdout:Updating / installing... 2024-03-23T05:55:51.530 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-6.8.0_g5ec3e6e88b2e-1 ######################################## 2024-03-23T05:56:07.788 INFO:teuthology.orchestra.run.smithi073.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-23T05:56:30.248 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-23T05:56:30.248 DEBUG:teuthology.orchestra.run.smithi073:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-23T05:56:30.328 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e 2024-03-23T05:56:30.328 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/System.map 2024-03-23T05:56:30.328 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/config 2024-03-23T05:56:30.328 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel 2024-03-23T05:56:30.328 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch 2024-03-23T05:56:30.328 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86 2024-03-23T05:56:30.328 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-23T05:56:30.329 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-23T05:56:30.330 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/arch/x86/kvm/kvm.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ansi_cprng.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/anubis.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/arc4.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_pq.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_tx.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/async_xor.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/async_tx/raid6test.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authenc.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/authencesn.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blake2b_generic.ko 2024-03-23T05:56:30.331 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_common.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/blowfish_generic.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/camellia_generic.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast5_generic.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast6_generic.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cast_common.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/ccm.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cmac.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crc32_generic.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_engine.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/crypto_user.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/cts.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/des_generic.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/dh_generic.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/echainiv.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/essiv.ko 2024-03-23T05:56:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/fcrypt.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/khazad.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/lz4hc.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/md4.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/michael_mic.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcbc.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/pcrypt.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/rmd160.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/seed.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/serpent_generic.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tcrypt.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/tea.ko 2024-03-23T05:56:30.333 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_common.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/twofish_generic.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/vmac.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/wp512.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xcbc.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xor.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/crypto/xxhash_generic.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/acpi_pad.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/custom_method.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/ec_sys.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/platform_profile.ko 2024-03-23T05:56:30.334 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbs.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/sbshc.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/acpi/video.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/acard-ahci.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ahci_platform.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/ata_generic.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/libahci_platform.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_acpi.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ali.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_amd.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_artop.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atiixp.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_atp867x.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd640.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-23T05:56:30.335 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_cypress.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_efar.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt366.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it8213.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_it821x.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_jmicron.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_marvell.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_mpiix.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_netcell.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ninja32.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87410.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_ns87415.ko 2024-03-23T05:56:30.336 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_opti.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_optidma.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_piccolo.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_rdc.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sch.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_serverworks.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sil680.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sis.ko 2024-03-23T05:56:30.337 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_triflex.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pata_via.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/pdc_adma.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_inic162x.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_mv.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_nv.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_promise.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_qstor.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sil24.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sis.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_svw.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_sx4.ko 2024-03-23T05:56:30.338 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_uli.ko 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_via.ko 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ata/sata_vsc.ko 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/bcma/bcma.ko 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/aoe/aoe.ko 2024-03-23T05:56:30.339 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/brd.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/drbd/drbd.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/floppy.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/loop.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/nbd.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/pktcdvd.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/rbd.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/virtio_blk.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-23T05:56:30.340 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/xen-blkfront.ko 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/block/zram/zram.ko 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hangcheck-timer.ko 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi 2024-03-23T05:56:30.341 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/lp.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/mwave/mwave.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/ppdev.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tlclk.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-23T05:56:30.342 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/uv_mmtimer.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/char/virtio_console.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-23T05:56:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-aes.ko 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/padlock-sha.ko 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dca/dca.ko 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq 2024-03-23T05:56:30.344 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/amd64_edac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/e752x_edac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3000_edac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i3200_edac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5100_edac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i5400_edac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7300_edac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i7core_edac.ko 2024-03-23T05:56:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/i82975x_edac.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/ie31200_edac.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/sb_edac.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/edac/x38_edac.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/edd.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-ich.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-appleir.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-aureal.ko 2024-03-23T05:56:30.346 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-axff.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-dr.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elecom.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-elo.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-emsff.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gaff.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gt683r.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-gyration.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-holtekff.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-hyperv.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-icade.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-keytouch.ko 2024-03-23T05:56:30.347 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-kye.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lcpower.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-led.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-lenovo.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-multitouch.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-ortek.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-penmount.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-petalynx.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-picolcd.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-pl.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-plantronics.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-primax.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-rmi.ko 2024-03-23T05:56:30.348 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-roccat.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-saitek.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-samsung.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-23T05:56:30.349 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sjoy.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sony.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-speedlink.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-steelseries.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-sunplus.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tivo.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-tmff.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-topseed.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-twinhan.ko 2024-03-23T05:56:30.350 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-uclogic.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-waltop.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-wiimote.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-xinmo.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zpff.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/hid-zydacron.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/uhid.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hid/wacom.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_balloon.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_utils.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hv/hv_vmbus.ko 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon 2024-03-23T05:56:30.351 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/abituguru3.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7414.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ad7418.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adc128d818.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1025.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1026.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1029.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm1031.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adm9240.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ads7828.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7410.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7411.ko 2024-03-23T05:56:30.352 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7462.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7470.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7475.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/adt7x10.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/amc6821.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/applesmc.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asb100.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asc7621.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/atxp1.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/coretemp.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/dme1737.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds1621.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ds620.ko 2024-03-23T05:56:30.353 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc1403.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/emc6w201.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71805f.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f71882fg.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/f75375s.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/fschmd.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g760a.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/g762.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl518sm.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/gl520sm.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-23T05:56:30.354 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmaem.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ibmpex.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina209.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ina2xx.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/it87.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k10temp.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/k8temp.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm63.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm73.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm75.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm77.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm78.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm80.ko 2024-03-23T05:56:30.355 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm83.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm85.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm87.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm90.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm92.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm93.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95234.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95241.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/lm95245.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc2945.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4151.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4215.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4222.ko 2024-03-23T05:56:30.356 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4245.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4260.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/ltc4261.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max16065.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1619.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max1668.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max197.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6639.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6650.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/max6697.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/mcp3021.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6683.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct6775.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/nct7802.ko 2024-03-23T05:56:30.357 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87360.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pc87427.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pcf8591.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-23T05:56:30.358 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/powr1220.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5627.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch5636.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht15.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sht21.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/shtc1.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/sis5595.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-23T05:56:30.359 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/thmc50.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp102.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp103.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp401.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/tmp421.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/via686a.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt1211.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/vt8231.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83627hf.ko 2024-03-23T05:56:30.360 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83781d.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83791d.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83792d.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83793.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83795.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-23T05:56:30.361 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-23T05:56:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-dev.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-mux.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/i2c/i2c-stub.ko 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core 2024-03-23T05:56:30.363 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-23T05:56:30.364 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4 2024-03-23T05:56:30.365 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-23T05:56:30.365 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5 2024-03-23T05:56:30.365 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-23T05:56:30.365 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca 2024-03-23T05:56:30.365 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-23T05:56:30.365 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp 2024-03-23T05:56:30.366 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib 2024-03-23T05:56:30.366 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-23T05:56:30.366 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser 2024-03-23T05:56:30.366 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-23T05:56:30.366 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert 2024-03-23T05:56:30.367 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-23T05:56:30.367 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp 2024-03-23T05:56:30.367 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-23T05:56:30.367 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt 2024-03-23T05:56:30.367 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-23T05:56:30.368 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input 2024-03-23T05:56:30.368 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport 2024-03-23T05:56:30.368 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-23T05:56:30.368 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-23T05:56:30.368 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/gameport/gameport.ko 2024-03-23T05:56:30.368 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/joydev.ko 2024-03-23T05:56:30.369 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard 2024-03-23T05:56:30.369 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-23T05:56:30.369 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse 2024-03-23T05:56:30.369 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/appletouch.ko 2024-03-23T05:56:30.369 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-23T05:56:30.369 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-23T05:56:30.370 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-23T05:56:30.370 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/sermouse.ko 2024-03-23T05:56:30.370 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-23T05:56:30.370 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-23T05:56:30.370 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-23T05:56:30.370 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4 2024-03-23T05:56:30.371 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-23T05:56:30.371 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio 2024-03-23T05:56:30.371 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-23T05:56:30.371 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-23T05:56:30.371 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-23T05:56:30.371 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/serio/serio_raw.ko 2024-03-23T05:56:30.372 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/input/sparse-keymap.ko 2024-03-23T05:56:30.372 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds 2024-03-23T05:56:30.372 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-blinkm.ko 2024-03-23T05:56:30.372 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lm3530.ko 2024-03-23T05:56:30.372 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-lp3944.ko 2024-03-23T05:56:30.372 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/leds-ss4200.ko 2024-03-23T05:56:30.373 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger 2024-03-23T05:56:30.373 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-23T05:56:30.373 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-23T05:56:30.373 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-23T05:56:30.373 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-23T05:56:30.373 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/bcache/bcache.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-bio-prison.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache-smq.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-cache.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-crypt.ko 2024-03-23T05:56:30.374 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-delay.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-flakey.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-log-userspace.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-multipath.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-queue-length.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-raid.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-round-robin.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-service-time.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-switch.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-thin-pool.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/dm-verity.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid0.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid1.ko 2024-03-23T05:56:30.375 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid10.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/md/raid456.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptbase.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptctl.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptfc.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptlan.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptsas.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/message/fusion/mptspi.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_ich.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/lpc_sch.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/mfd-core.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/sm501.ko 2024-03-23T05:56:30.376 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/viperboard.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/vx855.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/mfd/wl1273-core.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds9802als.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/apds990x.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/bh1770glc.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/cb710/cb710.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/at24.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-23T05:56:30.377 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/enclosure.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/hpilo.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29003.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/isl29020.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-me.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/mei/mei.ko 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru 2024-03-23T05:56:30.378 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tifm_core.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/tsl2550.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_balloon.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding 2024-03-23T05:56:30.379 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/bonding/bonding.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/dummy.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/eql.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-23T05:56:30.380 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd 2024-03-23T05:56:30.381 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom 2024-03-23T05:56:30.382 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-23T05:56:30.383 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-23T05:56:30.384 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/dnet.ko 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel 2024-03-23T05:56:30.385 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-23T05:56:30.386 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/jme.ko 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-23T05:56:30.387 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-23T05:56:30.388 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-23T05:56:30.389 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-23T05:56:30.390 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-23T05:56:30.391 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/geneve.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ifb.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-23T05:56:30.392 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvlan.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/macvtap.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/mii.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/net_failover.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/netconsole.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/nlmon.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-23T05:56:30.393 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/amd.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/broadcom.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/cicada.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/davicom.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/dp83640.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/et1011c.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/icplus.ko 2024-03-23T05:56:30.394 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/lxt.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/marvell.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/micrel.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/national.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/phylink.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/qsemi.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/realtek.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/smsc.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/phy/vitesse.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-23T05:56:30.395 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppoe.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pppox.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/ppp/pptp.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slhc.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/slip/slip.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/sungem_phy.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tap.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-23T05:56:30.396 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_random.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/tun.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/veth.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/virtio_net.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/net/xen-netfront.ko 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb 2024-03-23T05:56:30.397 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ntb/ntb.ko 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/nvme/host/nvme.ko 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport.ko 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_cs.ko 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_pc.ko 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/parport/parport_serial.ko 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie 2024-03-23T05:56:30.398 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pci/xen-pcifront.ko 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/i82092.ko 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/pd6729.ko 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-23T05:56:30.399 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/hdaps.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-23T05:56:30.400 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/platform/x86/wmi.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-23T05:56:30.401 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/pps/pps_core.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-23T05:56:30.402 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-23T05:56:30.403 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-sas.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/BusLogic.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/a100u2w.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-23T05:56:30.404 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/advansys.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/am53c974.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/atp870u.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-23T05:56:30.405 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ch.ko 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dc395x.ko 2024-03-23T05:56:30.406 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/dmx3191d.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/esp_scsi.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-23T05:56:30.407 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hpsa.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hptiop.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/initio.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ipr.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ips.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/isci/isci.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-23T05:56:30.408 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid.ko 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-23T05:56:30.409 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/mvumi.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/pmcraid.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla1280.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/raid_class.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_debug.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-23T05:56:30.410 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/ses.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/st.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/stex.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/scsi/wd719x.ko 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb 2024-03-23T05:56:30.411 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ssb/ssb.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_file.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_iblock.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_mod.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_pscsi.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/target_core_user.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel 2024-03-23T05:56:30.412 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-23T05:56:30.413 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_gsm.ko 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/n_hdlc.ko 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/nozomi.ko 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250 2024-03-23T05:56:30.414 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-23T05:56:30.415 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-23T05:56:30.415 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm 2024-03-23T05:56:30.415 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-23T05:56:30.415 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs 2024-03-23T05:56:30.415 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core 2024-03-23T05:56:30.415 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-23T05:56:30.415 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host 2024-03-23T05:56:30.416 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-23T05:56:30.416 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio 2024-03-23T05:56:30.416 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio.ko 2024-03-23T05:56:30.416 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_aec.ko 2024-03-23T05:56:30.416 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_cif.ko 2024-03-23T05:56:30.416 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-23T05:56:30.417 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/uio/uio_sercos3.ko 2024-03-23T05:56:30.417 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb 2024-03-23T05:56:30.417 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class 2024-03-23T05:56:30.417 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-23T05:56:30.417 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-23T05:56:30.417 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usblp.ko 2024-03-23T05:56:30.417 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/class/usbtmc.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/mdc800.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/image/microtek.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/adutux.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi26.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/emi62.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ezusb.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/idmouse.ko 2024-03-23T05:56:30.418 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/ldusb.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usb3503.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usblcd.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/uss720.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/misc/yurex.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-23T05:56:30.419 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/aircable.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ark3116.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ch341.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cp210x.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/empeg.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-23T05:56:30.420 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/io_ti.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipaq.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ipw.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7720.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/mos7840.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/navman.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/omninet.ko 2024-03-23T05:56:30.421 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/opticon.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/option.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/oti6858.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/pl2303.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcaux.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/qcserial.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/quatech2.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/sierra.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ssu100.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-23T05:56:30.422 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/visor.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/uas.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-23T05:56:30.423 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-23T05:56:30.424 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_net.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/lcd.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio 2024-03-23T05:56:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_balloon.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_mmio.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/virtio/virtio_ring.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2482.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/masters/ds2490.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-23T05:56:30.426 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/w1/wire.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/hpwdt.ko 2024-03-23T05:56:30.427 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/i6300esb.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ibmasr.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/machzwd.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/nv_tco.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/softdog.ko 2024-03-23T05:56:30.428 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/via_wdt.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-evtchn.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-gntdev.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-23T05:56:30.429 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xen-privcmd.ko 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/9p/9p.ko 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/affs/affs.ko 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/befs/befs.ko 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/binfmt_misc.ko 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/btrfs/btrfs.ko 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles 2024-03-23T05:56:30.430 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cachefiles/cachefiles.ko 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ceph/ceph.ko 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/coda/coda.ko 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/cramfs/cramfs.ko 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/dlm/dlm.ko 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/f2fs/f2fs.ko 2024-03-23T05:56:30.431 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/fat.ko 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/msdos.ko 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fat/vfat.ko 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/cuse.ko 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/fuse/fuse.ko 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/gfs2/gfs2.ko 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfs/hfs.ko 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/hfsplus/hfsplus.ko 2024-03-23T05:56:30.432 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/isofs/isofs.ko 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/jfs/jfs.ko 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/lockd/lockd.ko 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/minix/minix.ko 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/netfs/netfs.ko 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-23T05:56:30.433 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfs.ko 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv3.ko 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs/nfsv4.ko 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/grace.ko 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nfsd/nfsd.ko 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nilfs2/nilfs2.ko 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls 2024-03-23T05:56:30.434 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-celtic.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-centeuro.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-croatian.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-cyrillic.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-gaelic.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-greek.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-iceland.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-inuit.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-roman.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-romanian.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/mac-turkish.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1250.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1251.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp1255.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp737.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp775.ko 2024-03-23T05:56:30.435 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp850.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp852.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp855.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp857.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp860.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp861.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp862.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp863.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp864.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp865.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp866.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp869.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp874.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp932.ko 2024-03-23T05:56:30.436 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp936.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp949.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_cp950.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_euc-jp.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-23T05:56:30.437 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-r.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_koi8-u.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/nls/nls_utf8.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2.ko 2024-03-23T05:56:30.438 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/overlayfs/overlay.ko 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/pstore/ramoops.ko 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/reiserfs/reiserfs.ko 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/romfs/romfs.ko 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/client/cifs.ko 2024-03-23T05:56:30.439 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/smb/common/cifs_md4.ko 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/squashfs/squashfs.ko 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/sysv/sysv.ko 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/udf/udf.ko 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/ufs/ufs.ko 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/fs/xfs/xfs.ko 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu 2024-03-23T05:56:30.440 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/rcu/rcutorture.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/torture.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/asn1_encoder.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc-itu-t.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crc8.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libarc4.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/crypto/libdes.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/libcrc32c.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lru_cache.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4_compress.ko 2024-03-23T05:56:30.441 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/math/cordic.ko 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/raid6/raid6_pq.ko 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_bm.ko 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_fsm.ko 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/ts_kmp.ko 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/lib/zstd/zstd_compress.ko 2024-03-23T05:56:30.442 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/mm/hwpoison-inject.ko 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/6lowpan.ko 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_dest.ko 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_hop.ko 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-23T05:56:30.443 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_routing.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/6lowpan/nhc_udp.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/garp.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/mrp.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/p8022.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/psnap.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/802/stp.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/8021q/8021q.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_fd.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_rdma.ko 2024-03-23T05:56:30.444 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/9p/9pnet_virtio.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/batman-adv/batman-adv.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/br_netfilter.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/bridge.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-23T05:56:30.445 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-23T05:56:30.446 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ceph/libceph.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/failover.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/core/pktgen.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_diag.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv4.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dccp/dccp_ipv6.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dns_resolver/dns_resolver.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/dsa_core.ko 2024-03-23T05:56:30.447 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_brcm.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_dsa.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_none.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/dsa/tag_trailer.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ah4.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/esp4.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/fou.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/gre.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/inet_diag.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_gre.ko 2024-03-23T05:56:30.448 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_tunnel.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ip_vti.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipcomp.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/ipip.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-23T05:56:30.449 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-23T05:56:30.450 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_bic.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_diag.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_htcp.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_hybla.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_illinois.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_lp.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_scalable.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_vegas.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_veno.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_westwood.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tcp_yeah.ko 2024-03-23T05:56:30.451 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/tunnel4.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_diag.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/udp_tunnel.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ah6.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/esp6.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/fou6.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ip6_vti.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/ipcomp6.ko 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter 2024-03-23T05:56:30.452 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-23T05:56:30.453 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/sit.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/tunnel6.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/key/af_key.ko 2024-03-23T05:56:30.454 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_core.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_eth.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/llc/llc.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mac802154/mac802154.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/mpls/mpls_gso.ko 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter 2024-03-23T05:56:30.455 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-23T05:56:30.456 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-23T05:56:30.457 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conncount.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-23T05:56:30.458 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-23T05:56:30.459 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nf_tables.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_compat.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_ct.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fib.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-23T05:56:30.460 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_hash.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_limit.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_log.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_masq.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_nat.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_numgen.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_queue.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_quota.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_redir.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_socket.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/nft_tunnel.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-23T05:56:30.461 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_CT.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_DSCP.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HL.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_HMARK.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LED.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_LOG.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-23T05:56:30.462 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TEE.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_TRACE.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_addrtype.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_bpf.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cgroup.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cluster.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_comment.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connbytes.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlabel.ko 2024-03-23T05:56:30.463 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connlimit.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_connmark.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_conntrack.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_cpu.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dccp.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_devgroup.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_dscp.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ecn.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_esp.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_helper.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_hl.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_iprange.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_ipvs.ko 2024-03-23T05:56:30.464 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_l2tp.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_length.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_limit.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mac.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_mark.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_multiport.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nat.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_nfacct.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_osf.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_owner.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_physdev.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_pkttype.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_policy.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_quota.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_rateest.ko 2024-03-23T05:56:30.465 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_realm.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_recent.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_sctp.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_set.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_socket.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_state.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_statistic.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_string.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_time.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netfilter/xt_u32.ko 2024-03-23T05:56:30.466 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/netlink/netlink_diag.ko 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/nsh/nsh.ko 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/openvswitch.ko 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-geneve.ko 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-gre.ko 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/packet/af_packet_diag.ko 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds 2024-03-23T05:56:30.467 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_rdma.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/rds/rds_tcp.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_csum.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_gact.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_mirred.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_nat.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_pedit.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_police.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_simple.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_skbedit.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/act_vlan.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_basic.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_bpf.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_flow.ko 2024-03-23T05:56:30.468 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_fw.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_route.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/cls_u32.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_cmp.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_ipset.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_meta.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_nbyte.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_text.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/em_u32.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_choke.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_codel.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_drr.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_fq.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_gred.ko 2024-03-23T05:56:30.469 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hfsc.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_hhf.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_htb.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_ingress.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_multiq.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_netem.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_pie.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_plug.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_prio.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_qfq.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_red.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfb.ko 2024-03-23T05:56:30.470 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_sfq.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_tbf.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sched/sch_teql.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sctp/sctp_diag.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/sunrpc.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/diag.ko 2024-03-23T05:56:30.471 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/tipc/tipc.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/unix/unix_diag.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys 2024-03-23T05:56:30.472 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/security/keys/trusted-keys/trusted.ko 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/kernel/virt/lib/irqbypass.ko 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.alias.bin 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.alias.bin 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.bin 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.builtin.modinfo 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.dep.bin 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.devname 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.order 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.softdep 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols 2024-03-23T05:56:30.473 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/modules.symbols.bin 2024-03-23T05:56:30.474 INFO:teuthology.orchestra.run.smithi073.stdout:/lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-23T05:56:30.477 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g5ec3e6e88b2e 2024-03-23T05:56:30.477 DEBUG:teuthology.orchestra.run.smithi073:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-23T05:56:30.500 INFO:teuthology.orchestra.run.smithi073.stdout:postinstall scriptlet (using /bin/sh): 2024-03-23T05:56:30.500 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout: /usr/bin/kernel-install add 6.8.0-g5ec3e6e88b2e /lib/modules/6.8.0-g5ec3e6e88b2e/vmlinuz 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:for file in vmlinuz System.map config; do 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout: if ! cmp --silent "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e"; then 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout: cp "/lib/modules/6.8.0-g5ec3e6e88b2e/${file}" "/boot/${file}-6.8.0-g5ec3e6e88b2e" 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout: fi 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:new-kernel-pkg --remove 6.8.0-g5ec3e6e88b2e --rminitrd --initrdfile=/boot/initramfs-6.8.0-g5ec3e6e88b2e.img 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-install remove 6.8.0-g5ec3e6e88b2e 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-23T05:56:30.501 INFO:teuthology.orchestra.run.smithi073.stdout:/sbin/update-bootloader --remove 6.8.0-g5ec3e6e88b2e 2024-03-23T05:56:30.502 INFO:teuthology.orchestra.run.smithi073.stdout:fi 2024-03-23T05:56:30.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 68.el9 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8264254 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-23T05:56:30.577 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-03-23T05:56:30.578 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T05:56:30.579 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-03-23T05:56:30.579 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-23T05:56:30.580 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 6.8.0-g5ec3e6e88b2e 2024-03-23T05:56:30.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-23T05:56:31.171 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-03-23T05:56:32.606 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-23T05:56:32.639 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-03-23T05:56:32.652 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-23T05:56:32.668 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.eRw0adF4K9 2024-03-23T05:56:32.669 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eRw0adF4K9 2024-03-23T05:56:32.751 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.eRw0adF4K9 2024-03-23T05:56:32.894 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.eRw0adF4K9 is 6KB 2024-03-23T05:56:32.914 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.eRw0adF4K9 2024-03-23T05:56:32.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-03-23T05:56:32.991 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-23T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-23T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-23T05:56:32.992 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g5ec3e6e88b2e.conf 2024-03-23T05:56:32.993 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g5ec3e6e88b2e 2024-03-23T05:56:33.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-03-23T05:57:03.146 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-23T05:57:03.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-23T05:57:03.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T05:58:03.150 DEBUG:teuthology.orchestra.remote:timed out 2024-03-23T05:58:12.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-23T05:58:12.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T05:58:19.789 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-03-23T05:58:20.450 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-23T05:58:20.451 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g5ec3e6e88b2e"... 2024-03-23T05:58:20.451 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-03-23T05:58:20.488 INFO:teuthology.orchestra.run.smithi073.stdout:6.8.0-g5ec3e6e88b2e 2024-03-23T05:58:20.488 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g5ec3e6e88b2e vs 6.8.0-g5ec3e6e88b2e 2024-03-23T05:58:20.489 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-23T05:58:20.489 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-23T05:58:21.492 DEBUG:teuthology.parallel:result is None 2024-03-23T05:58:21.492 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-23T05:58:21.499 INFO:teuthology.task.internal:Creating test directory... 2024-03-23T05:58:21.499 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-23T05:58:21.506 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-23T05:58:21.550 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-23T05:58:21.556 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-23T05:58:21.608 INFO:teuthology.task.internal:Creating archive directory... 2024-03-23T05:58:21.608 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-23T05:58:21.615 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-23T05:58:21.731 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-23T05:58:21.738 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-23T05:58:21.738 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-23T05:58:21.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T05:58:21.755 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-23T05:58:21.760 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-23T05:58:21.839 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T05:58:21.875 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T05:58:21.906 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T05:58:21.984 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-23T05:58:21.989 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-23T05:58:21.996 INFO:teuthology.task.internal:Configuring sudo... 2024-03-23T05:58:21.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-23T05:58:22.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-23T05:58:22.074 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-23T05:58:22.082 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-23T05:58:22.082 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-23T05:58:22.087 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-23T05:58:22.120 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T05:58:22.230 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T05:58:22.333 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T05:58:22.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T05:58:22.490 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T05:58:22.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-23T05:58:22.587 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T05:58:22.632 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-23T05:58:22.692 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T05:58:22.778 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-23T05:58:22.819 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T05:58:22.820 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-23T05:58:22.889 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-03-23T05:58:22.894 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-03-23T05:58:22.974 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-23T05:58:23.025 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-23T05:58:23.478 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-23T05:58:23.489 INFO:teuthology.task.internal:Starting timer... 2024-03-23T05:58:23.489 INFO:teuthology.run_tasks:Running task pcp... 2024-03-23T05:58:23.518 INFO:teuthology.run_tasks:Running task selinux... 2024-03-23T05:58:23.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-03-23T05:58:23.629 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-03-23T05:58:23.633 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-03-23T05:58:23.695 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-03-23T05:58:23.697 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-23T05:58:23.697 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-03-23T05:58:23.743 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-03-23T05:58:23.743 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-03-23T05:58:23.766 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-03-23T05:58:23.766 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive'} 2024-03-23T05:58:23.767 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-23T05:58:23.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T05:58:23.845 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-23T05:58:23.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T05:58:23.875 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-23T05:58:23.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-03-23T05:58:23.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-03-23T05:58:24.018 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-23T05:58:24.027 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-23T05:58:24.032 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-23T05:58:24.140 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-23T05:58:24.153 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-23T05:58:24.154 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-23T06:04:13.582 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-03-23T06:04:13.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-23T06:04:13.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T06:04:13.726 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-03-23T06:04:13.880 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-23T06:04:13.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-23T06:04:13.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T06:04:13.967 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-03-23T06:04:14.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-03-23T06:04:14.039 INFO:teuthology.run_tasks:Running task clock... 2024-03-23T06:04:14.050 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-23T06:04:14.050 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-23T06:04:14.050 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T06:04:14.058 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-23T06:04:14.058 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T06:04:14.114 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-23T06:04:14.131 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-23T06:04:14.156 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-23T06:04:14.160 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-03-23T06:04:14.174 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-03-23T06:04:14.191 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-23T06:04:14.207 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-23T06:04:14.208 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-23T06:04:14.251 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-03-23T06:04:14.255 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-23T06:04:14.255 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-03-23T06:04:14.255 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:04:14.255 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:04:14.255 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:04:14.256 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:04:14.304 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-03-23T06:04:14.344 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-03-23T06:04:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-23T06:04:14.448 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-23T06:04:14.573 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-03-23T06:04:14.580 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-23T06:04:14.580 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-03-23T06:04:14.580 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:04:14.580 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:04:14.580 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:04:14.580 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:04:14.582 INFO:teuthology.run_tasks:Running task install... 2024-03-23T06:04:14.590 DEBUG:teuthology.task.install:project ceph 2024-03-23T06:04:14.590 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837'}} 2024-03-23T06:04:14.590 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837'} 2024-03-23T06:04:14.590 INFO:teuthology.task.install:Using flavor: default 2024-03-23T06:04:14.596 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-23T06:04:14.597 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-03-23T06:04:14.597 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837', 'tag': None, 'wait_for_package': False} 2024-03-23T06:04:14.597 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=82316b04821a6c2c1d458a881920454bbadb8837 2024-03-23T06:04:14.599 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837', 'tag': None, 'wait_for_package': False} 2024-03-23T06:04:14.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=82316b04821a6c2c1d458a881920454bbadb8837 2024-03-23T06:04:14.756 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-21-0851-reef/82316b04821a6c2c1d458a881920454bbadb8837/centos/9/flavors/default/ 2024-03-23T06:04:14.756 INFO:teuthology.task.install.rpm:Package version is 18.2.2-954.g82316b04 2024-03-23T06:04:14.823 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-21-0851-reef/82316b04821a6c2c1d458a881920454bbadb8837/centos/9/flavors/default/ 2024-03-23T06:04:14.824 INFO:teuthology.task.install.rpm:Package version is 18.2.2-954.g82316b04 2024-03-23T06:04:14.939 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-21-0851-reef/82316b04821a6c2c1d458a881920454bbadb8837/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-21-0851-reef/82316b04821a6c2c1d458a881920454bbadb8837/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-21-0851-reef/82316b04821a6c2c1d458a881920454bbadb8837/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-23T06:04:14.939 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:04:14.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-23T06:04:14.995 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-21-0851-reef/82316b04821a6c2c1d458a881920454bbadb8837/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-21-0851-reef/82316b04821a6c2c1d458a881920454bbadb8837/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-21-0851-reef/82316b04821a6c2c1d458a881920454bbadb8837/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-23T06:04:14.995 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:04:14.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-23T06:04:15.027 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-23T06:04:15.028 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/82316b04821a6c2c1d458a881920454bbadb8837/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-23T06:04:15.036 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-23T06:04:15.036 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/82316b04821a6c2c1d458a881920454bbadb8837/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-23T06:04:15.098 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-23T06:04:15.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-23T06:04:15.180 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-23T06:04:15.248 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-03-23T06:04:15.249 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-03-23T06:04:15.293 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-23T06:04:15.379 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-03-23T06:04:15.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-03-23T06:04:15.485 INFO:teuthology.orchestra.run.smithi110.stdout:74 files removed 2024-03-23T06:04:15.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-23T06:04:15.736 INFO:teuthology.orchestra.run.smithi073.stdout:74 files removed 2024-03-23T06:04:15.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-23T06:04:16.282 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 161 kB/s | 77 kB 00:00 2024-03-23T06:04:16.688 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 190 kB/s | 77 kB 00:00 2024-03-23T06:04:16.699 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 26 kB/s | 9.9 kB 00:00 2024-03-23T06:04:17.041 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-03-23T06:04:17.223 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 21 kB/s | 9.9 kB 00:00 2024-03-23T06:04:17.502 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-23T06:04:17.790 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-03-23T06:04:18.343 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-23T06:04:19.003 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-03-23T06:04:19.943 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-03-23T06:04:20.518 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.0 MB 00:01 2024-03-23T06:04:21.531 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.0 MB 00:01 2024-03-23T06:04:22.436 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-03-23T06:04:23.683 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-03-23T06:04:26.628 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.1 MB 00:00 2024-03-23T06:04:27.900 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-03-23T06:04:28.354 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 16 kB 00:00 2024-03-23T06:04:30.692 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-03-23T06:04:31.389 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 21 MB 00:02 2024-03-23T06:04:31.760 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-03-23T06:04:36.297 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-03-23T06:04:37.560 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-23T06:04:38.585 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-23T06:04:38.586 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-23T06:04:38.599 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-23T06:04:38.600 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-23T06:04:38.601 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-23T06:04:38.602 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-23T06:04:38.605 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-23T06:04:38.607 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-23T06:04:38.608 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-23T06:04:38.687 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-03-23T06:04:38.697 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================== 2024-03-23T06:04:38.697 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-03-23T06:04:38.697 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================== 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:18.2.2-954.g82316b04.el9 ceph 6.5 k 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:18.2.2-954.g82316b04.el9 ceph 5.1 M 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:18.2.2-954.g82316b04.el9 ceph 843 k 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-954.g82316b04.el9 ceph 143 k 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:18.2.2-954.g82316b04.el9 ceph 1.4 M 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 138 k 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 1.7 M 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 7.4 M 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 49 k 2024-03-23T06:04:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:18.2.2-954.g82316b04.el9 ceph 7.7 M 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:18.2.2-954.g82316b04.el9 ceph 40 M 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 264 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 224 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:18.2.2-954.g82316b04.el9 ceph 221 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 18 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:18.2.2-954.g82316b04.el9 ceph 31 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:18.2.2-954.g82316b04.el9 ceph 704 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:18.2.2-954.g82316b04.el9 ceph 127 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-23T06:04:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:18.2.2-954.g82316b04.el9 ceph 161 k 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:18.2.2-954.g82316b04.el9 ceph 320 k 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:18.2.2-954.g82316b04.el9 ceph 297 k 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:18.2.2-954.g82316b04.el9 ceph 99 k 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:18.2.2-954.g82316b04.el9 ceph 87 k 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:18.2.2-954.g82316b04.el9 ceph 3.0 M 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:18.2.2-954.g82316b04.el9 ceph 172 k 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-03-23T06:04:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-23T06:04:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:18.2.2-954.g82316b04.el9 ceph 3.3 M 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:18.2.2-954.g82316b04.el9 ceph 3.0 M 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-23T06:04:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:18.2.2-954.g82316b04.el9 ceph 18 M 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 23 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:18.2.2-954.g82316b04.el9 ceph 2.1 M 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 245 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:18.2.2-954.g82316b04.el9 ceph 4.7 M 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:18.2.2-954.g82316b04.el9 ceph 16 M 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 15 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:18.2.2-954.g82316b04.el9 ceph 25 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-23T06:04:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:18.2.2-954.g82316b04.el9 ceph 166 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:18.2.2-954.g82316b04.el9 ceph 474 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:18.2.2-954.g82316b04.el9 ceph 4.5 M 2024-03-23T06:04:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:18.2.2-954.g82316b04.el9 ceph 45 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:18.2.2-954.g82316b04.el9 ceph 127 k 2024-03-23T06:04:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-23T06:04:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-23T06:04:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-23T06:04:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:04:38.709 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-03-23T06:04:38.710 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================== 2024-03-23T06:04:38.710 INFO:teuthology.orchestra.run.smithi110.stdout:Install 132 Packages 2024-03-23T06:04:38.710 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 24 Packages 2024-03-23T06:04:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:04:38.710 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 204 M 2024-03-23T06:04:38.710 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-03-23T06:04:39.490 INFO:teuthology.orchestra.run.smithi110.stdout:(1/156): ceph-18.2.2-954.g82316b04.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-03-23T06:04:39.807 INFO:teuthology.orchestra.run.smithi110.stdout:(2/156): ceph-fuse-18.2.2-954.g82316b04.el9.x86 2.6 MB/s | 843 kB 00:00 2024-03-23T06:04:39.882 INFO:teuthology.orchestra.run.smithi110.stdout:(3/156): ceph-immutable-object-cache-18.2.2-954 1.9 MB/s | 143 kB 00:00 2024-03-23T06:04:40.197 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-23T06:04:40.199 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-23T06:04:40.221 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-23T06:04:40.222 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-23T06:04:40.224 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-23T06:04:40.226 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-23T06:04:40.228 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-23T06:04:40.232 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-23T06:04:40.234 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-23T06:04:40.282 INFO:teuthology.orchestra.run.smithi110.stdout:(4/156): ceph-mds-18.2.2-954.g82316b04.el9.x86_ 5.3 MB/s | 2.1 MB 00:00 2024-03-23T06:04:40.321 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-03-23T06:04:40.356 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================== 2024-03-23T06:04:40.356 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-03-23T06:04:40.356 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================== 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:18.2.2-954.g82316b04.el9 ceph 6.5 k 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:18.2.2-954.g82316b04.el9 ceph 5.1 M 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:18.2.2-954.g82316b04.el9 ceph 843 k 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-954.g82316b04.el9 ceph 143 k 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:18.2.2-954.g82316b04.el9 ceph 1.4 M 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 138 k 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 1.7 M 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 7.4 M 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 49 k 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:18.2.2-954.g82316b04.el9 ceph 7.7 M 2024-03-23T06:04:40.357 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:18.2.2-954.g82316b04.el9 ceph 40 M 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 264 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 224 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:18.2.2-954.g82316b04.el9 ceph 221 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 18 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:18.2.2-954.g82316b04.el9 ceph 31 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:18.2.2-954.g82316b04.el9 ceph 704 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:18.2.2-954.g82316b04.el9 ceph 127 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-23T06:04:40.358 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:18.2.2-954.g82316b04.el9 ceph 161 k 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:18.2.2-954.g82316b04.el9 ceph 320 k 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:18.2.2-954.g82316b04.el9 ceph 297 k 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:18.2.2-954.g82316b04.el9 ceph 99 k 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:18.2.2-954.g82316b04.el9 ceph 87 k 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:18.2.2-954.g82316b04.el9 ceph 3.0 M 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:18.2.2-954.g82316b04.el9 ceph 172 k 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-23T06:04:40.359 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:18.2.2-954.g82316b04.el9 ceph 3.3 M 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:18.2.2-954.g82316b04.el9 ceph 3.0 M 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-23T06:04:40.360 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:18.2.2-954.g82316b04.el9 ceph 18 M 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 23 k 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:18.2.2-954.g82316b04.el9 ceph 2.1 M 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 245 k 2024-03-23T06:04:40.361 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:18.2.2-954.g82316b04.el9 ceph 4.7 M 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:18.2.2-954.g82316b04.el9 ceph 16 M 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:18.2.2-954.g82316b04.el9 ceph-noarch 15 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:18.2.2-954.g82316b04.el9 ceph 25 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:18.2.2-954.g82316b04.el9 ceph 166 k 2024-03-23T06:04:40.362 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:18.2.2-954.g82316b04.el9 ceph 474 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:18.2.2-954.g82316b04.el9 ceph 4.5 M 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-23T06:04:40.363 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:18.2.2-954.g82316b04.el9 ceph 45 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:18.2.2-954.g82316b04.el9 ceph 127 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-23T06:04:40.364 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-23T06:04:40.365 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-23T06:04:40.366 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-23T06:04:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout:=========================================================================================== 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout:Install 132 Packages 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 24 Packages 2024-03-23T06:04:40.368 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:04:40.369 INFO:teuthology.orchestra.run.smithi110.stdout:(5/156): ceph-base-18.2.2-954.g82316b04.el9.x86 4.6 MB/s | 5.1 MB 00:01 2024-03-23T06:04:40.369 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 204 M 2024-03-23T06:04:40.369 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-03-23T06:04:40.550 INFO:teuthology.orchestra.run.smithi110.stdout:(6/156): ceph-mgr-18.2.2-954.g82316b04.el9.x86_ 5.4 MB/s | 1.4 MB 00:00 2024-03-23T06:04:40.908 INFO:teuthology.orchestra.run.smithi110.stdout:(7/156): ceph-mon-18.2.2-954.g82316b04.el9.x86_ 8.5 MB/s | 4.7 MB 00:00 2024-03-23T06:04:41.370 INFO:teuthology.orchestra.run.smithi073.stdout:(1/156): ceph-18.2.2-954.g82316b04.el9.x86_64.r 17 kB/s | 6.5 kB 00:00 2024-03-23T06:04:41.650 INFO:teuthology.orchestra.run.smithi110.stdout:(8/156): ceph-common-18.2.2-954.g82316b04.el9.x 7.7 MB/s | 18 MB 00:02 2024-03-23T06:04:41.750 INFO:teuthology.orchestra.run.smithi110.stdout:(9/156): ceph-radosgw-18.2.2-954.g82316b04.el9. 9.2 MB/s | 7.7 MB 00:00 2024-03-23T06:04:41.775 INFO:teuthology.orchestra.run.smithi110.stdout:(10/156): ceph-selinux-18.2.2-954.g82316b04.el9 201 kB/s | 25 kB 00:00 2024-03-23T06:04:41.901 INFO:teuthology.orchestra.run.smithi110.stdout:(11/156): cephfs-mirror-18.2.2-954.g82316b04.el 1.7 MB/s | 221 kB 00:00 2024-03-23T06:04:42.026 INFO:teuthology.orchestra.run.smithi110.stdout:(12/156): libcephfs-devel-18.2.2-954.g82316b04. 248 kB/s | 31 kB 00:00 2024-03-23T06:04:42.062 INFO:teuthology.orchestra.run.smithi073.stdout:(2/156): ceph-fuse-18.2.2-954.g82316b04.el9.x86 1.2 MB/s | 843 kB 00:00 2024-03-23T06:04:42.351 INFO:teuthology.orchestra.run.smithi110.stdout:(13/156): libcephfs2-18.2.2-954.g82316b04.el9.x 2.1 MB/s | 704 kB 00:00 2024-03-23T06:04:42.362 INFO:teuthology.orchestra.run.smithi073.stdout:(3/156): ceph-immutable-object-cache-18.2.2-954 477 kB/s | 143 kB 00:00 2024-03-23T06:04:42.510 INFO:teuthology.orchestra.run.smithi110.stdout:(14/156): ceph-osd-18.2.2-954.g82316b04.el9.x86 8.4 MB/s | 16 MB 00:01 2024-03-23T06:04:42.535 INFO:teuthology.orchestra.run.smithi110.stdout:(15/156): libcephsqlite-18.2.2-954.g82316b04.el 903 kB/s | 166 kB 00:00 2024-03-23T06:04:42.561 INFO:teuthology.orchestra.run.smithi110.stdout:(16/156): librados-devel-18.2.2-954.g82316b04.e 2.5 MB/s | 127 kB 00:00 2024-03-23T06:04:42.611 INFO:teuthology.orchestra.run.smithi110.stdout:(17/156): libradosstriper1-18.2.2-954.g82316b04 6.2 MB/s | 474 kB 00:00 2024-03-23T06:04:42.711 INFO:teuthology.orchestra.run.smithi110.stdout:(18/156): python3-ceph-argparse-18.2.2-954.g823 450 kB/s | 45 kB 00:00 2024-03-23T06:04:42.811 INFO:teuthology.orchestra.run.smithi110.stdout:(19/156): python3-ceph-common-18.2.2-954.g82316 1.2 MB/s | 127 kB 00:00 2024-03-23T06:04:42.912 INFO:teuthology.orchestra.run.smithi110.stdout:(20/156): python3-cephfs-18.2.2-954.g82316b04.e 1.6 MB/s | 161 kB 00:00 2024-03-23T06:04:43.053 INFO:teuthology.orchestra.run.smithi110.stdout:(21/156): librgw2-18.2.2-954.g82316b04.el9.x86_ 9.1 MB/s | 4.5 MB 00:00 2024-03-23T06:04:43.079 INFO:teuthology.orchestra.run.smithi110.stdout:(22/156): python3-rados-18.2.2-954.g82316b04.el 1.9 MB/s | 320 kB 00:00 2024-03-23T06:04:43.145 INFO:teuthology.orchestra.run.smithi110.stdout:(23/156): python3-rbd-18.2.2-954.g82316b04.el9. 3.2 MB/s | 297 kB 00:00 2024-03-23T06:04:43.175 INFO:teuthology.orchestra.run.smithi110.stdout:(24/156): python3-rgw-18.2.2-954.g82316b04.el9. 1.1 MB/s | 99 kB 00:00 2024-03-23T06:04:43.213 INFO:teuthology.orchestra.run.smithi110.stdout:(25/156): rbd-fuse-18.2.2-954.g82316b04.el9.x86 1.3 MB/s | 87 kB 00:00 2024-03-23T06:04:43.305 INFO:teuthology.orchestra.run.smithi110.stdout:(26/156): rbd-nbd-18.2.2-954.g82316b04.el9.x86_ 1.8 MB/s | 172 kB 00:00 2024-03-23T06:04:43.371 INFO:teuthology.orchestra.run.smithi110.stdout:(27/156): ceph-grafana-dashboards-18.2.2-954.g8 350 kB/s | 23 kB 00:00 2024-03-23T06:04:43.455 INFO:teuthology.orchestra.run.smithi110.stdout:(28/156): ceph-mgr-cephadm-18.2.2-954.g82316b04 1.6 MB/s | 138 kB 00:00 2024-03-23T06:04:43.722 INFO:teuthology.orchestra.run.smithi110.stdout:(29/156): ceph-mgr-dashboard-18.2.2-954.g82316b 6.5 MB/s | 1.7 MB 00:00 2024-03-23T06:04:43.806 INFO:teuthology.orchestra.run.smithi110.stdout:(30/156): rbd-mirror-18.2.2-954.g82316b04.el9.x 4.7 MB/s | 3.0 MB 00:00 2024-03-23T06:04:43.906 INFO:teuthology.orchestra.run.smithi110.stdout:(31/156): ceph-mgr-modules-core-18.2.2-954.g823 2.4 MB/s | 245 kB 00:00 2024-03-23T06:04:44.015 INFO:teuthology.orchestra.run.smithi110.stdout:(32/156): ceph-mgr-rook-18.2.2-954.g82316b04.el 456 kB/s | 49 kB 00:00 2024-03-23T06:04:44.054 INFO:teuthology.orchestra.run.smithi073.stdout:(4/156): ceph-mds-18.2.2-954.g82316b04.el9.x86_ 1.2 MB/s | 2.1 MB 00:01 2024-03-23T06:04:44.099 INFO:teuthology.orchestra.run.smithi110.stdout:(33/156): ceph-prometheus-alerts-18.2.2-954.g82 179 kB/s | 15 kB 00:00 2024-03-23T06:04:44.199 INFO:teuthology.orchestra.run.smithi110.stdout:(34/156): ceph-volume-18.2.2-954.g82316b04.el9. 2.6 MB/s | 264 kB 00:00 2024-03-23T06:04:44.307 INFO:teuthology.orchestra.run.smithi110.stdout:(35/156): cephadm-18.2.2-954.g82316b04.el9.noar 2.0 MB/s | 224 kB 00:00 2024-03-23T06:04:44.696 INFO:teuthology.orchestra.run.smithi073.stdout:(5/156): ceph-mgr-18.2.2-954.g82316b04.el9.x86_ 2.3 MB/s | 1.4 MB 00:00 2024-03-23T06:04:44.724 INFO:teuthology.orchestra.run.smithi110.stdout:(36/156): ceph-test-18.2.2-954.g82316b04.el9.x8 13 MB/s | 40 MB 00:02 2024-03-23T06:04:44.741 INFO:teuthology.orchestra.run.smithi110.stdout:(37/156): cephfs-top-18.2.2-954.g82316b04.el9.n 42 kB/s | 18 kB 00:00 2024-03-23T06:04:44.841 INFO:teuthology.orchestra.run.smithi110.stdout:(38/156): ceph-mgr-diskprediction-local-18.2.2- 6.6 MB/s | 7.4 MB 00:01 2024-03-23T06:04:45.000 INFO:teuthology.orchestra.run.smithi110.stdout:(39/156): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 106 kB 00:00 2024-03-23T06:04:45.034 INFO:teuthology.orchestra.run.smithi110.stdout:(40/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 662 kB 00:00 2024-03-23T06:04:45.067 INFO:teuthology.orchestra.run.smithi110.stdout:(41/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 920 kB 00:00 2024-03-23T06:04:45.092 INFO:teuthology.orchestra.run.smithi110.stdout:(42/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 307 kB 00:00 2024-03-23T06:04:45.118 INFO:teuthology.orchestra.run.smithi110.stdout:(43/156): flexiblas-3.0.4-8.el9.x86_64.rpm 383 kB/s | 32 kB 00:00 2024-03-23T06:04:45.143 INFO:teuthology.orchestra.run.smithi110.stdout:(44/156): flexiblas-openblas-openmp-3.0.4-8.el9 342 kB/s | 17 kB 00:00 2024-03-23T06:04:45.218 INFO:teuthology.orchestra.run.smithi110.stdout:(45/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-23T06:04:45.243 INFO:teuthology.orchestra.run.smithi110.stdout:(46/156): libaio-devel-0.3.111-13.el9.x86_64.rp 80 kB/s | 10 kB 00:00 2024-03-23T06:04:45.268 INFO:teuthology.orchestra.run.smithi110.stdout:(47/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 159 kB 00:00 2024-03-23T06:04:45.294 INFO:teuthology.orchestra.run.smithi110.stdout:(48/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 588 kB/s | 44 kB 00:00 2024-03-23T06:04:45.319 INFO:teuthology.orchestra.run.smithi110.stdout:(49/156): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-23T06:04:45.344 INFO:teuthology.orchestra.run.smithi110.stdout:(50/156): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2024-03-23T06:04:45.370 INFO:teuthology.orchestra.run.smithi110.stdout:(51/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 620 kB/s | 46 kB 00:00 2024-03-23T06:04:45.395 INFO:teuthology.orchestra.run.smithi110.stdout:(52/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-23T06:04:45.420 INFO:teuthology.orchestra.run.smithi110.stdout:(53/156): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-03-23T06:04:45.445 INFO:teuthology.orchestra.run.smithi110.stdout:(54/156): openblas-0.3.21-2.el9.x86_64.rpm 454 kB/s | 34 kB 00:00 2024-03-23T06:04:45.454 INFO:teuthology.orchestra.run.smithi073.stdout:(6/156): ceph-base-18.2.2-954.g82316b04.el9.x86 1.1 MB/s | 5.1 MB 00:04 2024-03-23T06:04:45.520 INFO:teuthology.orchestra.run.smithi110.stdout:(55/156): postgresql-13.11-1.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2024-03-23T06:04:45.595 INFO:teuthology.orchestra.run.smithi110.stdout:(56/156): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-03-23T06:04:45.621 INFO:teuthology.orchestra.run.smithi110.stdout:(57/156): postgresql-contrib-13.11-1.el9.x86_64 4.5 MB/s | 811 kB 00:00 2024-03-23T06:04:45.646 INFO:teuthology.orchestra.run.smithi110.stdout:(58/156): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2024-03-23T06:04:45.780 INFO:teuthology.orchestra.run.smithi110.stdout:(59/156): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2024-03-23T06:04:45.796 INFO:teuthology.orchestra.run.smithi110.stdout:(60/156): python3-jsonpatch-1.21-16.el9.noarch. 165 kB/s | 24 kB 00:00 2024-03-23T06:04:45.897 INFO:teuthology.orchestra.run.smithi110.stdout:(61/156): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-03-23T06:04:45.921 INFO:teuthology.orchestra.run.smithi073.stdout:(7/156): ceph-mon-18.2.2-954.g82316b04.el9.x86_ 3.8 MB/s | 4.7 MB 00:01 2024-03-23T06:04:45.922 INFO:teuthology.orchestra.run.smithi110.stdout:(62/156): python3-jsonpointer-2.0-4.el9.noarch. 127 kB/s | 18 kB 00:00 2024-03-23T06:04:45.947 INFO:teuthology.orchestra.run.smithi110.stdout:(63/156): python3-mako-1.1.4-6.el9.noarch.rpm 971 kB/s | 144 kB 00:00 2024-03-23T06:04:45.964 INFO:teuthology.orchestra.run.smithi110.stdout:(64/156): python3-markupsafe-1.1.1-12.el9.x86_6 472 kB/s | 32 kB 00:00 2024-03-23T06:04:45.990 INFO:teuthology.orchestra.run.smithi110.stdout:(65/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2024-03-23T06:04:46.098 INFO:teuthology.orchestra.run.smithi110.stdout:(66/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-23T06:04:46.126 INFO:teuthology.orchestra.run.smithi110.stdout:(67/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2024-03-23T06:04:46.151 INFO:teuthology.orchestra.run.smithi110.stdout:(68/156): python3-packaging-20.9-5.el9.noarch.r 432 kB/s | 69 kB 00:00 2024-03-23T06:04:46.177 INFO:teuthology.orchestra.run.smithi110.stdout:(69/156): python3-prettytable-0.7.2-27.el9.noar 531 kB/s | 41 kB 00:00 2024-03-23T06:04:46.202 INFO:teuthology.orchestra.run.smithi110.stdout:(70/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-23T06:04:46.227 INFO:teuthology.orchestra.run.smithi110.stdout:(71/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-23T06:04:46.252 INFO:teuthology.orchestra.run.smithi110.stdout:(72/156): python3-pytz-2021.1-5.el9.noarch.rpm 627 kB/s | 47 kB 00:00 2024-03-23T06:04:46.278 INFO:teuthology.orchestra.run.smithi110.stdout:(73/156): python3-requests-oauthlib-1.3.0-12.el 848 kB/s | 43 kB 00:00 2024-03-23T06:04:46.511 INFO:teuthology.orchestra.run.smithi110.stdout:(74/156): python3-toml-0.10.2-6.el9.noarch.rpm 150 kB/s | 39 kB 00:00 2024-03-23T06:04:46.662 INFO:teuthology.orchestra.run.smithi110.stdout:(75/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-03-23T06:04:46.687 INFO:teuthology.orchestra.run.smithi110.stdout:(76/156): socat-1.7.4.1-5.el9.x86_64.rpm 737 kB/s | 300 kB 00:00 2024-03-23T06:04:46.712 INFO:teuthology.orchestra.run.smithi110.stdout:(77/156): uuid-1.6.2-55.el9.x86_64.rpm 282 kB/s | 56 kB 00:00 2024-03-23T06:04:46.737 INFO:teuthology.orchestra.run.smithi110.stdout:(78/156): zlib-devel-1.2.11-40.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-03-23T06:04:46.762 INFO:teuthology.orchestra.run.smithi110.stdout:(79/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 831 kB/s | 63 kB 00:00 2024-03-23T06:04:46.788 INFO:teuthology.orchestra.run.smithi110.stdout:(80/156): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-23T06:04:46.813 INFO:teuthology.orchestra.run.smithi110.stdout:(81/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-23T06:04:46.838 INFO:teuthology.orchestra.run.smithi110.stdout:(82/156): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2024-03-23T06:04:46.880 INFO:teuthology.orchestra.run.smithi110.stdout:(83/156): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-03-23T06:04:46.905 INFO:teuthology.orchestra.run.smithi110.stdout:(84/156): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-03-23T06:04:46.931 INFO:teuthology.orchestra.run.smithi110.stdout:(85/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.0 MB/s | 187 kB 00:00 2024-03-23T06:04:47.139 INFO:teuthology.orchestra.run.smithi110.stdout:(86/156): jq-1.6-16.el9.x86_64.rpm 803 kB/s | 187 kB 00:00 2024-03-23T06:04:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:(87/156): libquadmath-11.4.1-3.el9.x86_64.rpm 837 kB/s | 195 kB 00:00 2024-03-23T06:04:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:(88/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-03-23T06:04:47.279 INFO:teuthology.orchestra.run.smithi073.stdout:(8/156): ceph-radosgw-18.2.2-954.g82316b04.el9. 5.7 MB/s | 7.7 MB 00:01 2024-03-23T06:04:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:(89/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-03-23T06:04:47.330 INFO:teuthology.orchestra.run.smithi073.stdout:(9/156): ceph-selinux-18.2.2-954.g82316b04.el9. 511 kB/s | 25 kB 00:00 2024-03-23T06:04:47.332 INFO:teuthology.orchestra.run.smithi110.stdout:(90/156): elfutils-libelf-devel-0.190-2.el9.x86 128 kB/s | 21 kB 00:00 2024-03-23T06:04:47.349 INFO:teuthology.orchestra.run.smithi110.stdout:(91/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 179 kB/s | 25 kB 00:00 2024-03-23T06:04:47.441 INFO:teuthology.orchestra.run.smithi110.stdout:(92/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-03-23T06:04:47.469 INFO:teuthology.orchestra.run.smithi110.stdout:(93/156): python3-devel-3.9.17-2.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-03-23T06:04:47.525 INFO:teuthology.orchestra.run.smithi110.stdout:(94/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-03-23T06:04:48.033 INFO:teuthology.orchestra.run.smithi110.stdout:(95/156): fmt-8.1.1-5.el9.x86_64.rpm 195 kB/s | 111 kB 00:00 2024-03-23T06:04:48.375 INFO:teuthology.orchestra.run.smithi110.stdout:(96/156): gperftools-libs-2.9.1-2.el9.x86_64.rp 363 kB/s | 309 kB 00:00 2024-03-23T06:04:48.483 INFO:teuthology.orchestra.run.smithi110.stdout:(97/156): libarrow-doc-9.0.0-10.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2024-03-23T06:04:48.609 INFO:teuthology.orchestra.run.smithi110.stdout:(98/156): liboath-2.6.7-2.el9.x86_64.rpm 388 kB/s | 49 kB 00:00 2024-03-23T06:04:48.826 INFO:teuthology.orchestra.run.smithi110.stdout:(99/156): libunwind-1.6.2-1.el9.x86_64.rpm 311 kB/s | 67 kB 00:00 2024-03-23T06:04:49.068 INFO:teuthology.orchestra.run.smithi110.stdout:(100/156): openssl-devel-3.0.7-27.el9.x86_64.rp 2.3 MB/s | 4.1 MB 00:01 2024-03-23T06:04:50.553 INFO:teuthology.orchestra.run.smithi073.stdout:(10/156): ceph-common-18.2.2-954.g82316b04.el9. 1.9 MB/s | 18 MB 00:09 2024-03-23T06:04:50.634 INFO:teuthology.orchestra.run.smithi110.stdout:(101/156): python3-asyncssh-2.13.2-5.el9.noarch 350 kB/s | 548 kB 00:01 2024-03-23T06:04:50.793 INFO:teuthology.orchestra.run.smithi110.stdout:(102/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 275 kB/s | 43 kB 00:00 2024-03-23T06:04:50.827 INFO:teuthology.orchestra.run.smithi110.stdout:(103/156): parquet-libs-9.0.0-10.el9.x86_64.rpm 419 kB/s | 838 kB 00:02 2024-03-23T06:04:50.910 INFO:teuthology.orchestra.run.smithi110.stdout:(104/156): python3-cachetools-4.2.4-1.el9.noarc 275 kB/s | 32 kB 00:00 2024-03-23T06:04:51.066 INFO:teuthology.orchestra.run.smithi073.stdout:(11/156): cephfs-mirror-18.2.2-954.g82316b04.el 433 kB/s | 221 kB 00:00 2024-03-23T06:04:51.177 INFO:teuthology.orchestra.run.smithi110.stdout:(105/156): python3-certifi-2021.10.8-2.el9.noar 43 kB/s | 15 kB 00:00 2024-03-23T06:04:51.182 INFO:teuthology.orchestra.run.smithi073.stdout:(12/156): libcephfs-devel-18.2.2-954.g82316b04. 269 kB/s | 31 kB 00:00 2024-03-23T06:04:51.697 INFO:teuthology.orchestra.run.smithi110.stdout:(106/156): python3-cheroot-8.6.0-4.el9.noarch.r 218 kB/s | 172 kB 00:00 2024-03-23T06:04:51.858 INFO:teuthology.orchestra.run.smithi073.stdout:(13/156): ceph-test-18.2.2-954.g82316b04.el9.x8 8.8 MB/s | 40 MB 00:04 2024-03-23T06:04:51.941 INFO:teuthology.orchestra.run.smithi073.stdout:(14/156): libcephsqlite-18.2.2-954.g82316b04.el 2.0 MB/s | 166 kB 00:00 2024-03-23T06:04:52.000 INFO:teuthology.orchestra.run.smithi073.stdout:(15/156): librados-devel-18.2.2-954.g82316b04.e 2.1 MB/s | 127 kB 00:00 2024-03-23T06:04:52.075 INFO:teuthology.orchestra.run.smithi073.stdout:(16/156): libradosstriper1-18.2.2-954.g82316b04 6.2 MB/s | 474 kB 00:00 2024-03-23T06:04:52.108 INFO:teuthology.orchestra.run.smithi073.stdout:(17/156): libcephfs2-18.2.2-954.g82316b04.el9.x 761 kB/s | 704 kB 00:00 2024-03-23T06:04:52.184 INFO:teuthology.orchestra.run.smithi073.stdout:(18/156): python3-ceph-argparse-18.2.2-954.g823 605 kB/s | 45 kB 00:00 2024-03-23T06:04:52.426 INFO:teuthology.orchestra.run.smithi073.stdout:(19/156): python3-ceph-common-18.2.2-954.g82316 526 kB/s | 127 kB 00:00 2024-03-23T06:04:52.643 INFO:teuthology.orchestra.run.smithi073.stdout:(20/156): librgw2-18.2.2-954.g82316b04.el9.x86_ 7.9 MB/s | 4.5 MB 00:00 2024-03-23T06:04:52.702 INFO:teuthology.orchestra.run.smithi073.stdout:(21/156): python3-cephfs-18.2.2-954.g82316b04.e 588 kB/s | 161 kB 00:00 2024-03-23T06:04:52.794 INFO:teuthology.orchestra.run.smithi073.stdout:(22/156): python3-rados-18.2.2-954.g82316b04.el 2.1 MB/s | 320 kB 00:00 2024-03-23T06:04:52.894 INFO:teuthology.orchestra.run.smithi073.stdout:(23/156): python3-rgw-18.2.2-954.g82316b04.el9. 1.0 MB/s | 99 kB 00:00 2024-03-23T06:04:52.911 INFO:teuthology.orchestra.run.smithi110.stdout:(107/156): python3-google-auth-2.28.2-1.el9.noa 167 kB/s | 203 kB 00:01 2024-03-23T06:04:53.002 INFO:teuthology.orchestra.run.smithi073.stdout:(24/156): rbd-fuse-18.2.2-954.g82316b04.el9.x86 805 kB/s | 87 kB 00:00 2024-03-23T06:04:53.028 INFO:teuthology.orchestra.run.smithi110.stdout:(108/156): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2024-03-23T06:04:53.053 INFO:teuthology.orchestra.run.smithi110.stdout:(109/156): python3-cherrypy-18.6.1-2.el9.noarch 191 kB/s | 358 kB 00:01 2024-03-23T06:04:53.170 INFO:teuthology.orchestra.run.smithi110.stdout:(110/156): python3-jaraco-classes-3.2.1-5.el9.n 124 kB/s | 18 kB 00:00 2024-03-23T06:04:53.195 INFO:teuthology.orchestra.run.smithi110.stdout:(111/156): python3-jaraco-collections-3.0.0-8.e 163 kB/s | 23 kB 00:00 2024-03-23T06:04:53.253 INFO:teuthology.orchestra.run.smithi073.stdout:(25/156): python3-rbd-18.2.2-954.g82316b04.el9. 540 kB/s | 297 kB 00:00 2024-03-23T06:04:53.287 INFO:teuthology.orchestra.run.smithi110.stdout:(112/156): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2024-03-23T06:04:53.313 INFO:teuthology.orchestra.run.smithi110.stdout:(113/156): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2024-03-23T06:04:53.520 INFO:teuthology.orchestra.run.smithi073.stdout:(26/156): rbd-mirror-18.2.2-954.g82316b04.el9.x 5.8 MB/s | 3.0 MB 00:00 2024-03-23T06:04:53.521 INFO:teuthology.orchestra.run.smithi110.stdout:(114/156): python3-logutils-0.3.5-21.el9.noarch 222 kB/s | 46 kB 00:00 2024-03-23T06:04:53.545 INFO:teuthology.orchestra.run.smithi073.stdout:(27/156): rbd-nbd-18.2.2-954.g82316b04.el9.x86_ 592 kB/s | 172 kB 00:00 2024-03-23T06:04:53.604 INFO:teuthology.orchestra.run.smithi073.stdout:(28/156): ceph-grafana-dashboards-18.2.2-954.g8 282 kB/s | 23 kB 00:00 2024-03-23T06:04:53.779 INFO:teuthology.orchestra.run.smithi073.stdout:(29/156): ceph-mgr-cephadm-18.2.2-954.g82316b04 592 kB/s | 138 kB 00:00 2024-03-23T06:04:53.879 INFO:teuthology.orchestra.run.smithi073.stdout:(30/156): ceph-mgr-dashboard-18.2.2-954.g82316b 6.4 MB/s | 1.7 MB 00:00 2024-03-23T06:04:53.930 INFO:teuthology.orchestra.run.smithi110.stdout:(115/156): python3-more-itertools-8.12.0-2.el9. 193 kB/s | 79 kB 00:00 2024-03-23T06:04:53.937 INFO:teuthology.orchestra.run.smithi073.stdout:(31/156): ceph-mgr-modules-core-18.2.2-954.g823 4.2 MB/s | 245 kB 00:00 2024-03-23T06:04:54.006 INFO:teuthology.orchestra.run.smithi073.stdout:(32/156): ceph-mgr-rook-18.2.2-954.g82316b04.el 746 kB/s | 49 kB 00:00 2024-03-23T06:04:54.055 INFO:teuthology.orchestra.run.smithi073.stdout:(33/156): ceph-prometheus-alerts-18.2.2-954.g82 303 kB/s | 15 kB 00:00 2024-03-23T06:04:54.130 INFO:teuthology.orchestra.run.smithi073.stdout:(34/156): ceph-volume-18.2.2-954.g82316b04.el9. 3.5 MB/s | 264 kB 00:00 2024-03-23T06:04:54.222 INFO:teuthology.orchestra.run.smithi073.stdout:(35/156): cephadm-18.2.2-954.g82316b04.el9.noar 2.4 MB/s | 224 kB 00:00 2024-03-23T06:04:54.297 INFO:teuthology.orchestra.run.smithi110.stdout:(116/156): python3-natsort-7.1.1-5.el9.noarch.r 157 kB/s | 58 kB 00:00 2024-03-23T06:04:54.297 INFO:teuthology.orchestra.run.smithi073.stdout:(36/156): cephfs-top-18.2.2-954.g82316b04.el9.n 246 kB/s | 18 kB 00:00 2024-03-23T06:04:54.823 INFO:teuthology.orchestra.run.smithi073.stdout:(37/156): ceph-osd-18.2.2-954.g82316b04.el9.x86 1.8 MB/s | 16 MB 00:09 2024-03-23T06:04:54.856 INFO:teuthology.orchestra.run.smithi073.stdout:(38/156): automake-1.16.2-8.el9.noarch.rpm 1.2 MB/s | 662 kB 00:00 2024-03-23T06:04:54.923 INFO:teuthology.orchestra.run.smithi073.stdout:(39/156): bison-3.7.4-5.el9.x86_64.rpm 9.4 MB/s | 920 kB 00:00 2024-03-23T06:04:54.949 INFO:teuthology.orchestra.run.smithi073.stdout:(40/156): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 106 kB 00:00 2024-03-23T06:04:54.982 INFO:teuthology.orchestra.run.smithi073.stdout:(41/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2024-03-23T06:04:55.008 INFO:teuthology.orchestra.run.smithi073.stdout:(42/156): flexiblas-3.0.4-8.el9.x86_64.rpm 571 kB/s | 32 kB 00:00 2024-03-23T06:04:55.108 INFO:teuthology.orchestra.run.smithi073.stdout:(43/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-23T06:04:55.133 INFO:teuthology.orchestra.run.smithi073.stdout:(44/156): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 17 kB 00:00 2024-03-23T06:04:55.175 INFO:teuthology.orchestra.run.smithi073.stdout:(45/156): libaio-devel-0.3.111-13.el9.x86_64.rp 249 kB/s | 10 kB 00:00 2024-03-23T06:04:55.200 INFO:teuthology.orchestra.run.smithi073.stdout:(46/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-03-23T06:04:55.222 INFO:teuthology.orchestra.run.smithi110.stdout:(117/156): python3-pecan-1.4.2-3.el9.noarch.rpm 294 kB/s | 272 kB 00:00 2024-03-23T06:04:55.242 INFO:teuthology.orchestra.run.smithi073.stdout:(47/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2024-03-23T06:04:55.284 INFO:teuthology.orchestra.run.smithi073.stdout:(48/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-03-23T06:04:55.326 INFO:teuthology.orchestra.run.smithi073.stdout:(49/156): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-03-23T06:04:55.339 INFO:teuthology.orchestra.run.smithi110.stdout:(118/156): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2024-03-23T06:04:55.351 INFO:teuthology.orchestra.run.smithi073.stdout:(50/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 755 kB/s | 46 kB 00:00 2024-03-23T06:04:55.385 INFO:teuthology.orchestra.run.smithi073.stdout:(51/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-23T06:04:55.427 INFO:teuthology.orchestra.run.smithi073.stdout:(52/156): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 217 kB 00:00 2024-03-23T06:04:55.452 INFO:teuthology.orchestra.run.smithi073.stdout:(53/156): openblas-0.3.21-2.el9.x86_64.rpm 532 kB/s | 34 kB 00:00 2024-03-23T06:04:55.603 INFO:teuthology.orchestra.run.smithi073.stdout:(54/156): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-03-23T06:04:55.653 INFO:teuthology.orchestra.run.smithi073.stdout:(55/156): postgresql-13.11-1.el9.x86_64.rpm 8.2 MB/s | 1.5 MB 00:00 2024-03-23T06:04:55.658 INFO:teuthology.orchestra.run.smithi110.stdout:(119/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 282 kB/s | 90 kB 00:00 2024-03-23T06:04:55.703 INFO:teuthology.orchestra.run.smithi073.stdout:(56/156): postgresql-contrib-13.11-1.el9.x86_64 8.2 MB/s | 811 kB 00:00 2024-03-23T06:04:55.729 INFO:teuthology.orchestra.run.smithi073.stdout:(57/156): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2024-03-23T06:04:55.789 INFO:teuthology.orchestra.run.smithi110.stdout:(120/156): python3-repoze-lru-0.7-16.el9.noarch 235 kB/s | 31 kB 00:00 2024-03-23T06:04:55.831 INFO:teuthology.orchestra.run.smithi110.stdout:(121/156): python3-kubernetes-26.1.0-2.el9.noar 411 kB/s | 1.0 MB 00:02 2024-03-23T06:04:55.879 INFO:teuthology.orchestra.run.smithi073.stdout:(58/156): postgresql-server-13.11-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2024-03-23T06:04:56.026 INFO:teuthology.orchestra.run.smithi110.stdout:(122/156): python3-rsa-4.9-2.el9.noarch.rpm 304 kB/s | 59 kB 00:00 2024-03-23T06:04:56.029 INFO:teuthology.orchestra.run.smithi073.stdout:(59/156): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-03-23T06:04:56.054 INFO:teuthology.orchestra.run.smithi073.stdout:(60/156): python3-jsonpatch-1.21-16.el9.noarch. 152 kB/s | 24 kB 00:00 2024-03-23T06:04:56.105 INFO:teuthology.orchestra.run.smithi073.stdout:(61/156): python3-jsonpointer-2.0-4.el9.noarch. 370 kB/s | 18 kB 00:00 2024-03-23T06:04:56.130 INFO:teuthology.orchestra.run.smithi073.stdout:(62/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-23T06:04:56.172 INFO:teuthology.orchestra.run.smithi073.stdout:(63/156): python3-markupsafe-1.1.1-12.el9.x86_6 774 kB/s | 32 kB 00:00 2024-03-23T06:04:56.235 INFO:teuthology.orchestra.run.smithi110.stdout:(123/156): python3-tempora-5.0.0-2.el9.noarch.r 172 kB/s | 36 kB 00:00 2024-03-23T06:04:56.239 INFO:teuthology.orchestra.run.smithi073.stdout:(64/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 217 kB 00:00 2024-03-23T06:04:56.289 INFO:teuthology.orchestra.run.smithi073.stdout:(65/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.5 MB/s | 174 kB 00:00 2024-03-23T06:04:56.393 INFO:teuthology.orchestra.run.smithi110.stdout:(124/156): python3-routes-2.5.1-5.el9.noarch.rp 312 kB/s | 188 kB 00:00 2024-03-23T06:04:56.398 INFO:teuthology.orchestra.run.smithi073.stdout:(66/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 4.8 MB 00:00 2024-03-23T06:04:56.431 INFO:teuthology.orchestra.run.smithi073.stdout:(67/156): python3-packaging-20.9-5.el9.noarch.r 536 kB/s | 69 kB 00:00 2024-03-23T06:04:56.444 INFO:teuthology.orchestra.run.smithi110.stdout:(125/156): python3-typing-extensions-4.4.0-2.el 244 kB/s | 51 kB 00:00 2024-03-23T06:04:56.457 INFO:teuthology.orchestra.run.smithi073.stdout:(68/156): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 41 kB 00:00 2024-03-23T06:04:56.482 INFO:teuthology.orchestra.run.smithi073.stdout:(69/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-23T06:04:56.516 INFO:teuthology.orchestra.run.smithi073.stdout:(70/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-03-23T06:04:56.541 INFO:teuthology.orchestra.run.smithi073.stdout:(71/156): python3-pytz-2021.1-5.el9.noarch.rpm 845 kB/s | 47 kB 00:00 2024-03-23T06:04:56.566 INFO:teuthology.orchestra.run.smithi073.stdout:(72/156): python3-requests-oauthlib-1.3.0-12.el 874 kB/s | 43 kB 00:00 2024-03-23T06:04:56.652 INFO:teuthology.orchestra.run.smithi110.stdout:(126/156): python3-websocket-client-1.2.3-2.el9 431 kB/s | 90 kB 00:00 2024-03-23T06:04:56.658 INFO:teuthology.orchestra.run.smithi073.stdout:(73/156): python3-toml-0.10.2-6.el9.noarch.rpm 481 kB/s | 39 kB 00:00 2024-03-23T06:04:56.817 INFO:teuthology.orchestra.run.smithi073.stdout:(74/156): socat-1.7.4.1-5.el9.x86_64.rpm 2.0 MB/s | 300 kB 00:00 2024-03-23T06:04:57.017 INFO:teuthology.orchestra.run.smithi073.stdout:(75/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-03-23T06:04:57.043 INFO:teuthology.orchestra.run.smithi073.stdout:(76/156): uuid-1.6.2-55.el9.x86_64.rpm 262 kB/s | 56 kB 00:00 2024-03-23T06:04:57.068 INFO:teuthology.orchestra.run.smithi073.stdout:(77/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-03-23T06:04:57.069 INFO:teuthology.orchestra.run.smithi110.stdout:(127/156): python3-webob-1.8.7-6.el9.noarch.rpm 340 kB/s | 230 kB 00:00 2024-03-23T06:04:57.093 INFO:teuthology.orchestra.run.smithi073.stdout:(78/156): zlib-devel-1.2.11-40.el9.x86_64.rpm 902 kB/s | 44 kB 00:00 2024-03-23T06:04:57.118 INFO:teuthology.orchestra.run.smithi073.stdout:(79/156): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-03-23T06:04:57.152 INFO:teuthology.orchestra.run.smithi073.stdout:(80/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-23T06:04:57.186 INFO:teuthology.orchestra.run.smithi110.stdout:(128/156): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-03-23T06:04:57.202 INFO:teuthology.orchestra.run.smithi073.stdout:(81/156): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-23T06:04:57.228 INFO:teuthology.orchestra.run.smithi073.stdout:(82/156): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-03-23T06:04:57.253 INFO:teuthology.orchestra.run.smithi073.stdout:(83/156): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-03-23T06:04:57.286 INFO:teuthology.orchestra.run.smithi073.stdout:(84/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-23T06:04:57.478 INFO:teuthology.orchestra.run.smithi110.stdout:(129/156): python3-werkzeug-2.0.3-3.el9.1.noarc 517 kB/s | 427 kB 00:00 2024-03-23T06:04:57.679 INFO:teuthology.orchestra.run.smithi110.stdout:(130/156): re2-20211101-3.el9.x86_64.rpm 389 kB/s | 192 kB 00:00 2024-03-23T06:04:58.812 INFO:teuthology.orchestra.run.smithi110.stdout:(131/156): librados2-18.2.2-954.g82316b04.el9.x 2.9 MB/s | 3.3 MB 00:01 2024-03-23T06:04:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:(85/156): jq-1.6-16.el9.x86_64.rpm 91 kB/s | 187 kB 00:02 2024-03-23T06:04:59.412 INFO:teuthology.orchestra.run.smithi110.stdout:(132/156): librbd1-18.2.2-954.g82316b04.el9.x86 5.0 MB/s | 3.0 MB 00:00 2024-03-23T06:04:59.429 INFO:teuthology.orchestra.run.smithi073.stdout:(86/156): libgfortran-11.4.1-3.el9.x86_64.rpm 375 kB/s | 803 kB 00:02 2024-03-23T06:04:59.454 INFO:teuthology.orchestra.run.smithi110.stdout:(133/156): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-23T06:05:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:(134/156): thrift-0.15.0-2.el9.x86_64.rpm 601 kB/s | 1.6 MB 00:02 2024-03-23T06:05:00.987 INFO:teuthology.orchestra.run.smithi073.stdout:(87/156): ceph-mgr-diskprediction-local-18.2.2- 1.0 MB/s | 7.4 MB 00:07 2024-03-23T06:05:01.188 INFO:teuthology.orchestra.run.smithi073.stdout:(88/156): elfutils-libelf-devel-0.190-2.el9.x86 108 kB/s | 21 kB 00:00 2024-03-23T06:05:01.221 INFO:teuthology.orchestra.run.smithi073.stdout:(89/156): libquadmath-11.4.1-3.el9.x86_64.rpm 103 kB/s | 195 kB 00:01 2024-03-23T06:05:01.246 INFO:teuthology.orchestra.run.smithi073.stdout:(90/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 439 kB/s | 25 kB 00:00 2024-03-23T06:05:01.338 INFO:teuthology.orchestra.run.smithi073.stdout:(91/156): python3-devel-3.9.17-2.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-03-23T06:05:01.405 INFO:teuthology.orchestra.run.smithi073.stdout:(92/156): python3-jinja2-2.11.3-5.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-03-23T06:05:01.464 INFO:teuthology.orchestra.run.smithi073.stdout:(93/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-03-23T06:05:01.580 INFO:teuthology.orchestra.run.smithi110.stdout:(135/156): libarrow-9.0.0-10.el9.x86_64.rpm 334 kB/s | 4.4 MB 00:13 2024-03-23T06:05:01.689 INFO:teuthology.orchestra.run.smithi073.stdout:(94/156): openssl-devel-3.0.7-27.el9.x86_64.rpm 8.8 MB/s | 4.1 MB 00:00 2024-03-23T06:05:02.946 INFO:teuthology.orchestra.run.smithi110.stdout:(136/156): NetworkManager-team-1.47.2-1.el9.x86 31 kB/s | 42 kB 00:01 2024-03-23T06:05:02.973 INFO:teuthology.orchestra.run.smithi073.stdout:(95/156): python3-requests-2.25.1-8.el9.noarch. 35 kB/s | 125 kB 00:03 2024-03-23T06:05:03.572 INFO:teuthology.orchestra.run.smithi110.stdout:(137/156): NetworkManager-1.47.2-1.el9.x86_64.r 573 kB/s | 2.3 MB 00:04 2024-03-23T06:05:03.597 INFO:teuthology.orchestra.run.smithi110.stdout:(138/156): NetworkManager-tui-1.47.2-1.el9.x86_ 382 kB/s | 248 kB 00:00 2024-03-23T06:05:03.639 INFO:teuthology.orchestra.run.smithi110.stdout:(139/156): NetworkManager-libnm-1.47.2-1.el9.x8 541 kB/s | 1.8 MB 00:03 2024-03-23T06:05:03.731 INFO:teuthology.orchestra.run.smithi110.stdout:(140/156): acl-2.3.1-4.el9.x86_64.rpm 449 kB/s | 71 kB 00:00 2024-03-23T06:05:03.756 INFO:teuthology.orchestra.run.smithi110.stdout:(141/156): elfutils-debuginfod-client-0.190-2.e 229 kB/s | 36 kB 00:00 2024-03-23T06:05:04.098 INFO:teuthology.orchestra.run.smithi110.stdout:(142/156): libacl-2.3.1-4.el9.x86_64.rpm 67 kB/s | 23 kB 00:00 2024-03-23T06:05:04.123 INFO:teuthology.orchestra.run.smithi110.stdout:(143/156): elfutils-libs-0.190-2.el9.x86_64.rpm 652 kB/s | 256 kB 00:00 2024-03-23T06:05:05.174 INFO:teuthology.orchestra.run.smithi110.stdout:(144/156): elfutils-libelf-0.190-2.el9.x86_64.r 125 kB/s | 192 kB 00:01 2024-03-23T06:05:05.310 INFO:teuthology.orchestra.run.smithi073.stdout:(96/156): fmt-8.1.1-5.el9.x86_64.rpm 29 kB/s | 111 kB 00:03 2024-03-23T06:05:05.457 INFO:teuthology.orchestra.run.smithi110.stdout:(145/156): libblkid-2.37.4-18.el9.x86_64.rpm 80 kB/s | 108 kB 00:01 2024-03-23T06:05:05.474 INFO:teuthology.orchestra.run.smithi110.stdout:(146/156): libfdisk-2.37.4-18.el9.x86_64.rpm 115 kB/s | 155 kB 00:01 2024-03-23T06:05:06.457 INFO:teuthology.orchestra.run.smithi073.stdout:(97/156): libarrow-doc-9.0.0-10.el9.noarch.rpm 23 kB/s | 26 kB 00:01 2024-03-23T06:05:07.233 INFO:teuthology.orchestra.run.smithi110.stdout:(147/156): libmount-2.37.4-18.el9.x86_64.rpm 66 kB/s | 136 kB 00:02 2024-03-23T06:05:07.416 INFO:teuthology.orchestra.run.smithi110.stdout:(148/156): libuuid-2.37.4-18.el9.x86_64.rpm 15 kB/s | 29 kB 00:01 2024-03-23T06:05:07.450 INFO:teuthology.orchestra.run.smithi110.stdout:(149/156): libsmartcols-2.37.4-18.el9.x86_64.rp 32 kB/s | 64 kB 00:01 2024-03-23T06:05:08.140 INFO:teuthology.orchestra.run.smithi073.stdout:(98/156): liboath-2.6.7-2.el9.x86_64.rpm 29 kB/s | 49 kB 00:01 2024-03-23T06:05:09.578 INFO:teuthology.orchestra.run.smithi110.stdout:(150/156): openssl-3.0.7-27.el9.x86_64.rpm 528 kB/s | 1.2 MB 00:02 2024-03-23T06:05:10.323 INFO:teuthology.orchestra.run.smithi073.stdout:(99/156): libunwind-1.6.2-1.el9.x86_64.rpm 31 kB/s | 67 kB 00:02 2024-03-23T06:05:11.007 INFO:teuthology.orchestra.run.smithi073.stdout:(100/156): gperftools-libs-2.9.1-2.el9.x86_64.r 33 kB/s | 309 kB 00:09 2024-03-23T06:05:13.492 INFO:teuthology.orchestra.run.smithi110.stdout:(151/156): util-linux-core-2.37.4-18.el9.x86_64 119 kB/s | 465 kB 00:03 2024-03-23T06:05:13.542 INFO:teuthology.orchestra.run.smithi110.stdout:(152/156): openssl-libs-3.0.7-27.el9.x86_64.rpm 360 kB/s | 2.2 MB 00:06 2024-03-23T06:05:13.625 INFO:teuthology.orchestra.run.smithi110.stdout:(153/156): util-linux-2.37.4-18.el9.x86_64.rpm 379 kB/s | 2.3 MB 00:06 2024-03-23T06:05:13.870 INFO:teuthology.orchestra.run.smithi110.stdout:(154/156): libacl-devel-2.3.1-4.el9.x86_64.rpm 307 kB/s | 74 kB 00:00 2024-03-23T06:05:14.285 INFO:teuthology.orchestra.run.smithi110.stdout:(155/156): util-linux-user-2.37.4-18.el9.x86_64 39 kB/s | 31 kB 00:00 2024-03-23T06:05:15.610 INFO:teuthology.orchestra.run.smithi110.stdout:(156/156): xfsprogs-6.3.0-1.el9.x86_64.rpm 532 kB/s | 1.1 MB 00:02 2024-03-23T06:05:15.612 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-03-23T06:05:15.612 INFO:teuthology.orchestra.run.smithi110.stdout:Total 5.5 MB/s | 204 MB 00:36 2024-03-23T06:05:16.039 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-03-23T06:05:16.304 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-03-23T06:05:16.304 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-03-23T06:05:17.880 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-03-23T06:05:17.881 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-03-23T06:05:24.177 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-03-23T06:05:24.272 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/180 2024-03-23T06:05:24.306 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/180 2024-03-23T06:05:24.329 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-23T06:05:24.338 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-23T06:05:24.378 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/180 2024-03-23T06:05:24.432 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/180 2024-03-23T06:05:24.465 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/180 2024-03-23T06:05:24.491 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/180 2024-03-23T06:05:24.533 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/180 2024-03-23T06:05:24.858 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/180 2024-03-23T06:05:24.917 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:18.2.2-954.g82316b04.el9.x86_64 10/180 2024-03-23T06:05:25.018 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:18.2.2-954.g82316b04.el9.x86_64 10/180 2024-03-23T06:05:25.052 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:18.2.2-954.g82316b04.el9.x86_64 11/180 2024-03-23T06:05:25.126 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:18.2.2-954.g82316b04.el9.x86_64 11/180 2024-03-23T06:05:25.156 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:18.2.2-954.g82316b04.el9.x86_64 12/180 2024-03-23T06:05:25.195 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/180 2024-03-23T06:05:25.369 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/180 2024-03-23T06:05:25.421 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/180 2024-03-23T06:05:25.448 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:18.2.2-954.g82316b04.el9.x86_64 16/180 2024-03-23T06:05:25.550 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:18.2.2-954.g82316b04.el9.x86_64 16/180 2024-03-23T06:05:25.574 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:18.2.2-954.g82316b04.el9.x86_ 17/180 2024-03-23T06:05:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:18.2.2-954.g82316b04.el9.x86_ 17/180 2024-03-23T06:05:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/180 2024-03-23T06:05:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/180 2024-03-23T06:05:25.824 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 20/180 2024-03-23T06:05:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 21/180 2024-03-23T06:05:25.982 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 21/180 2024-03-23T06:05:26.049 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-23T06:05:26.084 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-23T06:05:26.346 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-23T06:05:26.379 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/180 2024-03-23T06:05:26.406 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/180 2024-03-23T06:05:26.441 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/180 2024-03-23T06:05:26.515 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/180 2024-03-23T06:05:26.568 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/180 2024-03-23T06:05:26.608 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/180 2024-03-23T06:05:26.671 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/180 2024-03-23T06:05:26.707 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/180 2024-03-23T06:05:26.743 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/180 2024-03-23T06:05:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 32/180 2024-03-23T06:05:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:18.2.2-954.g82316b04.el9.x 33/180 2024-03-23T06:05:26.914 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:18.2.2-954.g82316b04.el9 34/180 2024-03-23T06:05:26.989 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:18.2.2-954.g82316b04.el9.x86_64 35/180 2024-03-23T06:05:27.120 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/180 2024-03-23T06:05:27.168 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/180 2024-03-23T06:05:27.315 INFO:teuthology.orchestra.run.smithi073.stdout:(101/156): python3-asyncssh-2.13.2-5.el9.noarch 34 kB/s | 548 kB 00:16 2024-03-23T06:05:27.684 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/180 2024-03-23T06:05:27.764 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/180 2024-03-23T06:05:27.831 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/180 2024-03-23T06:05:27.884 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-23T06:05:27.896 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-23T06:05:27.939 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/180 2024-03-23T06:05:27.977 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:18.2.2-954.g82316b04.el9.x86_64 43/180 2024-03-23T06:05:28.006 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/180 2024-03-23T06:05:28.239 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 45/180 2024-03-23T06:05:28.424 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 46/180 2024-03-23T06:05:28.484 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 47/180 2024-03-23T06:05:28.528 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 48/180 2024-03-23T06:05:28.654 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/180 2024-03-23T06:05:28.687 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 50/180 2024-03-23T06:05:28.793 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-3.el9.x86_64 51/180 2024-03-23T06:05:28.824 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 52/180 2024-03-23T06:05:28.878 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/180 2024-03-23T06:05:28.944 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/180 2024-03-23T06:05:28.975 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/180 2024-03-23T06:05:29.011 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/180 2024-03-23T06:05:29.058 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/180 2024-03-23T06:05:29.072 INFO:teuthology.orchestra.run.smithi073.stdout:(102/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 25 kB/s | 43 kB 00:01 2024-03-23T06:05:29.103 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/180 2024-03-23T06:05:29.145 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/180 2024-03-23T06:05:29.278 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/180 2024-03-23T06:05:29.331 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/180 2024-03-23T06:05:29.372 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/180 2024-03-23T06:05:29.465 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/180 2024-03-23T06:05:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 64/180 2024-03-23T06:05:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/180 2024-03-23T06:05:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/180 2024-03-23T06:05:29.590 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 67/180 2024-03-23T06:05:29.690 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fmt-8.1.1-5.el9.x86_64 68/180 2024-03-23T06:05:29.742 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 69/180 2024-03-23T06:05:29.790 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 70/180 2024-03-23T06:05:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 71/180 2024-03-23T06:05:30.029 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 72/180 2024-03-23T06:05:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 73/180 2024-03-23T06:05:30.209 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 74/180 2024-03-23T06:05:30.253 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/180 2024-03-23T06:05:30.281 INFO:teuthology.orchestra.run.smithi073.stdout:(103/156): python3-cachetools-4.2.4-1.el9.noarc 27 kB/s | 32 kB 00:01 2024-03-23T06:05:30.284 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/180 2024-03-23T06:05:30.324 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-15.el9.x86_64 77/180 2024-03-23T06:05:30.356 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 78/180 2024-03-23T06:05:30.391 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/180 2024-03-23T06:05:30.427 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/180 2024-03-23T06:05:30.466 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/180 2024-03-23T06:05:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/180 2024-03-23T06:05:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/180 2024-03-23T06:05:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/180 2024-03-23T06:05:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/180 2024-03-23T06:05:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/180 2024-03-23T06:05:30.765 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/180 2024-03-23T06:05:30.805 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/180 2024-03-23T06:05:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/180 2024-03-23T06:05:30.931 INFO:teuthology.orchestra.run.smithi073.stdout:(104/156): python3-certifi-2021.10.8-2.el9.noar 23 kB/s | 15 kB 00:00 2024-03-23T06:05:30.973 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 90/180 2024-03-23T06:05:31.023 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 91/180 2024-03-23T06:05:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/180 2024-03-23T06:05:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 93/180 2024-03-23T06:05:31.812 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 94/180 2024-03-23T06:05:31.845 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 95/180 2024-03-23T06:05:32.021 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/180 2024-03-23T06:05:32.051 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/180 2024-03-23T06:05:32.128 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/180 2024-03-23T06:05:32.775 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/180 2024-03-23T06:05:32.881 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/180 2024-03-23T06:05:34.084 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/180 2024-03-23T06:05:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/180 2024-03-23T06:05:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 103/180 2024-03-23T06:05:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jq-1.6-16.el9.x86_64 104/180 2024-03-23T06:05:34.251 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 105/180 2024-03-23T06:05:34.539 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/180 2024-03-23T06:05:34.564 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:18.2.2-954.g82316b04.el9.x86_64 107/180 2024-03-23T06:05:34.654 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:18.2.2-954.g82316b04.el9.x86_64 107/180 2024-03-23T06:05:34.686 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:18.2.2-954.g82316b04.el9.x86_64 108/180 2024-03-23T06:05:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/180 2024-03-23T06:05:35.139 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/180 2024-03-23T06:05:35.167 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:18.2.2-954.g82316b04.el9.x86_64 111/180 2024-03-23T06:05:35.189 INFO:teuthology.orchestra.run.smithi073.stdout:(105/156): parquet-libs-9.0.0-10.el9.x86_64.rpm 34 kB/s | 838 kB 00:24 2024-03-23T06:05:35.221 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:18.2.2-954.g82316b04.el9.x86_64 111/180 2024-03-23T06:05:35.244 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:18.2.2-954.g82316b04.el9.x86_64 112/180 2024-03-23T06:05:36.556 INFO:teuthology.orchestra.run.smithi073.stdout:(106/156): python3-cheroot-8.6.0-4.el9.noarch.r 31 kB/s | 172 kB 00:05 2024-03-23T06:05:37.283 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 113/180 2024-03-23T06:05:37.324 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 113/180 2024-03-23T06:05:37.836 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 113/180 2024-03-23T06:05:37.877 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:18.2.2-954.g82316b04.el9.x86_64 114/180 2024-03-23T06:05:37.959 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:18.2.2-954.g82316b04.el9.x86_64 114/180 2024-03-23T06:05:37.959 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-23T06:05:37.959 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-23T06:05:37.959 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:18.2.2-954.g82316b04.el9.x86_64 115/180 2024-03-23T06:05:43.005 INFO:teuthology.orchestra.run.smithi073.stdout:(107/156): python3-google-auth-2.28.2-1.el9.noa 31 kB/s | 203 kB 00:06 2024-03-23T06:05:43.664 INFO:teuthology.orchestra.run.smithi073.stdout:(108/156): python3-jaraco-8.2.1-3.el9.noarch.rp 16 kB/s | 11 kB 00:00 2024-03-23T06:05:44.506 INFO:teuthology.orchestra.run.smithi073.stdout:(109/156): python3-jaraco-classes-3.2.1-5.el9.n 21 kB/s | 18 kB 00:00 2024-03-23T06:05:45.514 INFO:teuthology.orchestra.run.smithi073.stdout:(110/156): python3-jaraco-collections-3.0.0-8.e 23 kB/s | 23 kB 00:01 2024-03-23T06:05:46.314 INFO:teuthology.orchestra.run.smithi073.stdout:(111/156): python3-cherrypy-18.6.1-2.el9.noarch 32 kB/s | 358 kB 00:11 2024-03-23T06:05:46.523 INFO:teuthology.orchestra.run.smithi073.stdout:(112/156): python3-jaraco-functools-3.5.0-2.el9 19 kB/s | 19 kB 00:01 2024-03-23T06:05:47.140 INFO:teuthology.orchestra.run.smithi073.stdout:(113/156): python3-jaraco-text-3.2.0-6.el9.noar 24 kB/s | 20 kB 00:00 2024-03-23T06:05:48.882 INFO:teuthology.orchestra.run.smithi073.stdout:(114/156): python3-logutils-0.3.5-21.el9.noarch 27 kB/s | 46 kB 00:01 2024-03-23T06:05:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:18.2.2-954.g82316b04.el9.x86_64 115/180 2024-03-23T06:05:49.166 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-03-23T06:05:49.166 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-03-23T06:05:49.166 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-03-23T06:05:49.166 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-03-23T06:05:49.166 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-03-23T06:05:49.166 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-03-23T06:05:49.167 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-03-23T06:05:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:49.335 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:18.2.2-954.g82316b04.el9.noarch 116/180 2024-03-23T06:05:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:18.2.2-954.g82316b04.el9.noarch 116/180 2024-03-23T06:05:49.351 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:49.351 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-23T06:05:49.351 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:50.797 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:18.2.2-954.g82316b04.el9.x86_64 117/180 2024-03-23T06:05:50.822 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:18.2.2-954.g82316b04.el9.x86_64 117/180 2024-03-23T06:05:50.823 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:50.823 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-23T06:05:50.823 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-23T06:05:50.823 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-23T06:05:50.823 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:51.022 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:18.2.2-954.g82316b04.el9.x86_64 118/180 2024-03-23T06:05:51.045 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:18.2.2-954.g82316b04.el9.x86_64 118/180 2024-03-23T06:05:51.045 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:51.045 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-23T06:05:51.045 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-23T06:05:51.045 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-23T06:05:51.045 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:51.490 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:18.2.2-954.g82316b04.el9.x86_64 119/180 2024-03-23T06:05:51.512 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:18.2.2-954.g82316b04.el9.x86_64 119/180 2024-03-23T06:05:51.512 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:51.513 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-23T06:05:51.513 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-23T06:05:51.513 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-23T06:05:51.513 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:51.600 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 120/180 2024-03-23T06:05:51.798 INFO:teuthology.orchestra.run.smithi073.stdout:(115/156): python3-more-itertools-8.12.0-2.el9. 27 kB/s | 79 kB 00:02 2024-03-23T06:05:51.979 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:18.2.2-954.g82316b04.el9.noarch 121/180 2024-03-23T06:05:52.007 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:18.2.2-954.g82316b04.el9.noarch 121/180 2024-03-23T06:05:52.036 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-954.g82316b04.el 122/180 2024-03-23T06:05:52.090 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-954.g82316b04.e 123/180 2024-03-23T06:05:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-954.g82316b04.el9.noar 124/180 2024-03-23T06:05:52.334 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-954.g82316b04.el9.noar 124/180 2024-03-23T06:05:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-954.g82316b04.el9.no 125/180 2024-03-23T06:05:53.320 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-954.g82316b04.el9.no 125/180 2024-03-23T06:05:53.348 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-954.g8231 126/180 2024-03-23T06:05:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-954.g8231 126/180 2024-03-23T06:05:53.603 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-954.g82316b04.el9 127/180 2024-03-23T06:05:53.633 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:18.2.2-954.g82316b04.el9.x86_64 128/180 2024-03-23T06:05:53.657 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:18.2.2-954.g82316b04.el9.x86_64 128/180 2024-03-23T06:05:53.657 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:53.657 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-23T06:05:53.657 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-23T06:05:53.657 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-23T06:05:53.657 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:53.701 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:18.2.2-954.g82316b04.el9.noarch 129/180 2024-03-23T06:05:53.712 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-954.g82316b04.el9.noarch 129/180 2024-03-23T06:05:53.757 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:18.2.2-954.g82316b04.el9.x86_64 130/180 2024-03-23T06:05:53.865 INFO:teuthology.orchestra.run.smithi073.stdout:(116/156): python3-natsort-7.1.1-5.el9.noarch.r 28 kB/s | 58 kB 00:02 2024-03-23T06:05:54.460 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/180 2024-03-23T06:05:54.497 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:18.2.2-954.g82316b04.el9.x86_64 132/180 2024-03-23T06:05:54.519 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-954.g82316b04.el9.x86_64 132/180 2024-03-23T06:05:54.519 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:54.520 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-23T06:05:54.520 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-23T06:05:54.520 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-23T06:05:54.520 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:54.564 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-954.g82316b 133/180 2024-03-23T06:05:54.586 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-954.g82316b 133/180 2024-03-23T06:05:54.586 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:54.586 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-23T06:05:54.586 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:54.631 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:18.2.2-954.g82316b04.el9.x86_64 134/180 2024-03-23T06:05:54.653 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-954.g82316b04.el9.x86_64 134/180 2024-03-23T06:05:54.654 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:54.654 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-23T06:05:54.654 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-23T06:05:54.654 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-23T06:05:54.654 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:54.949 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:18.2.2-954.g82316b04.el9.x86_64 135/180 2024-03-23T06:05:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:18.2.2-954.g82316b04.el9.x86_64 135/180 2024-03-23T06:05:54.971 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:05:54.971 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-23T06:05:54.971 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-23T06:05:54.971 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-23T06:05:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:05:58.611 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:18.2.2-954.g82316b04.el9.x86_64 136/180 2024-03-23T06:05:58.652 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:18.2.2-954.g82316b04.el9.x86_64 137/180 2024-03-23T06:05:58.682 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:18.2.2-954.g82316b04.el9.x86_64 138/180 2024-03-23T06:05:58.854 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/180 2024-03-23T06:05:58.964 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/180 2024-03-23T06:05:59.000 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:18.2.2-954.g82316b04.el9.x86_64 141/180 2024-03-23T06:05:59.031 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/180 2024-03-23T06:05:59.083 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 143/180 2024-03-23T06:05:59.127 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 144/180 2024-03-23T06:05:59.151 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:18.2.2-954.g82316b04.el9.x86_6 145/180 2024-03-23T06:05:59.183 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 146/180 2024-03-23T06:05:59.222 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 147/180 2024-03-23T06:05:59.267 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 148/180 2024-03-23T06:05:59.328 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/180 2024-03-23T06:05:59.362 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 150/180 2024-03-23T06:05:59.937 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-23T06:05:59.977 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-23T06:05:59.997 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-23T06:06:00.812 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:18.2.2-954.g82316b04.el9.noarch 152/180 2024-03-23T06:06:00.891 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 153/180 2024-03-23T06:06:00.932 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/180 2024-03-23T06:06:01.013 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/180 2024-03-23T06:06:01.045 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/180 2024-03-23T06:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 157/180 2024-03-23T06:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 158/180 2024-03-23T06:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 159/180 2024-03-23T06:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-23T06:06:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-23T06:06:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/180 2024-03-23T06:06:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-23T06:06:01.291 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-23T06:06:01.317 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 163/180 2024-03-23T06:06:01.350 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/180 2024-03-23T06:06:01.384 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 165/180 2024-03-23T06:06:01.409 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 166/180 2024-03-23T06:06:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 167/180 2024-03-23T06:06:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 168/180 2024-03-23T06:06:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 169/180 2024-03-23T06:06:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 170/180 2024-03-23T06:06:01.566 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 171/180 2024-03-23T06:06:01.590 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 172/180 2024-03-23T06:06:01.617 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/180 2024-03-23T06:06:01.623 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-23T06:06:01.623 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-23T06:06:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-23T06:06:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-23T06:06:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-23T06:06:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 176/180 2024-03-23T06:06:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 177/180 2024-03-23T06:06:01.952 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 178/180 2024-03-23T06:06:01.977 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/180 2024-03-23T06:06:02.041 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-23T06:06:03.147 INFO:teuthology.orchestra.run.smithi073.stdout:(117/156): python3-pecan-1.4.2-3.el9.noarch.rpm 29 kB/s | 272 kB 00:09 2024-03-23T06:06:04.048 INFO:teuthology.orchestra.run.smithi073.stdout:(118/156): python3-portend-3.1.0-2.el9.noarch.r 18 kB/s | 16 kB 00:00 2024-03-23T06:06:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-23T06:06:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:18.2.2-954.g82316b04.el9.x86_64 1/180 2024-03-23T06:06:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:18.2.2-954.g82316b04.el9.x86_64 2/180 2024-03-23T06:06:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 3/180 2024-03-23T06:06:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:18.2.2-954.g82316b04.el9.x86_64 4/180 2024-03-23T06:06:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-954.g82316b 5/180 2024-03-23T06:06:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:18.2.2-954.g82316b04.el9.x86_64 6/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:18.2.2-954.g82316b04.el9.x86_64 7/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:18.2.2-954.g82316b04.el9.x86_64 8/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:18.2.2-954.g82316b04.el9.x86_64 9/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:18.2.2-954.g82316b04.el9.x86_64 10/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:18.2.2-954.g82316b04.el9.x86_64 11/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:18.2.2-954.g82316b04.el9.x86_64 12/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:18.2.2-954.g82316b04.el9.x86_64 13/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:18.2.2-954.g82316b04.el9.x86_6 14/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:18.2.2-954.g82316b04.el9.x86_64 15/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:18.2.2-954.g82316b04.el9.x86_64 16/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:18.2.2-954.g82316b04.el9.x86_64 17/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:18.2.2-954.g82316b04.el9.x86_ 18/180 2024-03-23T06:06:06.328 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:18.2.2-954.g82316b04.el9.x86_64 19/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:18.2.2-954.g82316b04.el9 20/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:18.2.2-954.g82316b04.el9.x 21/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:18.2.2-954.g82316b04.el9.x86_64 22/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:18.2.2-954.g82316b04.el9.x86_64 23/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:18.2.2-954.g82316b04.el9.x86_64 24/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:18.2.2-954.g82316b04.el9.x86_64 25/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:18.2.2-954.g82316b04.el9.x86_64 26/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:18.2.2-954.g82316b04.el9.x86_64 27/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:18.2.2-954.g82316b04.el9.x86_64 28/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-954.g82316b04.e 29/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-954.g82316b04.el9.noar 30/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-954.g82316b04.el9.no 31/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-954.g8231 32/180 2024-03-23T06:06:06.329 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-954.g82316b04.el9 33/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:18.2.2-954.g82316b04.el9.noarch 34/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-954.g82316b04.el 35/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:18.2.2-954.g82316b04.el9.noarch 36/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:18.2.2-954.g82316b04.el9.noarch 37/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:18.2.2-954.g82316b04.el9.noarch 38/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 42/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 43/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 44/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 45/180 2024-03-23T06:06:06.330 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 51/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 53/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 54/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 55/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-13.11-1.el9.x86_64 56/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 57/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 58/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 59/180 2024-03-23T06:06:06.331 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 70/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 71/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 72/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/180 2024-03-23T06:06:06.332 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 74/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 75/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 77/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 78/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 79/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 80/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 85/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jq-1.6-16.el9.x86_64 86/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 87/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 88/180 2024-03-23T06:06:06.333 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 89/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 90/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 91/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 92/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 93/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 94/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 95/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 96/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/180 2024-03-23T06:06:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 103/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 109/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/180 2024-03-23T06:06:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/180 2024-03-23T06:06:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:18.2.2-954.g82316b04.el9.x86_64 133/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:18.2.2-954.g82316b04.el9.x86_64 135/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 137/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 138/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 139/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 141/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 143/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 145/180 2024-03-23T06:06:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 151/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 153/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 157/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 158/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 159/180 2024-03-23T06:06:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 160/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 161/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 162/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 163/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 164/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 165/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 166/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 167/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 168/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 169/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 170/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 171/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 172/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 173/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 174/180 2024-03-23T06:06:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 175/180 2024-03-23T06:06:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 176/180 2024-03-23T06:06:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 177/180 2024-03-23T06:06:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 178/180 2024-03-23T06:06:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 179/180 2024-03-23T06:06:07.306 INFO:teuthology.orchestra.run.smithi073.stdout:(119/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 28 kB/s | 90 kB 00:03 2024-03-23T06:06:08.631 INFO:teuthology.orchestra.run.smithi073.stdout:(120/156): python3-repoze-lru-0.7-16.el9.noarch 23 kB/s | 31 kB 00:01 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 180/180 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout: acl-2.3.1-4.el9.x86_64 2024-03-23T06:06:09.044 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-23T06:06:09.045 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.046 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: jq-1.6-16.el9.x86_64 2024-03-23T06:06:09.048 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-23T06:06:09.049 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-13.11-1.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-23T06:06:09.050 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-23T06:06:09.051 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-23T06:06:09.052 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-23T06:06:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-3.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-23T06:06:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:06:09.056 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-03-23T06:06:09.673 DEBUG:teuthology.parallel:result is None 2024-03-23T06:06:15.289 INFO:teuthology.orchestra.run.smithi073.stdout:(121/156): python3-routes-2.5.1-5.el9.noarch.rp 28 kB/s | 188 kB 00:06 2024-03-23T06:06:17.751 INFO:teuthology.orchestra.run.smithi073.stdout:(122/156): python3-rsa-4.9-2.el9.noarch.rpm 24 kB/s | 59 kB 00:02 2024-03-23T06:06:19.247 INFO:teuthology.orchestra.run.smithi073.stdout:(123/156): python3-tempora-5.0.0-2.el9.noarch.r 24 kB/s | 36 kB 00:01 2024-03-23T06:06:20.772 INFO:teuthology.orchestra.run.smithi073.stdout:(124/156): python3-kubernetes-26.1.0-2.el9.noar 31 kB/s | 1.0 MB 00:34 2024-03-23T06:06:21.122 INFO:teuthology.orchestra.run.smithi073.stdout:(125/156): python3-typing-extensions-4.4.0-2.el 27 kB/s | 51 kB 00:01 2024-03-23T06:06:24.431 INFO:teuthology.orchestra.run.smithi073.stdout:(126/156): python3-websocket-client-1.2.3-2.el9 27 kB/s | 90 kB 00:03 2024-03-23T06:06:28.897 INFO:teuthology.orchestra.run.smithi073.stdout:(127/156): python3-webob-1.8.7-6.el9.noarch.rpm 28 kB/s | 230 kB 00:08 2024-03-23T06:06:29.822 INFO:teuthology.orchestra.run.smithi073.stdout:(128/156): python3-zc-lockfile-2.0-10.el9.noarc 22 kB/s | 20 kB 00:00 2024-03-23T06:06:36.721 INFO:teuthology.orchestra.run.smithi073.stdout:(129/156): re2-20211101-3.el9.x86_64.rpm 28 kB/s | 192 kB 00:06 2024-03-23T06:06:39.780 INFO:teuthology.orchestra.run.smithi073.stdout:(130/156): python3-werkzeug-2.0.3-3.el9.1.noarc 28 kB/s | 427 kB 00:15 2024-03-23T06:06:40.421 INFO:teuthology.orchestra.run.smithi073.stdout:(131/156): librados2-18.2.2-954.g82316b04.el9.x 5.1 MB/s | 3.3 MB 00:00 2024-03-23T06:06:40.630 INFO:teuthology.orchestra.run.smithi073.stdout:(132/156): librbd1-18.2.2-954.g82316b04.el9.x86 14 MB/s | 3.0 MB 00:00 2024-03-23T06:06:40.672 INFO:teuthology.orchestra.run.smithi073.stdout:(133/156): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-03-23T06:07:17.243 INFO:teuthology.orchestra.run.smithi073.stdout:(134/156): NetworkManager-1.47.2-1.el9.x86_64.r 65 kB/s | 2.3 MB 00:36 2024-03-23T06:07:17.768 INFO:teuthology.orchestra.run.smithi073.stdout:(135/156): NetworkManager-libnm-1.47.2-1.el9.x8 3.5 MB/s | 1.8 MB 00:00 2024-03-23T06:07:17.826 INFO:teuthology.orchestra.run.smithi073.stdout:(136/156): NetworkManager-team-1.47.2-1.el9.x86 731 kB/s | 42 kB 00:00 2024-03-23T06:07:17.893 INFO:teuthology.orchestra.run.smithi073.stdout:(137/156): NetworkManager-tui-1.47.2-1.el9.x86_ 3.7 MB/s | 248 kB 00:00 2024-03-23T06:07:17.960 INFO:teuthology.orchestra.run.smithi073.stdout:(138/156): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-03-23T06:07:18.019 INFO:teuthology.orchestra.run.smithi073.stdout:(139/156): elfutils-debuginfod-client-0.190-2.e 632 kB/s | 36 kB 00:00 2024-03-23T06:07:18.078 INFO:teuthology.orchestra.run.smithi073.stdout:(140/156): elfutils-libelf-0.190-2.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2024-03-23T06:07:18.145 INFO:teuthology.orchestra.run.smithi073.stdout:(141/156): elfutils-libs-0.190-2.el9.x86_64.rpm 3.8 MB/s | 256 kB 00:00 2024-03-23T06:07:18.203 INFO:teuthology.orchestra.run.smithi073.stdout:(142/156): libacl-2.3.1-4.el9.x86_64.rpm 398 kB/s | 23 kB 00:00 2024-03-23T06:07:18.262 INFO:teuthology.orchestra.run.smithi073.stdout:(143/156): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-03-23T06:07:18.329 INFO:teuthology.orchestra.run.smithi073.stdout:(144/156): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-03-23T06:07:18.388 INFO:teuthology.orchestra.run.smithi073.stdout:(145/156): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-23T06:07:18.446 INFO:teuthology.orchestra.run.smithi073.stdout:(146/156): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-23T06:07:18.505 INFO:teuthology.orchestra.run.smithi073.stdout:(147/156): libuuid-2.37.4-18.el9.x86_64.rpm 496 kB/s | 29 kB 00:00 2024-03-23T06:07:18.697 INFO:teuthology.orchestra.run.smithi073.stdout:(148/156): openssl-3.0.7-27.el9.x86_64.rpm 6.3 MB/s | 1.2 MB 00:00 2024-03-23T06:07:18.930 INFO:teuthology.orchestra.run.smithi073.stdout:(149/156): openssl-libs-3.0.7-27.el9.x86_64.rpm 9.3 MB/s | 2.2 MB 00:00 2024-03-23T06:07:19.156 INFO:teuthology.orchestra.run.smithi073.stdout:(150/156): util-linux-2.37.4-18.el9.x86_64.rpm 10 MB/s | 2.3 MB 00:00 2024-03-23T06:07:19.239 INFO:teuthology.orchestra.run.smithi073.stdout:(151/156): util-linux-core-2.37.4-18.el9.x86_64 5.5 MB/s | 465 kB 00:00 2024-03-23T06:07:19.298 INFO:teuthology.orchestra.run.smithi073.stdout:(152/156): util-linux-user-2.37.4-18.el9.x86_64 538 kB/s | 31 kB 00:00 2024-03-23T06:07:19.407 INFO:teuthology.orchestra.run.smithi073.stdout:(153/156): xfsprogs-6.3.0-1.el9.x86_64.rpm 10 MB/s | 1.1 MB 00:00 2024-03-23T06:07:20.268 INFO:teuthology.orchestra.run.smithi073.stdout:(154/156): libacl-devel-2.3.1-4.el9.x86_64.rpm 86 kB/s | 74 kB 00:00 2024-03-23T06:07:35.484 INFO:teuthology.orchestra.run.smithi073.stdout:(155/156): thrift-0.15.0-2.el9.x86_64.rpm 28 kB/s | 1.6 MB 00:58 2024-03-23T06:07:45.806 INFO:teuthology.orchestra.run.smithi073.stdout:(156/156): libarrow-9.0.0-10.el9.x86_64.rpm 28 kB/s | 4.4 MB 02:42 2024-03-23T06:07:45.812 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-03-23T06:07:45.812 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.1 MB/s | 204 MB 03:05 2024-03-23T06:07:47.053 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-03-23T06:07:47.423 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-03-23T06:07:47.424 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-03-23T06:07:49.512 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-03-23T06:07:49.512 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-03-23T06:07:56.069 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-03-23T06:07:56.174 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/180 2024-03-23T06:07:56.213 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/180 2024-03-23T06:07:56.251 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-23T06:07:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-23T06:07:56.387 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/180 2024-03-23T06:07:56.506 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/180 2024-03-23T06:07:56.562 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/180 2024-03-23T06:07:56.600 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/180 2024-03-23T06:07:56.681 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/180 2024-03-23T06:07:57.081 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/180 2024-03-23T06:07:57.123 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:18.2.2-954.g82316b04.el9.x86_64 10/180 2024-03-23T06:07:57.273 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:18.2.2-954.g82316b04.el9.x86_64 10/180 2024-03-23T06:07:57.307 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:18.2.2-954.g82316b04.el9.x86_64 11/180 2024-03-23T06:07:57.412 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:18.2.2-954.g82316b04.el9.x86_64 11/180 2024-03-23T06:07:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:18.2.2-954.g82316b04.el9.x86_64 12/180 2024-03-23T06:07:57.509 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/180 2024-03-23T06:07:57.785 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/180 2024-03-23T06:07:57.833 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/180 2024-03-23T06:07:57.859 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:18.2.2-954.g82316b04.el9.x86_64 16/180 2024-03-23T06:07:57.999 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:18.2.2-954.g82316b04.el9.x86_64 16/180 2024-03-23T06:07:58.034 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:18.2.2-954.g82316b04.el9.x86_ 17/180 2024-03-23T06:07:58.133 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:18.2.2-954.g82316b04.el9.x86_ 17/180 2024-03-23T06:07:58.208 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/180 2024-03-23T06:07:58.252 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/180 2024-03-23T06:07:58.568 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 20/180 2024-03-23T06:07:58.716 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 21/180 2024-03-23T06:07:58.821 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 21/180 2024-03-23T06:07:59.012 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-23T06:07:59.069 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-23T06:07:59.487 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 22/180 2024-03-23T06:07:59.525 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/180 2024-03-23T06:07:59.562 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/180 2024-03-23T06:07:59.628 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/180 2024-03-23T06:07:59.738 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/180 2024-03-23T06:07:59.809 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/180 2024-03-23T06:07:59.859 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/180 2024-03-23T06:07:59.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/180 2024-03-23T06:07:59.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/180 2024-03-23T06:08:00.014 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/180 2024-03-23T06:08:00.118 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 32/180 2024-03-23T06:08:00.153 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:18.2.2-954.g82316b04.el9.x 33/180 2024-03-23T06:08:00.201 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:18.2.2-954.g82316b04.el9 34/180 2024-03-23T06:08:00.304 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:18.2.2-954.g82316b04.el9.x86_64 35/180 2024-03-23T06:08:00.480 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/180 2024-03-23T06:08:00.546 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/180 2024-03-23T06:08:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/180 2024-03-23T06:08:01.301 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/180 2024-03-23T06:08:01.406 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/180 2024-03-23T06:08:01.462 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-23T06:08:01.501 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-23T06:08:01.571 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/180 2024-03-23T06:08:01.618 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:18.2.2-954.g82316b04.el9.x86_64 43/180 2024-03-23T06:08:01.685 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/180 2024-03-23T06:08:02.118 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 45/180 2024-03-23T06:08:02.315 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 46/180 2024-03-23T06:08:02.408 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 47/180 2024-03-23T06:08:02.462 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 48/180 2024-03-23T06:08:02.661 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/180 2024-03-23T06:08:02.710 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 50/180 2024-03-23T06:08:02.848 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-3.el9.x86_64 51/180 2024-03-23T06:08:02.897 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 52/180 2024-03-23T06:08:02.959 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/180 2024-03-23T06:08:03.049 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/180 2024-03-23T06:08:03.089 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/180 2024-03-23T06:08:03.128 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/180 2024-03-23T06:08:03.193 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/180 2024-03-23T06:08:03.252 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/180 2024-03-23T06:08:03.313 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/180 2024-03-23T06:08:03.505 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/180 2024-03-23T06:08:03.554 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/180 2024-03-23T06:08:03.602 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/180 2024-03-23T06:08:03.729 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/180 2024-03-23T06:08:03.780 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 64/180 2024-03-23T06:08:03.826 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/180 2024-03-23T06:08:03.864 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/180 2024-03-23T06:08:03.901 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 67/180 2024-03-23T06:08:04.065 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fmt-8.1.1-5.el9.x86_64 68/180 2024-03-23T06:08:04.128 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 69/180 2024-03-23T06:08:04.196 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 70/180 2024-03-23T06:08:04.294 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 71/180 2024-03-23T06:08:04.558 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 72/180 2024-03-23T06:08:04.614 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 73/180 2024-03-23T06:08:04.789 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 74/180 2024-03-23T06:08:04.839 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/180 2024-03-23T06:08:04.876 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/180 2024-03-23T06:08:04.915 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-15.el9.x86_64 77/180 2024-03-23T06:08:04.956 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 78/180 2024-03-23T06:08:05.009 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/180 2024-03-23T06:08:05.063 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/180 2024-03-23T06:08:05.109 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/180 2024-03-23T06:08:05.238 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/180 2024-03-23T06:08:05.314 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/180 2024-03-23T06:08:05.350 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/180 2024-03-23T06:08:05.414 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/180 2024-03-23T06:08:05.445 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/180 2024-03-23T06:08:05.587 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/180 2024-03-23T06:08:05.624 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/180 2024-03-23T06:08:05.686 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/180 2024-03-23T06:08:05.843 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 90/180 2024-03-23T06:08:05.907 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 91/180 2024-03-23T06:08:06.872 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/180 2024-03-23T06:08:06.922 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 93/180 2024-03-23T06:08:06.956 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 94/180 2024-03-23T06:08:06.989 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 95/180 2024-03-23T06:08:07.229 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/180 2024-03-23T06:08:07.260 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/180 2024-03-23T06:08:07.357 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/180 2024-03-23T06:08:08.148 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/180 2024-03-23T06:08:08.280 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/180 2024-03-23T06:08:09.775 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/180 2024-03-23T06:08:09.865 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/180 2024-03-23T06:08:09.904 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 103/180 2024-03-23T06:08:09.935 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-16.el9.x86_64 104/180 2024-03-23T06:08:09.974 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 105/180 2024-03-23T06:08:10.341 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/180 2024-03-23T06:08:10.381 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:18.2.2-954.g82316b04.el9.x86_64 107/180 2024-03-23T06:08:10.501 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:18.2.2-954.g82316b04.el9.x86_64 107/180 2024-03-23T06:08:10.529 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:18.2.2-954.g82316b04.el9.x86_64 108/180 2024-03-23T06:08:10.583 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/180 2024-03-23T06:08:11.035 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/180 2024-03-23T06:08:11.059 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:18.2.2-954.g82316b04.el9.x86_64 111/180 2024-03-23T06:08:11.150 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:18.2.2-954.g82316b04.el9.x86_64 111/180 2024-03-23T06:08:11.177 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:18.2.2-954.g82316b04.el9.x86_64 112/180 2024-03-23T06:08:13.570 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 113/180 2024-03-23T06:08:13.608 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 113/180 2024-03-23T06:08:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 113/180 2024-03-23T06:08:14.269 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:18.2.2-954.g82316b04.el9.x86_64 114/180 2024-03-23T06:08:14.443 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:18.2.2-954.g82316b04.el9.x86_64 114/180 2024-03-23T06:08:14.443 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-23T06:08:14.444 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-23T06:08:14.444 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:14.495 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:18.2.2-954.g82316b04.el9.x86_64 115/180 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:18.2.2-954.g82316b04.el9.x86_64 115/180 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-03-23T06:08:27.890 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:28.108 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:18.2.2-954.g82316b04.el9.noarch 116/180 2024-03-23T06:08:28.159 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:18.2.2-954.g82316b04.el9.noarch 116/180 2024-03-23T06:08:28.160 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:28.160 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-23T06:08:28.160 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:29.762 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:18.2.2-954.g82316b04.el9.x86_64 117/180 2024-03-23T06:08:29.842 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:18.2.2-954.g82316b04.el9.x86_64 117/180 2024-03-23T06:08:29.842 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:29.842 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-23T06:08:29.842 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-23T06:08:29.842 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-23T06:08:29.842 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:30.086 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:18.2.2-954.g82316b04.el9.x86_64 118/180 2024-03-23T06:08:30.154 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:18.2.2-954.g82316b04.el9.x86_64 118/180 2024-03-23T06:08:30.155 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:30.155 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-23T06:08:30.155 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-23T06:08:30.155 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-23T06:08:30.155 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:30.637 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:18.2.2-954.g82316b04.el9.x86_64 119/180 2024-03-23T06:08:30.717 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:18.2.2-954.g82316b04.el9.x86_64 119/180 2024-03-23T06:08:30.718 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:30.718 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-23T06:08:30.718 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-23T06:08:30.718 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-23T06:08:30.718 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:30.831 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 120/180 2024-03-23T06:08:31.403 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:18.2.2-954.g82316b04.el9.noarch 121/180 2024-03-23T06:08:31.442 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:18.2.2-954.g82316b04.el9.noarch 121/180 2024-03-23T06:08:31.489 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-954.g82316b04.el 122/180 2024-03-23T06:08:31.602 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-954.g82316b04.e 123/180 2024-03-23T06:08:31.636 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-954.g82316b04.el9.noar 124/180 2024-03-23T06:08:31.963 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-954.g82316b04.el9.noar 124/180 2024-03-23T06:08:31.995 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-954.g82316b04.el9.no 125/180 2024-03-23T06:08:33.112 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-954.g82316b04.el9.no 125/180 2024-03-23T06:08:33.137 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-954.g8231 126/180 2024-03-23T06:08:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-954.g8231 126/180 2024-03-23T06:08:33.452 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-954.g82316b04.el9 127/180 2024-03-23T06:08:33.498 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:18.2.2-954.g82316b04.el9.x86_64 128/180 2024-03-23T06:08:33.566 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:18.2.2-954.g82316b04.el9.x86_64 128/180 2024-03-23T06:08:33.566 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:33.566 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-23T06:08:33.567 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-23T06:08:33.567 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-23T06:08:33.567 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:33.624 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:18.2.2-954.g82316b04.el9.noarch 129/180 2024-03-23T06:08:33.661 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-954.g82316b04.el9.noarch 129/180 2024-03-23T06:08:33.784 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:18.2.2-954.g82316b04.el9.x86_64 130/180 2024-03-23T06:08:34.611 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/180 2024-03-23T06:08:34.642 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:18.2.2-954.g82316b04.el9.x86_64 132/180 2024-03-23T06:08:34.709 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-954.g82316b04.el9.x86_64 132/180 2024-03-23T06:08:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-23T06:08:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-23T06:08:34.710 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-23T06:08:34.710 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:34.751 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-954.g82316b 133/180 2024-03-23T06:08:34.818 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-954.g82316b 133/180 2024-03-23T06:08:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-23T06:08:34.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:34.893 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:18.2.2-954.g82316b04.el9.x86_64 134/180 2024-03-23T06:08:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-954.g82316b04.el9.x86_64 134/180 2024-03-23T06:08:34.970 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:34.970 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-23T06:08:34.970 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-23T06:08:34.970 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-23T06:08:34.970 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:35.319 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:18.2.2-954.g82316b04.el9.x86_64 135/180 2024-03-23T06:08:35.387 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:18.2.2-954.g82316b04.el9.x86_64 135/180 2024-03-23T06:08:35.387 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-23T06:08:35.388 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-23T06:08:35.388 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-23T06:08:35.388 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-23T06:08:35.388 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:39.343 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:18.2.2-954.g82316b04.el9.x86_64 136/180 2024-03-23T06:08:39.398 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:18.2.2-954.g82316b04.el9.x86_64 137/180 2024-03-23T06:08:39.430 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:18.2.2-954.g82316b04.el9.x86_64 138/180 2024-03-23T06:08:39.697 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/180 2024-03-23T06:08:39.821 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/180 2024-03-23T06:08:39.873 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:18.2.2-954.g82316b04.el9.x86_64 141/180 2024-03-23T06:08:39.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/180 2024-03-23T06:08:39.990 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 143/180 2024-03-23T06:08:40.036 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 144/180 2024-03-23T06:08:40.070 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:18.2.2-954.g82316b04.el9.x86_6 145/180 2024-03-23T06:08:40.114 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 146/180 2024-03-23T06:08:40.166 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 147/180 2024-03-23T06:08:40.249 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 148/180 2024-03-23T06:08:40.367 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/180 2024-03-23T06:08:40.407 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 150/180 2024-03-23T06:08:41.330 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-23T06:08:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-23T06:08:41.442 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-23T06:08:42.763 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:18.2.2-954.g82316b04.el9.noarch 152/180 2024-03-23T06:08:42.868 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 153/180 2024-03-23T06:08:42.903 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/180 2024-03-23T06:08:43.037 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/180 2024-03-23T06:08:43.078 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/180 2024-03-23T06:08:43.112 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 157/180 2024-03-23T06:08:43.146 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 158/180 2024-03-23T06:08:43.187 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 159/180 2024-03-23T06:08:43.188 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-23T06:08:43.325 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-23T06:08:43.375 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/180 2024-03-23T06:08:43.376 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-23T06:08:43.530 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-23T06:08:43.585 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 163/180 2024-03-23T06:08:43.628 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/180 2024-03-23T06:08:43.662 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 165/180 2024-03-23T06:08:43.694 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 166/180 2024-03-23T06:08:43.763 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 167/180 2024-03-23T06:08:43.833 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 168/180 2024-03-23T06:08:43.874 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 169/180 2024-03-23T06:08:43.907 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 170/180 2024-03-23T06:08:43.941 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 171/180 2024-03-23T06:08:43.974 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 172/180 2024-03-23T06:08:44.007 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/180 2024-03-23T06:08:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-23T06:08:44.044 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-23T06:08:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-23T06:08:44.359 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-23T06:08:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-23T06:08:44.511 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 176/180 2024-03-23T06:08:44.544 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 177/180 2024-03-23T06:08:44.581 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 178/180 2024-03-23T06:08:44.621 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/180 2024-03-23T06:08:44.767 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-23T06:08:45.015 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-23T06:08:45.016 INFO:teuthology.orchestra.run.smithi073.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-23T06:08:45.016 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:49.495 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:18.2.2-954.g82316b04.el9.x86_64 1/180 2024-03-23T06:08:49.495 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:18.2.2-954.g82316b04.el9.x86_64 2/180 2024-03-23T06:08:49.495 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 3/180 2024-03-23T06:08:49.495 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:18.2.2-954.g82316b04.el9.x86_64 4/180 2024-03-23T06:08:49.495 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-954.g82316b 5/180 2024-03-23T06:08:49.495 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:18.2.2-954.g82316b04.el9.x86_64 6/180 2024-03-23T06:08:49.495 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:18.2.2-954.g82316b04.el9.x86_64 7/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:18.2.2-954.g82316b04.el9.x86_64 8/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:18.2.2-954.g82316b04.el9.x86_64 9/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:18.2.2-954.g82316b04.el9.x86_64 10/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:18.2.2-954.g82316b04.el9.x86_64 11/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:18.2.2-954.g82316b04.el9.x86_64 12/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:18.2.2-954.g82316b04.el9.x86_64 13/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:18.2.2-954.g82316b04.el9.x86_6 14/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:18.2.2-954.g82316b04.el9.x86_64 15/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:18.2.2-954.g82316b04.el9.x86_64 16/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:18.2.2-954.g82316b04.el9.x86_64 17/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:18.2.2-954.g82316b04.el9.x86_ 18/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:18.2.2-954.g82316b04.el9.x86_64 19/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:18.2.2-954.g82316b04.el9 20/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:18.2.2-954.g82316b04.el9.x 21/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:18.2.2-954.g82316b04.el9.x86_64 22/180 2024-03-23T06:08:49.496 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:18.2.2-954.g82316b04.el9.x86_64 23/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:18.2.2-954.g82316b04.el9.x86_64 24/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:18.2.2-954.g82316b04.el9.x86_64 25/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:18.2.2-954.g82316b04.el9.x86_64 26/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:18.2.2-954.g82316b04.el9.x86_64 27/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:18.2.2-954.g82316b04.el9.x86_64 28/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-954.g82316b04.e 29/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-954.g82316b04.el9.noar 30/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-954.g82316b04.el9.no 31/180 2024-03-23T06:08:49.497 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-954.g8231 32/180 2024-03-23T06:08:49.509 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-954.g82316b04.el9 33/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:18.2.2-954.g82316b04.el9.noarch 34/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-954.g82316b04.el 35/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:18.2.2-954.g82316b04.el9.noarch 36/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:18.2.2-954.g82316b04.el9.noarch 37/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:18.2.2-954.g82316b04.el9.noarch 38/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 42/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 43/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 44/180 2024-03-23T06:08:49.510 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 45/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 51/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 53/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 54/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 55/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.11-1.el9.x86_64 56/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 57/180 2024-03-23T06:08:49.511 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 58/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 59/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 70/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 71/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 72/180 2024-03-23T06:08:49.512 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 74/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 75/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 77/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 78/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 79/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 80/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 85/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-16.el9.x86_64 86/180 2024-03-23T06:08:49.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 87/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 88/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 89/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 90/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 91/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 92/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 93/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 94/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 95/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 96/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/180 2024-03-23T06:08:49.514 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 103/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 109/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/180 2024-03-23T06:08:49.515 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/180 2024-03-23T06:08:49.516 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:18.2.2-954.g82316b04.el9.x86_64 133/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:18.2.2-954.g82316b04.el9.x86_64 135/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 137/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 138/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 139/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 141/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 143/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 145/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/180 2024-03-23T06:08:49.517 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 151/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 153/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 157/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 158/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 159/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 160/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 161/180 2024-03-23T06:08:49.518 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 162/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 163/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 164/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 165/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 166/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 167/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 168/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 169/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 170/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 171/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 172/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 173/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 174/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 175/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 176/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 177/180 2024-03-23T06:08:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 178/180 2024-03-23T06:08:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 179/180 2024-03-23T06:08:51.819 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 180/180 2024-03-23T06:08:51.819 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:51.819 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: acl-2.3.1-4.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.820 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-23T06:08:51.821 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.822 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:18.2.2-954.g82316b04.el9.noarch 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-23T06:08:51.823 INFO:teuthology.orchestra.run.smithi073.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-16.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-23T06:08:51.824 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-23T06:08:51.825 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.11-1.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-23T06:08:51.826 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-23T06:08:51.827 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-23T06:08:51.828 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-23T06:08:51.829 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:18.2.2-954.g82316b04.el9.x86_64 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-3.el9.x86_64 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-23T06:08:51.830 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-23T06:08:51.831 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-23T06:08:51.831 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:51.831 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-03-23T06:08:52.487 DEBUG:teuthology.parallel:result is None 2024-03-23T06:08:52.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=82316b04821a6c2c1d458a881920454bbadb8837 2024-03-23T06:08:52.702 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-23T06:08:52.757 INFO:teuthology.orchestra.run.smithi073.stdout:18.2.2-954.g82316b04.el9 2024-03-23T06:08:52.758 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-954.g82316b04.el9 2024-03-23T06:08:52.758 INFO:teuthology.task.install:The correct ceph version 18.2.2-954.g82316b04 is installed. 2024-03-23T06:08:52.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=82316b04821a6c2c1d458a881920454bbadb8837 2024-03-23T06:08:52.971 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-23T06:08:52.995 INFO:teuthology.orchestra.run.smithi110.stdout:18.2.2-954.g82316b04.el9 2024-03-23T06:08:52.995 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-954.g82316b04.el9 2024-03-23T06:08:52.995 INFO:teuthology.task.install:The correct ceph version 18.2.2-954.g82316b04 is installed. 2024-03-23T06:08:52.997 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-23T06:08:52.997 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:52.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-23T06:08:53.074 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:08:53.074 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-23T06:08:53.104 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-23T06:08:53.104 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:53.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-03-23T06:08:53.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-23T06:08:53.297 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:08:53.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-03-23T06:08:53.325 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-23T06:08:53.392 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-23T06:08:53.393 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:53.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-23T06:08:53.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-23T06:08:53.593 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:08:53.593 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-23T06:08:53.620 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-23T06:08:53.687 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-23T06:08:53.687 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:53.688 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-03-23T06:08:53.763 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-23T06:08:53.877 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:08:53.877 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-03-23T06:08:53.903 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-23T06:08:53.970 INFO:teuthology.run_tasks:Running task ceph... 2024-03-23T06:08:54.029 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-23T06:08:54.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-03-23T06:08:54.035 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-03-23T06:08:54.103 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-23T06:08:54.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-23T06:08:54.107 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-23T06:08:54.172 INFO:tasks.ceph:Creating extra log directories... 2024-03-23T06:08:54.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-23T06:08:54.176 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-23T06:08:54.246 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-23T06:08:54.246 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-23T06:08:54.246 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-23T06:08:54.247 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:54.247 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-23T06:08:54.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-23T06:08:54.495 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-23T06:08:54.573 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:08:54.573 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-23T06:08:54.588 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-23T06:08:54.709 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-23T06:08:54.740 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-23T06:08:54.740 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-23T06:08:54.740 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300', 'branch': 'wip-yuri11-testing-2024-03-21-0851-reef', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7617300', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri11-testing-2024-03-21-0851-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri11-testing-2024-03-21-0851-reef', 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1919, 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri11-testing-2024-03-21-0851-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_82316b04821a6c2c1d458a881920454bbadb8837/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '82316b04821a6c2c1d458a881920454bbadb8837', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOIE+m5d5gJ9ejXRmMtymx5RlzM4GAGsrptPn422giAu2p9TfTzdvquQoKNZuiutzQhnKdfbOqpaQnwYPpSpKk=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6EUeBXM2SHebB8vY03X2DvVg1ilhcdNVWA+XcY3VpE765bfRcatHeM5kCe/R6uYTqUT1Tqao/GjgcmwT6wd5k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': '82316b04821a6c2c1d458a881920454bbadb8837', 'cluster': 'ceph'}}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-22_13:15:24', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-23T06:08:54.741 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-23T06:08:54.746 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-23T06:08:54.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-03-23T06:08:54.830 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-03-23T06:08:54.897 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:54.897 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-03-23T06:08:54.937 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-23T06:08:54.937 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-03-23T06:08:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-23T06:08:55.019 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T06:08:55.020 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-23T06:08:55.020 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:08:55.020 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T06:08:55.020 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-23 06:08:45.422054680 +0000 2024-03-23T06:08:55.020 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-23 06:03:42.810923596 +0000 2024-03-23T06:08:55.020 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-23 06:03:42.810923596 +0000 2024-03-23T06:08:55.020 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-23 06:03:42.810923596 +0000 2024-03-23T06:08:55.020 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-23T06:08:55.126 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-23T06:08:55.126 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-23T06:08:55.126 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000338077 s, 1.5 MB/s 2024-03-23T06:08:55.129 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-23T06:08:55.169 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-23 06:08:45.423054656 +0000 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-23 06:03:43.363910309 +0000 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-23 06:03:43.363910309 +0000 2024-03-23T06:08:55.248 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-23 06:03:43.363910309 +0000 2024-03-23T06:08:55.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-23T06:08:55.356 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-23T06:08:55.357 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-23T06:08:55.357 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000282479 s, 1.8 MB/s 2024-03-23T06:08:55.359 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-23T06:08:55.399 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-03-23T06:08:55.479 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-23T06:08:55.479 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T06:08:55.479 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-03-23T06:08:55.479 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:08:55.479 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T06:08:55.480 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-23 06:08:45.424054632 +0000 2024-03-23T06:08:55.480 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-23 06:03:43.940896446 +0000 2024-03-23T06:08:55.480 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-23 06:03:43.940896446 +0000 2024-03-23T06:08:55.480 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-23 06:03:43.940896446 +0000 2024-03-23T06:08:55.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-23T06:08:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-23T06:08:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-23T06:08:55.591 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000296406 s, 1.7 MB/s 2024-03-23T06:08:55.595 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-23T06:08:55.636 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-03-23T06:08:55.716 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-23T06:08:55.717 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T06:08:55.717 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-03-23T06:08:55.717 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:08:55.717 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T06:08:55.717 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-23 06:08:45.424054632 +0000 2024-03-23T06:08:55.717 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-23 06:03:44.485883351 +0000 2024-03-23T06:08:55.717 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-23 06:03:44.485883351 +0000 2024-03-23T06:08:55.718 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-23 06:03:44.485883351 +0000 2024-03-23T06:08:55.718 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-23T06:08:55.823 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-23T06:08:55.823 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-23T06:08:55.823 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.0002641 s, 1.9 MB/s 2024-03-23T06:08:55.825 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-23T06:08:55.867 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T06:08:55.867 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:08:55.867 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-03-23T06:08:55.885 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-23T06:08:55.885 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-03-23 06:06:02.351719354 +0000 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-03-23 06:02:54.077042836 +0000 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-03-23 06:02:54.077042836 +0000 2024-03-23T06:08:55.942 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-03-23 06:02:54.077042836 +0000 2024-03-23T06:08:55.943 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-23T06:08:56.009 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-03-23T06:08:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-03-23T06:08:56.010 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000118443 s, 4.3 MB/s 2024-03-23T06:08:56.011 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-23T06:08:56.069 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-03-23 06:06:02.351719354 +0000 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-03-23 06:02:54.416036958 +0000 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-03-23 06:02:54.416036958 +0000 2024-03-23T06:08:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-03-23 06:02:54.416036958 +0000 2024-03-23T06:08:56.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-23T06:08:56.192 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-03-23T06:08:56.192 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-03-23T06:08:56.192 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000114318 s, 4.5 MB/s 2024-03-23T06:08:56.193 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-23T06:08:56.250 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-03-23T06:08:56.306 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-23T06:08:56.306 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T06:08:56.306 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 700 Links: 1 2024-03-23T06:08:56.306 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:08:56.306 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T06:08:56.307 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-03-23 06:06:02.351719354 +0000 2024-03-23T06:08:56.307 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-03-23 06:02:54.784030577 +0000 2024-03-23T06:08:56.307 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-03-23 06:02:54.784030577 +0000 2024-03-23T06:08:56.307 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-03-23 06:02:54.784030577 +0000 2024-03-23T06:08:56.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-23T06:08:56.373 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-03-23T06:08:56.373 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-03-23T06:08:56.373 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.7528e-05 s, 5.2 MB/s 2024-03-23T06:08:56.374 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-23T06:08:56.431 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-03-23T06:08:56.485 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-23T06:08:56.485 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-23T06:08:56.486 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-03-23T06:08:56.486 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:08:56.486 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-03-23T06:08:56.486 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-03-23 06:06:02.352719336 +0000 2024-03-23T06:08:56.486 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-03-23 06:02:55.101025081 +0000 2024-03-23T06:08:56.486 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-03-23 06:02:55.101025081 +0000 2024-03-23T06:08:56.486 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-03-23 06:02:55.101025081 +0000 2024-03-23T06:08:56.486 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-23T06:08:56.551 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-03-23T06:08:56.551 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-03-23T06:08:56.551 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 9.748e-05 s, 5.3 MB/s 2024-03-23T06:08:56.553 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-23T06:08:56.608 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T06:08:56.608 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-23T06:08:56.608 INFO:tasks.ceph:Generating config... 2024-03-23T06:08:56.609 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-23T06:08:56.609 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-03-23T06:08:56.609 INFO:tasks.ceph:[client] debug client = 20 2024-03-23T06:08:56.610 INFO:tasks.ceph:[client] debug ms = 1 2024-03-23T06:08:56.610 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-23T06:08:56.610 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-23T06:08:56.610 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-23T06:08:56.610 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] mds_dir_prefetch = False 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-23T06:08:56.611 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-23T06:08:56.612 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-23T06:08:56.612 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-23T06:08:56.612 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-03-23T06:08:56.612 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-03-23T06:08:56.613 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-03-23T06:08:56.613 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-03-23T06:08:56.613 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-03-23T06:08:56.613 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-23T06:08:56.613 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-03-23T06:08:56.613 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-23T06:08:56.613 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-23T06:08:56.613 INFO:tasks.ceph:Setting up mon.a... 2024-03-23T06:08:56.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-23T06:08:56.771 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-03-23T06:08:56.779 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-23T06:08:56.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T06:08:57.001 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]')] 2024-03-23T06:08:57.001 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-23T06:08:57.002 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:57.002 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-23T06:08:57.051 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --add b 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:08:57.191 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:08:57.191 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 4707007f-1ceb-450e-b69b-d09789f75edc 2024-03-23T06:08:57.191 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2024-03-23T06:08:57.191 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-03-23T06:08:57.191 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 4707007f-1ceb-450e-b69b-d09789f75edc 2024-03-23T06:08:57.191 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-03-23T06:08:57.192527+0000 2024-03-23T06:08:57.191 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-03-23T06:08:57.192527+0000 2024-03-23T06:08:57.192 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2024-03-23T06:08:57.192 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-03-23T06:08:57.192 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-03-23T06:08:57.192 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-03-23T06:08:57.192 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-03-23T06:08:57.192 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-23T06:08:57.195 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-23T06:08:57.240 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4707007f-1ceb-450e-b69b-d09789f75edc... 2024-03-23T06:08:57.241 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-23T06:08:57.287 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-03-23T06:08:57.339 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.340 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.341 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.73,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 4707007f-1ceb-450e-b69b-d09789f75edc 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.342 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-03-23T06:08:57.343 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 20 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 20 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-03-23T06:08:57.344 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 10 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: filestore flush min = 0 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: mon client directed command retry = 5 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay max = 1 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay probability = 0.005 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay type = client mds 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject socket failures = 2500 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: osd blocked scrub grace period = 3600 2024-03-23T06:08:57.345 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: osd max markdown count = 1000 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-03-23T06:08:57.346 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-03-23T06:08:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-23T06:08:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: client_shutdown_timeout = 120 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-03-23T06:08:57.349 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal fragment size max = 10000 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal merge size = 5 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split bits = 3 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds bal split size = 100 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds oft prefetch dirfrags = True 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds_dir_prefetch = False 2024-03-23T06:08:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: mds_sleep_rank_change = 5000000.0 2024-03-23T06:08:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: mon client directed command retry = 5 2024-03-23T06:08:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay max = 1 2024-03-23T06:08:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay probability = 0.005 2024-03-23T06:08:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject delay type = client mds osd 2024-03-23T06:08:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject socket failures = 2500 2024-03-23T06:08:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-03-23T06:08:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-03-23T06:08:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-03-23T06:08:57.446 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-03-23T06:08:57.446 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-03-23T06:08:57.446 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-23T06:08:57.446 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-03-23T06:08:57.446 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.447 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-23T06:08:57.448 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4707007f-1ceb-450e-b69b-d09789f75edc 2024-03-23T06:08:57.449 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-03-23T06:08:57.450 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-03-23T06:08:57.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: filestore flush min = 0 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: mon client directed command retry = 5 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-03-23T06:08:57.452 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject delay max = 1 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject delay probability = 0.005 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject delay type = client mds 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject socket failures = 2500 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: osd blocked scrub grace period = 3600 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: osd max markdown count = 1000 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-03-23T06:08:57.453 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-03-23T06:08:57.454 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-03-23T06:08:57.455 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: client_shutdown_timeout = 120 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-03-23T06:08:57.456 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2024-03-23T06:08:57.457 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal fragment size max = 10000 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal merge size = 5 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split bits = 3 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split size = 100 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds oft prefetch dirfrags = True 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds_dir_prefetch = False 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mds_sleep_rank_change = 5000000.0 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: mon client directed command retry = 5 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject delay max = 1 2024-03-23T06:08:57.458 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject delay probability = 0.005 2024-03-23T06:08:57.459 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject delay type = client mds osd 2024-03-23T06:08:57.459 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject socket failures = 2500 2024-03-23T06:08:57.459 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-03-23T06:08:57.459 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-03-23T06:08:57.459 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-03-23T06:08:57.490 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-23T06:08:57.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-23T06:08:57.618 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-23T06:08:57.619 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:57.619 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-23T06:08:57.671 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:57.671 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-23T06:08:57.766 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:08:57.766 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:57.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-23T06:08:57.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T06:08:57.901 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:08:57.902 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:08:57.995 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:08:57.996 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:08:57.996 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-23T06:08:57.996 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-23T06:08:58.038 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:08:58.038 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:08:58.094 INFO:tasks.ceph:Setting up mon nodes... 2024-03-23T06:08:58.094 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-23T06:08:58.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-23T06:08:58.279 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-23T06:08:58.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-23T06:08:58.351 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-23T06:08:58.354 INFO:tasks.ceph:Setting up mds nodes... 2024-03-23T06:08:58.354 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-23T06:08:58.522 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-23T06:08:58.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-23T06:08:58.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-23T06:08:58.804 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-23T06:08:58.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-23T06:08:58.913 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-03-23T06:08:59.090 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-03-23T06:08:59.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-03-23T06:08:59.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-23T06:08:59.260 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-23T06:08:59.263 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-23T06:08:59.290 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-23T06:08:59.387 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-23T06:08:59.389 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-23T06:08:59.415 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-03-23T06:08:59.509 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-03-23T06:08:59.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-03-23T06:08:59.538 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-23T06:08:59.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-23T06:08:59.655 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-23T06:08:59.715 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-23T06:08:59.715 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-23T06:08:59.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-23T06:08:59.801 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T06:08:59.802 INFO:tasks.ceph:role: osd.0 2024-03-23T06:08:59.802 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:08:59.802 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T06:08:59.889 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T06:09:00.392 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-23T06:09:00.399 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-23T06:09:00.399 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-23T06:09:00.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-23T06:09:00.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-23T06:09:00.739 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T06:09:00.739 INFO:tasks.ceph:role: osd.1 2024-03-23T06:09:00.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:09:00.739 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-23T06:09:00.818 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T06:09:00.818 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T06:09:00.818 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T06:09:00.818 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T06:09:00.818 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T06:09:00.818 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-23T06:09:00.818 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T06:09:00.818 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T06:09:00.819 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T06:09:00.819 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T06:09:01.278 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-23T06:09:01.285 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-23T06:09:01.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-23T06:09:01.433 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-23T06:09:01.526 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-23T06:09:01.626 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T06:09:01.626 INFO:tasks.ceph:role: osd.2 2024-03-23T06:09:01.626 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:09:01.626 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T06:09:01.724 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T06:09:02.230 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-23T06:09:02.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-23T06:09:02.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-23T06:09:02.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-23T06:09:02.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-23T06:09:02.600 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-23T06:09:02.600 INFO:tasks.ceph:role: osd.3 2024-03-23T06:09:02.600 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:09:02.600 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T06:09:02.696 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T06:09:02.697 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T06:09:03.139 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-23T06:09:03.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-23T06:09:03.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-23T06:09:03.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-23T06:09:03.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:03.544+0000 7f62b10224c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-23T06:09:03.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:03.544+0000 7f62b10224c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-23T06:09:03.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:03.544+0000 7f62b10224c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T06:09:03.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:03.544+0000 7f62b10224c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T06:09:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:03.545+0000 7f62b10224c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-23T06:09:03.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:03.554+0000 7f62b10224c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-23T06:09:06.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-23T06:09:06.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:06.981+0000 7fbde66164c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-23T06:09:06.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:06.982+0000 7fbde66164c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-23T06:09:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:06.982+0000 7fbde66164c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T06:09:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:06.982+0000 7fbde66164c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T06:09:06.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:06.982+0000 7fbde66164c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-23T06:09:06.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:06.984+0000 7fbde66164c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-23T06:09:10.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-23T06:09:10.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:10.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:10.397+0000 7f3d3fd4a4c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-23T06:09:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:10.397+0000 7f3d3fd4a4c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-23T06:09:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:10.398+0000 7f3d3fd4a4c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T06:09:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:10.398+0000 7f3d3fd4a4c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T06:09:10.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:10.398+0000 7f3d3fd4a4c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-23T06:09:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:10.400+0000 7f3d3fd4a4c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-23T06:09:13.344 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-23T06:09:13.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:13.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:13.579+0000 7f9b3aa124c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-23T06:09:13.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:13.579+0000 7f9b3aa124c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-23T06:09:13.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:13.579+0000 7f9b3aa124c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T06:09:13.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:13.579+0000 7f9b3aa124c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T06:09:13.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:13.579+0000 7f9b3aa124c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-23T06:09:13.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:13.582+0000 7f9b3aa124c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-23T06:09:16.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-23T06:09:16.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-23T06:09:16.622 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T06:09:16.622 INFO:tasks.ceph:role: osd.4 2024-03-23T06:09:16.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:09:16.623 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T06:09:16.692 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T06:09:16.725 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-03-23T06:09:16.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-03-23T06:09:16.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-23T06:09:16.800 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-23T06:09:16.871 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-23T06:09:16.938 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T06:09:16.939 INFO:tasks.ceph:role: osd.5 2024-03-23T06:09:16.939 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:09:16.939 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T06:09:17.005 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T06:09:17.038 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-03-23T06:09:17.040 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-03-23T06:09:17.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-23T06:09:17.109 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-23T06:09:17.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-23T06:09:17.247 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T06:09:17.247 INFO:tasks.ceph:role: osd.6 2024-03-23T06:09:17.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:09:17.247 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-23T06:09:17.313 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T06:09:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T06:09:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T06:09:17.313 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T06:09:17.313 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T06:09:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-03-23T06:09:17.314 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T06:09:17.314 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T06:09:17.314 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T06:09:17.314 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T06:09:17.346 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-03-23T06:09:17.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-03-23T06:09:17.348 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-23T06:09:17.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-23T06:09:17.488 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-23T06:09:17.554 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-23T06:09:17.554 INFO:tasks.ceph:role: osd.7 2024-03-23T06:09:17.554 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:09:17.554 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-23T06:09:17.620 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-23T06:09:17.620 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-23T06:09:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-23T06:09:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-23T06:09:17.621 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-23T06:09:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-03-23T06:09:17.621 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-23T06:09:17.621 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-23T06:09:17.621 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-23T06:09:17.621 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-23T06:09:17.653 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-03-23T06:09:17.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-03-23T06:09:17.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-23T06:09:17.725 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-23T06:09:17.796 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:17.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:17.886+0000 7fc3718d24c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-23T06:09:17.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:17.886+0000 7fc3718d24c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-23T06:09:17.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:17.886+0000 7fc3718d24c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T06:09:17.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:17.886+0000 7fc3718d24c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T06:09:17.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:17.886+0000 7fc3718d24c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-23T06:09:17.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:17.886+0000 7fc3718d24c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-23T06:09:20.732 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-23T06:09:20.760 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:20.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:20.846+0000 7f3c374124c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-23T06:09:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:20.846+0000 7f3c374124c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-23T06:09:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:20.846+0000 7f3c374124c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T06:09:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:20.846+0000 7f3c374124c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T06:09:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:20.846+0000 7f3c374124c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-23T06:09:20.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:20.847+0000 7f3c374124c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-23T06:09:23.688 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-23T06:09:23.718 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:23.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:23.805+0000 7fad66f394c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-23T06:09:23.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:23.805+0000 7fad66f394c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-23T06:09:23.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:23.805+0000 7fad66f394c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T06:09:23.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:23.805+0000 7fad66f394c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T06:09:23.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:23.805+0000 7fad66f394c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-23T06:09:23.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:23.806+0000 7fad66f394c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-23T06:09:24.742 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:09:24.750 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:09:26.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-23T06:09:26.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:26.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:26.770+0000 7f9c778144c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-23T06:09:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:26.770+0000 7f9c778144c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-23T06:09:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:26.771+0000 7f9c778144c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T06:09:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:26.771+0000 7f9c778144c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T06:09:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:26.771+0000 7f9c778144c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-23T06:09:26.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:26.771+0000 7f9c778144c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-23T06:09:29.619 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-23T06:09:29.650 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-23T06:09:29.650 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:29.650 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-23T06:09:29.753 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:29.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-23T06:09:29.841 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:29.841 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-23T06:09:29.934 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:29.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-03-23T06:09:30.031 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:30.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-23T06:09:30.125 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:30.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-23T06:09:30.219 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:30.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-23T06:09:30.313 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:30.313 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-23T06:09:30.453 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:30.453 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-23T06:09:30.484 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:30.484 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-23T06:09:30.555 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:30.555 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-23T06:09:30.623 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:30.623 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-03-23T06:09:30.692 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:30.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-23T06:09:30.759 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:30.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-23T06:09:30.825 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:30.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-23T06:09:30.892 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:30.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-23T06:09:30.959 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:30.959 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-23T06:09:31.014 INFO:tasks.ceph:Adding keys to all mons... 2024-03-23T06:09:31.014 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-23T06:09:31.019 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD6cf5lGBG7EBAAdR4OGlNnacXPBH0MEo4GPw== 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD6cf5lTYI1HxAAW93W+89WpemxdEin+8+K5Q== 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD6cf5lXncBMBAAHVfLwnDGb94EmoeMEdzi1A== 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.e] 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD7cf5lgxFyBRAAiB0ZKozC7XpoKUfU9r7qog== 2024-03-23T06:09:31.044 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD/cf5lXUF+IBAAqJVQysgV2ImRNsldo30GPw== 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQACcv5lB1KOOhAABw3p4hbZdBIwcuqZ50cBSw== 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAGcv5lEAW/FxAA/U0V3QAhm/r+oQXXKB1OaA== 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAJcv5lMsaVIhAA93q4jZ1WQz0q1Lsh76vs9g== 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD6cf5l1C0IFRAAEIrBWiSc+OZMVB3kwuzqDg== 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD7cf5ldoKRDxAAyDkcEBevnNcGWoPKlKNdBw== 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD7cf5lzHEkFxAAjy6SVkZ8XKAcEhSJsz925A== 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.f] 2024-03-23T06:09:31.045 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD7cf5ln3Z5HhAAx7+lAvPpVg+OTeAL4NzoOw== 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQANcv5lSXDkNBAAS+CV3sLVIJLqiYvCivTtpQ== 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAQcv5lg9GFMhAAwCalqL9CcAAmtzlcIQtN2A== 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQATcv5lBK4UMBAAsAGYyjzrJkoOq07r2IdYiQ== 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAWcv5l20v/LRAAqOp5O6HgfvYBg+l6whnbxw== 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-03-23T06:09:31.046 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQD7cf5lEb0kJxAAETdI2SbEOzko0qvA0ucp1Q== 2024-03-23T06:09:31.098 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-03-23T06:09:31.098 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD6cf5lGBG7EBAAdR4OGlNnacXPBH0MEo4GPw== 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD6cf5lTYI1HxAAW93W+89WpemxdEin+8+K5Q== 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD6cf5lXncBMBAAHVfLwnDGb94EmoeMEdzi1A== 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.e] 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD7cf5lgxFyBRAAiB0ZKozC7XpoKUfU9r7qog== 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD/cf5lXUF+IBAAqJVQysgV2ImRNsldo30GPw== 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQACcv5lB1KOOhAABw3p4hbZdBIwcuqZ50cBSw== 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAGcv5lEAW/FxAA/U0V3QAhm/r+oQXXKB1OaA== 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAJcv5lMsaVIhAA93q4jZ1WQz0q1Lsh76vs9g== 2024-03-23T06:09:31.099 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD6cf5l1C0IFRAAEIrBWiSc+OZMVB3kwuzqDg== 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD7cf5ldoKRDxAAyDkcEBevnNcGWoPKlKNdBw== 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD7cf5lzHEkFxAAjy6SVkZ8XKAcEhSJsz925A== 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.f] 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD7cf5ln3Z5HhAAx7+lAvPpVg+OTeAL4NzoOw== 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQANcv5lSXDkNBAAS+CV3sLVIJLqiYvCivTtpQ== 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAQcv5lg9GFMhAAwCalqL9CcAAmtzlcIQtN2A== 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQATcv5lBK4UMBAAsAGYyjzrJkoOq07r2IdYiQ== 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAWcv5l20v/LRAAqOp5O6HgfvYBg+l6whnbxw== 2024-03-23T06:09:31.100 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-03-23T06:09:31.101 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD7cf5lEb0kJxAAETdI2SbEOzko0qvA0ucp1Q== 2024-03-23T06:09:31.102 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T06:09:31.150 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T06:09:31.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:31.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:31.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:31.428 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:31.564 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:31.569 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:31.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:31.709 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:31.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:31.849 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:31.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:31.989 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:32.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:32.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:32.259 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T06:09:32.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-23T06:09:32.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:32.403 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:32.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:32.546 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:32.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:32.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-23T06:09:32.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:32.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:32.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:32.959 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:33.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:33.098 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:33.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:33.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-23T06:09:33.361 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-23T06:09:33.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-23T06:09:33.502 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-23T06:09:33.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-23T06:09:33.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T06:09:33.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-23T06:09:33.823 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-23T06:09:33.850 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T06:09:33.946 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-23T06:09:33.972 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-23T06:09:34.038 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-23T06:09:34.134 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-23T06:09:34.161 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:34.169 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-23T06:09:34.216 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-23T06:09:34.217 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T06:09:34.217 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T06:09:34.222 INFO:tasks.ceph.mon.a:Started 2024-03-23T06:09:34.222 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T06:09:34.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T06:09:34.258 INFO:tasks.ceph.mon.b:Started 2024-03-23T06:09:34.258 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T06:09:34.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T06:09:34.260 INFO:tasks.ceph.mon.c:Started 2024-03-23T06:09:34.260 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-23T06:09:34.261 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-23T06:09:34.261 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-23T06:09:34.265 INFO:tasks.ceph.mgr.y:Started 2024-03-23T06:09:34.265 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-23T06:09:34.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-23T06:09:34.267 INFO:tasks.ceph.mgr.x:Started 2024-03-23T06:09:34.267 INFO:tasks.ceph:Setting crush tunables to default 2024-03-23T06:09:34.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-03-23T06:09:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.450+0000 7f66e9200640 1 Processor -- start 2024-03-23T06:09:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.450+0000 7f66e9200640 1 -- start start 2024-03-23T06:09:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.451+0000 7f66e9200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66e4153760 0x7f66e4159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.451+0000 7f66e9200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f66e40c9740 0x7f66e40cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.451+0000 7f66e9200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40cbd10 0x7f66e40ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.451+0000 7f66e9200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e406a2d0 con 0x7f66e40c9740 2024-03-23T06:09:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.451+0000 7f66e9200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e406a5b0 con 0x7f66e4153760 2024-03-23T06:09:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.451+0000 7f66e9200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e406a890 con 0x7f66e40cbd10 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e1e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66e4153760 0x7f66e4159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e2800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40cbd10 0x7f66e40ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e2800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40cbd10 0x7f66e40ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:50348/0 (socket says 172.21.15.73:50348) 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e1e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66e4153760 0x7f66e4159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:38604/0 (socket says 172.21.15.73:38604) 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e2800640 1 -- 172.21.15.73:0/1625498666 learned_addr learned my addr 172.21.15.73:0/1625498666 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e2800640 1 -- 172.21.15.73:0/1625498666 >> v2:172.21.15.110:3300/0 conn(0x7f66e4153760 msgr2=0x7f66e4159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e2800640 1 --2- 172.21.15.73:0/1625498666 >> v2:172.21.15.110:3300/0 conn(0x7f66e4153760 0x7f66e4159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e2800640 1 -- 172.21.15.73:0/1625498666 >> v2:172.21.15.73:3300/0 conn(0x7f66e40c9740 msgr2=0x7f66e40cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e1400640 1 --2- 172.21.15.73:0/1625498666 >> v2:172.21.15.73:3300/0 conn(0x7f66e40c9740 0x7f66e40cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e2800640 1 --2- 172.21.15.73:0/1625498666 >> v2:172.21.15.73:3300/0 conn(0x7f66e40c9740 0x7f66e40cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e2800640 1 -- 172.21.15.73:0/1625498666 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e406ab70 con 0x7f66e40cbd10 2024-03-23T06:09:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.452+0000 7f66e1400640 1 --2- 172.21.15.73:0/1625498666 >> v2:172.21.15.73:3300/0 conn(0x7f66e40c9740 0x7f66e40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:09:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.453+0000 7f66e2800640 1 --2- 172.21.15.73:0/1625498666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40cbd10 0x7f66e40ca940 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f66e40cfe30 tx=0x7f66dc02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42deb8ef4d40087 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.454+0000 7f66e0a00640 1 -- 172.21.15.73:0/1625498666 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc02ca70 con 0x7f66e40cbd10 2024-03-23T06:09:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.454+0000 7f66e0a00640 1 -- 172.21.15.73:0/1625498666 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc02cbd0 con 0x7f66e40cbd10 2024-03-23T06:09:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.454+0000 7f66e0a00640 1 -- 172.21.15.73:0/1625498666 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0343f0 con 0x7f66e40cbd10 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 -- 172.21.15.73:0/1625498666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40cbd10 msgr2=0x7f66e40ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 --2- 172.21.15.73:0/1625498666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40cbd10 0x7f66e40ca940 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f66e40cfe30 tx=0x7f66dc02bed0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 -- 172.21.15.73:0/1625498666 shutdown_connections 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 --2- 172.21.15.73:0/1625498666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40cbd10 0x7f66e40ca940 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 --2- 172.21.15.73:0/1625498666 >> v2:172.21.15.73:3300/0 conn(0x7f66e40c9740 0x7f66e40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 --2- 172.21.15.73:0/1625498666 >> v2:172.21.15.110:3300/0 conn(0x7f66e4153760 0x7f66e4159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 -- 172.21.15.73:0/1625498666 >> 172.21.15.73:0/1625498666 conn(0x7f66e406c310 msgr2=0x7f66e40713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 -- 172.21.15.73:0/1625498666 shutdown_connections 2024-03-23T06:09:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.455+0000 7f66e9200640 1 -- 172.21.15.73:0/1625498666 wait complete. 2024-03-23T06:09:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.457+0000 7f66e9200640 1 Processor -- start 2024-03-23T06:09:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.457+0000 7f66e9200640 1 -- start start 2024-03-23T06:09:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e9200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40c9740 0x7f66e40b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e9200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e40cbd10 0x7f66e4147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66e4153760 0x7f66e40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e9200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40b2d00 con 0x7f66e4153760 2024-03-23T06:09:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e9200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4158f70 con 0x7f66e40cbd10 2024-03-23T06:09:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e9200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40ccba0 con 0x7f66e40c9740 2024-03-23T06:09:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40c9740 0x7f66e40b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40c9740 0x7f66e40b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:50356/0 (socket says 172.21.15.73:50356) 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e1e00640 1 -- 172.21.15.73:0/2064353378 learned_addr learned my addr 172.21.15.73:0/2064353378 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e1400640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e40cbd10 0x7f66e4147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e2800640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66e4153760 0x7f66e40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e1e00640 1 -- 172.21.15.73:0/2064353378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e40cbd10 msgr2=0x7f66e4147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.458+0000 7f66e1e00640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e40cbd10 0x7f66e4147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66e1e00640 1 -- 172.21.15.73:0/2064353378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66e4153760 msgr2=0x7f66e40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66e1e00640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66e4153760 0x7f66e40cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66e1e00640 1 -- 172.21.15.73:0/2064353378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc009b30 con 0x7f66e40c9740 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66e2800640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66e4153760 0x7f66e40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66e1e00640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40c9740 0x7f66e40b2550 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f66d400e9b0 tx=0x7f66d400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66da000640 1 -- 172.21.15.73:0/2064353378 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4009670 con 0x7f66e40c9740 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66da000640 1 -- 172.21.15.73:0/2064353378 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d400c9a0 con 0x7f66e40c9740 2024-03-23T06:09:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66da000640 1 -- 172.21.15.73:0/2064353378 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d400cd50 con 0x7f66e40c9740 2024-03-23T06:09:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e40cce80 con 0x7f66e40c9740 2024-03-23T06:09:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e40b2a90 con 0x7f66e40c9740 2024-03-23T06:09:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.459+0000 7f66da000640 1 -- 172.21.15.73:0/2064353378 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f66d4013770 con 0x7f66e40c9740 2024-03-23T06:09:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.460+0000 7f66da000640 1 -- 172.21.15.73:0/2064353378 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f66d401cbf0 con 0x7f66e40c9740 2024-03-23T06:09:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.460+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e414d7e0 con 0x7f66e40c9740 2024-03-23T06:09:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.463+0000 7f66da000640 1 -- 172.21.15.73:0/2064353378 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f66d4021060 con 0x7f66e40c9740 2024-03-23T06:09:34.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.590+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f66e404e110 con 0x7f66e40c9740 2024-03-23T06:09:34.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.594+0000 7f66da000640 1 -- 172.21.15.73:0/2064353378 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f66d402a090 con 0x7f66e40c9740 2024-03-23T06:09:34.594 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-03-23T06:09:34.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40c9740 msgr2=0x7f66e40b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:34.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40c9740 0x7f66e40b2550 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f66d400e9b0 tx=0x7f66d400ee70 comp rx=0 tx=0).stop 2024-03-23T06:09:34.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 shutdown_connections 2024-03-23T06:09:34.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66e4153760 0x7f66e40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66e40cbd10 0x7f66e4147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 --2- 172.21.15.73:0/2064353378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66e40c9740 0x7f66e40b2550 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:34.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 >> 172.21.15.73:0/2064353378 conn(0x7f66e406c310 msgr2=0x7f66e41e27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:34.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 shutdown_connections 2024-03-23T06:09:34.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:34.596+0000 7f66e9200640 1 -- 172.21.15.73:0/2064353378 wait complete. 2024-03-23T06:09:34.612 INFO:tasks.ceph:check_enable_crimson: False 2024-03-23T06:09:34.612 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-23T06:09:34.612 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:34.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-23T06:09:34.695 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:34.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-23T06:09:34.823 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:34.823 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-23T06:09:34.902 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:34.903+0000 7f7cc4020040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-23T06:09:34.947 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:09:34.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-23T06:09:34.955 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:34.956+0000 7f7cc4020040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-23T06:09:35.063 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:35.063+0000 7f3a00c2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-23T06:09:35.079 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:35.079 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-23T06:09:35.106 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:35.106 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-23T06:09:35.128 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:35.128+0000 7f3a00c2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-23T06:09:35.173 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:35.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-23T06:09:35.241 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-03-23T06:09:35.241 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-23T06:09:35.308 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 45968980-05a3-4f43-b2b6-d1012f1f958e 0 2024-03-23T06:09:35.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.449+0000 7f607c51b640 1 Processor -- start 2024-03-23T06:09:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.449+0000 7f607c51b640 1 -- start start 2024-03-23T06:09:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.449+0000 7f607c51b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60740cb050 0x7f60740c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607c51b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740c9c80 con 0x7f6074159420 2024-03-23T06:09:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607c51b640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607406a2d0 con 0x7f6074153760 2024-03-23T06:09:35.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607c51b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6074159860 con 0x7f60740cb050 2024-03-23T06:09:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607aab8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60740cb050 0x7f60740c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607a2b7640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6074153760 0x7f60740cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40586/0 (socket says 172.21.15.110:40586) 2024-03-23T06:09:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607a2b7640 1 -- 172.21.15.110:0/2410137385 learned_addr learned my addr 172.21.15.110:0/2410137385 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-03-23T06:09:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607aab8640 1 -- 172.21.15.110:0/2410137385 >> v1:172.21.15.110:6789/0 conn(0x7f6074153760 legacy=0x7f60740cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607aab8640 1 -- 172.21.15.110:0/2410137385 >> v1:172.21.15.73:6789/0 conn(0x7f6074159420 legacy=0x7f60740ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.450+0000 7f607aab8640 1 -- 172.21.15.110:0/2410137385 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607406a5b0 con 0x7f60740cb050 2024-03-23T06:09:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.451+0000 7f607aab8640 1 --2- 172.21.15.110:0/2410137385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60740cb050 0x7f60740c9740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f606c009d90 tx=0x7f606c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb417443ff6e2b1b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.451+0000 7f60792b5640 1 -- 172.21.15.110:0/2410137385 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c02cd00 con 0x7f60740cb050 2024-03-23T06:09:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.451+0000 7f60792b5640 1 -- 172.21.15.110:0/2410137385 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c02ce60 con 0x7f60740cb050 2024-03-23T06:09:35.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.451+0000 7f60792b5640 1 -- 172.21.15.110:0/2410137385 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c034660 con 0x7f60740cb050 2024-03-23T06:09:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.452+0000 7f607c51b640 1 -- 172.21.15.110:0/2410137385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60740cb050 msgr2=0x7f60740c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.452+0000 7f607c51b640 1 --2- 172.21.15.110:0/2410137385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60740cb050 0x7f60740c9740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f606c009d90 tx=0x7f606c02bf50 comp rx=0 tx=0).stop 2024-03-23T06:09:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.452+0000 7f607c51b640 1 -- 172.21.15.110:0/2410137385 shutdown_connections 2024-03-23T06:09:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.452+0000 7f607c51b640 1 --2- 172.21.15.110:0/2410137385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60740cb050 0x7f60740c9740 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.452+0000 7f607c51b640 1 -- 172.21.15.110:0/2410137385 >> 172.21.15.110:0/2410137385 conn(0x7f607406c310 msgr2=0x7f60740713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.452+0000 7f607c51b640 1 -- 172.21.15.110:0/2410137385 shutdown_connections 2024-03-23T06:09:35.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.452+0000 7f607c51b640 1 -- 172.21.15.110:0/2410137385 wait complete. 2024-03-23T06:09:35.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.453+0000 7f607c51b640 1 Processor -- start 2024-03-23T06:09:35.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.453+0000 7f607c51b640 1 -- start start 2024-03-23T06:09:35.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607c51b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60740cb050 0x7f60741f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607c51b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6074153760 0x7f6074143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607c51b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6074159420 0x7f60741456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607c51b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607415c680 con 0x7f6074159420 2024-03-23T06:09:35.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607c51b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074144c70 con 0x7f6074153760 2024-03-23T06:09:35.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607c51b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60741f24e0 con 0x7f60740cb050 2024-03-23T06:09:35.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607a2b7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60740cb050 0x7f60741f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f6079ab6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6074153760 0x7f6074143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607a2b7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60740cb050 0x7f60741f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:51436/0 (socket says 172.21.15.110:51436) 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f6079ab6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6074153760 0x7f6074143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:55992/0 (socket says 172.21.15.110:55992) 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f607a2b7640 1 -- 172.21.15.110:0/1752366411 learned_addr learned my addr 172.21.15.110:0/1752366411 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f6079ab6640 1 -- 172.21.15.110:0/1752366411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60740cb050 msgr2=0x7f60741f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f6079ab6640 1 --2- 172.21.15.110:0/1752366411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60740cb050 0x7f60741f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f6079ab6640 1 -- 172.21.15.110:0/1752366411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6074159420 msgr2=0x7f60741456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f6079ab6640 1 --2- 172.21.15.110:0/1752366411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6074159420 0x7f60741456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f6079ab6640 1 -- 172.21.15.110:0/1752366411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c009a70 con 0x7f6074153760 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.454+0000 7f6079ab6640 1 --2- 172.21.15.110:0/1752366411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6074153760 0x7f6074143ef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f606400c390 tx=0x7f606400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.455+0000 7f606affd640 1 -- 172.21.15.110:0/1752366411 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60640052d0 con 0x7f6074153760 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.455+0000 7f606affd640 1 -- 172.21.15.110:0/1752366411 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064005430 con 0x7f6074153760 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.455+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60741f2770 con 0x7f6074153760 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.455+0000 7f606affd640 1 -- 172.21.15.110:0/1752366411 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064003830 con 0x7f6074153760 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.455+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60741f2d30 con 0x7f6074153760 2024-03-23T06:09:35.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.455+0000 7f606affd640 1 -- 172.21.15.110:0/1752366411 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6064003c90 con 0x7f6074153760 2024-03-23T06:09:35.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.455+0000 7f606affd640 1 -- 172.21.15.110:0/1752366411 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f606401c780 con 0x7f6074153760 2024-03-23T06:09:35.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.456+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607404e110 con 0x7f6074153760 2024-03-23T06:09:35.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.458+0000 7f606affd640 1 -- 172.21.15.110:0/1752366411 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f6064017070 con 0x7f6074153760 2024-03-23T06:09:35.473 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:35.474+0000 7f7cc4020040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-23T06:09:35.527 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:35.527+0000 7f7cc4020040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-23T06:09:35.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.529+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45968980-05a3-4f43-b2b6-d1012f1f958e", "id": 0} v 0) v1 -- 0x7f60740c45c0 con 0x7f6074153760 2024-03-23T06:09:35.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.535+0000 7f606affd640 1 -- 172.21.15.110:0/1752366411 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45968980-05a3-4f43-b2b6-d1012f1f958e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f60740c9c80 con 0x7f6074153760 2024-03-23T06:09:35.535 INFO:teuthology.orchestra.run.smithi110.stdout:0 2024-03-23T06:09:35.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6074153760 msgr2=0x7f6074143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 --2- 172.21.15.110:0/1752366411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6074153760 0x7f6074143ef0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f606400c390 tx=0x7f606400c850 comp rx=0 tx=0).stop 2024-03-23T06:09:35.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 shutdown_connections 2024-03-23T06:09:35.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 --2- 172.21.15.110:0/1752366411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6074159420 0x7f60741456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 --2- 172.21.15.110:0/1752366411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6074153760 0x7f6074143ef0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 --2- 172.21.15.110:0/1752366411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60740cb050 0x7f60741f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 >> 172.21.15.110:0/1752366411 conn(0x7f607406c310 msgr2=0x7f60740c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:35.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 shutdown_connections 2024-03-23T06:09:35.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.536+0000 7f607c51b640 1 -- 172.21.15.110:0/1752366411 wait complete. 2024-03-23T06:09:35.547 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new cf996b30-6d88-4e2d-8942-34761d57502d 1 2024-03-23T06:09:35.576 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:35.576+0000 7f7cc4020040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-23T06:09:35.632 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:35.632+0000 7f7cc4020040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-23T06:09:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.646+0000 7fc9c77fd640 1 Processor -- start 2024-03-23T06:09:35.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.646+0000 7fc9c77fd640 1 -- start start 2024-03-23T06:09:35.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c77fd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc9c0150050 0x7fc9c00700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c77fd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0156bb0 0x7fc9c00c7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c77fd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00c5f60 con 0x7fc9c0065a50 2024-03-23T06:09:35.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c77fd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c01570d0 con 0x7fc9c0150050 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c77fd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00c34a0 con 0x7fc9c0156bb0 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c5599640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc9c0150050 0x7fc9c00700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c4d98640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0156bb0 0x7fc9c00c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c5d9a640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc9c0065a50 0x7fc9c006adc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40588/0 (socket says 172.21.15.110:40588) 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c5d9a640 1 -- 172.21.15.110:0/1601393693 learned_addr learned my addr 172.21.15.110:0/1601393693 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c4d98640 1 -- 172.21.15.110:0/1601393693 >> v2:172.21.15.110:3300/0 conn(0x7fc9c0150050 msgr2=0x7fc9c00700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c4d98640 1 --2- 172.21.15.110:0/1601393693 >> v2:172.21.15.110:3300/0 conn(0x7fc9c0150050 0x7fc9c00700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c4d98640 1 -- 172.21.15.110:0/1601393693 >> v1:172.21.15.110:6789/0 conn(0x7fc9c0065a50 legacy=0x7fc9c006adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c4d98640 1 -- 172.21.15.110:0/1601393693 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00c6240 con 0x7fc9c0156bb0 2024-03-23T06:09:35.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.647+0000 7fc9c5599640 1 --2- 172.21.15.110:0/1601393693 >> v2:172.21.15.110:3300/0 conn(0x7fc9c0150050 0x7fc9c00700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.648+0000 7fc9c4d98640 1 --2- 172.21.15.110:0/1601393693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0156bb0 0x7fc9c00c7000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0097a0 tx=0x7fc9bc02dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=216712b5665eace1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.648+0000 7fc9b7fff640 1 -- 172.21.15.110:0/1601393693 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc02f8a0 con 0x7fc9c0156bb0 2024-03-23T06:09:35.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.648+0000 7fc9b7fff640 1 -- 172.21.15.110:0/1601393693 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc02fa00 con 0x7fc9c0156bb0 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.648+0000 7fc9b7fff640 1 -- 172.21.15.110:0/1601393693 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc02fd90 con 0x7fc9c0156bb0 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.649+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1601393693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0156bb0 msgr2=0x7fc9c00c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.649+0000 7fc9c77fd640 1 --2- 172.21.15.110:0/1601393693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0156bb0 0x7fc9c00c7000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0097a0 tx=0x7fc9bc02dae0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.649+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1601393693 shutdown_connections 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.649+0000 7fc9c77fd640 1 --2- 172.21.15.110:0/1601393693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0156bb0 0x7fc9c00c7000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.649+0000 7fc9c77fd640 1 --2- 172.21.15.110:0/1601393693 >> v2:172.21.15.110:3300/0 conn(0x7fc9c0150050 0x7fc9c00700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.649+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1601393693 >> 172.21.15.110:0/1601393693 conn(0x7fc9c00c7ec0 msgr2=0x7fc9c00c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.649+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1601393693 shutdown_connections 2024-03-23T06:09:35.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.649+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1601393693 wait complete. 2024-03-23T06:09:35.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.650+0000 7fc9c77fd640 1 Processor -- start 2024-03-23T06:09:35.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.650+0000 7fc9c77fd640 1 -- start start 2024-03-23T06:09:35.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c77fd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c0065a50 0x7fc9c01e0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c77fd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0150050 0x7fc9c014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c77fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c0156bb0 0x7fc9c014a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c77fd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c006b440 con 0x7fc9c0156bb0 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c77fd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c014e260 con 0x7fc9c0065a50 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c77fd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c014e540 con 0x7fc9c0150050 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c0065a50 0x7fc9c01e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c0065a50 0x7fc9c01e0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56004/0 (socket says 172.21.15.110:56004) 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c4d98640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0150050 0x7fc9c014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 -- 172.21.15.110:0/1639275116 learned_addr learned my addr 172.21.15.110:0/1639275116 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 -- 172.21.15.110:0/1639275116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0150050 msgr2=0x7fc9c014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 --2- 172.21.15.110:0/1639275116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0150050 0x7fc9c014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 -- 172.21.15.110:0/1639275116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c0156bb0 msgr2=0x7fc9c014a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 --2- 172.21.15.110:0/1639275116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c0156bb0 0x7fc9c014a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 -- 172.21.15.110:0/1639275116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009400 con 0x7fc9c0065a50 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c4d98640 1 --2- 172.21.15.110:0/1639275116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0150050 0x7fc9c014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:35.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c5599640 1 --2- 172.21.15.110:0/1639275116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c0065a50 0x7fc9c01e0620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000ebe0 tx=0x7fc9b000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9b5ffb640 1 -- 172.21.15.110:0/1639275116 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0009760 con 0x7fc9c0065a50 2024-03-23T06:09:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9b5ffb640 1 -- 172.21.15.110:0/1639275116 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b000cc30 con 0x7fc9c0065a50 2024-03-23T06:09:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.651+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc009400 con 0x7fc9c0065a50 2024-03-23T06:09:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.652+0000 7fc9b5ffb640 1 -- 172.21.15.110:0/1639275116 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000eee0 con 0x7fc9c0065a50 2024-03-23T06:09:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.652+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c014eb00 con 0x7fc9c0065a50 2024-03-23T06:09:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.652+0000 7fc9b5ffb640 1 -- 172.21.15.110:0/1639275116 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc9b0005c90 con 0x7fc9c0065a50 2024-03-23T06:09:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.652+0000 7fc9b5ffb640 1 -- 172.21.15.110:0/1639275116 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc9b0013930 con 0x7fc9c0065a50 2024-03-23T06:09:35.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.653+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c00c3070 con 0x7fc9c0065a50 2024-03-23T06:09:35.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.655+0000 7fc9b5ffb640 1 -- 172.21.15.110:0/1639275116 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fc9b0021060 con 0x7fc9c0065a50 2024-03-23T06:09:35.677 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:35.677+0000 7f7cc4020040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-23T06:09:35.707 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:35.708+0000 7f3a00c2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-23T06:09:35.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.726+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf996b30-6d88-4e2d-8942-34761d57502d", "id": 1} v 0) v1 -- 0x7fc9c01eeee0 con 0x7fc9c0065a50 2024-03-23T06:09:35.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.734+0000 7fc9b5ffb640 1 -- 172.21.15.110:0/1639275116 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf996b30-6d88-4e2d-8942-34761d57502d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc9b0017070 con 0x7fc9c0065a50 2024-03-23T06:09:35.734 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-03-23T06:09:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c0065a50 msgr2=0x7fc9c01e0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 --2- 172.21.15.110:0/1639275116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c0065a50 0x7fc9c01e0620 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000ebe0 tx=0x7fc9b000c520 comp rx=0 tx=0).stop 2024-03-23T06:09:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 shutdown_connections 2024-03-23T06:09:35.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 --2- 172.21.15.110:0/1639275116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c0156bb0 0x7fc9c014a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 --2- 172.21.15.110:0/1639275116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c0150050 0x7fc9c014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 --2- 172.21.15.110:0/1639275116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c0065a50 0x7fc9c01e0620 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 >> 172.21.15.110:0/1639275116 conn(0x7fc9c00c7ec0 msgr2=0x7fc9c0069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 shutdown_connections 2024-03-23T06:09:35.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.735+0000 7fc9c77fd640 1 -- 172.21.15.110:0/1639275116 wait complete. 2024-03-23T06:09:35.749 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 46605b4f-b7af-4e34-912f-9c21f0905078 2 2024-03-23T06:09:35.770 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:35.770+0000 7f3a00c2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-23T06:09:35.801 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:35.801+0000 7f7cc4020040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-23T06:09:35.821 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:35.821+0000 7f3a00c2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-23T06:09:35.873 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:35.873+0000 7f7cc4020040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-23T06:09:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9ad11e7640 1 Processor -- start 2024-03-23T06:09:35.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9ad11e7640 1 -- start start 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9ad11e7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9acc151470 0x7f9acc06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9ad11e7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9acc0c5f10 0x7f9acc06e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9ad11e7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc06e6a0 0x7f9acc0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9ad11e7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc06bfd0 con 0x7f9acc151470 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9ad11e7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc071210 con 0x7f9acc0c5f10 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9ad11e7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc15b670 con 0x7f9acc06e6a0 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9aca59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9acc0c5f10 0x7f9acc06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9aca59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9acc0c5f10 0x7f9acc06e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56020/0 (socket says 172.21.15.110:56020) 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9aca59c640 1 -- 172.21.15.110:0/3545037488 learned_addr learned my addr 172.21.15.110:0/3545037488 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.888+0000 7f9acb59e640 1 --2- 172.21.15.110:0/3545037488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc06e6a0 0x7f9acc0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.889+0000 7f9aca59c640 1 -- 172.21.15.110:0/3545037488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc06e6a0 msgr2=0x7f9acc0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:35.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.889+0000 7f9aca59c640 1 --2- 172.21.15.110:0/3545037488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc06e6a0 0x7f9acc0716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.889+0000 7f9aca59c640 1 -- 172.21.15.110:0/3545037488 >> v2:172.21.15.73:3300/0 conn(0x7f9acc151470 msgr2=0x7f9acc06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.889+0000 7f9aca59c640 1 --2- 172.21.15.110:0/3545037488 >> v2:172.21.15.73:3300/0 conn(0x7f9acc151470 0x7f9acc06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.889+0000 7f9aca59c640 1 -- 172.21.15.110:0/3545037488 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc15b390 con 0x7f9acc0c5f10 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.889+0000 7f9aca59c640 1 --2- 172.21.15.110:0/3545037488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc0c5f10 0x7f9acc06e160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9acc06dc20 tx=0x7f9ac002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad1ee050d7b9092f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ac9d9b640 1 -- 172.21.15.110:0/3545037488 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0030860 con 0x7f9acc0c5f10 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ac9d9b640 1 -- 172.21.15.110:0/3545037488 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac00309c0 con 0x7f9acc0c5f10 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ac9d9b640 1 -- 172.21.15.110:0/3545037488 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0030d50 con 0x7f9acc0c5f10 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 -- 172.21.15.110:0/3545037488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc0c5f10 msgr2=0x7f9acc06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 --2- 172.21.15.110:0/3545037488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc0c5f10 0x7f9acc06e160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9acc06dc20 tx=0x7f9ac002b9a0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 -- 172.21.15.110:0/3545037488 shutdown_connections 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 --2- 172.21.15.110:0/3545037488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc06e6a0 0x7f9acc0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 --2- 172.21.15.110:0/3545037488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc0c5f10 0x7f9acc06e160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 --2- 172.21.15.110:0/3545037488 >> v2:172.21.15.73:3300/0 conn(0x7f9acc151470 0x7f9acc06ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 -- 172.21.15.110:0/3545037488 >> 172.21.15.110:0/3545037488 conn(0x7f9acc0c88c0 msgr2=0x7f9acc0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:35.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 -- 172.21.15.110:0/3545037488 shutdown_connections 2024-03-23T06:09:35.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.890+0000 7f9ad11e7640 1 -- 172.21.15.110:0/3545037488 wait complete. 2024-03-23T06:09:35.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9ad11e7640 1 Processor -- start 2024-03-23T06:09:35.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9ad11e7640 1 -- start start 2024-03-23T06:09:35.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9ad11e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9acc06e6a0 0x7f9acc144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9ad11e7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc0c5f10 0x7f9acc1ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9ad11e7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc151470 0x7f9acc140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:35.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9ad11e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc14f8c0 con 0x7f9acc06e6a0 2024-03-23T06:09:35.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9ad11e7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc145fa0 con 0x7f9acc151470 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9ad11e7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1ede80 con 0x7f9acc0c5f10 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9aca59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc0c5f10 0x7f9acc1ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.892+0000 7f9acb59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc151470 0x7f9acc140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9aca59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc0c5f10 0x7f9acc1ed940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:51486/0 (socket says 172.21.15.110:51486) 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9aca59c640 1 -- 172.21.15.110:0/1723356907 learned_addr learned my addr 172.21.15.110:0/1723356907 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9acad9d640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9acc06e6a0 0x7f9acc144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9aca59c640 1 -- 172.21.15.110:0/1723356907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc151470 msgr2=0x7f9acc140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9aca59c640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc151470 0x7f9acc140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9aca59c640 1 -- 172.21.15.110:0/1723356907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9acc06e6a0 msgr2=0x7f9acc144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9aca59c640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9acc06e6a0 0x7f9acc144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9aca59c640 1 -- 172.21.15.110:0/1723356907 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac00094d0 con 0x7f9acc0c5f10 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9acb59e640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc151470 0x7f9acc140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9aca59c640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc0c5f10 0x7f9acc1ed940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0000c00 tx=0x7f9ac0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:35.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9ab37fe640 1 -- 172.21.15.110:0/1723356907 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0039c90 con 0x7f9acc0c5f10 2024-03-23T06:09:35.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9ab37fe640 1 -- 172.21.15.110:0/1723356907 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac0039df0 con 0x7f9acc0c5f10 2024-03-23T06:09:35.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc149ab0 con 0x7f9acc0c5f10 2024-03-23T06:09:35.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9ab37fe640 1 -- 172.21.15.110:0/1723356907 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0043620 con 0x7f9acc0c5f10 2024-03-23T06:09:35.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc141140 con 0x7f9acc0c5f10 2024-03-23T06:09:35.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9ab37fe640 1 -- 172.21.15.110:0/1723356907 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9ac0043a80 con 0x7f9acc0c5f10 2024-03-23T06:09:35.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.893+0000 7f9ab37fe640 1 -- 172.21.15.110:0/1723356907 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9ac003e070 con 0x7f9acc0c5f10 2024-03-23T06:09:35.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.894+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc0caf90 con 0x7f9acc0c5f10 2024-03-23T06:09:35.896 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:35.893+0000 7f3a00c2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-23T06:09:35.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:35.897+0000 7f9ab37fe640 1 -- 172.21.15.110:0/1723356907 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f9ac0034070 con 0x7f9acc0c5f10 2024-03-23T06:09:35.938 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:35.938+0000 7f7cc4020040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-23T06:09:35.942 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:35.942+0000 7f3a00c2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-23T06:09:36.000 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:36.000+0000 7f7cc4020040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-23T06:09:36.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.002+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "46605b4f-b7af-4e34-912f-9c21f0905078", "id": 2} v 0) v1 -- 0x7f9acc0cbba0 con 0x7f9acc0c5f10 2024-03-23T06:09:36.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.010+0000 7f9ab37fe640 1 -- 172.21.15.110:0/1723356907 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46605b4f-b7af-4e34-912f-9c21f0905078", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ac004d460 con 0x7f9acc0c5f10 2024-03-23T06:09:36.010 INFO:teuthology.orchestra.run.smithi110.stdout:2 2024-03-23T06:09:36.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc0c5f10 msgr2=0x7f9acc1ed940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc0c5f10 0x7f9acc1ed940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0000c00 tx=0x7f9ac0004730 comp rx=0 tx=0).stop 2024-03-23T06:09:36.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 shutdown_connections 2024-03-23T06:09:36.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9acc151470 0x7f9acc140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9acc0c5f10 0x7f9acc1ed940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 --2- 172.21.15.110:0/1723356907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9acc06e6a0 0x7f9acc144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 >> 172.21.15.110:0/1723356907 conn(0x7f9acc0c88c0 msgr2=0x7f9acc0ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 shutdown_connections 2024-03-23T06:09:36.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.011+0000 7f9ad11e7640 1 -- 172.21.15.110:0/1723356907 wait complete. 2024-03-23T06:09:36.025 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new fe6e559c-a95b-49d2-b790-d22bf54d1188 3 2024-03-23T06:09:36.053 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:36.054+0000 7f7cc4020040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-23T06:09:36.070 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:36.070+0000 7f3a00c2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-23T06:09:36.149 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:36.149+0000 7f3a00c2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-23T06:09:36.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.153+0000 7f7d124bd640 1 Processor -- start 2024-03-23T06:09:36.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.153+0000 7f7d124bd640 1 -- start start 2024-03-23T06:09:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.153+0000 7f7d124bd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7d0c150500 0x7f7d0c071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.153+0000 7f7d124bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c0c57f0 0x7f7d0c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.153+0000 7f7d124bd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0728d0 con 0x7f7d0c0c7c00 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.153+0000 7f7d124bd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c15a640 con 0x7f7d0c150500 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d124bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1598c0 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d0b7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7d0c0c7c00 0x7f7d0c06f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40596/0 (socket says 172.21.15.110:40596) 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d0b7fe640 1 -- 172.21.15.110:0/3892922648 learned_addr learned my addr 172.21.15.110:0/3892922648 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d10a5a640 1 --2- 172.21.15.110:0/3892922648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c0c57f0 0x7f7d0c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d0affd640 1 -- 172.21.15.110:0/3892922648 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963404346 0 0) 0x7f7d0c0728d0 con 0x7f7d0c0c7c00 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d0affd640 1 -- 172.21.15.110:0/3892922648 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cf4003520 con 0x7f7d0c0c7c00 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d0bfff640 1 --2- 172.21.15.110:0/3892922648 >> v2:172.21.15.73:3300/0 conn(0x7f7d0c150500 0x7f7d0c071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d10a5a640 1 -- 172.21.15.110:0/3892922648 >> v2:172.21.15.73:3300/0 conn(0x7f7d0c150500 msgr2=0x7f7d0c071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d10a5a640 1 --2- 172.21.15.110:0/3892922648 >> v2:172.21.15.73:3300/0 conn(0x7f7d0c150500 0x7f7d0c071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d10a5a640 1 -- 172.21.15.110:0/3892922648 >> v1:172.21.15.110:6789/0 conn(0x7f7d0c0c7c00 legacy=0x7f7d0c06f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.154+0000 7f7d10a5a640 1 -- 172.21.15.110:0/3892922648 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0725f0 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d10a5a640 1 --2- 172.21.15.110:0/3892922648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c0c57f0 0x7f7d0c0c5c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009d90 tx=0x7f7d0402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cb23231bb33e09b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d0affd640 1 -- 172.21.15.110:0/3892922648 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0402cc50 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d0affd640 1 -- 172.21.15.110:0/3892922648 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0402cdb0 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d0affd640 1 -- 172.21.15.110:0/3892922648 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04034660 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d124bd640 1 -- 172.21.15.110:0/3892922648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c0c57f0 msgr2=0x7f7d0c0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d124bd640 1 --2- 172.21.15.110:0/3892922648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c0c57f0 0x7f7d0c0c5c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009d90 tx=0x7f7d0402bea0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d124bd640 1 -- 172.21.15.110:0/3892922648 shutdown_connections 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d124bd640 1 --2- 172.21.15.110:0/3892922648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c0c57f0 0x7f7d0c0c5c80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d124bd640 1 --2- 172.21.15.110:0/3892922648 >> v2:172.21.15.73:3300/0 conn(0x7f7d0c150500 0x7f7d0c071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d124bd640 1 -- 172.21.15.110:0/3892922648 >> 172.21.15.110:0/3892922648 conn(0x7f7d0c069cb0 msgr2=0x7f7d0c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d124bd640 1 -- 172.21.15.110:0/3892922648 shutdown_connections 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.155+0000 7f7d124bd640 1 -- 172.21.15.110:0/3892922648 wait complete. 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.156+0000 7f7d124bd640 1 Processor -- start 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d124bd640 1 -- start start 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d124bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d0c0c57f0 0x7f7d0c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d124bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d0c0c7c00 0x7f7d0c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d124bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c150500 0x7f7d0c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d124bd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1ef3f0 con 0x7f7d0c0c7c00 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d124bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c1f03c0 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d124bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c159580 con 0x7f7d0c150500 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d0bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d0c0c57f0 0x7f7d0c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d0bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d0c0c57f0 0x7f7d0c0affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56040/0 (socket says 172.21.15.110:56040) 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d0bfff640 1 -- 172.21.15.110:0/357188173 learned_addr learned my addr 172.21.15.110:0/357188173 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.157+0000 7f7d10a5a640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c150500 0x7f7d0c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d0bfff640 1 -- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c150500 msgr2=0x7f7d0c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d0bfff640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c150500 0x7f7d0c157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d0bfff640 1 -- 172.21.15.110:0/357188173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d0c0c7c00 msgr2=0x7f7d0c158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d0bfff640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d0c0c7c00 0x7f7d0c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d0bfff640 1 -- 172.21.15.110:0/357188173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d04009a70 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d10a5a640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c150500 0x7f7d0c157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:36.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d0bfff640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d0c0c57f0 0x7f7d0c0affa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00c5e0 tx=0x7f7cfc00caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:36.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d08ff9640 1 -- 172.21.15.110:0/357188173 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc004220 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d08ff9640 1 -- 172.21.15.110:0/357188173 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0043c0 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c0add40 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d08ff9640 1 -- 172.21.15.110:0/357188173 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc003850 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c1ef600 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d08ff9640 1 -- 172.21.15.110:0/357188173 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7cfc0039b0 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.158+0000 7f7d08ff9640 1 -- 172.21.15.110:0/357188173 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7cfc011bf0 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.159+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c070780 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.161+0000 7f7d08ff9640 1 -- 172.21.15.110:0/357188173 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f7cfc038b50 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.202 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:36.203+0000 7f3a00c2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-23T06:09:36.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.233+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe6e559c-a95b-49d2-b790-d22bf54d1188", "id": 3} v 0) v1 -- 0x7f7d0c0718d0 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.240+0000 7f7d08ff9640 1 -- 172.21.15.110:0/357188173 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe6e559c-a95b-49d2-b790-d22bf54d1188", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7cfc027030 con 0x7f7d0c0c57f0 2024-03-23T06:09:36.240 INFO:teuthology.orchestra.run.smithi110.stdout:3 2024-03-23T06:09:36.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d0c0c57f0 msgr2=0x7f7d0c0affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d0c0c57f0 0x7f7d0c0affa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00c5e0 tx=0x7f7cfc00caa0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 shutdown_connections 2024-03-23T06:09:36.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d0c150500 0x7f7d0c157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d0c0c7c00 0x7f7d0c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 --2- 172.21.15.110:0/357188173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d0c0c57f0 0x7f7d0c0affa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 >> 172.21.15.110:0/357188173 conn(0x7f7d0c069cb0 msgr2=0x7f7d0c146360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 shutdown_connections 2024-03-23T06:09:36.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.241+0000 7f7d124bd640 1 -- 172.21.15.110:0/357188173 wait complete. 2024-03-23T06:09:36.255 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new c1e45bfa-e59c-410f-ae99-725ce8354bb5 4 2024-03-23T06:09:36.262 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:36.263+0000 7f3a00c2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-23T06:09:36.317 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:36.317+0000 7f3a00c2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-23T06:09:36.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.354+0000 7f120268e640 1 Processor -- start 2024-03-23T06:09:36.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.354+0000 7f120268e640 1 -- start start 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f120268e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11fc06bcc0 0x7f11fc15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f120268e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc071fd0 con 0x7f11fc153750 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f120268e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc071400 con 0x7f11fc0722c0 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f120268e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc153b30 con 0x7f11fc06bcc0 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f1200c2b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f11fc0722c0 0x7f11fc163d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40608/0 (socket says 172.21.15.110:40608) 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f1200c2b640 1 -- 172.21.15.110:0/1706441422 learned_addr learned my addr 172.21.15.110:0/1706441422 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586439551 0 0) 0x7f11fc071400 con 0x7f11fc0722c0 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e4003520 con 0x7f11fc0722c0 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11fb7fe640 1 --2- 172.21.15.110:0/1706441422 >> v2:172.21.15.73:3300/0 conn(0x7f11fc06bcc0 0x7f11fc15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3935331793 0 0) 0x7f11e4003520 con 0x7f11fc0722c0 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 >> v2:172.21.15.73:3300/0 conn(0x7f11fc06bcc0 msgr2=0x7f11fc15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 --2- 172.21.15.110:0/1706441422 >> v2:172.21.15.73:3300/0 conn(0x7f11fc06bcc0 0x7f11fc15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 >> v1:172.21.15.73:6789/0 conn(0x7f11fc153750 legacy=0x7f11fc0c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0716a0 con 0x7f11fc0722c0 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f11f40019f0 con 0x7f11fc0722c0 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 >> v1:172.21.15.110:6789/0 conn(0x7f11fc0722c0 legacy=0x7f11fc163d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.355+0000 7f11faffd640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11e4003970 0x7f11e4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11faffd640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11e40047c0 0x7f11e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11faffd640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40052a0 0x7f11e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc153b30 con 0x7f11e40052a0 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e400c150 con 0x7f11e40047c0 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e400c310 con 0x7f11e4003970 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11fb7fe640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11e40047c0 0x7f11e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11fbfff640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11e4003970 0x7f11e4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11fb7fe640 1 -- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11e4003970 msgr2=0x7f11e4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f1200c2b640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40052a0 0x7f11e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11fb7fe640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11e4003970 0x7f11e4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11fb7fe640 1 -- 172.21.15.110:0/1706441422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40052a0 msgr2=0x7f11e400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11fb7fe640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40052a0 0x7f11e400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f11fb7fe640 1 -- 172.21.15.110:0/1706441422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4003520 con 0x7f11e40047c0 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f1200c2b640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40052a0 0x7f11e400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.356+0000 7f1200c2b640 1 -- 172.21.15.110:0/1706441422 reap_dead start 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f11fb7fe640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11e40047c0 0x7f11e4004c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00ba00 tx=0x7f11e40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f055e0936ae79e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec032620 con 0x7f11e40047c0 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec032780 con 0x7f11e40047c0 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f11faffd640 1 -- 172.21.15.110:0/1706441422 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec032b10 con 0x7f11e40047c0 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f120268e640 1 -- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11e40047c0 msgr2=0x7f11e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f120268e640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11e40047c0 0x7f11e4004c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00ba00 tx=0x7f11e40057f0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.360 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f120268e640 1 -- 172.21.15.110:0/1706441422 shutdown_connections 2024-03-23T06:09:36.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f120268e640 1 --2- 172.21.15.110:0/1706441422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11e40047c0 0x7f11e4004c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f120268e640 1 -- 172.21.15.110:0/1706441422 >> 172.21.15.110:0/1706441422 conn(0x7f11fc0c88c0 msgr2=0x7f11fc0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f120268e640 1 -- 172.21.15.110:0/1706441422 shutdown_connections 2024-03-23T06:09:36.361 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.357+0000 7f120268e640 1 -- 172.21.15.110:0/1706441422 wait complete. 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.358+0000 7f120268e640 1 Processor -- start 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f120268e640 1 -- start start 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f120268e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40047c0 0x7f11fc14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f120268e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11fc15c5e0 0x7f11fc14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f120268e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11fc155460 0x7f11fc1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f120268e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc156330 con 0x7f11e40047c0 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f120268e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc15b0e0 con 0x7f11fc155460 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f120268e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc15b940 con 0x7f11fc15c5e0 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f11fb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11fc15c5e0 0x7f11fc14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f1200c2b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11fc155460 0x7f11fc1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f11fb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11fc15c5e0 0x7f11fc14dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:51530/0 (socket says 172.21.15.110:51530) 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f1200c2b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11fc155460 0x7f11fc1558e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56070/0 (socket says 172.21.15.110:56070) 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.359+0000 7f11fb7fe640 1 -- 172.21.15.110:0/1161353708 learned_addr learned my addr 172.21.15.110:0/1161353708 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11fbfff640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40047c0 0x7f11fc14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11fb7fe640 1 -- 172.21.15.110:0/1161353708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11fc155460 msgr2=0x7f11fc1558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11fb7fe640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11fc155460 0x7f11fc1558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11fb7fe640 1 -- 172.21.15.110:0/1161353708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40047c0 msgr2=0x7f11fc14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11fb7fe640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40047c0 0x7f11fc14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11fb7fe640 1 -- 172.21.15.110:0/1161353708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc14d3c0 con 0x7f11fc15c5e0 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f1200c2b640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11fc155460 0x7f11fc1558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11fbfff640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40047c0 0x7f11fc14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11fb7fe640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11fc15c5e0 0x7f11fc14dde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00bb20 tx=0x7f11ec004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11f8ff9640 1 -- 172.21.15.110:0/1161353708 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec032de0 con 0x7f11fc15c5e0 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11f8ff9640 1 -- 172.21.15.110:0/1161353708 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec03b420 con 0x7f11fc15c5e0 2024-03-23T06:09:36.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc15b310 con 0x7f11fc15c5e0 2024-03-23T06:09:36.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11f8ff9640 1 -- 172.21.15.110:0/1161353708 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec03b7d0 con 0x7f11fc15c5e0 2024-03-23T06:09:36.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc15bec0 con 0x7f11fc15c5e0 2024-03-23T06:09:36.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11f8ff9640 1 -- 172.21.15.110:0/1161353708 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f11ec03bc30 con 0x7f11fc15c5e0 2024-03-23T06:09:36.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.360+0000 7f11f8ff9640 1 -- 172.21.15.110:0/1161353708 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f11ec044920 con 0x7f11fc15c5e0 2024-03-23T06:09:36.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.361+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc04e110 con 0x7f11fc15c5e0 2024-03-23T06:09:36.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.363+0000 7f11f8ff9640 1 -- 172.21.15.110:0/1161353708 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f11ec049070 con 0x7f11fc15c5e0 2024-03-23T06:09:36.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.433+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c1e45bfa-e59c-410f-ae99-725ce8354bb5", "id": 4} v 0) v1 -- 0x7f11fc152300 con 0x7f11fc15c5e0 2024-03-23T06:09:36.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.440+0000 7f11f8ff9640 1 -- 172.21.15.110:0/1161353708 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1e45bfa-e59c-410f-ae99-725ce8354bb5", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11ec036020 con 0x7f11fc15c5e0 2024-03-23T06:09:36.440 INFO:teuthology.orchestra.run.smithi110.stdout:4 2024-03-23T06:09:36.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11fc15c5e0 msgr2=0x7f11fc14dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11fc15c5e0 0x7f11fc14dde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00bb20 tx=0x7f11ec004730 comp rx=0 tx=0).stop 2024-03-23T06:09:36.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 shutdown_connections 2024-03-23T06:09:36.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11fc155460 0x7f11fc1558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11fc15c5e0 0x7f11fc14dde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 --2- 172.21.15.110:0/1161353708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11e40047c0 0x7f11fc14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 >> 172.21.15.110:0/1161353708 conn(0x7f11fc0c88c0 msgr2=0x7f11fc1517c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 shutdown_connections 2024-03-23T06:09:36.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.441+0000 7f120268e640 1 -- 172.21.15.110:0/1161353708 wait complete. 2024-03-23T06:09:36.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new fec41108-00f1-4cfc-8cdd-8e87195f0936 5 2024-03-23T06:09:36.454 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:36.454+0000 7f7cc4020040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-23T06:09:36.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.550+0000 7fd274b92640 1 Processor -- start 2024-03-23T06:09:36.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.550+0000 7fd274b92640 1 -- start start 2024-03-23T06:09:36.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.551+0000 7fd274b92640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2700c24d0 0x7fd2700c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.551+0000 7fd274b92640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700c83e0 con 0x7fd2700c20f0 2024-03-23T06:09:36.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.551+0000 7fd274b92640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700c9460 con 0x7fd27006f270 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.551+0000 7fd274b92640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700c7f10 con 0x7fd2700c24d0 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.551+0000 7fd26ed9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd27006f270 0x7fd270151050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40624/0 (socket says 172.21.15.110:40624) 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.551+0000 7fd26ed9d640 1 -- 172.21.15.110:0/3717205089 learned_addr learned my addr 172.21.15.110:0/3717205089 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.551+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507489264 0 0) 0x7fd2700c9460 con 0x7fd27006f270 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.551+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd25c003520 con 0x7fd27006f270 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd267fff640 1 --2- 172.21.15.110:0/3717205089 >> v2:172.21.15.73:3300/0 conn(0x7fd2700c24d0 0x7fd2700c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 456413023 0 0) 0x7fd25c003520 con 0x7fd27006f270 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 >> v2:172.21.15.73:3300/0 conn(0x7fd2700c24d0 msgr2=0x7fd2700c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 --2- 172.21.15.110:0/3717205089 >> v2:172.21.15.73:3300/0 conn(0x7fd2700c24d0 0x7fd2700c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 >> v1:172.21.15.73:6789/0 conn(0x7fd2700c20f0 legacy=0x7fd270157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700c86a0 con 0x7fd27006f270 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fd2680019f0 con 0x7fd27006f270 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 >> v1:172.21.15.110:6789/0 conn(0x7fd27006f270 legacy=0x7fd270151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c003970 0x7fd25c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0047c0 0x7fd25c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0052a0 0x7fd25c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700c7f10 con 0x7fd25c0047c0 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c00c150 con 0x7fd25c003970 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c00c310 con 0x7fd25c0052a0 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26e59c640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c003970 0x7fd25c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26ed9d640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0052a0 0x7fd25c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26ed9d640 1 -- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c003970 msgr2=0x7fd25c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26ed9d640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd25c003970 0x7fd25c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd267fff640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0047c0 0x7fd25c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26ed9d640 1 -- 172.21.15.110:0/3717205089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0047c0 msgr2=0x7fd25c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26ed9d640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0047c0 0x7fd25c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.552+0000 7fd26ed9d640 1 -- 172.21.15.110:0/3717205089 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c003520 con 0x7fd25c0052a0 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.553+0000 7fd26ed9d640 1 -- 172.21.15.110:0/3717205089 reap_dead start 2024-03-23T06:09:36.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.553+0000 7fd26ed9d640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0052a0 0x7fd25c00b980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd268002230 tx=0x7fd25c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dd95256d5f5b903 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.553+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268034630 con 0x7fd25c0052a0 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.553+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26802f070 con 0x7fd25c0052a0 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.553+0000 7fd26dd9b640 1 -- 172.21.15.110:0/3717205089 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680349f0 con 0x7fd25c0052a0 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.554+0000 7fd274b92640 1 -- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0052a0 msgr2=0x7fd25c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.554+0000 7fd274b92640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0052a0 0x7fd25c00b980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd268002230 tx=0x7fd25c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.554+0000 7fd274b92640 1 -- 172.21.15.110:0/3717205089 shutdown_connections 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.554+0000 7fd274b92640 1 --2- 172.21.15.110:0/3717205089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd25c0052a0 0x7fd25c00b980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.554+0000 7fd274b92640 1 -- 172.21.15.110:0/3717205089 >> 172.21.15.110:0/3717205089 conn(0x7fd2700ccdd0 msgr2=0x7fd2700cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.554+0000 7fd274b92640 1 -- 172.21.15.110:0/3717205089 shutdown_connections 2024-03-23T06:09:36.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.554+0000 7fd274b92640 1 -- 172.21.15.110:0/3717205089 wait complete. 2024-03-23T06:09:36.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.556+0000 7fd274b92640 1 Processor -- start 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.556+0000 7fd274b92640 1 -- start start 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd274b92640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0052a0 0x7fd270153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd274b92640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd27013cd00 0x7fd270154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd274b92640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2701ecb10 0x7fd270151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd274b92640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701539c0 con 0x7fd25c0052a0 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd274b92640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701f0080 con 0x7fd2701ecb10 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd274b92640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701463b0 con 0x7fd27013cd00 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd26ed9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2701ecb10 0x7fd270151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd27013cd00 0x7fd270154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd27013cd00 0x7fd270154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:51558/0 (socket says 172.21.15.110:51558) 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd26ed9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2701ecb10 0x7fd270151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56084/0 (socket says 172.21.15.110:56084) 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 -- 172.21.15.110:0/1968041792 learned_addr learned my addr 172.21.15.110:0/1968041792 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd26e59c640 1 --2- 172.21.15.110:0/1968041792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0052a0 0x7fd270153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 -- 172.21.15.110:0/1968041792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2701ecb10 msgr2=0x7fd270151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 --2- 172.21.15.110:0/1968041792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2701ecb10 0x7fd270151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 -- 172.21.15.110:0/1968041792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0052a0 msgr2=0x7fd270153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 --2- 172.21.15.110:0/1968041792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0052a0 0x7fd270153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 -- 172.21.15.110:0/1968041792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270146690 con 0x7fd27013cd00 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.557+0000 7fd267fff640 1 --2- 172.21.15.110:0/1968041792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd27013cd00 0x7fd270154290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd25800e810 tx=0x7fd25800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.558+0000 7fd266ffd640 1 -- 172.21.15.110:0/1968041792 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800c6d0 con 0x7fd27013cd00 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.558+0000 7fd266ffd640 1 -- 172.21.15.110:0/1968041792 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800c830 con 0x7fd27013cd00 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.558+0000 7fd266ffd640 1 -- 172.21.15.110:0/1968041792 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800cbe0 con 0x7fd27013cd00 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.558+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2701f0340 con 0x7fd27013cd00 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.558+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2701f0900 con 0x7fd27013cd00 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.558+0000 7fd266ffd640 1 -- 172.21.15.110:0/1968041792 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd25801c450 con 0x7fd27013cd00 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.558+0000 7fd266ffd640 1 -- 172.21.15.110:0/1968041792 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd2580139e0 con 0x7fd27013cd00 2024-03-23T06:09:36.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.559+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd270071290 con 0x7fd27013cd00 2024-03-23T06:09:36.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.562+0000 7fd266ffd640 1 -- 172.21.15.110:0/1968041792 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fd258021060 con 0x7fd27013cd00 2024-03-23T06:09:36.598 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:36.598+0000 7f7cc4020040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-23T06:09:36.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.634+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fec41108-00f1-4cfc-8cdd-8e87195f0936", "id": 5} v 0) v1 -- 0x7fd270067060 con 0x7fd27013cd00 2024-03-23T06:09:36.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.642+0000 7fd266ffd640 1 -- 172.21.15.110:0/1968041792 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fec41108-00f1-4cfc-8cdd-8e87195f0936", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd25802a0b0 con 0x7fd27013cd00 2024-03-23T06:09:36.642 INFO:teuthology.orchestra.run.smithi110.stdout:5 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd27013cd00 msgr2=0x7fd270154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 --2- 172.21.15.110:0/1968041792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd27013cd00 0x7fd270154290 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd25800e810 tx=0x7fd25800ecd0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 shutdown_connections 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 --2- 172.21.15.110:0/1968041792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2701ecb10 0x7fd270151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 --2- 172.21.15.110:0/1968041792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd27013cd00 0x7fd270154290 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 --2- 172.21.15.110:0/1968041792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd25c0052a0 0x7fd270153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 >> 172.21.15.110:0/1968041792 conn(0x7fd2700ccdd0 msgr2=0x7fd2700730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 shutdown_connections 2024-03-23T06:09:36.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.643+0000 7fd274b92640 1 -- 172.21.15.110:0/1968041792 wait complete. 2024-03-23T06:09:36.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new dd9fcf25-f670-44ce-a393-b86c2dffaea5 6 2024-03-23T06:09:36.713 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:36.713+0000 7f7cc4020040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-23T06:09:36.760 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:36.761+0000 7f7cc4020040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-23T06:09:36.767 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:36.767+0000 7f3a00c2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-23T06:09:36.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.792+0000 7fcd83c84640 1 Processor -- start 2024-03-23T06:09:36.792 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.792+0000 7fcd83c84640 1 -- start start 2024-03-23T06:09:36.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd83c84640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd7c150440 0x7fcd7c0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd83c84640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcd7c0c7ff0 0x7fcd7c0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd83c84640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c0c2910 con 0x7fcd7c0c6d00 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd83c84640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c7110 con 0x7fcd7c0c7ff0 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd83c84640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0c7e20 con 0x7fcd7c150440 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd81a20640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd7c150440 0x7fcd7c0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd81a20640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd7c150440 0x7fcd7c0c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56090/0 (socket says 172.21.15.110:56090) 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd81a20640 1 -- 172.21.15.110:0/1790900065 learned_addr learned my addr 172.21.15.110:0/1790900065 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd81a20640 1 -- 172.21.15.110:0/1790900065 >> v2:172.21.15.73:3300/0 conn(0x7fcd7c0c7ff0 msgr2=0x7fcd7c0c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.793+0000 7fcd81a20640 1 --2- 172.21.15.110:0/1790900065 >> v2:172.21.15.73:3300/0 conn(0x7fcd7c0c7ff0 0x7fcd7c0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.794+0000 7fcd81a20640 1 -- 172.21.15.110:0/1790900065 >> v1:172.21.15.73:6789/0 conn(0x7fcd7c0c6d00 legacy=0x7fcd7c06e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:36.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.794+0000 7fcd81a20640 1 -- 172.21.15.110:0/1790900065 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c06adc0 con 0x7fcd7c150440 2024-03-23T06:09:36.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.794+0000 7fcd81a20640 1 --2- 172.21.15.110:0/1790900065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c0c74b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0c98b0 tx=0x7fcd7802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39aec2bf9a2d49f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:36.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.794+0000 7fcd80a1e640 1 -- 172.21.15.110:0/1790900065 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78031870 con 0x7fcd7c150440 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.794+0000 7fcd80a1e640 1 -- 172.21.15.110:0/1790900065 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd780319d0 con 0x7fcd7c150440 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.794+0000 7fcd80a1e640 1 -- 172.21.15.110:0/1790900065 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78031d60 con 0x7fcd7c150440 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.795+0000 7fcd83c84640 1 -- 172.21.15.110:0/1790900065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 msgr2=0x7fcd7c0c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.795+0000 7fcd83c84640 1 --2- 172.21.15.110:0/1790900065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c0c74b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0c98b0 tx=0x7fcd7802b910 comp rx=0 tx=0).stop 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.795+0000 7fcd83c84640 1 -- 172.21.15.110:0/1790900065 shutdown_connections 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.795+0000 7fcd83c84640 1 --2- 172.21.15.110:0/1790900065 >> v2:172.21.15.73:3300/0 conn(0x7fcd7c0c7ff0 0x7fcd7c0c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.795+0000 7fcd83c84640 1 --2- 172.21.15.110:0/1790900065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c0c74b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.795+0000 7fcd83c84640 1 -- 172.21.15.110:0/1790900065 >> 172.21.15.110:0/1790900065 conn(0x7fcd7c0c88c0 msgr2=0x7fcd7c0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.795+0000 7fcd83c84640 1 -- 172.21.15.110:0/1790900065 shutdown_connections 2024-03-23T06:09:36.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.795+0000 7fcd83c84640 1 -- 172.21.15.110:0/1790900065 wait complete. 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.796+0000 7fcd83c84640 1 Processor -- start 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.796+0000 7fcd83c84640 1 -- start start 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd83c84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd7c0c6d00 0x7fcd7c146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd83c84640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c7ff0 0x7fcd7c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd83c84640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd83c84640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c1569b0 con 0x7fcd7c0c6d00 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd83c84640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c155640 con 0x7fcd7c150440 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd83c84640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c1516c0 con 0x7fcd7c0c7ff0 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd8121f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c7ff0 0x7fcd7c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd82221640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd8121f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c7ff0 0x7fcd7c155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:51564/0 (socket says 172.21.15.110:51564) 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd82221640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c1561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56102/0 (socket says 172.21.15.110:56102) 2024-03-23T06:09:36.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.797+0000 7fcd8121f640 1 -- 172.21.15.110:0/166167405 learned_addr learned my addr 172.21.15.110:0/166167405 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd81a20640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd7c0c6d00 0x7fcd7c146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd82221640 1 -- 172.21.15.110:0/166167405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c7ff0 msgr2=0x7fcd7c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd82221640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c7ff0 0x7fcd7c155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd82221640 1 -- 172.21.15.110:0/166167405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd7c0c6d00 msgr2=0x7fcd7c146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd82221640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd7c0c6d00 0x7fcd7c146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd82221640 1 -- 172.21.15.110:0/166167405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd780094d0 con 0x7fcd7c150440 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd8121f640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c7ff0 0x7fcd7c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd82221640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c1561c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c780 tx=0x7fcd7400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd727fc640 1 -- 172.21.15.110:0/166167405 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74003b70 con 0x7fcd7c150440 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd727fc640 1 -- 172.21.15.110:0/166167405 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74003cf0 con 0x7fcd7c150440 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c150d70 con 0x7fcd7c150440 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd727fc640 1 -- 172.21.15.110:0/166167405 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74003ea0 con 0x7fcd7c150440 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c151960 con 0x7fcd7c150440 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd727fc640 1 -- 172.21.15.110:0/166167405 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd740055b0 con 0x7fcd7c150440 2024-03-23T06:09:36.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.798+0000 7fcd727fc640 1 -- 172.21.15.110:0/166167405 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcd740129f0 con 0x7fcd7c150440 2024-03-23T06:09:36.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.799+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c151b50 con 0x7fcd7c150440 2024-03-23T06:09:36.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.801+0000 7fcd727fc640 1 -- 172.21.15.110:0/166167405 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fcd74017070 con 0x7fcd7c150440 2024-03-23T06:09:36.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.872+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd9fcf25-f670-44ce-a393-b86c2dffaea5", "id": 6} v 0) v1 -- 0x7fcd7c14f410 con 0x7fcd7c150440 2024-03-23T06:09:36.876 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:36.877+0000 7f7cc4020040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-23T06:09:36.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.880+0000 7fcd727fc640 1 -- 172.21.15.110:0/166167405 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd9fcf25-f670-44ce-a393-b86c2dffaea5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd740124d0 con 0x7fcd7c150440 2024-03-23T06:09:36.880 INFO:teuthology.orchestra.run.smithi110.stdout:6 2024-03-23T06:09:36.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 msgr2=0x7fcd7c1561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:36.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c1561c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c780 tx=0x7fcd7400cc40 comp rx=0 tx=0).stop 2024-03-23T06:09:36.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 shutdown_connections 2024-03-23T06:09:36.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd7c150440 0x7fcd7c1561c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd7c0c7ff0 0x7fcd7c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 --2- 172.21.15.110:0/166167405 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd7c0c6d00 0x7fcd7c146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:36.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 >> 172.21.15.110:0/166167405 conn(0x7fcd7c0c88c0 msgr2=0x7fcd7c152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:36.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 shutdown_connections 2024-03-23T06:09:36.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:36.881+0000 7fcd83c84640 1 -- 172.21.15.110:0/166167405 wait complete. 2024-03-23T06:09:36.890 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5 7 2024-03-23T06:09:36.927 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:36.927+0000 7f3a00c2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-23T06:09:36.975 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:36.976+0000 7f7cc4020040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-23T06:09:37.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.030+0000 7f25f2551640 1 Processor -- start 2024-03-23T06:09:37.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.030+0000 7f25f2551640 1 -- start start 2024-03-23T06:09:37.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25f2551640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25f2551640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ec159e50 con 0x7f25ec0c6030 2024-03-23T06:09:37.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25f2551640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25ec071210 con 0x7f25ec0c7740 2024-03-23T06:09:37.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25f2551640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec159520 con 0x7f25ec0c6410 2024-03-23T06:09:37.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25eb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:37.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25f0aee640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f25ec0c7740 0x7f25ec153250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40630/0 (socket says 172.21.15.110:40630) 2024-03-23T06:09:37.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25f0aee640 1 -- 172.21.15.110:0/3308587249 learned_addr learned my addr 172.21.15.110:0/3308587249 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-03-23T06:09:37.031 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25eb7fe640 1 -- 172.21.15.110:0/3308587249 >> v1:172.21.15.110:6789/0 conn(0x7f25ec0c7740 legacy=0x7f25ec153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25eb7fe640 1 -- 172.21.15.110:0/3308587249 >> v1:172.21.15.73:6789/0 conn(0x7f25ec0c6030 legacy=0x7f25ec070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:37.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25eaffd640 1 -- 172.21.15.110:0/3308587249 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183565391 0 0) 0x7f25ec071210 con 0x7f25ec0c7740 2024-03-23T06:09:37.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.031+0000 7f25eb7fe640 1 -- 172.21.15.110:0/3308587249 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec159800 con 0x7f25ec0c6410 2024-03-23T06:09:37.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.032+0000 7f25eb7fe640 1 --2- 172.21.15.110:0/3308587249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec069cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0097d0 tx=0x7f25dc02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b06606c1b2f5ba90 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:37.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.032+0000 7f25eaffd640 1 -- 172.21.15.110:0/3308587249 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc031890 con 0x7f25ec0c6410 2024-03-23T06:09:37.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.032+0000 7f25eaffd640 1 -- 172.21.15.110:0/3308587249 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc0319f0 con 0x7f25ec0c6410 2024-03-23T06:09:37.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.032+0000 7f25eaffd640 1 -- 172.21.15.110:0/3308587249 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc031d80 con 0x7f25ec0c6410 2024-03-23T06:09:37.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.033+0000 7f25f2551640 1 -- 172.21.15.110:0/3308587249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 msgr2=0x7f25ec069cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.033+0000 7f25f2551640 1 --2- 172.21.15.110:0/3308587249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec069cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f25dc0097d0 tx=0x7f25dc02b930 comp rx=0 tx=0).stop 2024-03-23T06:09:37.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.033+0000 7f25f2551640 1 -- 172.21.15.110:0/3308587249 shutdown_connections 2024-03-23T06:09:37.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.033+0000 7f25f2551640 1 --2- 172.21.15.110:0/3308587249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec069cb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.033+0000 7f25f2551640 1 -- 172.21.15.110:0/3308587249 >> 172.21.15.110:0/3308587249 conn(0x7f25ec0c7ec0 msgr2=0x7f25ec0c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:37.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.033+0000 7f25f2551640 1 -- 172.21.15.110:0/3308587249 shutdown_connections 2024-03-23T06:09:37.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.033+0000 7f25f2551640 1 -- 172.21.15.110:0/3308587249 wait complete. 2024-03-23T06:09:37.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.034+0000 7f25f2551640 1 Processor -- start 2024-03-23T06:09:37.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.034+0000 7f25f2551640 1 -- start start 2024-03-23T06:09:37.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f2551640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ec0c6030 0x7f25ec158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f2551640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f2551640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec0c7740 0x7f25ec1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f2551640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec150b10 con 0x7f25ec0c6030 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f2551640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec150530 con 0x7f25ec0c7740 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f2551640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec0c46f0 con 0x7f25ec0c6410 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25eb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f0aee640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec0c7740 0x7f25ec1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25eb7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:51590/0 (socket says 172.21.15.110:51590) 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25eb7fe640 1 -- 172.21.15.110:0/2151319853 learned_addr learned my addr 172.21.15.110:0/2151319853 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f0aee640 1 -- 172.21.15.110:0/2151319853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 msgr2=0x7f25ec150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f0aee640 1 --2- 172.21.15.110:0/2151319853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f0aee640 1 -- 172.21.15.110:0/2151319853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ec0c6030 msgr2=0x7f25ec158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f0aee640 1 --2- 172.21.15.110:0/2151319853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ec0c6030 0x7f25ec158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f0aee640 1 -- 172.21.15.110:0/2151319853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc009400 con 0x7f25ec0c7740 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25f0aee640 1 --2- 172.21.15.110:0/2151319853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec0c7740 0x7f25ec1514e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f25e400c750 tx=0x7f25e400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:37.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25e8ff9640 1 -- 172.21.15.110:0/2151319853 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4004d70 con 0x7f25ec0c7740 2024-03-23T06:09:37.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.035+0000 7f25e8ff9640 1 -- 172.21.15.110:0/2151319853 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400a640 con 0x7f25ec0c7740 2024-03-23T06:09:37.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.036+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec1507a0 con 0x7f25ec0c7740 2024-03-23T06:09:37.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.036+0000 7f25e8ff9640 1 -- 172.21.15.110:0/2151319853 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400a9f0 con 0x7f25ec0c7740 2024-03-23T06:09:37.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.036+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ec0c49d0 con 0x7f25ec0c7740 2024-03-23T06:09:37.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.036+0000 7f25e8ff9640 1 -- 172.21.15.110:0/2151319853 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f25e40070d0 con 0x7f25ec0c7740 2024-03-23T06:09:37.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.036+0000 7f25e8ff9640 1 -- 172.21.15.110:0/2151319853 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f25e4012400 con 0x7f25ec0c7740 2024-03-23T06:09:37.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.036+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ec04e110 con 0x7f25ec0c7740 2024-03-23T06:09:37.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.038+0000 7f25e8ff9640 1 -- 172.21.15.110:0/2151319853 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f25e4018070 con 0x7f25ec0c7740 2024-03-23T06:09:37.073 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:37.073+0000 7f3a00c2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-23T06:09:37.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.110+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5", "id": 7} v 0) v1 -- 0x7f25ec14bb80 con 0x7f25ec0c7740 2024-03-23T06:09:37.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.118+0000 7f25e8ff9640 1 -- 172.21.15.110:0/2151319853 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f25e4007380 con 0x7f25ec0c7740 2024-03-23T06:09:37.118 INFO:teuthology.orchestra.run.smithi110.stdout:7 2024-03-23T06:09:37.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec0c7740 msgr2=0x7f25ec1514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 --2- 172.21.15.110:0/2151319853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec0c7740 0x7f25ec1514e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f25e400c750 tx=0x7f25e400cc10 comp rx=0 tx=0).stop 2024-03-23T06:09:37.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 shutdown_connections 2024-03-23T06:09:37.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 --2- 172.21.15.110:0/2151319853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25ec0c7740 0x7f25ec1514e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 --2- 172.21.15.110:0/2151319853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25ec0c6410 0x7f25ec150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 --2- 172.21.15.110:0/2151319853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25ec0c6030 0x7f25ec158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 >> 172.21.15.110:0/2151319853 conn(0x7f25ec0c7ec0 msgr2=0x7f25ec153020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:37.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 shutdown_connections 2024-03-23T06:09:37.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-03-23T06:09:37.119+0000 7f25f2551640 1 -- 172.21.15.110:0/2151319853 wait complete. 2024-03-23T06:09:37.126 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:37.126+0000 7f3a00c2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-23T06:09:37.129 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-23T06:09:37.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-23T06:09:37.136 INFO:tasks.ceph.osd.0:Started 2024-03-23T06:09:37.137 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-23T06:09:37.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-23T06:09:37.137 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:37.137+0000 7f7cc4020040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-23T06:09:37.143 INFO:tasks.ceph.osd.1:Started 2024-03-23T06:09:37.143 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-23T06:09:37.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-23T06:09:37.149 INFO:tasks.ceph.osd.2:Started 2024-03-23T06:09:37.149 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-23T06:09:37.149 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-23T06:09:37.153 INFO:tasks.ceph.osd.3:Started 2024-03-23T06:09:37.153 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-23T06:09:37.154 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-23T06:09:37.156 INFO:tasks.ceph.osd.4:Started 2024-03-23T06:09:37.156 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-23T06:09:37.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-23T06:09:37.158 INFO:tasks.ceph.osd.5:Started 2024-03-23T06:09:37.158 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-23T06:09:37.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-23T06:09:37.160 INFO:tasks.ceph.osd.6:Started 2024-03-23T06:09:37.160 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-23T06:09:37.160 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-23T06:09:37.162 INFO:tasks.ceph.osd.7:Started 2024-03-23T06:09:37.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:09:37.188 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:37.189+0000 7f7cc4020040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-23T06:09:37.285 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:37.285+0000 7f3a00c2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-23T06:09:37.361 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:37.361+0000 7f7cc4020040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-23T06:09:37.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.384+0000 7f93e7e00640 1 Processor -- start 2024-03-23T06:09:37.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.384+0000 7f93e7e00640 1 -- start start 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e7e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93e0153410 0x7f93e0159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93e00c7590 0x7f93e00c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e7e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e00c6320 con 0x7f93e00c6f00 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e7e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e015a4a0 con 0x7f93e0153410 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e7e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e006dfd0 con 0x7f93e00c7590 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93e0153410 0x7f93e0159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93e0153410 0x7f93e0159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45802/0 (socket says 172.21.15.73:45802) 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e5400640 1 -- 172.21.15.73:0/1647463135 learned_addr learned my addr 172.21.15.73:0/1647463135 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.385+0000 7f93e5e00640 1 --2- 172.21.15.73:0/1647463135 >> v2:172.21.15.110:3300/0 conn(0x7f93e00c7590 0x7f93e00c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:37.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.386+0000 7f93e5400640 1 -- 172.21.15.73:0/1647463135 >> v2:172.21.15.110:3300/0 conn(0x7f93e00c7590 msgr2=0x7f93e00c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:37.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.386+0000 7f93e5400640 1 --2- 172.21.15.73:0/1647463135 >> v2:172.21.15.110:3300/0 conn(0x7f93e00c7590 0x7f93e00c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.386+0000 7f93e5400640 1 -- 172.21.15.73:0/1647463135 >> v1:172.21.15.73:6789/0 conn(0x7f93e00c6f00 legacy=0x7f93e00bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.386+0000 7f93e5400640 1 -- 172.21.15.73:0/1647463135 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e006db40 con 0x7f93e0153410 2024-03-23T06:09:37.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.387+0000 7f93e5400640 1 --2- 172.21.15.73:0/1647463135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e0153410 0x7f93e0159f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93e0070ab0 tx=0x7f93d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85596fd750417a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:37.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.387+0000 7f93dfe00640 1 -- 172.21.15.73:0/1647463135 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4030860 con 0x7f93e0153410 2024-03-23T06:09:37.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.387+0000 7f93dfe00640 1 -- 172.21.15.73:0/1647463135 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d40309c0 con 0x7f93e0153410 2024-03-23T06:09:37.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.387+0000 7f93dfe00640 1 -- 172.21.15.73:0/1647463135 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4030d50 con 0x7f93e0153410 2024-03-23T06:09:37.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.388+0000 7f93e7e00640 1 -- 172.21.15.73:0/1647463135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e0153410 msgr2=0x7f93e0159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.388+0000 7f93e7e00640 1 --2- 172.21.15.73:0/1647463135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e0153410 0x7f93e0159f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f93e0070ab0 tx=0x7f93d402b9a0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.388+0000 7f93e7e00640 1 -- 172.21.15.73:0/1647463135 shutdown_connections 2024-03-23T06:09:37.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.388+0000 7f93e7e00640 1 --2- 172.21.15.73:0/1647463135 >> v2:172.21.15.110:3300/0 conn(0x7f93e00c7590 0x7f93e00c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.388+0000 7f93e7e00640 1 --2- 172.21.15.73:0/1647463135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e0153410 0x7f93e0159f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.388+0000 7f93e7e00640 1 -- 172.21.15.73:0/1647463135 >> 172.21.15.73:0/1647463135 conn(0x7f93e006bb40 msgr2=0x7f93e006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:37.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.388+0000 7f93e7e00640 1 -- 172.21.15.73:0/1647463135 shutdown_connections 2024-03-23T06:09:37.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.388+0000 7f93e7e00640 1 -- 172.21.15.73:0/1647463135 wait complete. 2024-03-23T06:09:37.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.390+0000 7f93e7e00640 1 Processor -- start 2024-03-23T06:09:37.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.390+0000 7f93e7e00640 1 -- start start 2024-03-23T06:09:37.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e00c6f00 0x7f93e014b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93e00c7590 0x7f93e01525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93e0153410 0x7f93e01ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:37.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e7e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e01eefe0 con 0x7f93e00c6f00 2024-03-23T06:09:37.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e014bdb0 con 0x7f93e0153410 2024-03-23T06:09:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e7e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e014a540 con 0x7f93e00c7590 2024-03-23T06:09:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93e0153410 0x7f93e01ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e4a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93e00c7590 0x7f93e01525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93e0153410 0x7f93e01ef470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:38670/0 (socket says 172.21.15.73:38670) 2024-03-23T06:09:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e5e00640 1 -- 172.21.15.73:0/2535819625 learned_addr learned my addr 172.21.15.73:0/2535819625 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.391+0000 7f93e5400640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e00c6f00 0x7f93e014b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.392+0000 7f93e5e00640 1 -- 172.21.15.73:0/2535819625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93e00c7590 msgr2=0x7f93e01525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.392+0000 7f93e5e00640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93e00c7590 0x7f93e01525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.392+0000 7f93e5e00640 1 -- 172.21.15.73:0/2535819625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e00c6f00 msgr2=0x7f93e014b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.392+0000 7f93e5e00640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e00c6f00 0x7f93e014b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.392+0000 7f93e5e00640 1 -- 172.21.15.73:0/2535819625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40094d0 con 0x7f93e0153410 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.392+0000 7f93e5400640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e00c6f00 0x7f93e014b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.392+0000 7f93e5e00640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93e0153410 0x7f93e01ef470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f93d800efc0 tx=0x7f93d800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.392+0000 7f93dd600640 1 -- 172.21.15.73:0/2535819625 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8014480 con 0x7f93e0153410 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.393+0000 7f93dd600640 1 -- 172.21.15.73:0/2535819625 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800f040 con 0x7f93e0153410 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.393+0000 7f93dd600640 1 -- 172.21.15.73:0/2535819625 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8014820 con 0x7f93e0153410 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.393+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e014a820 con 0x7f93e0153410 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.393+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e014ade0 con 0x7f93e0153410 2024-03-23T06:09:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.393+0000 7f93dd600640 1 -- 172.21.15.73:0/2535819625 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f93d8014c80 con 0x7f93e0153410 2024-03-23T06:09:37.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.393+0000 7f93dd600640 1 -- 172.21.15.73:0/2535819625 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f93d801dcc0 con 0x7f93e0153410 2024-03-23T06:09:37.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.394+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e01ef150 con 0x7f93e0153410 2024-03-23T06:09:37.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.396+0000 7f93dd600640 1 -- 172.21.15.73:0/2535819625 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f93d803bb50 con 0x7f93e0153410 2024-03-23T06:09:37.424 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:37.425+0000 7f3a00c2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-23T06:09:37.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.460+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e00c6ad0 con 0x7f93e0153410 2024-03-23T06:09:37.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.461+0000 7f93dd600640 1 -- 172.21.15.73:0/2535819625 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f93d802a070 con 0x7f93e0153410 2024-03-23T06:09:37.461 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:09:37.461 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:09:37.112749+0000","last_up_change":"0.000000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:09:37.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93e0153410 msgr2=0x7f93e01ef470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:37.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93e0153410 0x7f93e01ef470 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f93d800efc0 tx=0x7f93d800c490 comp rx=0 tx=0).stop 2024-03-23T06:09:37.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 shutdown_connections 2024-03-23T06:09:37.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93e0153410 0x7f93e01ef470 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93e00c7590 0x7f93e01525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 --2- 172.21.15.73:0/2535819625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93e00c6f00 0x7f93e014b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:37.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 >> 172.21.15.73:0/2535819625 conn(0x7f93e006bb40 msgr2=0x7f93e00c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:37.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 shutdown_connections 2024-03-23T06:09:37.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:37.462+0000 7f93e7e00640 1 -- 172.21.15.73:0/2535819625 wait complete. 2024-03-23T06:09:37.479 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-23T06:09:37.479 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-23T06:09:37.604 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:37.604+0000 7f3a00c2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-23T06:09:37.654 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:37.654+0000 7f3a00c2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-23T06:09:37.752 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-03-23T06:09:37.752+0000 7fd738e1a4c0 -1 Falling back to public interface 2024-03-23T06:09:37.753 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-03-23T06:09:37.752+0000 7f7633b904c0 -1 Falling back to public interface 2024-03-23T06:09:37.753 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-03-23T06:09:37.752+0000 7f7632b37640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-03-23T06:09:37.774 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-03-23T06:09:37.775+0000 7fafb480c4c0 -1 Falling back to public interface 2024-03-23T06:09:37.778 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-03-23T06:09:37.778+0000 7f25778254c0 -1 Falling back to public interface 2024-03-23T06:09:37.827 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:37.826+0000 7f3a00c2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-23T06:09:37.858 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-23T06:09:37.858+0000 7fa4a1e0d4c0 -1 Falling back to public interface 2024-03-23T06:09:37.860 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-23T06:09:37.860+0000 7f981b5e04c0 -1 Falling back to public interface 2024-03-23T06:09:37.864 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-23T06:09:37.864+0000 7ff6640104c0 -1 Falling back to public interface 2024-03-23T06:09:37.868 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-23T06:09:37.868+0000 7fe21780c4c0 -1 Falling back to public interface 2024-03-23T06:09:38.146 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:38.146+0000 7f7cc4020040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-23T06:09:38.284 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T06:09:38.414 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:38.414+0000 7f7cc4020040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-23T06:09:38.433 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.433+0000 7f7eb2000640 1 Processor -- start 2024-03-23T06:09:38.433 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.433+0000 7f7eb2000640 1 -- start start 2024-03-23T06:09:38.434 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.434+0000 7f7eb2000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7eac162f20 0x7f7eac165310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:38.434 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.434+0000 7f7eb2000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0c9bb0 con 0x7f7eac1539c0 2024-03-23T06:09:38.434 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.434+0000 7f7eb2000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0cf790 con 0x7f7eac0caf80 2024-03-23T06:09:38.434 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.434+0000 7f7eb2000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac159b70 con 0x7f7eac162f20 2024-03-23T06:09:38.435 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7eabe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7eac162f20 0x7f7eac165310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:38.435 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7ea2a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7eac0caf80 0x7f7eac0cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58310/0 (socket says 172.21.15.73:58310) 2024-03-23T06:09:38.435 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7ea2a00640 1 -- 172.21.15.73:0/2128375508 learned_addr learned my addr 172.21.15.73:0/2128375508 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:38.435 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7eaaa00640 1 -- 172.21.15.73:0/2128375508 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140267100 0 0) 0x7f7eac0cf790 con 0x7f7eac0caf80 2024-03-23T06:09:38.435 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7eaaa00640 1 -- 172.21.15.73:0/2128375508 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e90003520 con 0x7f7eac0caf80 2024-03-23T06:09:38.436 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7eabe00640 1 -- 172.21.15.73:0/2128375508 >> v1:172.21.15.110:6789/0 conn(0x7f7eac0caf80 legacy=0x7f7eac0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:38.436 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7eaaa00640 1 -- 172.21.15.73:0/2128375508 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641082850 0 0) 0x7f7eac0c9bb0 con 0x7f7eac1539c0 2024-03-23T06:09:38.436 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7eabe00640 1 -- 172.21.15.73:0/2128375508 >> v1:172.21.15.73:6789/0 conn(0x7f7eac1539c0 legacy=0x7f7eac159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:38.436 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.435+0000 7f7eabe00640 1 -- 172.21.15.73:0/2128375508 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac15d960 con 0x7f7eac162f20 2024-03-23T06:09:38.436 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.436+0000 7f7eabe00640 1 --2- 172.21.15.73:0/2128375508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac165310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40097a0 tx=0x7f7ea402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955261e5d1eb6332 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.436+0000 7f7eaaa00640 1 -- 172.21.15.73:0/2128375508 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4031830 con 0x7f7eac162f20 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.436+0000 7f7eaaa00640 1 -- 172.21.15.73:0/2128375508 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea4031990 con 0x7f7eac162f20 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.436+0000 7f7eaaa00640 1 -- 172.21.15.73:0/2128375508 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4031d20 con 0x7f7eac162f20 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.437+0000 7f7eb2000640 1 -- 172.21.15.73:0/2128375508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 msgr2=0x7f7eac165310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.437+0000 7f7eb2000640 1 --2- 172.21.15.73:0/2128375508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac165310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40097a0 tx=0x7f7ea402b8d0 comp rx=0 tx=0).stop 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.437+0000 7f7eb2000640 1 -- 172.21.15.73:0/2128375508 shutdown_connections 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.437+0000 7f7eb2000640 1 --2- 172.21.15.73:0/2128375508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac165310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.437+0000 7f7eb2000640 1 -- 172.21.15.73:0/2128375508 >> 172.21.15.73:0/2128375508 conn(0x7f7eac0713e0 msgr2=0x7f7eac0717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:38.437 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.437+0000 7f7eb2000640 1 -- 172.21.15.73:0/2128375508 shutdown_connections 2024-03-23T06:09:38.438 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.437+0000 7f7eb2000640 1 -- 172.21.15.73:0/2128375508 wait complete. 2024-03-23T06:09:38.438 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.439+0000 7f7eb2000640 1 Processor -- start 2024-03-23T06:09:38.438 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.439+0000 7f7eb2000640 1 -- start start 2024-03-23T06:09:38.441 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eb2000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac0caf80 0x7f7eac1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:38.441 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eb2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac1539c0 0x7f7eac1565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:38.441 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eb2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:38.441 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eb2000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac06c6c0 con 0x7f7eac162f20 2024-03-23T06:09:38.441 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eb2000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac06c100 con 0x7f7eac1539c0 2024-03-23T06:09:38.441 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eb2000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac06c3e0 con 0x7f7eac0caf80 2024-03-23T06:09:38.441 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7ea2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac1539c0 0x7f7eac1565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eabe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eabe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac14f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45838/0 (socket says 172.21.15.73:45838) 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7ea2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac1539c0 0x7f7eac1565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:38686/0 (socket says 172.21.15.73:38686) 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.440+0000 7f7eabe00640 1 -- 172.21.15.73:0/1923894126 learned_addr learned my addr 172.21.15.73:0/1923894126 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eab400640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac0caf80 0x7f7eac1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eabe00640 1 -- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac0caf80 msgr2=0x7f7eac1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eabe00640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac0caf80 0x7f7eac1560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eabe00640 1 -- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac1539c0 msgr2=0x7f7eac1565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eabe00640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac1539c0 0x7f7eac1565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eabe00640 1 -- 172.21.15.73:0/1923894126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4009400 con 0x7f7eac162f20 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eab400640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac0caf80 0x7f7eac1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7ea2a00640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac1539c0 0x7f7eac1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eabe00640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac14f6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40097a0 tx=0x7f7ea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:38.442 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7ea3e00640 1 -- 172.21.15.73:0/1923894126 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea403a830 con 0x7f7eac162f20 2024-03-23T06:09:38.443 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7ea3e00640 1 -- 172.21.15.73:0/1923894126 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea403a9b0 con 0x7f7eac162f20 2024-03-23T06:09:38.443 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7ea3e00640 1 -- 172.21.15.73:0/1923894126 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea403ad60 con 0x7f7eac162f20 2024-03-23T06:09:38.443 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.441+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac0c3550 con 0x7f7eac162f20 2024-03-23T06:09:38.443 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.442+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac156d70 con 0x7f7eac162f20 2024-03-23T06:09:38.443 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.442+0000 7f7ea3e00640 1 -- 172.21.15.73:0/1923894126 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ea404d750 con 0x7f7eac162f20 2024-03-23T06:09:38.443 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.442+0000 7f7ea3e00640 1 -- 172.21.15.73:0/1923894126 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7ea4044c80 con 0x7f7eac162f20 2024-03-23T06:09:38.443 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.443+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac0c3a70 con 0x7f7eac162f20 2024-03-23T06:09:38.445 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.445+0000 7f7ea3e00640 1 -- 172.21.15.73:0/1923894126 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f7eac0c3a70 con 0x7f7eac162f20 2024-03-23T06:09:38.466 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:38.466+0000 7f7cc4020040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-23T06:09:38.509 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.509+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eac074580 con 0x7f7eac162f20 2024-03-23T06:09:38.510 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.510+0000 7f7ea3e00640 1 -- 172.21.15.73:0/1923894126 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7ea4035020 con 0x7f7eac162f20 2024-03-23T06:09:38.510 INFO:teuthology.misc.health.smithi073.stdout: 2024-03-23T06:09:38.510 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:09:37.112749+0000","last_up_change":"0.000000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 msgr2=0x7f7eac14f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac14f6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40097a0 tx=0x7f7ea40046c0 comp rx=0 tx=0).stop 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 shutdown_connections 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7eac162f20 0x7f7eac14f6f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac1539c0 0x7f7eac1565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 --2- 172.21.15.73:0/1923894126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac0caf80 0x7f7eac1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 >> 172.21.15.73:0/1923894126 conn(0x7f7eac0713e0 msgr2=0x7f7eac0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 shutdown_connections 2024-03-23T06:09:38.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:38.511+0000 7f7eb2000640 1 -- 172.21.15.73:0/1923894126 wait complete. 2024-03-23T06:09:38.523 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-23T06:09:38.581 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:38.581+0000 7f7cc4020040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-23T06:09:38.825 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:38.825+0000 7f3a00c2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-23T06:09:39.128 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:39.128+0000 7f3a00c2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-23T06:09:39.186 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:39.187+0000 7f3a00c2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-23T06:09:39.315 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-23T06:09:39.316+0000 7f3a00c2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-23T06:09:39.619 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:39.619+0000 7f7c64b02640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-23T06:09:39.619 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-03-23T06:09:39.619+0000 7f7c64b02640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-23T06:09:41.204 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-03-23T06:09:41.205+0000 7fd738e1a4c0 -1 osd.4 0 log_to_monitors true 2024-03-23T06:09:41.252 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-03-23T06:09:41.252+0000 7f7633b904c0 -1 osd.6 0 log_to_monitors true 2024-03-23T06:09:41.282 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-03-23T06:09:41.282+0000 7fafb480c4c0 -1 osd.5 0 log_to_monitors true 2024-03-23T06:09:41.288 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-03-23T06:09:41.289+0000 7f25778254c0 -1 osd.7 0 log_to_monitors true 2024-03-23T06:09:41.462 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-23T06:09:41.462+0000 7fa4a1e0d4c0 -1 osd.2 0 log_to_monitors true 2024-03-23T06:09:41.462 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-23T06:09:41.463+0000 7fe21780c4c0 -1 osd.0 0 log_to_monitors true 2024-03-23T06:09:41.474 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-23T06:09:41.474+0000 7ff6640104c0 -1 osd.3 0 log_to_monitors true 2024-03-23T06:09:41.480 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-23T06:09:41.481+0000 7f981b5e04c0 -1 osd.1 0 log_to_monitors true 2024-03-23T06:09:43.979 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-03-23T06:09:43.978+0000 7f25737b0640 -1 osd.7 0 waiting for initial osdmap 2024-03-23T06:09:43.995 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-03-23T06:09:43.994+0000 7f256b5d1640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T06:09:44.055 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-03-23T06:09:44.054+0000 7fafb0246640 -1 osd.5 0 waiting for initial osdmap 2024-03-23T06:09:44.070 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-03-23T06:09:44.070+0000 7fafa8067640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T06:09:44.110 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-03-23T06:09:44.110+0000 7fd7346e3640 -1 osd.4 0 waiting for initial osdmap 2024-03-23T06:09:44.113 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-03-23T06:09:44.112+0000 7f7630332640 -1 osd.6 0 waiting for initial osdmap 2024-03-23T06:09:44.119 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-03-23T06:09:44.119+0000 7fd72c504640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T06:09:44.125 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-03-23T06:09:44.125+0000 7f762793c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T06:09:45.019 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-23T06:09:45.018+0000 7fa49c800640 -1 osd.2 0 waiting for initial osdmap 2024-03-23T06:09:45.030 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-23T06:09:45.031+0000 7fa492800640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T06:09:45.064 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-23T06:09:45.064+0000 7fe212000640 -1 osd.0 0 waiting for initial osdmap 2024-03-23T06:09:45.071 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-23T06:09:45.072+0000 7fe208000640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T06:09:45.094 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-23T06:09:45.095+0000 7f9816400640 -1 osd.1 0 waiting for initial osdmap 2024-03-23T06:09:45.104 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-23T06:09:45.105+0000 7f980c400640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T06:09:45.129 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-23T06:09:45.130+0000 7ff65e800640 -1 osd.3 0 waiting for initial osdmap 2024-03-23T06:09:45.136 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-23T06:09:45.137+0000 7ff654800640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-23T06:09:45.330 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T06:09:45.502 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.503+0000 7f7097e00640 1 Processor -- start 2024-03-23T06:09:45.503 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.503+0000 7f7097e00640 1 -- start start 2024-03-23T06:09:45.504 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.504+0000 7f7097e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7090071c00 0x7f70900c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:45.505 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.504+0000 7f7097e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7090071fe0 0x7f70901510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:45.505 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.504+0000 7f7097e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70900c1b00 con 0x7f70900c6c20 2024-03-23T06:09:45.505 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.504+0000 7f7097e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70900c7100 con 0x7f7090071fe0 2024-03-23T06:09:45.505 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.504+0000 7f7097e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7090157350 con 0x7f7090071c00 2024-03-23T06:09:45.505 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.505+0000 7f7095400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7090071c00 0x7f70900c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:45.505 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.505+0000 7f7095400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7090071c00 0x7f70900c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:44306/0 (socket says 172.21.15.73:44306) 2024-03-23T06:09:45.505 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.505+0000 7f7095400640 1 -- 172.21.15.73:0/127913581 learned_addr learned my addr 172.21.15.73:0/127913581 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:45.505 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.505+0000 7f7095e00640 1 --2- 172.21.15.73:0/127913581 >> v2:172.21.15.110:3300/0 conn(0x7f7090071fe0 0x7f70901510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:45.506 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.505+0000 7f7095400640 1 -- 172.21.15.73:0/127913581 >> v2:172.21.15.110:3300/0 conn(0x7f7090071fe0 msgr2=0x7f70901510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:45.506 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.505+0000 7f7095400640 1 --2- 172.21.15.73:0/127913581 >> v2:172.21.15.110:3300/0 conn(0x7f7090071fe0 0x7f70901510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.506 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.505+0000 7f7095400640 1 -- 172.21.15.73:0/127913581 >> v1:172.21.15.73:6789/0 conn(0x7f70900c6c20 legacy=0x7f709015a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:45.506 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.505+0000 7f7095400640 1 -- 172.21.15.73:0/127913581 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090157610 con 0x7f7090071c00 2024-03-23T06:09:45.507 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.506+0000 7f7095400640 1 --2- 172.21.15.73:0/127913581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7090071c00 0x7f70900c66e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfebd64ec8d9c59a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:45.507 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f708fe00640 1 -- 172.21.15.73:0/127913581 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708402f840 con 0x7f7090071c00 2024-03-23T06:09:45.507 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f708fe00640 1 -- 172.21.15.73:0/127913581 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708402f9a0 con 0x7f7090071c00 2024-03-23T06:09:45.507 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f708fe00640 1 -- 172.21.15.73:0/127913581 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708402fd30 con 0x7f7090071c00 2024-03-23T06:09:45.507 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f7097e00640 1 -- 172.21.15.73:0/127913581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7090071c00 msgr2=0x7f70900c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:45.507 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f7097e00640 1 --2- 172.21.15.73:0/127913581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7090071c00 0x7f70900c66e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402ba20 comp rx=0 tx=0).stop 2024-03-23T06:09:45.507 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f7097e00640 1 -- 172.21.15.73:0/127913581 shutdown_connections 2024-03-23T06:09:45.507 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f7097e00640 1 --2- 172.21.15.73:0/127913581 >> v2:172.21.15.110:3300/0 conn(0x7f7090071fe0 0x7f70901510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.508 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f7097e00640 1 --2- 172.21.15.73:0/127913581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7090071c00 0x7f70900c66e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.508 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f7097e00640 1 -- 172.21.15.73:0/127913581 >> 172.21.15.73:0/127913581 conn(0x7f70900c7460 msgr2=0x7f70900c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:45.508 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f7097e00640 1 -- 172.21.15.73:0/127913581 shutdown_connections 2024-03-23T06:09:45.508 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.507+0000 7f7097e00640 1 -- 172.21.15.73:0/127913581 wait complete. 2024-03-23T06:09:45.508 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.509+0000 7f7097e00640 1 Processor -- start 2024-03-23T06:09:45.509 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.509+0000 7f7097e00640 1 -- start start 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7097e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090071c00 0x7f7090148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7097e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7090071fe0 0x7f70901554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7097e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c6c20 0x7f7090070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7097e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709015a9f0 con 0x7f7090071fe0 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7097e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70901efcf0 con 0x7f7090071c00 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7097e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70901eee70 con 0x7f70900c6c20 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7094a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7090071fe0 0x7f70901554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7094a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7090071fe0 0x7f70901554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56870/0 (socket says 172.21.15.73:56870) 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7094a00640 1 -- 172.21.15.73:0/157657166 learned_addr learned my addr 172.21.15.73:0/157657166 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:45.511 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7095e00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c6c20 0x7f7090070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7095400640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090071c00 0x7f7090148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7094a00640 1 -- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c6c20 msgr2=0x7f7090070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7094a00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c6c20 0x7f7090070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7094a00640 1 -- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090071c00 msgr2=0x7f7090148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.510+0000 7f7094a00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090071c00 0x7f7090148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.511+0000 7f7094a00640 1 -- 172.21.15.73:0/157657166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840094d0 con 0x7f7090071fe0 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.511+0000 7f7094a00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7090071fe0 0x7f70901554b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c460 tx=0x7f707c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.511+0000 7f708d600640 1 -- 172.21.15.73:0/157657166 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0052d0 con 0x7f7090071fe0 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.511+0000 7f708d600640 1 -- 172.21.15.73:0/157657166 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c005430 con 0x7f7090071fe0 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.511+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70901ef0e0 con 0x7f7090071fe0 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.511+0000 7f708d600640 1 -- 172.21.15.73:0/157657166 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c012870 con 0x7f7090071fe0 2024-03-23T06:09:45.512 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.511+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70901ef980 con 0x7f7090071fe0 2024-03-23T06:09:45.513 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.512+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70901ef500 con 0x7f7090071fe0 2024-03-23T06:09:45.513 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.513+0000 7f708d600640 1 -- 172.21.15.73:0/157657166 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7f707c0129d0 con 0x7f7090071fe0 2024-03-23T06:09:45.514 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.515+0000 7f708d600640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707006ab70 0x7f707006d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:45.514 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.515+0000 7f708d600640 1 -- 172.21.15.73:0/157657166 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f707c088250 con 0x7f7090071fe0 2024-03-23T06:09:45.515 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.515+0000 7f7095400640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707006ab70 0x7f707006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:45.515 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.516+0000 7f7095400640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707006ab70 0x7f707006d030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7084036000 tx=0x7f7084008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:45.519 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.520+0000 7f708d600640 1 -- 172.21.15.73:0/157657166 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f70901ef500 con 0x7f7090071fe0 2024-03-23T06:09:45.706 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.706+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70901ef500 con 0x7f7090071fe0 2024-03-23T06:09:45.708 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.708+0000 7f708d600640 1 -- 172.21.15.73:0/157657166 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8784 (secure 0 0 0) 0x7f70901ef500 con 0x7f7090071fe0 2024-03-23T06:09:45.708 INFO:teuthology.misc.health.smithi073.stdout: 2024-03-23T06:09:45.708 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":13,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:09:44.857422+0000","last_up_change":"2024-03-23T06:09:44.857422+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.710+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707006ab70 msgr2=0x7f707006d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.710+0000 7f7097e00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707006ab70 0x7f707006d030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7084036000 tx=0x7f7084008030 comp rx=0 tx=0).stop 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.710+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7090071fe0 msgr2=0x7f70901554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.710+0000 7f7097e00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7090071fe0 0x7f70901554b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f707c00c460 tx=0x7f707c00c920 comp rx=0 tx=0).stop 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.711+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 shutdown_connections 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.711+0000 7f7097e00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707006ab70 0x7f707006d030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.711+0000 7f7097e00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c6c20 0x7f7090070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.711+0000 7f7097e00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7090071fe0 0x7f70901554b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.711+0000 7f7097e00640 1 --2- 172.21.15.73:0/157657166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090071c00 0x7f7090148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.711+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 >> 172.21.15.73:0/157657166 conn(0x7f70900c7460 msgr2=0x7f7090156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:45.711 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.711+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 shutdown_connections 2024-03-23T06:09:45.712 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:45.711+0000 7f7097e00640 1 -- 172.21.15.73:0/157657166 wait complete. 2024-03-23T06:09:45.723 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-03-23T06:09:52.530 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-23T06:09:52.713 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.713+0000 7f0a1b200640 1 Processor -- start 2024-03-23T06:09:52.713 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.713+0000 7f0a1b200640 1 -- start start 2024-03-23T06:09:52.715 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.714+0000 7f0a1b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:52.715 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.714+0000 7f0a1b200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c156460 con 0x7f0a1c1501d0 2024-03-23T06:09:52.715 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.714+0000 7f0a1b200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c06f700 con 0x7f0a1c0c7e60 2024-03-23T06:09:52.715 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.714+0000 7f0a1b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0c4450 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.715 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a19e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0a1c1501d0 0x7f0a1c1568f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45636/0 (socket says 172.21.15.73:45636) 2024-03-23T06:09:52.715 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a19e00640 1 -- 172.21.15.73:0/286876338 learned_addr learned my addr 172.21.15.73:0/286876338 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:52.715 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a19400640 1 --2- 172.21.15.73:0/286876338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a18a00640 1 -- 172.21.15.73:0/286876338 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261858204 0 0) 0x7f0a1c156460 con 0x7f0a1c1501d0 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a18a00640 1 -- 172.21.15.73:0/286876338 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a00003520 con 0x7f0a1c1501d0 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a18a00640 1 -- 172.21.15.73:0/286876338 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502869459 0 0) 0x7f0a1c06f700 con 0x7f0a1c0c7e60 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a18a00640 1 -- 172.21.15.73:0/286876338 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a1c156460 con 0x7f0a1c0c7e60 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a19400640 1 -- 172.21.15.73:0/286876338 >> v1:172.21.15.110:6789/0 conn(0x7f0a1c0c7e60 legacy=0x7f0a1c160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a18a00640 1 -- 172.21.15.73:0/286876338 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161539606 0 0) 0x7f0a00003520 con 0x7f0a1c1501d0 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a19400640 1 -- 172.21.15.73:0/286876338 >> v1:172.21.15.73:6789/0 conn(0x7f0a1c1501d0 legacy=0x7f0a1c1568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.715+0000 7f0a19400640 1 -- 172.21.15.73:0/286876338 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c0c4730 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.716 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.717+0000 7f0a19400640 1 --2- 172.21.15.73:0/286876338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c0c6400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097d0 tx=0x7f0a0402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1b8ec55e067cae2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:52.717 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.717+0000 7f0a18a00640 1 -- 172.21.15.73:0/286876338 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c001670 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.717 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.717+0000 7f0a18a00640 1 -- 172.21.15.73:0/286876338 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a04031580 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.717 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.717+0000 7f0a18a00640 1 -- 172.21.15.73:0/286876338 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04031910 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.717 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.717+0000 7f0a1b200640 1 -- 172.21.15.73:0/286876338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 msgr2=0x7f0a1c0c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:52.718 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.717+0000 7f0a1b200640 1 --2- 172.21.15.73:0/286876338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c0c6400 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0a040097d0 tx=0x7f0a0402b8a0 comp rx=0 tx=0).stop 2024-03-23T06:09:52.718 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.718+0000 7f0a1b200640 1 -- 172.21.15.73:0/286876338 shutdown_connections 2024-03-23T06:09:52.718 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.718+0000 7f0a1b200640 1 --2- 172.21.15.73:0/286876338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c0c6400 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:52.718 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.718+0000 7f0a1b200640 1 -- 172.21.15.73:0/286876338 >> 172.21.15.73:0/286876338 conn(0x7f0a1c069cb0 msgr2=0x7f0a1c06a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:52.718 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.718+0000 7f0a1b200640 1 -- 172.21.15.73:0/286876338 shutdown_connections 2024-03-23T06:09:52.718 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.718+0000 7f0a1b200640 1 -- 172.21.15.73:0/286876338 wait complete. 2024-03-23T06:09:52.719 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.719+0000 7f0a1b200640 1 Processor -- start 2024-03-23T06:09:52.719 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.719+0000 7f0a1b200640 1 -- start start 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.720+0000 7f0a1b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.720+0000 7f0a1b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a1c0c7e60 0x7f0a1c0c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.720+0000 7f0a1b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c1501d0 0x7f0a1c1f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.720+0000 7f0a1b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c153540 con 0x7f0a1c0c7e60 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.720+0000 7f0a1b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c151050 con 0x7f0a1c1501d0 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.720+0000 7f0a1b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c151f80 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a1c0c7e60 0x7f0a1c0c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a1a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c1501d0 0x7f0a1c1f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:58138/0 (socket says 172.21.15.73:58138) 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19e00640 1 -- 172.21.15.73:0/2168196623 learned_addr learned my addr 172.21.15.73:0/2168196623 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:52.722 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a1a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c1501d0 0x7f0a1c1f1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:60264/0 (socket says 172.21.15.73:60264) 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19e00640 1 -- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c1501d0 msgr2=0x7f0a1c1f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19e00640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c1501d0 0x7f0a1c1f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19e00640 1 -- 172.21.15.73:0/2168196623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a1c0c7e60 msgr2=0x7f0a1c0c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19e00640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a1c0c7e60 0x7f0a1c0c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.721+0000 7f0a19e00640 1 -- 172.21.15.73:0/2168196623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009400 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.722+0000 7f0a19e00640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c151a40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00c780 tx=0x7f0a0c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.722+0000 7f0a12000640 1 -- 172.21.15.73:0/2168196623 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c005ad0 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.722+0000 7f0a12000640 1 -- 172.21.15.73:0/2168196623 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c005c50 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.722+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c150d70 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.722+0000 7f0a12000640 1 -- 172.21.15.73:0/2168196623 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c007070 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.723 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.722+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c152a60 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.724 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.723+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c074580 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.724 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.724+0000 7f0a12000640 1 -- 172.21.15.73:0/2168196623 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0a0c0071d0 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.724 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.725+0000 7f0a12000640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f09f806ac00 0x7f09f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:52.725 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.725+0000 7f0a12000640 1 -- 172.21.15.73:0/2168196623 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a0c0886e0 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.725 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.725+0000 7f0a19400640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f09f806ac00 0x7f09f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:52.725 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.726+0000 7f0a19400640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f09f806ac00 0x7f09f806d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a04036000 tx=0x7f0a0403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:52.729 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.730+0000 7f0a12000640 1 -- 172.21.15.73:0/2168196623 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0a0c053c10 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.922 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.923+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a1c066ab0 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.924 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.924+0000 7f0a12000640 1 -- 172.21.15.73:0/2168196623 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f0a0c017020 con 0x7f0a1c0c3f60 2024-03-23T06:09:52.924 INFO:teuthology.misc.health.smithi073.stdout: 2024-03-23T06:09:52.924 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":17,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:09:49.045962+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:09:52.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f09f806ac00 msgr2=0x7f09f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:52.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f09f806ac00 0x7f09f806d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a04036000 tx=0x7f0a0403d040 comp rx=0 tx=0).stop 2024-03-23T06:09:52.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 msgr2=0x7f0a1c151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c151a40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00c780 tx=0x7f0a0c00cc40 comp rx=0 tx=0).stop 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 shutdown_connections 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a1c1501d0 0x7f0a1c1f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a1c0c7e60 0x7f0a1c0c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f09f806ac00 0x7f09f806d0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 --2- 172.21.15.73:0/2168196623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a1c0c3f60 0x7f0a1c151a40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 >> 172.21.15.73:0/2168196623 conn(0x7f0a1c069cb0 msgr2=0x7f0a1c0c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.927+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 shutdown_connections 2024-03-23T06:09:52.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-23T06:09:52.928+0000 7f0a1b200640 1 -- 172.21.15.73:0/2168196623 wait complete. 2024-03-23T06:09:52.942 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-23T06:09:52.942 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-23T06:09:52.943 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-23T06:09:52.943 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-23T06:09:52.947 INFO:tasks.ceph.mds.a:Started 2024-03-23T06:09:52.948 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-23T06:09:52.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-23T06:09:52.953 INFO:tasks.ceph.mds.c:Started 2024-03-23T06:09:52.953 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-23T06:09:52.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-03-23T06:09:52.959 INFO:tasks.ceph.mds.e:Started 2024-03-23T06:09:52.959 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-23T06:09:52.959 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-23T06:09:52.961 INFO:tasks.ceph.mds.b:Started 2024-03-23T06:09:52.962 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-23T06:09:52.962 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-23T06:09:52.964 INFO:tasks.ceph.mds.d:Started 2024-03-23T06:09:52.964 INFO:tasks.ceph.mds.f:Restarting daemon 2024-03-23T06:09:52.964 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-03-23T06:09:52.966 INFO:tasks.ceph.mds.f:Started 2024-03-23T06:09:52.966 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-23T06:09:52.967 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:09:53.048 INFO:tasks.ceph.mds.f.smithi110.stdout:starting mds.f at 2024-03-23T06:09:53.048 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-03-23T06:09:53.049 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-03-23T06:09:53.102 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-03-23T06:09:53.109 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-03-23T06:09:53.113 INFO:tasks.ceph.mds.e.smithi073.stdout:starting mds.e at 2024-03-23T06:09:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.150+0000 7f95e7600640 1 Processor -- start 2024-03-23T06:09:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.150+0000 7f95e7600640 1 -- start start 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.151+0000 7f95e7600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95e0153a80 0x7f95e00cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.151+0000 7f95e7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 0x7f95e00cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.151+0000 7f95e7600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e01599a0 con 0x7f95e01536a0 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.151+0000 7f95e7600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e015a520 con 0x7f95e0153a80 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.151+0000 7f95e7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e0159c80 con 0x7f95e01594f0 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95e4c00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f95e01536a0 0x7f95e00ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48996/0 (socket says 172.21.15.73:48996) 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95e4c00640 1 -- 172.21.15.73:0/4260241706 learned_addr learned my addr 172.21.15.73:0/4260241706 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95dfe00640 1 --2- 172.21.15.73:0/4260241706 >> v2:172.21.15.73:3300/0 conn(0x7f95e0153a80 0x7f95e00cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95e5600640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 0x7f95e00cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374825015 0 0) 0x7f95e01599a0 con 0x7f95e01536a0 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c8003520 con 0x7f95e01536a0 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1540447001 0 0) 0x7f95c8003520 con 0x7f95e01536a0 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 msgr2=0x7f95e00cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 0x7f95e00cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 >> v2:172.21.15.73:3300/0 conn(0x7f95e0153a80 msgr2=0x7f95e00cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 --2- 172.21.15.73:0/4260241706 >> v2:172.21.15.73:3300/0 conn(0x7f95e0153a80 0x7f95e00cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0159f60 con 0x7f95e01536a0 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f95d4001670 con 0x7f95e01536a0 2024-03-23T06:09:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 >> v1:172.21.15.110:6789/0 conn(0x7f95e01536a0 legacy=0x7f95e00ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 0x7f95c8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c8003f40 0x7f95c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95c8004d00 0x7f95c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e015a520 con 0x7f95c8004d00 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e0159c80 con 0x7f95c8003f40 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c800b980 con 0x7f95e01594f0 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.152+0000 7f95e4c00640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 0x7f95c8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.153+0000 7f95dfe00640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c8003f40 0x7f95c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.153+0000 7f95e5600640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95c8004d00 0x7f95c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.153+0000 7f95e4c00640 1 -- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c8003f40 msgr2=0x7f95c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.153+0000 7f95e4c00640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c8003f40 0x7f95c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.153+0000 7f95e4c00640 1 -- 172.21.15.73:0/4260241706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95c8004d00 msgr2=0x7f95c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.153+0000 7f95e4c00640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95c8004d00 0x7f95c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.153+0000 7f95e4c00640 1 -- 172.21.15.73:0/4260241706 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8003520 con 0x7f95e01594f0 2024-03-23T06:09:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.154+0000 7f95e4c00640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 0x7f95c8003970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c190 tx=0x7f95c80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d128ec5b66ca8bfc server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.154+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4005ad0 con 0x7f95e01594f0 2024-03-23T06:09:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.154+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d4005c50 con 0x7f95e01594f0 2024-03-23T06:09:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.154+0000 7f95df400640 1 -- 172.21.15.73:0/4260241706 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d402c810 con 0x7f95e01594f0 2024-03-23T06:09:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.155+0000 7f95e7600640 1 -- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 msgr2=0x7f95c8003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.155+0000 7f95e7600640 1 --2- 172.21.15.73:0/4260241706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e01594f0 0x7f95c8003970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c190 tx=0x7f95c80057f0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.155+0000 7f95e5600640 1 -- 172.21.15.73:0/4260241706 reap_dead start 2024-03-23T06:09:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.155+0000 7f95e7600640 1 -- 172.21.15.73:0/4260241706 shutdown_connections 2024-03-23T06:09:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.155+0000 7f95e7600640 1 -- 172.21.15.73:0/4260241706 >> 172.21.15.73:0/4260241706 conn(0x7f95e006a060 msgr2=0x7f95e006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.155+0000 7f95e7600640 1 -- 172.21.15.73:0/4260241706 shutdown_connections 2024-03-23T06:09:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.155+0000 7f95e7600640 1 -- 172.21.15.73:0/4260241706 wait complete. 2024-03-23T06:09:53.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.156+0000 7f95e7600640 1 Processor -- start 2024-03-23T06:09:53.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.156+0000 7f95e7600640 1 -- start start 2024-03-23T06:09:53.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.157+0000 7f95e7600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95e01594f0 0x7f95e00c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.157+0000 7f95e7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e0154610 0x7f95e014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.157+0000 7f95e7600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95e01ee210 0x7f95e01ee690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.157+0000 7f95e7600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e014fac0 con 0x7f95e01594f0 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.157+0000 7f95e7600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e014dee0 con 0x7f95e01ee210 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.157+0000 7f95e7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e0154ca0 con 0x7f95e0154610 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95e01594f0 0x7f95e00c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95e01594f0 0x7f95e00c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50322/0 (socket says 172.21.15.73:50322) 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 -- 172.21.15.73:0/1768633513 learned_addr learned my addr 172.21.15.73:0/1768633513 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95dfe00640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e0154610 0x7f95e014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e5600640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95e01ee210 0x7f95e01ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 -- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e0154610 msgr2=0x7f95e014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e0154610 0x7f95e014e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 -- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95e01ee210 msgr2=0x7f95e01ee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95e01ee210 0x7f95e01ee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 -- 172.21.15.73:0/1768633513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e014f660 con 0x7f95e01594f0 2024-03-23T06:09:53.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95e4c00640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95e01594f0 0x7f95e00c8e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c190 tx=0x7f95d4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:53.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.158+0000 7f95dcc00640 1 -- 172.21.15.73:0/1768633513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4039070 con 0x7f95e01594f0 2024-03-23T06:09:53.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.159+0000 7f95dcc00640 1 -- 172.21.15.73:0/1768633513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d402cc20 con 0x7f95e01594f0 2024-03-23T06:09:53.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.159+0000 7f95dcc00640 1 -- 172.21.15.73:0/1768633513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d403c040 con 0x7f95e01594f0 2024-03-23T06:09:53.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.159+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e014fd10 con 0x7f95e01594f0 2024-03-23T06:09:53.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.159+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e014e130 con 0x7f95e01594f0 2024-03-23T06:09:53.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.160+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e014e2f0 con 0x7f95e01594f0 2024-03-23T06:09:53.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.161+0000 7f95dcc00640 1 -- 172.21.15.73:0/1768633513 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f95d4032070 con 0x7f95e01594f0 2024-03-23T06:09:53.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.162+0000 7f95dcc00640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95c006ac00 0x7f95c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.162+0000 7f95dcc00640 1 -- 172.21.15.73:0/1768633513 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f95d40aabd0 con 0x7f95e01594f0 2024-03-23T06:09:53.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.163+0000 7f95dfe00640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95c006ac00 0x7f95c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.163+0000 7f95dfe00640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95c006ac00 0x7f95c006d0c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f95e0158be0 tx=0x7f95cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:53.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.167+0000 7f95dcc00640 1 -- 172.21.15.73:0/1768633513 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f95d4076400 con 0x7f95e01594f0 2024-03-23T06:09:53.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.348+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95e00c9810 con 0x7f95e01594f0 2024-03-23T06:09:53.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.349+0000 7f95dcc00640 1 -- 172.21.15.73:0/1768633513 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f95d404f020 con 0x7f95e01594f0 2024-03-23T06:09:53.350 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:09:53.350 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:09:49.045962+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:09:53.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95c006ac00 msgr2=0x7f95c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95c006ac00 0x7f95c006d0c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f95e0158be0 tx=0x7f95cc008040 comp rx=0 tx=0).stop 2024-03-23T06:09:53.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95e01594f0 msgr2=0x7f95e00c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95e01594f0 0x7f95e00c8e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c190 tx=0x7f95d4001930 comp rx=0 tx=0).stop 2024-03-23T06:09:53.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 shutdown_connections 2024-03-23T06:09:53.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95e01ee210 0x7f95e01ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95c006ac00 0x7f95c006d0c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95e0154610 0x7f95e014e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 --2- 172.21.15.73:0/1768633513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95e01594f0 0x7f95e00c8e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 >> 172.21.15.73:0/1768633513 conn(0x7f95e006a060 msgr2=0x7f95e00c3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:53.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.352+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 shutdown_connections 2024-03-23T06:09:53.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.353+0000 7f95e7600640 1 -- 172.21.15.73:0/1768633513 wait complete. 2024-03-23T06:09:53.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T06:09:53.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:09:53.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.569+0000 7fcd1da00640 1 Processor -- start 2024-03-23T06:09:53.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.569+0000 7fcd1da00640 1 -- start start 2024-03-23T06:09:53.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.570+0000 7fcd1da00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd18157e60 0x7fcd18071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.570+0000 7fcd1da00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18072090 0x7fcd18158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.570+0000 7fcd1da00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1815b710 con 0x7fcd18151480 2024-03-23T06:09:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.570+0000 7fcd1da00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd181588d0 con 0x7fcd18157e60 2024-03-23T06:09:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.570+0000 7fcd1da00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd181582d0 con 0x7fcd18072090 2024-03-23T06:09:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd16a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcd18151480 0x7fcd180c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45664/0 (socket says 172.21.15.73:45664) 2024-03-23T06:09:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd16a00640 1 -- 172.21.15.73:0/3617477114 learned_addr learned my addr 172.21.15.73:0/3617477114 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd0fe00640 1 --2- 172.21.15.73:0/3617477114 >> v2:172.21.15.110:3300/0 conn(0x7fcd18157e60 0x7fcd18071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd17400640 1 --2- 172.21.15.73:0/3617477114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18072090 0x7fcd18158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd16000640 1 -- 172.21.15.73:0/3617477114 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624499969 0 0) 0x7fcd1815b710 con 0x7fcd18151480 2024-03-23T06:09:53.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd16000640 1 -- 172.21.15.73:0/3617477114 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccfc003520 con 0x7fcd18151480 2024-03-23T06:09:53.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd17400640 1 -- 172.21.15.73:0/3617477114 >> v2:172.21.15.110:3300/0 conn(0x7fcd18157e60 msgr2=0x7fcd18071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:53.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd17400640 1 --2- 172.21.15.73:0/3617477114 >> v2:172.21.15.110:3300/0 conn(0x7fcd18157e60 0x7fcd18071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd17400640 1 -- 172.21.15.73:0/3617477114 >> v1:172.21.15.73:6789/0 conn(0x7fcd18151480 legacy=0x7fcd180c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.571+0000 7fcd17400640 1 -- 172.21.15.73:0/3617477114 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1815ab90 con 0x7fcd18072090 2024-03-23T06:09:53.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.572+0000 7fcd17400640 1 --2- 172.21.15.73:0/3617477114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18072090 0x7fcd18158cf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009d90 tx=0x7fcd1002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57206a3cc5fa54f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:53.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.573+0000 7fcd16000640 1 -- 172.21.15.73:0/3617477114 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1002cce0 con 0x7fcd18072090 2024-03-23T06:09:53.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.573+0000 7fcd16000640 1 -- 172.21.15.73:0/3617477114 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1002ce40 con 0x7fcd18072090 2024-03-23T06:09:53.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.573+0000 7fcd16000640 1 -- 172.21.15.73:0/3617477114 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10034660 con 0x7fcd18072090 2024-03-23T06:09:53.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.573+0000 7fcd1da00640 1 -- 172.21.15.73:0/3617477114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18072090 msgr2=0x7fcd18158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.573+0000 7fcd1da00640 1 --2- 172.21.15.73:0/3617477114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18072090 0x7fcd18158cf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009d90 tx=0x7fcd1002bf30 comp rx=0 tx=0).stop 2024-03-23T06:09:53.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.573+0000 7fcd1da00640 1 -- 172.21.15.73:0/3617477114 shutdown_connections 2024-03-23T06:09:53.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.574+0000 7fcd1da00640 1 --2- 172.21.15.73:0/3617477114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18072090 0x7fcd18158cf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.574+0000 7fcd1da00640 1 --2- 172.21.15.73:0/3617477114 >> v2:172.21.15.110:3300/0 conn(0x7fcd18157e60 0x7fcd18071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.574+0000 7fcd1da00640 1 -- 172.21.15.73:0/3617477114 >> 172.21.15.73:0/3617477114 conn(0x7fcd18069cb0 msgr2=0x7fcd1806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:53.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.574+0000 7fcd1da00640 1 -- 172.21.15.73:0/3617477114 shutdown_connections 2024-03-23T06:09:53.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.574+0000 7fcd1da00640 1 -- 172.21.15.73:0/3617477114 wait complete. 2024-03-23T06:09:53.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.575+0000 7fcd1da00640 1 Processor -- start 2024-03-23T06:09:53.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.575+0000 7fcd1da00640 1 -- start start 2024-03-23T06:09:53.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.576+0000 7fcd1da00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd18072090 0x7fcd181ef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.576+0000 7fcd1da00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18151480 0x7fcd1806bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.576+0000 7fcd1da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18157e60 0x7fcd180c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.576+0000 7fcd1da00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd180c9730 con 0x7fcd18072090 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.576+0000 7fcd1da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd180c22e0 con 0x7fcd18157e60 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.576+0000 7fcd1da00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd181efce0 con 0x7fcd18151480 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd18072090 0x7fcd181ef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd18072090 0x7fcd181ef7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50330/0 (socket says 172.21.15.73:50330) 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 -- 172.21.15.73:0/2030382228 learned_addr learned my addr 172.21.15.73:0/2030382228 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd0fe00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18151480 0x7fcd1806bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd17400640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18157e60 0x7fcd180c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 -- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18151480 msgr2=0x7fcd1806bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18151480 0x7fcd1806bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 -- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18157e60 msgr2=0x7fcd180c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18157e60 0x7fcd180c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 -- 172.21.15.73:0/2030382228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10009a70 con 0x7fcd18072090 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd0fe00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18151480 0x7fcd1806bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.577+0000 7fcd16a00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd18072090 0x7fcd181ef7a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800c530 tx=0x7fcd0800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.578+0000 7fcd0ea00640 1 -- 172.21.15.73:0/2030382228 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd08005ce0 con 0x7fcd18072090 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.578+0000 7fcd0ea00640 1 -- 172.21.15.73:0/2030382228 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08005e40 con 0x7fcd18072090 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.578+0000 7fcd0ea00640 1 -- 172.21.15.73:0/2030382228 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd080072b0 con 0x7fcd18072090 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.578+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd180c2510 con 0x7fcd18072090 2024-03-23T06:09:53.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.578+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd180c8d90 con 0x7fcd18072090 2024-03-23T06:09:53.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.579+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd18150d30 con 0x7fcd18072090 2024-03-23T06:09:53.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.580+0000 7fcd0ea00640 1 -- 172.21.15.73:0/2030382228 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcd08007410 con 0x7fcd18072090 2024-03-23T06:09:53.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.581+0000 7fcd0ea00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fccf406ac30 0x7fccf406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.581+0000 7fcd0ea00640 1 -- 172.21.15.73:0/2030382228 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd080885b0 con 0x7fcd18072090 2024-03-23T06:09:53.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.581+0000 7fcd0fe00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fccf406ac30 0x7fccf406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.582+0000 7fcd0fe00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fccf406ac30 0x7fccf406d0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcd1806c730 tx=0x7fcd00009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:53.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.585+0000 7fcd0ea00640 1 -- 172.21.15.73:0/2030382228 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fcd08053bb0 con 0x7fcd18072090 2024-03-23T06:09:53.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.779+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd180cb720 con 0x7fcd18072090 2024-03-23T06:09:53.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.780+0000 7fcd0ea00640 1 -- 172.21.15.73:0/2030382228 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd080170a0 con 0x7fcd18072090 2024-03-23T06:09:53.780 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:09:53.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fccf406ac30 msgr2=0x7fccf406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fccf406ac30 0x7fccf406d0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcd1806c730 tx=0x7fcd00009190 comp rx=0 tx=0).stop 2024-03-23T06:09:53.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd18072090 msgr2=0x7fcd181ef7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd18072090 0x7fcd181ef7a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800c530 tx=0x7fcd0800c9f0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 shutdown_connections 2024-03-23T06:09:53.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd18157e60 0x7fcd180c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fccf406ac30 0x7fccf406d0f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd18151480 0x7fcd1806bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 --2- 172.21.15.73:0/2030382228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd18072090 0x7fcd181ef7a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 >> 172.21.15.73:0/2030382228 conn(0x7fcd18069cb0 msgr2=0x7fcd180c0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:53.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 shutdown_connections 2024-03-23T06:09:53.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.782+0000 7fcd1da00640 1 -- 172.21.15.73:0/2030382228 wait complete. 2024-03-23T06:09:53.798 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:09:53.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.995+0000 7f60e9200640 1 Processor -- start 2024-03-23T06:09:53.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.995+0000 7f60e9200640 1 -- start start 2024-03-23T06:09:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e9200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60e406f8b0 0x7f60e41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e9200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e40c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e9200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e41583a0 con 0x7f60e406fc90 2024-03-23T06:09:53.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e9200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e4157920 con 0x7f60e406f8b0 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e9200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4157b00 con 0x7f60e40c7580 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e1400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f60e406fc90 0x7f60e415b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45674/0 (socket says 172.21.15.73:45674) 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e1400640 1 -- 172.21.15.73:0/3653564670 learned_addr learned my addr 172.21.15.73:0/3653564670 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e1e00640 1 --2- 172.21.15.73:0/3653564670 >> v2:172.21.15.110:3300/0 conn(0x7f60e406f8b0 0x7f60e41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.997+0000 7f60e2800640 1 --2- 172.21.15.73:0/3653564670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e40c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.998+0000 7f60e1e00640 1 -- 172.21.15.73:0/3653564670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 msgr2=0x7f60e40c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.998+0000 7f60e1e00640 1 --2- 172.21.15.73:0/3653564670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e40c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.998+0000 7f60e1e00640 1 -- 172.21.15.73:0/3653564670 >> v1:172.21.15.73:6789/0 conn(0x7f60e406fc90 legacy=0x7f60e415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.998+0000 7f60e1e00640 1 -- 172.21.15.73:0/3653564670 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4157de0 con 0x7f60e406f8b0 2024-03-23T06:09:53.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.998+0000 7f60e0a00640 1 -- 172.21.15.73:0/3653564670 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956575578 0 0) 0x7f60d0001110 con 0x7f60e406fc90 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.999+0000 7f60e1e00640 1 --2- 172.21.15.73:0/3653564670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 0x7f60e41573e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60d40097a0 tx=0x7f60d402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c5a8956c674fff3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.999+0000 7f60e0a00640 1 -- 172.21.15.73:0/3653564670 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4030610 con 0x7f60e406f8b0 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.999+0000 7f60e0a00640 1 -- 172.21.15.73:0/3653564670 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d4030770 con 0x7f60e406f8b0 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.999+0000 7f60e0a00640 1 -- 172.21.15.73:0/3653564670 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d4030b00 con 0x7f60e406f8b0 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.999+0000 7f60e9200640 1 -- 172.21.15.73:0/3653564670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 msgr2=0x7f60e41573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.999+0000 7f60e9200640 1 --2- 172.21.15.73:0/3653564670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 0x7f60e41573e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f60d40097a0 tx=0x7f60d402b960 comp rx=0 tx=0).stop 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.999+0000 7f60e9200640 1 -- 172.21.15.73:0/3653564670 shutdown_connections 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:53.999+0000 7f60e9200640 1 --2- 172.21.15.73:0/3653564670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e40c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.000+0000 7f60e9200640 1 --2- 172.21.15.73:0/3653564670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 0x7f60e41573e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.000+0000 7f60e9200640 1 -- 172.21.15.73:0/3653564670 >> 172.21.15.73:0/3653564670 conn(0x7f60e406a0a0 msgr2=0x7f60e4071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.000+0000 7f60e9200640 1 -- 172.21.15.73:0/3653564670 shutdown_connections 2024-03-23T06:09:54.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.000+0000 7f60e9200640 1 -- 172.21.15.73:0/3653564670 wait complete. 2024-03-23T06:09:54.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.001+0000 7f60e9200640 1 Processor -- start 2024-03-23T06:09:54.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.001+0000 7f60e9200640 1 -- start start 2024-03-23T06:09:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e9200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 0x7f60e40ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e406fc90 0x7f60e4149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e9200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e4149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e9200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40cc010 con 0x7f60e406fc90 2024-03-23T06:09:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e9200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40cc520 con 0x7f60e406f8b0 2024-03-23T06:09:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e9200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e414f710 con 0x7f60e40c7580 2024-03-23T06:09:54.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e406fc90 0x7f60e4149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e406fc90 0x7f60e4149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50332/0 (socket says 172.21.15.73:50332) 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e1400640 1 -- 172.21.15.73:0/4030975453 learned_addr learned my addr 172.21.15.73:0/4030975453 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e1e00640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 0x7f60e40ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.002+0000 7f60e2800640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e4149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60e2800640 1 -- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 msgr2=0x7f60e40ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60e2800640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 0x7f60e40ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60e2800640 1 -- 172.21.15.73:0/4030975453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e406fc90 msgr2=0x7f60e4149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60e2800640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e406fc90 0x7f60e4149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60e2800640 1 -- 172.21.15.73:0/4030975453 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4009400 con 0x7f60e40c7580 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60e1400640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e406fc90 0x7f60e4149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60e2800640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e4149cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00eb70 tx=0x7f60dc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60da000640 1 -- 172.21.15.73:0/4030975453 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc00cd20 con 0x7f60e40c7580 2024-03-23T06:09:54.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60da000640 1 -- 172.21.15.73:0/4030975453 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00f040 con 0x7f60e40c7580 2024-03-23T06:09:54.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60da000640 1 -- 172.21.15.73:0/4030975453 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0146c0 con 0x7f60e40c7580 2024-03-23T06:09:54.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.003+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e414f970 con 0x7f60e40c7580 2024-03-23T06:09:54.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.004+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e40c5470 con 0x7f60e40c7580 2024-03-23T06:09:54.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.005+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e4067060 con 0x7f60e40c7580 2024-03-23T06:09:54.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.006+0000 7f60da000640 1 -- 172.21.15.73:0/4030975453 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f60dc014820 con 0x7f60e40c7580 2024-03-23T06:09:54.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.006+0000 7f60da000640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f60c406ac00 0x7f60c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.007+0000 7f60da000640 1 -- 172.21.15.73:0/4030975453 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f60dc089cb0 con 0x7f60e40c7580 2024-03-23T06:09:54.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.007+0000 7f60e1e00640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f60c406ac00 0x7f60c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.007+0000 7f60e1e00640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f60c406ac00 0x7f60c406d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f60d4036000 tx=0x7f60d4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.011+0000 7f60da000640 1 -- 172.21.15.73:0/4030975453 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f60dc0551e0 con 0x7f60e40c7580 2024-03-23T06:09:54.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.243+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e40cc660 con 0x7f60e40c7580 2024-03-23T06:09:54.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.244+0000 7f60da000640 1 -- 172.21.15.73:0/4030975453 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5039 (secure 0 0 0) 0x7f60dc018070 con 0x7f60e40c7580 2024-03-23T06:09:54.244 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:09:54.245 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-03-23T06:09:54.245 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2024-03-23T06:09:54.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f60c406ac00 msgr2=0x7f60c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f60c406ac00 0x7f60c406d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f60d4036000 tx=0x7f60d4008030 comp rx=0 tx=0).stop 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 msgr2=0x7f60e4149cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e4149cd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00eb70 tx=0x7f60dc00c490 comp rx=0 tx=0).stop 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 shutdown_connections 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f60c406ac00 0x7f60c406d0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40c7580 0x7f60e4149cd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60e406fc90 0x7f60e4149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 --2- 172.21.15.73:0/4030975453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e406f8b0 0x7f60e40ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 >> 172.21.15.73:0/4030975453 conn(0x7f60e406a0a0 msgr2=0x7f60e40c1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 shutdown_connections 2024-03-23T06:09:54.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.247+0000 7f60e9200640 1 -- 172.21.15.73:0/4030975453 wait complete. 2024-03-23T06:09:54.263 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:09:54.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.465+0000 7f612f000640 1 Processor -- start 2024-03-23T06:09:54.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.465+0000 7f612f000640 1 -- start start 2024-03-23T06:09:54.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.466+0000 7f612f000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61280c5a10 0x7f61280bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f612f000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61280c03a0 0x7f6128071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f612f000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6128157b60 con 0x7f61281513f0 2024-03-23T06:09:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f612f000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6128158dc0 con 0x7f61280c03a0 2024-03-23T06:09:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f612f000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280c0830 con 0x7f61280c5a10 2024-03-23T06:09:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f612d000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f61280c03a0 0x7f6128071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f6127400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61280c5a10 0x7f61280bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f6127e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f61281513f0 0x7f61281586b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48998/0 (socket says 172.21.15.73:48998) 2024-03-23T06:09:54.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f6127e00640 1 -- 172.21.15.73:0/1502157636 learned_addr learned my addr 172.21.15.73:0/1502157636 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f6127400640 1 -- 172.21.15.73:0/1502157636 >> v2:172.21.15.73:3300/0 conn(0x7f61280c03a0 msgr2=0x7f6128071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f6127400640 1 --2- 172.21.15.73:0/1502157636 >> v2:172.21.15.73:3300/0 conn(0x7f61280c03a0 0x7f6128071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f6127400640 1 -- 172.21.15.73:0/1502157636 >> v1:172.21.15.110:6789/0 conn(0x7f61281513f0 legacy=0x7f61281586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f6127400640 1 -- 172.21.15.73:0/1502157636 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280c0b10 con 0x7f61280c5a10 2024-03-23T06:09:54.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.467+0000 7f6126a00640 1 -- 172.21.15.73:0/1502157636 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341593594 0 0) 0x7f6128157b60 con 0x7f61281513f0 2024-03-23T06:09:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.469+0000 7f6127400640 1 --2- 172.21.15.73:0/1502157636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 0x7f61280bfe60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6128072880 tx=0x7f611402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cef4f2952b18b04 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.469+0000 7f6126a00640 1 -- 172.21.15.73:0/1502157636 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114030610 con 0x7f61280c5a10 2024-03-23T06:09:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.469+0000 7f6126a00640 1 -- 172.21.15.73:0/1502157636 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114030770 con 0x7f61280c5a10 2024-03-23T06:09:54.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.469+0000 7f6126a00640 1 -- 172.21.15.73:0/1502157636 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114030b00 con 0x7f61280c5a10 2024-03-23T06:09:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.470+0000 7f612f000640 1 -- 172.21.15.73:0/1502157636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 msgr2=0x7f61280bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.470+0000 7f612f000640 1 --2- 172.21.15.73:0/1502157636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 0x7f61280bfe60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6128072880 tx=0x7f611402b960 comp rx=0 tx=0).stop 2024-03-23T06:09:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.470+0000 7f612f000640 1 -- 172.21.15.73:0/1502157636 shutdown_connections 2024-03-23T06:09:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.470+0000 7f612f000640 1 --2- 172.21.15.73:0/1502157636 >> v2:172.21.15.73:3300/0 conn(0x7f61280c03a0 0x7f6128071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.470+0000 7f612f000640 1 --2- 172.21.15.73:0/1502157636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 0x7f61280bfe60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.470+0000 7f612f000640 1 -- 172.21.15.73:0/1502157636 >> 172.21.15.73:0/1502157636 conn(0x7f612806bb40 msgr2=0x7f612806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.470+0000 7f612f000640 1 -- 172.21.15.73:0/1502157636 shutdown_connections 2024-03-23T06:09:54.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.470+0000 7f612f000640 1 -- 172.21.15.73:0/1502157636 wait complete. 2024-03-23T06:09:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.471+0000 7f612f000640 1 Processor -- start 2024-03-23T06:09:54.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.472+0000 7f612f000640 1 -- start start 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.472+0000 7f612f000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 0x7f61281f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.472+0000 7f612f000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61281513f0 0x7f61281ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.472+0000 7f612f000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61281e17a0 0x7f6128071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.472+0000 7f612f000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61280c8d30 con 0x7f61281513f0 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.472+0000 7f612f000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61281f0710 con 0x7f61280c5a10 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.472+0000 7f612f000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61281f0100 con 0x7f61281e17a0 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61281513f0 0x7f61281ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 0x7f61281f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61281513f0 0x7f61281ecaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50340/0 (socket says 172.21.15.73:50340) 2024-03-23T06:09:54.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127400640 1 -- 172.21.15.73:0/4206995498 learned_addr learned my addr 172.21.15.73:0/4206995498 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f612d000640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61281e17a0 0x7f6128071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127400640 1 -- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61281e17a0 msgr2=0x7f6128071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127400640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61281e17a0 0x7f6128071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127400640 1 -- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 msgr2=0x7f61281f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127400640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 0x7f61281f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127400640 1 -- 172.21.15.73:0/4206995498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6114009400 con 0x7f61281513f0 2024-03-23T06:09:54.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.473+0000 7f6127e00640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 0x7f61281f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:54.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.474+0000 7f6127400640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61281513f0 0x7f61281ecaf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6114009890 tx=0x7f61140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.474+0000 7f611fe00640 1 -- 172.21.15.73:0/4206995498 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611403e070 con 0x7f61281513f0 2024-03-23T06:09:54.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.474+0000 7f611fe00640 1 -- 172.21.15.73:0/4206995498 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114030e10 con 0x7f61281513f0 2024-03-23T06:09:54.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.474+0000 7f611fe00640 1 -- 172.21.15.73:0/4206995498 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114039c30 con 0x7f61281513f0 2024-03-23T06:09:54.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.474+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61280c8f40 con 0x7f61281513f0 2024-03-23T06:09:54.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.474+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61281f03a0 con 0x7f61281513f0 2024-03-23T06:09:54.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.475+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61281577b0 con 0x7f61281513f0 2024-03-23T06:09:54.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.476+0000 7f611fe00640 1 -- 172.21.15.73:0/4206995498 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f61140423f0 con 0x7f61281513f0 2024-03-23T06:09:54.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.477+0000 7f611fe00640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.477+0000 7f611fe00640 1 -- 172.21.15.73:0/4206995498 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f61140aac40 con 0x7f61281513f0 2024-03-23T06:09:54.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.477+0000 7f6127e00640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.478+0000 7f6127e00640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f610806ac00 0x7f610806d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6118000f60 tx=0x7f6118007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.482+0000 7f611fe00640 1 -- 172.21.15.73:0/4206995498 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f61140760f0 con 0x7f61281513f0 2024-03-23T06:09:54.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.675+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61280bfe60 con 0x7f61281513f0 2024-03-23T06:09:54.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.677+0000 7f611fe00640 1 -- 172.21.15.73:0/4206995498 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f6114034020 con 0x7f61281513f0 2024-03-23T06:09:54.677 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:09:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:09:49.045962+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:09:54.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f610806ac00 msgr2=0x7f610806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f610806ac00 0x7f610806d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6118000f60 tx=0x7f6118007d50 comp rx=0 tx=0).stop 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61281513f0 msgr2=0x7f61281ecaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61281513f0 0x7f61281ecaf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6114009890 tx=0x7f61140046c0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 shutdown_connections 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61281e17a0 0x7f6128071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61281513f0 0x7f61281ecaf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 --2- 172.21.15.73:0/4206995498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61280c5a10 0x7f61281f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 >> 172.21.15.73:0/4206995498 conn(0x7f612806bb40 msgr2=0x7f6128150020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.679+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 shutdown_connections 2024-03-23T06:09:54.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.680+0000 7f612f000640 1 -- 172.21.15.73:0/4206995498 wait complete. 2024-03-23T06:09:54.697 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-23T06:09:54.697 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:09:54.890 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:09:54.898 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:09:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.910+0000 7f6f6b000640 1 Processor -- start 2024-03-23T06:09:54.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.911+0000 7f6f6b000640 1 -- start start 2024-03-23T06:09:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f6b000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640ca7d0 0x7f6f640cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f6b000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f640b1c40 0x7f6f64163e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f6b000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f640b2460 con 0x7f6f641537b0 2024-03-23T06:09:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f6b000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f640ca140 con 0x7f6f640b1c40 2024-03-23T06:09:54.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f6b000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6415a4b0 con 0x7f6f640ca7d0 2024-03-23T06:09:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f69000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f640b1c40 0x7f6f64163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f5b400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6f641537b0 0x7f6f6406a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45680/0 (socket says 172.21.15.73:45680) 2024-03-23T06:09:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f5b400640 1 -- 172.21.15.73:0/3975629124 learned_addr learned my addr 172.21.15.73:0/3975629124 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.912+0000 7f6f69000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f640b1c40 0x7f6f64163e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50348/0 (socket says 172.21.15.73:50348) 2024-03-23T06:09:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.913+0000 7f6f63e00640 1 --2- 172.21.15.73:0/3975629124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640ca7d0 0x7f6f640cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.913+0000 7f6f69000640 1 -- 172.21.15.73:0/3975629124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640ca7d0 msgr2=0x7f6f640cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:54.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.913+0000 7f6f69000640 1 --2- 172.21.15.73:0/3975629124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640ca7d0 0x7f6f640cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.913+0000 7f6f69000640 1 -- 172.21.15.73:0/3975629124 >> v1:172.21.15.73:6789/0 conn(0x7f6f641537b0 legacy=0x7f6f6406a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.913+0000 7f6f69000640 1 -- 172.21.15.73:0/3975629124 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f640c9e60 con 0x7f6f640b1c40 2024-03-23T06:09:54.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.913+0000 7f6f63400640 1 -- 172.21.15.73:0/3975629124 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509361171 0 0) 0x7f6f54001110 con 0x7f6f641537b0 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.914+0000 7f6f69000640 1 --2- 172.21.15.73:0/3975629124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f640b1c40 0x7f6f64163e60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009d90 tx=0x7f6f5c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ad07974cea3773 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.914+0000 7f6f63400640 1 -- 172.21.15.73:0/3975629124 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c02cbc0 con 0x7f6f640b1c40 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f63400640 1 -- 172.21.15.73:0/3975629124 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c02cd20 con 0x7f6f640b1c40 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f63400640 1 -- 172.21.15.73:0/3975629124 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c034660 con 0x7f6f640b1c40 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f6b000640 1 -- 172.21.15.73:0/3975629124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f640b1c40 msgr2=0x7f6f64163e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f6b000640 1 --2- 172.21.15.73:0/3975629124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f640b1c40 0x7f6f64163e60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009d90 tx=0x7f6f5c02be10 comp rx=0 tx=0).stop 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f6b000640 1 -- 172.21.15.73:0/3975629124 shutdown_connections 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f6b000640 1 --2- 172.21.15.73:0/3975629124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f640b1c40 0x7f6f64163e60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f6b000640 1 --2- 172.21.15.73:0/3975629124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640ca7d0 0x7f6f640cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f6b000640 1 -- 172.21.15.73:0/3975629124 >> 172.21.15.73:0/3975629124 conn(0x7f6f64071800 msgr2=0x7f6f64071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:54.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f6b000640 1 -- 172.21.15.73:0/3975629124 shutdown_connections 2024-03-23T06:09:54.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.915+0000 7f6f6b000640 1 -- 172.21.15.73:0/3975629124 wait complete. 2024-03-23T06:09:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.917+0000 7f6f6b000640 1 Processor -- start 2024-03-23T06:09:54.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.917+0000 7f6f6b000640 1 -- start start 2024-03-23T06:09:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f6b000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640b1c40 0x7f6f6414eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f6b000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f640ca7d0 0x7f6f64142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f6b000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f641e52f0 0x7f6f64142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f6b000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641e41a0 con 0x7f6f641e52f0 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f6b000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641e28f0 con 0x7f6f640ca7d0 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f6b000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641e2eb0 con 0x7f6f640b1c40 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f69000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f641e52f0 0x7f6f64142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f69000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f641e52f0 0x7f6f64142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50364/0 (socket says 172.21.15.73:50364) 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.918+0000 7f6f69000640 1 -- 172.21.15.73:0/1887080758 learned_addr learned my addr 172.21.15.73:0/1887080758 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.919+0000 7f6f5b400640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f640ca7d0 0x7f6f64142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.919+0000 7f6f63e00640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640b1c40 0x7f6f6414eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.919+0000 7f6f69000640 1 -- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640b1c40 msgr2=0x7f6f6414eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.919+0000 7f6f69000640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640b1c40 0x7f6f6414eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.919+0000 7f6f69000640 1 -- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f640ca7d0 msgr2=0x7f6f64142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.919+0000 7f6f69000640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f640ca7d0 0x7f6f64142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.919+0000 7f6f69000640 1 -- 172.21.15.73:0/1887080758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c009a70 con 0x7f6f641e52f0 2024-03-23T06:09:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.919+0000 7f6f69000640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f641e52f0 0x7f6f64142b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009d90 tx=0x7f6f5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.920+0000 7f6f60c00640 1 -- 172.21.15.73:0/1887080758 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c040650 con 0x7f6f641e52f0 2024-03-23T06:09:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.920+0000 7f6f60c00640 1 -- 172.21.15.73:0/1887080758 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c02ce90 con 0x7f6f641e52f0 2024-03-23T06:09:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.920+0000 7f6f6b000640 1 -- 172.21.15.73:0/1887080758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f64149760 con 0x7f6f641e52f0 2024-03-23T06:09:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.920+0000 7f6f60c00640 1 -- 172.21.15.73:0/1887080758 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0409f0 con 0x7f6f641e52f0 2024-03-23T06:09:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.920+0000 7f6f6b000640 1 -- 172.21.15.73:0/1887080758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f641f0030 con 0x7f6f641e52f0 2024-03-23T06:09:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.921+0000 7f6f59600640 1 -- 172.21.15.73:0/1887080758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f34005250 con 0x7f6f641e52f0 2024-03-23T06:09:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.922+0000 7f6f60c00640 1 -- 172.21.15.73:0/1887080758 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6f5c040b50 con 0x7f6f641e52f0 2024-03-23T06:09:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.924+0000 7f6f60c00640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f4006ac30 0x7f6f4006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.924+0000 7f6f60c00640 1 -- 172.21.15.73:0/1887080758 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6f5c0abae0 con 0x7f6f641e52f0 2024-03-23T06:09:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.924+0000 7f6f63e00640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f4006ac30 0x7f6f4006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:54.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.925+0000 7f6f63e00640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f4006ac30 0x7f6f4006d0f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009b40 tx=0x7f6f4c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:54.928+0000 7f6f60c00640 1 -- 172.21.15.73:0/1887080758 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6f5c0771d0 con 0x7f6f641e52f0 2024-03-23T06:09:55.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.126+0000 7f6f59600640 1 -- 172.21.15.73:0/1887080758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f34005a80 con 0x7f6f641e52f0 2024-03-23T06:09:55.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.127+0000 7f6f60c00640 1 -- 172.21.15.73:0/1887080758 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f5c009450 con 0x7f6f641e52f0 2024-03-23T06:09:55.127 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:09:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 -- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f4006ac30 msgr2=0x7f6f4006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f4006ac30 0x7f6f4006d0f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009b40 tx=0x7f6f4c009190 comp rx=0 tx=0).stop 2024-03-23T06:09:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 -- 172.21.15.73:0/1887080758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f641e52f0 msgr2=0x7f6f64142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f641e52f0 0x7f6f64142b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009d90 tx=0x7f6f5c004a40 comp rx=0 tx=0).stop 2024-03-23T06:09:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 -- 172.21.15.73:0/1887080758 shutdown_connections 2024-03-23T06:09:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f641e52f0 0x7f6f64142b90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f640ca7d0 0x7f6f64142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f4006ac30 0x7f6f4006d0f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 --2- 172.21.15.73:0/1887080758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f640b1c40 0x7f6f6414eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 -- 172.21.15.73:0/1887080758 >> 172.21.15.73:0/1887080758 conn(0x7f6f64071800 msgr2=0x7f6f64151760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:55.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 -- 172.21.15.73:0/1887080758 shutdown_connections 2024-03-23T06:09:55.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.130+0000 7f6f59600640 1 -- 172.21.15.73:0/1887080758 wait complete. 2024-03-23T06:09:55.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-23T06:09:55.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.357+0000 7fdb85e00640 1 Processor -- start 2024-03-23T06:09:55.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.357+0000 7fdb85e00640 1 -- start start 2024-03-23T06:09:55.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb85e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb80153410 0x7fdb80159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb85e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb800c6f00 0x7fdb800bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb85e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb800c6320 con 0x7fdb800c03a0 2024-03-23T06:09:55.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb85e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8015a4a0 con 0x7fdb800c6f00 2024-03-23T06:09:55.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb85e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8006dfd0 con 0x7fdb80153410 2024-03-23T06:09:55.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb76000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb800c6f00 0x7fdb800bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb76000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb800c6f00 0x7fdb800bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50368/0 (socket says 172.21.15.73:50368) 2024-03-23T06:09:55.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb76000640 1 -- 172.21.15.73:0/4042991336 learned_addr learned my addr 172.21.15.73:0/4042991336 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:55.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.359+0000 7fdb7ea00640 1 --2- 172.21.15.73:0/4042991336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb80153410 0x7fdb80159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.360+0000 7fdb7ea00640 1 -- 172.21.15.73:0/4042991336 >> v2:172.21.15.73:3300/0 conn(0x7fdb800c6f00 msgr2=0x7fdb800bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:55.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.360+0000 7fdb7ea00640 1 --2- 172.21.15.73:0/4042991336 >> v2:172.21.15.73:3300/0 conn(0x7fdb800c6f00 0x7fdb800bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.360+0000 7fdb7ea00640 1 -- 172.21.15.73:0/4042991336 >> v1:172.21.15.110:6789/0 conn(0x7fdb800c03a0 legacy=0x7fdb800c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.360+0000 7fdb7ea00640 1 -- 172.21.15.73:0/4042991336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8006db40 con 0x7fdb80153410 2024-03-23T06:09:55.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.360+0000 7fdb76000640 1 --2- 172.21.15.73:0/4042991336 >> v2:172.21.15.73:3300/0 conn(0x7fdb800c6f00 0x7fdb800bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:55.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.360+0000 7fdb7e000640 1 -- 172.21.15.73:0/4042991336 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218956683 0 0) 0x7fdb800c6320 con 0x7fdb800c03a0 2024-03-23T06:09:55.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.361+0000 7fdb7ea00640 1 --2- 172.21.15.73:0/4042991336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb80153410 0x7fdb80159f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097a0 tx=0x7fdb7002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50755173ca9940a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:55.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.361+0000 7fdb7e000640 1 -- 172.21.15.73:0/4042991336 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70030800 con 0x7fdb80153410 2024-03-23T06:09:55.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.361+0000 7fdb7e000640 1 -- 172.21.15.73:0/4042991336 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70030960 con 0x7fdb80153410 2024-03-23T06:09:55.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.361+0000 7fdb7e000640 1 -- 172.21.15.73:0/4042991336 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70030cf0 con 0x7fdb80153410 2024-03-23T06:09:55.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.362+0000 7fdb85e00640 1 -- 172.21.15.73:0/4042991336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb80153410 msgr2=0x7fdb80159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.362+0000 7fdb85e00640 1 --2- 172.21.15.73:0/4042991336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb80153410 0x7fdb80159f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097a0 tx=0x7fdb7002b940 comp rx=0 tx=0).stop 2024-03-23T06:09:55.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.362+0000 7fdb85e00640 1 -- 172.21.15.73:0/4042991336 shutdown_connections 2024-03-23T06:09:55.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.362+0000 7fdb85e00640 1 --2- 172.21.15.73:0/4042991336 >> v2:172.21.15.73:3300/0 conn(0x7fdb800c6f00 0x7fdb800bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.362+0000 7fdb85e00640 1 --2- 172.21.15.73:0/4042991336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb80153410 0x7fdb80159f60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.362+0000 7fdb85e00640 1 -- 172.21.15.73:0/4042991336 >> 172.21.15.73:0/4042991336 conn(0x7fdb8006bb40 msgr2=0x7fdb8006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:55.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.362+0000 7fdb85e00640 1 -- 172.21.15.73:0/4042991336 shutdown_connections 2024-03-23T06:09:55.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.362+0000 7fdb85e00640 1 -- 172.21.15.73:0/4042991336 wait complete. 2024-03-23T06:09:55.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.364+0000 7fdb85e00640 1 Processor -- start 2024-03-23T06:09:55.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.364+0000 7fdb85e00640 1 -- start start 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb85e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb800c03a0 0x7fdb800c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb85e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb800c6f00 0x7fdb8014db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb85e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb80153410 0x7fdb8014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb85e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014c3c0 con 0x7fdb800c6f00 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb85e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014d6e0 con 0x7fdb80153410 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb85e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014e5f0 con 0x7fdb800c03a0 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb76000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb800c6f00 0x7fdb8014db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb76000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb800c6f00 0x7fdb8014db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50370/0 (socket says 172.21.15.73:50370) 2024-03-23T06:09:55.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb76000640 1 -- 172.21.15.73:0/2647169941 learned_addr learned my addr 172.21.15.73:0/2647169941 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb7f400640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb80153410 0x7fdb8014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb7ea00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb800c03a0 0x7fdb800c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.365+0000 7fdb76000640 1 -- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb800c03a0 msgr2=0x7fdb800c0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb76000640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb800c03a0 0x7fdb800c0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb76000640 1 -- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb80153410 msgr2=0x7fdb8014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb76000640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb80153410 0x7fdb8014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb76000640 1 -- 172.21.15.73:0/2647169941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb680094d0 con 0x7fdb800c6f00 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb7ea00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb800c03a0 0x7fdb800c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb76000640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb800c6f00 0x7fdb8014db70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800ea00 tx=0x7fdb6800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb77e00640 1 -- 172.21.15.73:0/2647169941 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6800ca60 con 0x7fdb800c6f00 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb77e00640 1 -- 172.21.15.73:0/2647169941 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6800cbc0 con 0x7fdb800c6f00 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb77e00640 1 -- 172.21.15.73:0/2647169941 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68013470 con 0x7fdb800c6f00 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb70009400 con 0x7fdb800c6f00 2024-03-23T06:09:55.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.366+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8014c610 con 0x7fdb800c6f00 2024-03-23T06:09:55.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.367+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8014d4b0 con 0x7fdb800c6f00 2024-03-23T06:09:55.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.368+0000 7fdb77e00640 1 -- 172.21.15.73:0/2647169941 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdb680135d0 con 0x7fdb800c6f00 2024-03-23T06:09:55.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.369+0000 7fdb77e00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb5c06ac00 0x7fdb5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.369+0000 7fdb77e00640 1 -- 172.21.15.73:0/2647169941 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb680895c0 con 0x7fdb800c6f00 2024-03-23T06:09:55.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.370+0000 7fdb7ea00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb5c06ac00 0x7fdb5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.370+0000 7fdb7ea00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb5c06ac00 0x7fdb5c06d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb70036000 tx=0x7fdb70008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:55.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.374+0000 7fdb77e00640 1 -- 172.21.15.73:0/2647169941 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fdb68054b90 con 0x7fdb800c6f00 2024-03-23T06:09:55.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.572+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdb800c5820 con 0x7fdb800c6f00 2024-03-23T06:09:55.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.573+0000 7fdb77e00640 1 -- 172.21.15.73:0/2647169941 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdb680581b0 con 0x7fdb800c6f00 2024-03-23T06:09:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:09:55.572 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-03-23T06:09:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:09:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-03-23T06:09:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-03-23T06:09:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:09:55.573 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-03-23T06:09:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb5c06ac00 msgr2=0x7fdb5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb5c06ac00 0x7fdb5c06d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb70036000 tx=0x7fdb70008030 comp rx=0 tx=0).stop 2024-03-23T06:09:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb800c6f00 msgr2=0x7fdb8014db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb800c6f00 0x7fdb8014db70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800ea00 tx=0x7fdb6800eec0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 shutdown_connections 2024-03-23T06:09:55.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb80153410 0x7fdb8014e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb800c6f00 0x7fdb8014db70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb5c06ac00 0x7fdb5c06d0c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 --2- 172.21.15.73:0/2647169941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb800c03a0 0x7fdb800c0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 >> 172.21.15.73:0/2647169941 conn(0x7fdb8006bb40 msgr2=0x7fdb80157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:55.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.575+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 shutdown_connections 2024-03-23T06:09:55.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.576+0000 7fdb85e00640 1 -- 172.21.15.73:0/2647169941 wait complete. 2024-03-23T06:09:55.595 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-23T06:09:55.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.807+0000 7fecc9800640 1 Processor -- start 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.807+0000 7fecc9800640 1 -- start start 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc9800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fecc4153790 0x7fecc40c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc9800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc40cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc9800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc40cf8b0 con 0x7fecc40cc140 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc9800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc40ceca0 con 0x7fecc4153790 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc9800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40cef80 con 0x7fecc415a050 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fecc4153790 0x7fecc40c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc8e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fecc40cc140 0x7fecc40b3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45688/0 (socket says 172.21.15.73:45688) 2024-03-23T06:09:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc8e00640 1 -- 172.21.15.73:0/568430928 learned_addr learned my addr 172.21.15.73:0/568430928 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc3400640 1 --2- 172.21.15.73:0/568430928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc40cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc3e00640 1 -- 172.21.15.73:0/568430928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 msgr2=0x7fecc40cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.809+0000 7fecc3e00640 1 --2- 172.21.15.73:0/568430928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc40cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.810+0000 7fecc3e00640 1 -- 172.21.15.73:0/568430928 >> v1:172.21.15.73:6789/0 conn(0x7fecc40cc140 legacy=0x7fecc40b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.810+0000 7fecc3e00640 1 -- 172.21.15.73:0/568430928 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40cf260 con 0x7fecc4153790 2024-03-23T06:09:55.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.810+0000 7fecc2a00640 1 -- 172.21.15.73:0/568430928 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980812605 0 0) 0x7fecc40cf8b0 con 0x7fecc40cc140 2024-03-23T06:09:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.811+0000 7fecc3e00640 1 --2- 172.21.15.73:0/568430928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc4153790 0x7fecc40c9e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecb40097a0 tx=0x7fecb402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b5beda1d356f28 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.811+0000 7fecc2a00640 1 -- 172.21.15.73:0/568430928 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4031780 con 0x7fecc4153790 2024-03-23T06:09:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.811+0000 7fecc2a00640 1 -- 172.21.15.73:0/568430928 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb40318e0 con 0x7fecc4153790 2024-03-23T06:09:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.811+0000 7fecc2a00640 1 -- 172.21.15.73:0/568430928 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4031c70 con 0x7fecc4153790 2024-03-23T06:09:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.811+0000 7fecc9800640 1 -- 172.21.15.73:0/568430928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc4153790 msgr2=0x7fecc40c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.811+0000 7fecc9800640 1 --2- 172.21.15.73:0/568430928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc4153790 0x7fecc40c9e90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fecb40097a0 tx=0x7fecb402b820 comp rx=0 tx=0).stop 2024-03-23T06:09:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.812+0000 7fecc9800640 1 -- 172.21.15.73:0/568430928 shutdown_connections 2024-03-23T06:09:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.812+0000 7fecc9800640 1 --2- 172.21.15.73:0/568430928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc40cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.812+0000 7fecc9800640 1 --2- 172.21.15.73:0/568430928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc4153790 0x7fecc40c9e90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.812+0000 7fecc9800640 1 -- 172.21.15.73:0/568430928 >> 172.21.15.73:0/568430928 conn(0x7fecc406c050 msgr2=0x7fecc406c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.812+0000 7fecc9800640 1 -- 172.21.15.73:0/568430928 shutdown_connections 2024-03-23T06:09:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.812+0000 7fecc9800640 1 -- 172.21.15.73:0/568430928 wait complete. 2024-03-23T06:09:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.813+0000 7fecc9800640 1 Processor -- start 2024-03-23T06:09:55.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.814+0000 7fecc9800640 1 -- start start 2024-03-23T06:09:55.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.814+0000 7fecc9800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc40cc140 0x7fecc40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.814+0000 7fecc9800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc4153790 0x7fecc41efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc9800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc41f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc9800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4153f60 con 0x7fecc4153790 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc9800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc4154200 con 0x7fecc40cc140 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc9800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc41544e0 con 0x7fecc415a050 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc4153790 0x7fecc41efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc40cc140 0x7fecc40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc8e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc41f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc4153790 0x7fecc41efdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50380/0 (socket says 172.21.15.73:50380) 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 -- 172.21.15.73:0/1972651051 learned_addr learned my addr 172.21.15.73:0/1972651051 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 -- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 msgr2=0x7fecc41f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc41f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 -- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc40cc140 msgr2=0x7fecc40ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc40cc140 0x7fecc40ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 -- 172.21.15.73:0/1972651051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4009400 con 0x7fecc4153790 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc8e00640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc41f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3e00640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc40cc140 0x7fecc40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.815+0000 7fecc3400640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc4153790 0x7fecc41efdc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fecb000e9b0 tx=0x7fecb000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.816+0000 7fecbbe00640 1 -- 172.21.15.73:0/1972651051 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0009670 con 0x7fecc4153790 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.816+0000 7fecbbe00640 1 -- 172.21.15.73:0/1972651051 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb000c9a0 con 0x7fecc4153790 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.816+0000 7fecbbe00640 1 -- 172.21.15.73:0/1972651051 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000cd50 con 0x7fecc4153790 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.816+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc41547c0 con 0x7fecc4153790 2024-03-23T06:09:55.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.816+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc414f570 con 0x7fecc4153790 2024-03-23T06:09:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.817+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc4069310 con 0x7fecc4153790 2024-03-23T06:09:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.818+0000 7fecbbe00640 1 -- 172.21.15.73:0/1972651051 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fecb0013470 con 0x7fecc4153790 2024-03-23T06:09:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.819+0000 7fecbbe00640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feca406ac00 0x7feca406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:55.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.819+0000 7fecbbe00640 1 -- 172.21.15.73:0/1972651051 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fecb00892d0 con 0x7fecc4153790 2024-03-23T06:09:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.819+0000 7fecc3e00640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feca406ac00 0x7feca406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:55.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.820+0000 7fecc3e00640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feca406ac00 0x7feca406d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecb4036000 tx=0x7fecb403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:55.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:55.823+0000 7fecbbe00640 1 -- 172.21.15.73:0/1972651051 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fecb0054780 con 0x7fecc4153790 2024-03-23T06:09:56.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.016+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fecc404e030 con 0x7fecc4153790 2024-03-23T06:09:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.429+0000 7fecbbe00640 1 -- 172.21.15.73:0/1972651051 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fecb0057da0 con 0x7fecc4153790 2024-03-23T06:09:56.431 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-03-23T06:09:56.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.438+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feca406ac00 msgr2=0x7feca406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.438+0000 7fecc9800640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feca406ac00 0x7feca406d0c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecb4036000 tx=0x7fecb403d040 comp rx=0 tx=0).stop 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.438+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc4153790 msgr2=0x7fecc41efdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.438+0000 7fecc9800640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc4153790 0x7fecc41efdc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fecb000e9b0 tx=0x7fecb000ee70 comp rx=0 tx=0).stop 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.439+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 shutdown_connections 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.439+0000 7fecc9800640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feca406ac00 0x7feca406d0c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.439+0000 7fecc9800640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecc415a050 0x7fecc41f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.439+0000 7fecc9800640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecc4153790 0x7fecc41efdc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.439+0000 7fecc9800640 1 --2- 172.21.15.73:0/1972651051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecc40cc140 0x7fecc40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.439+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 >> 172.21.15.73:0/1972651051 conn(0x7fecc406c050 msgr2=0x7fecc406c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:56.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.441+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 shutdown_connections 2024-03-23T06:09:56.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.441+0000 7fecc9800640 1 -- 172.21.15.73:0/1972651051 wait complete. 2024-03-23T06:09:56.463 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-23T06:09:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.657+0000 7f9afba00640 1 Processor -- start 2024-03-23T06:09:56.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.657+0000 7f9afba00640 1 -- start start 2024-03-23T06:09:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.658+0000 7f9afba00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415cd80 0x7f9af40cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9afba00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9af415d160 0x7f9af40ca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9afba00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40c4bd0 con 0x7f9af40c5060 2024-03-23T06:09:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9afba00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af415d860 con 0x7f9af415d160 2024-03-23T06:09:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9afba00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c45c0 con 0x7f9af415cd80 2024-03-23T06:09:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9af415d160 0x7f9af40ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:56.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af9a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9af40c5060 0x7f9af4153320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:49012/0 (socket says 172.21.15.73:49012) 2024-03-23T06:09:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af9000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415cd80 0x7f9af40cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af3e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9af415d160 0x7f9af40ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50386/0 (socket says 172.21.15.73:50386) 2024-03-23T06:09:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af9a00640 1 -- 172.21.15.73:0/620734690 learned_addr learned my addr 172.21.15.73:0/620734690 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af3e00640 1 -- 172.21.15.73:0/620734690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415cd80 msgr2=0x7f9af40cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af3e00640 1 --2- 172.21.15.73:0/620734690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415cd80 0x7f9af40cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af3e00640 1 -- 172.21.15.73:0/620734690 >> v1:172.21.15.110:6789/0 conn(0x7f9af40c5060 legacy=0x7f9af4153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af3e00640 1 -- 172.21.15.73:0/620734690 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40c3cc0 con 0x7f9af415d160 2024-03-23T06:09:56.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.659+0000 7f9af3400640 1 -- 172.21.15.73:0/620734690 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205474424 0 0) 0x7f9af40c4bd0 con 0x7f9af40c5060 2024-03-23T06:09:56.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.660+0000 7f9af3e00640 1 --2- 172.21.15.73:0/620734690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af415d160 0x7f9af40ca110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00097a0 tx=0x7f9ae002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf67171fb4d9418 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:56.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9af3400640 1 -- 172.21.15.73:0/620734690 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0031830 con 0x7f9af415d160 2024-03-23T06:09:56.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9af3400640 1 -- 172.21.15.73:0/620734690 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae0031990 con 0x7f9af415d160 2024-03-23T06:09:56.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9af3400640 1 -- 172.21.15.73:0/620734690 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0031d20 con 0x7f9af415d160 2024-03-23T06:09:56.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9afba00640 1 -- 172.21.15.73:0/620734690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af415d160 msgr2=0x7f9af40ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:56.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9afba00640 1 --2- 172.21.15.73:0/620734690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af415d160 0x7f9af40ca110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00097a0 tx=0x7f9ae002b8d0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9afba00640 1 -- 172.21.15.73:0/620734690 shutdown_connections 2024-03-23T06:09:56.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9afba00640 1 --2- 172.21.15.73:0/620734690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af415d160 0x7f9af40ca110 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9afba00640 1 --2- 172.21.15.73:0/620734690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415cd80 0x7f9af40cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9afba00640 1 -- 172.21.15.73:0/620734690 >> 172.21.15.73:0/620734690 conn(0x7f9af40cf3b0 msgr2=0x7f9af40cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:56.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.661+0000 7f9afba00640 1 -- 172.21.15.73:0/620734690 shutdown_connections 2024-03-23T06:09:56.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.662+0000 7f9afba00640 1 -- 172.21.15.73:0/620734690 wait complete. 2024-03-23T06:09:56.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.663+0000 7f9afba00640 1 Processor -- start 2024-03-23T06:09:56.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.663+0000 7f9afba00640 1 -- start start 2024-03-23T06:09:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9afba00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af40c5060 0x7f9af41f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9afba00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af415cd80 0x7f9af414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9afba00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415d160 0x7f9af415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9afba00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af415a700 con 0x7f9af40c5060 2024-03-23T06:09:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9afba00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af414b340 con 0x7f9af415cd80 2024-03-23T06:09:56.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9afba00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af414b620 con 0x7f9af415d160 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9af9000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af40c5060 0x7f9af41f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9af9000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af40c5060 0x7f9af41f25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50390/0 (socket says 172.21.15.73:50390) 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.664+0000 7f9af9000640 1 -- 172.21.15.73:0/313203658 learned_addr learned my addr 172.21.15.73:0/313203658 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af3e00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af415cd80 0x7f9af414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af9a00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415d160 0x7f9af415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af9000640 1 -- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415d160 msgr2=0x7f9af415ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af9000640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415d160 0x7f9af415ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af9000640 1 -- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af415cd80 msgr2=0x7f9af414e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af9000640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af415cd80 0x7f9af414e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af9000640 1 -- 172.21.15.73:0/313203658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae0009400 con 0x7f9af40c5060 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af3e00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af415cd80 0x7f9af414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af9000640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af40c5060 0x7f9af41f25e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800e9b0 tx=0x7f9ae800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:56.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af0c00640 1 -- 172.21.15.73:0/313203658 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8009670 con 0x7f9af40c5060 2024-03-23T06:09:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af0c00640 1 -- 172.21.15.73:0/313203658 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae800c9a0 con 0x7f9af40c5060 2024-03-23T06:09:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9af0c00640 1 -- 172.21.15.73:0/313203658 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800cd50 con 0x7f9af40c5060 2024-03-23T06:09:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.665+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af414b900 con 0x7f9af40c5060 2024-03-23T06:09:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.666+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af40cc130 con 0x7f9af40c5060 2024-03-23T06:09:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.666+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af40caca0 con 0x7f9af40c5060 2024-03-23T06:09:56.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.668+0000 7f9af0c00640 1 -- 172.21.15.73:0/313203658 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9ae8013470 con 0x7f9af40c5060 2024-03-23T06:09:56.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.668+0000 7f9af0c00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9ad406ac30 0x7f9ad406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:56.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.669+0000 7f9af0c00640 1 -- 172.21.15.73:0/313203658 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9ae8089400 con 0x7f9af40c5060 2024-03-23T06:09:56.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.669+0000 7f9af3e00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9ad406ac30 0x7f9ad406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:56.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.669+0000 7f9af3e00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9ad406ac30 0x7f9ad406d0f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0036000 tx=0x7f9ae003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:56.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.674+0000 7f9af0c00640 1 -- 172.21.15.73:0/313203658 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9ae80547c0 con 0x7f9af40c5060 2024-03-23T06:09:56.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:56.867+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f9af404e110 con 0x7f9af40c5060 2024-03-23T06:09:57.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.455+0000 7f9af0c00640 1 -- 172.21.15.73:0/313203658 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f9ae8057de0 con 0x7f9af40c5060 2024-03-23T06:09:57.460 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-03-23T06:09:57.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.463+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9ad406ac30 msgr2=0x7f9ad406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:57.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.463+0000 7f9afba00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9ad406ac30 0x7f9ad406d0f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0036000 tx=0x7f9ae003c040 comp rx=0 tx=0).stop 2024-03-23T06:09:57.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.463+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af40c5060 msgr2=0x7f9af41f25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:57.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.463+0000 7f9afba00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af40c5060 0x7f9af41f25e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800e9b0 tx=0x7f9ae800ee70 comp rx=0 tx=0).stop 2024-03-23T06:09:57.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.464+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 shutdown_connections 2024-03-23T06:09:57.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.464+0000 7f9afba00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9ad406ac30 0x7f9ad406d0f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.464+0000 7f9afba00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af415d160 0x7f9af415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.464+0000 7f9afba00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af415cd80 0x7f9af414e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.464+0000 7f9afba00640 1 --2- 172.21.15.73:0/313203658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af40c5060 0x7f9af41f25e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.464+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 >> 172.21.15.73:0/313203658 conn(0x7f9af40cf3b0 msgr2=0x7f9af40cb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:57.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.465+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 shutdown_connections 2024-03-23T06:09:57.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.465+0000 7f9afba00640 1 -- 172.21.15.73:0/313203658 wait complete. 2024-03-23T06:09:57.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-23T06:09:57.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.673+0000 7fb61b200640 1 Processor -- start 2024-03-23T06:09:57.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.674+0000 7fb61b200640 1 -- start start 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.675+0000 7fb61b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c4930 0x7fb61c0c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.675+0000 7fb61b200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb61c0c0d30 0x7fb61c1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.675+0000 7fb61b200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61c06dfe0 con 0x7fb61c140320 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.675+0000 7fb61b200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61c0c5470 con 0x7fb61c0c0d30 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.675+0000 7fb61b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0c1ca0 con 0x7fb61c0c4930 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.675+0000 7fb619e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb61c140320 0x7fb61c06d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45700/0 (socket says 172.21.15.73:45700) 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.675+0000 7fb619e00640 1 -- 172.21.15.73:0/1533019116 learned_addr learned my addr 172.21.15.73:0/1533019116 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.676+0000 7fb61a800640 1 --2- 172.21.15.73:0/1533019116 >> v2:172.21.15.110:3300/0 conn(0x7fb61c0c0d30 0x7fb61c1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.676+0000 7fb611400640 1 --2- 172.21.15.73:0/1533019116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c4930 0x7fb61c0c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.676+0000 7fb619400640 1 -- 172.21.15.73:0/1533019116 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624253243 0 0) 0x7fb61c06dfe0 con 0x7fb61c140320 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.676+0000 7fb611400640 1 -- 172.21.15.73:0/1533019116 >> v2:172.21.15.110:3300/0 conn(0x7fb61c0c0d30 msgr2=0x7fb61c1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.676+0000 7fb611400640 1 --2- 172.21.15.73:0/1533019116 >> v2:172.21.15.110:3300/0 conn(0x7fb61c0c0d30 0x7fb61c1576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.676+0000 7fb611400640 1 -- 172.21.15.73:0/1533019116 >> v1:172.21.15.73:6789/0 conn(0x7fb61c140320 legacy=0x7fb61c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:57.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.676+0000 7fb611400640 1 -- 172.21.15.73:0/1533019116 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0c1f60 con 0x7fb61c0c4930 2024-03-23T06:09:57.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.676+0000 7fb61a800640 1 --2- 172.21.15.73:0/1533019116 >> v2:172.21.15.110:3300/0 conn(0x7fb61c0c0d30 0x7fb61c1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.677+0000 7fb611400640 1 --2- 172.21.15.73:0/1533019116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c4930 0x7fb61c0c07f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb6040097a0 tx=0x7fb60402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2710b9035982af3c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.677+0000 7fb619400640 1 -- 172.21.15.73:0/1533019116 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604030800 con 0x7fb61c0c4930 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.677+0000 7fb619400640 1 -- 172.21.15.73:0/1533019116 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604030960 con 0x7fb61c0c4930 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.677+0000 7fb619400640 1 -- 172.21.15.73:0/1533019116 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb604030cf0 con 0x7fb61c0c4930 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.678+0000 7fb61b200640 1 -- 172.21.15.73:0/1533019116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c4930 msgr2=0x7fb61c0c07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.678+0000 7fb61b200640 1 --2- 172.21.15.73:0/1533019116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c4930 0x7fb61c0c07f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb6040097a0 tx=0x7fb60402b940 comp rx=0 tx=0).stop 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.678+0000 7fb61b200640 1 -- 172.21.15.73:0/1533019116 shutdown_connections 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.678+0000 7fb61b200640 1 --2- 172.21.15.73:0/1533019116 >> v2:172.21.15.110:3300/0 conn(0x7fb61c0c0d30 0x7fb61c1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.678+0000 7fb61b200640 1 --2- 172.21.15.73:0/1533019116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c4930 0x7fb61c0c07f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.678+0000 7fb61b200640 1 -- 172.21.15.73:0/1533019116 >> 172.21.15.73:0/1533019116 conn(0x7fb61c069cb0 msgr2=0x7fb61c06a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.678+0000 7fb61b200640 1 -- 172.21.15.73:0/1533019116 shutdown_connections 2024-03-23T06:09:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.678+0000 7fb61b200640 1 -- 172.21.15.73:0/1533019116 wait complete. 2024-03-23T06:09:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.680+0000 7fb61b200640 1 Processor -- start 2024-03-23T06:09:57.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.680+0000 7fb61b200640 1 -- start start 2024-03-23T06:09:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb61b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c0d30 0x7fb61c1f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb61b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb61c0c4930 0x7fb61c1f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb61b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb61c140320 0x7fb61c0be850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb61b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c0bfad0 con 0x7fb61c140320 2024-03-23T06:09:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb61b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c152af0 con 0x7fb61c0c4930 2024-03-23T06:09:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb61b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c154200 con 0x7fb61c0c0d30 2024-03-23T06:09:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb61a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb61c140320 0x7fb61c0be850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:57.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb611400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb61c0c4930 0x7fb61c1f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb611400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb61c0c4930 0x7fb61c1f09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:60478/0 (socket says 172.21.15.73:60478) 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb61a800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb61c140320 0x7fb61c0be850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50396/0 (socket says 172.21.15.73:50396) 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb611400640 1 -- 172.21.15.73:0/3721726762 learned_addr learned my addr 172.21.15.73:0/3721726762 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.681+0000 7fb619e00640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c0d30 0x7fb61c1f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb61a800640 1 -- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c0d30 msgr2=0x7fb61c1f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb61a800640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c0d30 0x7fb61c1f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb61a800640 1 -- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb61c0c4930 msgr2=0x7fb61c1f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb61a800640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb61c0c4930 0x7fb61c1f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb61a800640 1 -- 172.21.15.73:0/3721726762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614009400 con 0x7fb61c140320 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb611400640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb61c0c4930 0x7fb61c1f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb61a800640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb61c140320 0x7fb61c0be850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e800 tx=0x7fb61400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb612a00640 1 -- 172.21.15.73:0/3721726762 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140095b0 con 0x7fb61c140320 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb612a00640 1 -- 172.21.15.73:0/3721726762 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb614004020 con 0x7fb61c140320 2024-03-23T06:09:57.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb604009400 con 0x7fb61c140320 2024-03-23T06:09:57.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb612a00640 1 -- 172.21.15.73:0/3721726762 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140043b0 con 0x7fb61c140320 2024-03-23T06:09:57.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.682+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c1effd0 con 0x7fb61c140320 2024-03-23T06:09:57.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.683+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c1f0160 con 0x7fb61c140320 2024-03-23T06:09:57.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.685+0000 7fb612a00640 1 -- 172.21.15.73:0/3721726762 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb61400c8e0 con 0x7fb61c140320 2024-03-23T06:09:57.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.685+0000 7fb612a00640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb5f806ac00 0x7fb5f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:57.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.686+0000 7fb612a00640 1 -- 172.21.15.73:0/3721726762 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb614089360 con 0x7fb61c140320 2024-03-23T06:09:57.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.686+0000 7fb619e00640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb5f806ac00 0x7fb5f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:57.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.686+0000 7fb619e00640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb5f806ac00 0x7fb5f806d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0012e0 tx=0x7fb60c001700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:57.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.690+0000 7fb612a00640 1 -- 172.21.15.73:0/3721726762 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb614054640 con 0x7fb61c140320 2024-03-23T06:09:57.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.915+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb61c04e030 con 0x7fb61c140320 2024-03-23T06:09:57.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.934+0000 7fb612a00640 1 -- 172.21.15.73:0/3721726762 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb614057c60 con 0x7fb61c140320 2024-03-23T06:09:57.939 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2024-03-23T06:09:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb5f806ac00 msgr2=0x7fb5f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb5f806ac00 0x7fb5f806d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0012e0 tx=0x7fb60c001700 comp rx=0 tx=0).stop 2024-03-23T06:09:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb61c140320 msgr2=0x7fb61c0be850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb61c140320 0x7fb61c0be850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb61400e800 tx=0x7fb61400ecc0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 shutdown_connections 2024-03-23T06:09:57.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb61c140320 0x7fb61c0be850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb61c0c4930 0x7fb61c1f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb5f806ac00 0x7fb5f806d0c0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0012e0 tx=0x7fb60c001700 comp rx=0 tx=0).stop 2024-03-23T06:09:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 --2- 172.21.15.73:0/3721726762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb61c0c0d30 0x7fb61c1f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.942+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 >> 172.21.15.73:0/3721726762 conn(0x7fb61c069cb0 msgr2=0x7fb61c06a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.943+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 shutdown_connections 2024-03-23T06:09:57.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:57.943+0000 7fb61b200640 1 -- 172.21.15.73:0/3721726762 wait complete. 2024-03-23T06:09:57.970 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-23T06:09:57.970 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-23T06:09:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.142+0000 7f6f01a00640 1 Processor -- start 2024-03-23T06:09:58.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.142+0000 7f6f01a00640 1 -- start start 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6f01a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6efc1515e0 0x7f6efc0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6f01a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6efc06f7d0 con 0x7f6efc0b0c30 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6f01a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6efc157360 con 0x7f6efc0c54a0 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6f01a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc1575e0 con 0x7f6efc1515e0 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6efbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6efc1515e0 0x7f6efc0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6efbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6efc1515e0 0x7f6efc0b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50410/0 (socket says 172.21.15.73:50410) 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6efbe00640 1 -- 172.21.15.73:0/4120962697 learned_addr learned my addr 172.21.15.73:0/4120962697 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6efbe00640 1 -- 172.21.15.73:0/4120962697 >> v1:172.21.15.110:6789/0 conn(0x7f6efc0c54a0 legacy=0x7f6efc06fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6efbe00640 1 -- 172.21.15.73:0/4120962697 >> v1:172.21.15.73:6789/0 conn(0x7f6efc0b0c30 legacy=0x7f6efc071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6efb400640 1 -- 172.21.15.73:0/4120962697 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548018574 0 0) 0x7f6efc06f7d0 con 0x7f6efc0b0c30 2024-03-23T06:09:58.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.144+0000 7f6efbe00640 1 -- 172.21.15.73:0/4120962697 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc1578c0 con 0x7f6efc1515e0 2024-03-23T06:09:58.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.146+0000 7f6efbe00640 1 --2- 172.21.15.73:0/4120962697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc1515e0 0x7f6efc0b06f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009870 tx=0x7f6eec02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb7eef5ea74aff3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.146+0000 7f6efb400640 1 -- 172.21.15.73:0/4120962697 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec02f840 con 0x7f6efc1515e0 2024-03-23T06:09:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.146+0000 7f6efb400640 1 -- 172.21.15.73:0/4120962697 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec02f9a0 con 0x7f6efc1515e0 2024-03-23T06:09:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.146+0000 7f6efb400640 1 -- 172.21.15.73:0/4120962697 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec02fd30 con 0x7f6efc1515e0 2024-03-23T06:09:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.146+0000 7f6f01a00640 1 -- 172.21.15.73:0/4120962697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc1515e0 msgr2=0x7f6efc0b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:58.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.146+0000 7f6f01a00640 1 --2- 172.21.15.73:0/4120962697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc1515e0 0x7f6efc0b06f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009870 tx=0x7f6eec02ba20 comp rx=0 tx=0).stop 2024-03-23T06:09:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.147+0000 7f6f01a00640 1 -- 172.21.15.73:0/4120962697 shutdown_connections 2024-03-23T06:09:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.147+0000 7f6f01a00640 1 --2- 172.21.15.73:0/4120962697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc1515e0 0x7f6efc0b06f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.147+0000 7f6f01a00640 1 -- 172.21.15.73:0/4120962697 >> 172.21.15.73:0/4120962697 conn(0x7f6efc0caba0 msgr2=0x7f6efc0cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.147+0000 7f6f01a00640 1 -- 172.21.15.73:0/4120962697 shutdown_connections 2024-03-23T06:09:58.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.147+0000 7f6f01a00640 1 -- 172.21.15.73:0/4120962697 wait complete. 2024-03-23T06:09:58.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.148+0000 7f6f01a00640 1 Processor -- start 2024-03-23T06:09:58.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.148+0000 7f6f01a00640 1 -- start start 2024-03-23T06:09:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6f01a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6efc0b0c30 0x7f6efc1500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6f01a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc0c54a0 0x7f6efc156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6f01a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6efc1515e0 0x7f6efc1f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6f01a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc150620 con 0x7f6efc0c54a0 2024-03-23T06:09:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6f01a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc14f790 con 0x7f6efc1515e0 2024-03-23T06:09:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6f01a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc1f29e0 con 0x7f6efc0b0c30 2024-03-23T06:09:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6ef3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc0c54a0 0x7f6efc156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:58.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6ef3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc0c54a0 0x7f6efc156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50414/0 (socket says 172.21.15.73:50414) 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6efc0b0c30 0x7f6efc1500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6ef3400640 1 -- 172.21.15.73:0/2429149393 learned_addr learned my addr 172.21.15.73:0/2429149393 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.149+0000 7f6f01000640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6efc1515e0 0x7f6efc1f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef3400640 1 -- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6efc0b0c30 msgr2=0x7f6efc1500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef3400640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6efc0b0c30 0x7f6efc1500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef3400640 1 -- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6efc1515e0 msgr2=0x7f6efc1f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef3400640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6efc1515e0 0x7f6efc1f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef3400640 1 -- 172.21.15.73:0/2429149393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0094d0 con 0x7f6efc0c54a0 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef3400640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc0c54a0 0x7f6efc156a50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c3c0 tx=0x7f6ee400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef8c00640 1 -- 172.21.15.73:0/2429149393 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee40035f0 con 0x7f6efc0c54a0 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef8c00640 1 -- 172.21.15.73:0/2429149393 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee4003770 con 0x7f6efc0c54a0 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6ef8c00640 1 -- 172.21.15.73:0/2429149393 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4003b20 con 0x7f6efc0c54a0 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc14ec30 con 0x7f6efc0c54a0 2024-03-23T06:09:58.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.150+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc14f1d0 con 0x7f6efc0c54a0 2024-03-23T06:09:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.151+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc0715e0 con 0x7f6efc0c54a0 2024-03-23T06:09:58.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.152+0000 7f6ef8c00640 1 -- 172.21.15.73:0/2429149393 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6ee4003c80 con 0x7f6efc0c54a0 2024-03-23T06:09:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.153+0000 7f6ef8c00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ed806ac00 0x7f6ed806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.153+0000 7f6ef8c00640 1 -- 172.21.15.73:0/2429149393 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ee4088970 con 0x7f6efc0c54a0 2024-03-23T06:09:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.154+0000 7f6efbe00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ed806ac00 0x7f6ed806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:58.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.154+0000 7f6efbe00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ed806ac00 0x7f6ed806d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6eec036000 tx=0x7f6eec008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:58.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.158+0000 7f6ef8c00640 1 -- 172.21.15.73:0/2429149393 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6ee4053ad0 con 0x7f6efc0c54a0 2024-03-23T06:09:58.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.344+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f6efc04e030 con 0x7f6efc0c54a0 2024-03-23T06:09:58.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.928+0000 7f6ef8c00640 1 -- 172.21.15.73:0/2429149393 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f6ee4017020 con 0x7f6efc0c54a0 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ed806ac00 msgr2=0x7f6ed806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ed806ac00 0x7f6ed806d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6eec036000 tx=0x7f6eec008030 comp rx=0 tx=0).stop 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc0c54a0 msgr2=0x7f6efc156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc0c54a0 0x7f6efc156a50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c3c0 tx=0x7f6ee400c880 comp rx=0 tx=0).stop 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 shutdown_connections 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6efc1515e0 0x7f6efc1f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6efc0c54a0 0x7f6efc156a50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ed806ac00 0x7f6ed806d0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:58.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 --2- 172.21.15.73:0/2429149393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6efc0b0c30 0x7f6efc1500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:58.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 >> 172.21.15.73:0/2429149393 conn(0x7f6efc0caba0 msgr2=0x7f6efc0c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:58.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 shutdown_connections 2024-03-23T06:09:58.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:58.932+0000 7f6f01a00640 1 -- 172.21.15.73:0/2429149393 wait complete. 2024-03-23T06:09:58.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-23T06:09:59.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.169+0000 7f2cdc200640 1 Processor -- start 2024-03-23T06:09:59.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.169+0000 7f2cdc200640 1 -- start start 2024-03-23T06:09:59.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.170+0000 7f2cdc200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd40c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:59.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.170+0000 7f2cdc200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cd40b0760 0x7f2cd40b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:59.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.170+0000 7f2cdc200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd40c2a30 con 0x7f2cd4151580 2024-03-23T06:09:59.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.170+0000 7f2cdc200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cd40c5290 con 0x7f2cd40b0760 2024-03-23T06:09:59.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.170+0000 7f2cdc200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40c4cd0 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd8e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd40c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:59.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd9800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2cd4151580 0x7f2cd41573d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:49030/0 (socket says 172.21.15.73:49030) 2024-03-23T06:09:59.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd9800640 1 -- 172.21.15.73:0/2791537727 learned_addr learned my addr 172.21.15.73:0/2791537727 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:09:59.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cda200640 1 --2- 172.21.15.73:0/2791537727 >> v2:172.21.15.110:3300/0 conn(0x7f2cd40b0760 0x7f2cd40b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:59.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd3e00640 1 -- 172.21.15.73:0/2791537727 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790291365 0 0) 0x7f2cd40c2a30 con 0x7f2cd4151580 2024-03-23T06:09:59.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd3e00640 1 -- 172.21.15.73:0/2791537727 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cbc003520 con 0x7f2cd4151580 2024-03-23T06:09:59.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd8e00640 1 -- 172.21.15.73:0/2791537727 >> v2:172.21.15.110:3300/0 conn(0x7f2cd40b0760 msgr2=0x7f2cd40b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:09:59.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd8e00640 1 --2- 172.21.15.73:0/2791537727 >> v2:172.21.15.110:3300/0 conn(0x7f2cd40b0760 0x7f2cd40b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:59.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd8e00640 1 -- 172.21.15.73:0/2791537727 >> v1:172.21.15.110:6789/0 conn(0x7f2cd4151580 legacy=0x7f2cd41573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:59.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cd8e00640 1 -- 172.21.15.73:0/2791537727 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40c4fb0 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.171+0000 7f2cda200640 1 --2- 172.21.15.73:0/2791537727 >> v2:172.21.15.110:3300/0 conn(0x7f2cd40b0760 0x7f2cd40b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:09:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.172+0000 7f2cd8e00640 1 --2- 172.21.15.73:0/2791537727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd40c4690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00097a0 tx=0x7f2cc002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8157a2233b8c615 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cd3e00640 1 -- 172.21.15.73:0/2791537727 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc002d040 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cd3e00640 1 -- 172.21.15.73:0/2791537727 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc0031810 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cd3e00640 1 -- 172.21.15.73:0/2791537727 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0031ba0 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cdc200640 1 -- 172.21.15.73:0/2791537727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 msgr2=0x7f2cd40c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2791537727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd40c4690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00097a0 tx=0x7f2cc002b8b0 comp rx=0 tx=0).stop 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cdc200640 1 -- 172.21.15.73:0/2791537727 shutdown_connections 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2791537727 >> v2:172.21.15.110:3300/0 conn(0x7f2cd40b0760 0x7f2cd40b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2791537727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd40c2ec0 0x7f2cd40c4690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cdc200640 1 -- 172.21.15.73:0/2791537727 >> 172.21.15.73:0/2791537727 conn(0x7f2cd40c78b0 msgr2=0x7f2cd40c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cdc200640 1 -- 172.21.15.73:0/2791537727 shutdown_connections 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.173+0000 7f2cdc200640 1 -- 172.21.15.73:0/2791537727 wait complete. 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.175+0000 7f2cdc200640 1 Processor -- start 2024-03-23T06:09:59.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.175+0000 7f2cdc200640 1 -- start start 2024-03-23T06:09:59.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cdc200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40b0760 0x7f2cd40bef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:59.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cdc200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd41e2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:59.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cdc200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd4151580 0x7f2cd41e2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:59.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cdc200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd41ecc90 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cdc200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd41e1980 con 0x7f2cd40b0760 2024-03-23T06:09:59.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cdc200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd41e24c0 con 0x7f2cd4151580 2024-03-23T06:09:59.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cd8e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd41e2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cd8e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd41e2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50428/0 (socket says 172.21.15.73:50428) 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cd8e00640 1 -- 172.21.15.73:0/2256900515 learned_addr learned my addr 172.21.15.73:0/2256900515 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cd9800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40b0760 0x7f2cd40bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.176+0000 7f2cda200640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd4151580 0x7f2cd41e2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd8e00640 1 -- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd4151580 msgr2=0x7f2cd41e2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd8e00640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd4151580 0x7f2cd41e2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd8e00640 1 -- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40b0760 msgr2=0x7f2cd40bef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd8e00640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40b0760 0x7f2cd40bef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd8e00640 1 -- 172.21.15.73:0/2256900515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc0009400 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cda200640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd4151580 0x7f2cd41e2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd8e00640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd41e2950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00098c0 tx=0x7f2cc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd1600640 1 -- 172.21.15.73:0/2256900515 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0006e10 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd1600640 1 -- 172.21.15.73:0/2256900515 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc003ad60 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cd1600640 1 -- 172.21.15.73:0/2256900515 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0044620 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.177+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd41ece80 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.178+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd41e1e70 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.179+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd4066e50 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.179+0000 7f2cd1600640 1 -- 172.21.15.73:0/2256900515 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2cc004d440 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.180+0000 7f2cd1600640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2cb406ac00 0x7f2cb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:09:59.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.180+0000 7f2cd1600640 1 -- 172.21.15.73:0/2256900515 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f2cc00ab590 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.181+0000 7f2cd9800640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2cb406ac00 0x7f2cb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:09:59.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.181+0000 7f2cd9800640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2cb406ac00 0x7f2cb406d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80011e0 tx=0x7f2cc8007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:09:59.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.185+0000 7f2cd1600640 1 -- 172.21.15.73:0/2256900515 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2cc0076730 con 0x7f2cd40c2ec0 2024-03-23T06:09:59.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:09:59.376+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2cd40c6260 con 0x7f2cd40c2ec0 2024-03-23T06:10:00.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.937+0000 7f2cd1600640 1 -- 172.21.15.73:0/2256900515 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f2cc0079d50 con 0x7f2cd40c2ec0 2024-03-23T06:10:00.939 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data_ec' created 2024-03-23T06:10:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.945+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2cb406ac00 msgr2=0x7f2cb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.945+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2cb406ac00 0x7f2cb406d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2cc80011e0 tx=0x7f2cc8007d30 comp rx=0 tx=0).stop 2024-03-23T06:10:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.945+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd40c2ec0 msgr2=0x7f2cd41e2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.945+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd41e2950 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00098c0 tx=0x7f2cc00046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:00.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.947+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 shutdown_connections 2024-03-23T06:10:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.947+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2cb406ac00 0x7f2cb406d0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.947+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cd4151580 0x7f2cd41e2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.947+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd40c2ec0 0x7f2cd41e2950 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2cc00098c0 tx=0x7f2cc00046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.947+0000 7f2cdc200640 1 --2- 172.21.15.73:0/2256900515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cd40b0760 0x7f2cd40bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:00.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.947+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 >> 172.21.15.73:0/2256900515 conn(0x7f2cd40c78b0 msgr2=0x7f2cd41501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.951+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 shutdown_connections 2024-03-23T06:10:00.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:00.951+0000 7f2cdc200640 1 -- 172.21.15.73:0/2256900515 wait complete. 2024-03-23T06:10:00.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-23T06:10:01.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.161+0000 7f9b00a00640 1 Processor -- start 2024-03-23T06:10:01.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.161+0000 7f9b00a00640 1 -- start start 2024-03-23T06:10:01.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9b00a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9afc151730 0x7f9afc157d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:01.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9b00a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc0c4c40 con 0x7f9afc070210 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9b00a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc0c63b0 con 0x7f9afc0c5cd0 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9b00a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc158290 con 0x7f9afc151730 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9afa800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9afc070210 0x7f9afc070620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46708/0 (socket says 172.21.15.73:46708) 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9afa800640 1 -- 172.21.15.73:0/303191293 learned_addr learned my addr 172.21.15.73:0/303191293 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9af9e00640 1 --2- 172.21.15.73:0/303191293 >> v2:172.21.15.110:3300/0 conn(0x7f9afc151730 0x7f9afc157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9af8a00640 1 -- 172.21.15.73:0/303191293 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589477060 0 0) 0x7f9afc0c63b0 con 0x7f9afc0c5cd0 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9af8a00640 1 -- 172.21.15.73:0/303191293 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae0003520 con 0x7f9afc0c5cd0 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.163+0000 7f9af8a00640 1 -- 172.21.15.73:0/303191293 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029041348 0 0) 0x7f9afc0c4c40 con 0x7f9afc070210 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.164+0000 7f9af8a00640 1 -- 172.21.15.73:0/303191293 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9afc0c63b0 con 0x7f9afc070210 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.164+0000 7f9af9e00640 1 -- 172.21.15.73:0/303191293 >> v1:172.21.15.110:6789/0 conn(0x7f9afc0c5cd0 legacy=0x7f9afc06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.164+0000 7f9af9e00640 1 -- 172.21.15.73:0/303191293 >> v1:172.21.15.73:6789/0 conn(0x7f9afc070210 legacy=0x7f9afc070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.164+0000 7f9af9e00640 1 -- 172.21.15.73:0/303191293 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0c4e90 con 0x7f9afc151730 2024-03-23T06:10:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.165+0000 7f9af9e00640 1 --2- 172.21.15.73:0/303191293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc151730 0x7f9afc157d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80097a0 tx=0x7f9ae802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=768b7ff5a6cfa0f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.165+0000 7f9af8a00640 1 -- 172.21.15.73:0/303191293 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae802f810 con 0x7f9afc151730 2024-03-23T06:10:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.165+0000 7f9af8a00640 1 -- 172.21.15.73:0/303191293 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae802f970 con 0x7f9afc151730 2024-03-23T06:10:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.165+0000 7f9af8a00640 1 -- 172.21.15.73:0/303191293 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae802fd00 con 0x7f9afc151730 2024-03-23T06:10:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.166+0000 7f9b00a00640 1 -- 172.21.15.73:0/303191293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc151730 msgr2=0x7f9afc157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.166+0000 7f9b00a00640 1 --2- 172.21.15.73:0/303191293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc151730 0x7f9afc157d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80097a0 tx=0x7f9ae802b9f0 comp rx=0 tx=0).stop 2024-03-23T06:10:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.166+0000 7f9b00a00640 1 -- 172.21.15.73:0/303191293 shutdown_connections 2024-03-23T06:10:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.166+0000 7f9b00a00640 1 --2- 172.21.15.73:0/303191293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc151730 0x7f9afc157d50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.166+0000 7f9b00a00640 1 -- 172.21.15.73:0/303191293 >> 172.21.15.73:0/303191293 conn(0x7f9afc06bd00 msgr2=0x7f9afc069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.166+0000 7f9b00a00640 1 -- 172.21.15.73:0/303191293 shutdown_connections 2024-03-23T06:10:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.166+0000 7f9b00a00640 1 -- 172.21.15.73:0/303191293 wait complete. 2024-03-23T06:10:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.168+0000 7f9b00a00640 1 Processor -- start 2024-03-23T06:10:01.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.168+0000 7f9b00a00640 1 -- start start 2024-03-23T06:10:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9b00a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc070210 0x7f9afc0c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9b00a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9afc0c5cd0 0x7f9afc1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9b00a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9afc151730 0x7f9afc0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9b00a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc152f80 con 0x7f9afc151730 2024-03-23T06:10:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9b00a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1f0060 con 0x7f9afc070210 2024-03-23T06:10:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9b00a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0c4590 con 0x7f9afc0c5cd0 2024-03-23T06:10:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9afa800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9afc151730 0x7f9afc0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:01.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9afa800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9afc151730 0x7f9afc0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47138/0 (socket says 172.21.15.73:47138) 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9afa800640 1 -- 172.21.15.73:0/1543168763 learned_addr learned my addr 172.21.15.73:0/1543168763 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9af9400640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9afc0c5cd0 0x7f9afc1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.169+0000 7f9af9e00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc070210 0x7f9afc0c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9afa800640 1 -- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9afc0c5cd0 msgr2=0x7f9afc1491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9afa800640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9afc0c5cd0 0x7f9afc1491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9afa800640 1 -- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc070210 msgr2=0x7f9afc0c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9afa800640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc070210 0x7f9afc0c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9afa800640 1 -- 172.21.15.73:0/1543168763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009400 con 0x7f9afc151730 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9afa800640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9afc151730 0x7f9afc0c3170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9af400caa0 tx=0x7f9af400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9af2000640 1 -- 172.21.15.73:0/1543168763 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af400ac00 con 0x7f9afc151730 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9af2000640 1 -- 172.21.15.73:0/1543168763 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af400ad60 con 0x7f9afc151730 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9af2000640 1 -- 172.21.15.73:0/1543168763 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4012620 con 0x7f9afc151730 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc1f02b0 con 0x7f9afc151730 2024-03-23T06:10:01.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.170+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc1f0870 con 0x7f9afc151730 2024-03-23T06:10:01.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.171+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc0c48a0 con 0x7f9afc151730 2024-03-23T06:10:01.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.172+0000 7f9af2000640 1 -- 172.21.15.73:0/1543168763 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9af4007070 con 0x7f9afc151730 2024-03-23T06:10:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.174+0000 7f9af2000640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9adc06ac00 0x7f9adc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.174+0000 7f9af2000640 1 -- 172.21.15.73:0/1543168763 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f9af4089520 con 0x7f9afc151730 2024-03-23T06:10:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.174+0000 7f9af9e00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9adc06ac00 0x7f9adc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.175+0000 7f9af9e00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9adc06ac00 0x7f9adc06d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8036000 tx=0x7f9ae8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.179+0000 7f9af2000640 1 -- 172.21.15.73:0/1543168763 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9af4054440 con 0x7f9afc151730 2024-03-23T06:10:01.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.375+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f9afc156950 con 0x7f9afc151730 2024-03-23T06:10:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.941+0000 7f9af2000640 1 -- 172.21.15.73:0/1543168763 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9af4057a60 con 0x7f9afc151730 2024-03-23T06:10:01.942 INFO:teuthology.orchestra.run.smithi073.stderr:set pool 4 allow_ec_overwrites to true 2024-03-23T06:10:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.946+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9adc06ac00 msgr2=0x7f9adc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.946+0000 7f9b00a00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9adc06ac00 0x7f9adc06d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8036000 tx=0x7f9ae8008030 comp rx=0 tx=0).stop 2024-03-23T06:10:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.946+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9afc151730 msgr2=0x7f9afc0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:01.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.946+0000 7f9b00a00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9afc151730 0x7f9afc0c3170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9af400caa0 tx=0x7f9af400cf60 comp rx=0 tx=0).stop 2024-03-23T06:10:01.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.948+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 shutdown_connections 2024-03-23T06:10:01.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.948+0000 7f9b00a00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9afc151730 0x7f9afc0c3170 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:01.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.948+0000 7f9b00a00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9adc06ac00 0x7f9adc06d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:01.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.948+0000 7f9b00a00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9afc0c5cd0 0x7f9afc1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:01.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.948+0000 7f9b00a00640 1 --2- 172.21.15.73:0/1543168763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9afc070210 0x7f9afc0c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:01.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.948+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 >> 172.21.15.73:0/1543168763 conn(0x7f9afc06bd00 msgr2=0x7f9afc14fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:01.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.952+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 shutdown_connections 2024-03-23T06:10:01.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:01.955+0000 7f9b00a00640 1 -- 172.21.15.73:0/1543168763 wait complete. 2024-03-23T06:10:01.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-23T06:10:02.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.169+0000 7f6612200640 1 Processor -- start 2024-03-23T06:10:02.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.169+0000 7f6612200640 1 -- start start 2024-03-23T06:10:02.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.170+0000 7f6612200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 0x7f660c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.170+0000 7f6612200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f660c072090 0x7f660c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.170+0000 7f6612200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c15b710 con 0x7f660c151480 2024-03-23T06:10:02.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.170+0000 7f6612200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c1588d0 con 0x7f660c072090 2024-03-23T06:10:02.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.170+0000 7f6612200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c1582d0 con 0x7f660c157e60 2024-03-23T06:10:02.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f660c072090 0x7f660c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f660c072090 0x7f660c158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47144/0 (socket says 172.21.15.73:47144) 2024-03-23T06:10:02.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660be00640 1 -- 172.21.15.73:0/3686546323 learned_addr learned my addr 172.21.15.73:0/3686546323 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:02.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660b400640 1 --1- 172.21.15.73:0/3686546323 >> v1:172.21.15.73:6789/0 conn(0x7f660c151480 0x7f660c0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46712/0 (socket says 172.21.15.73:46712) 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f6602a00640 1 --2- 172.21.15.73:0/3686546323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 0x7f660c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660be00640 1 -- 172.21.15.73:0/3686546323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 msgr2=0x7f660c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660be00640 1 --2- 172.21.15.73:0/3686546323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 0x7f660c071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660be00640 1 -- 172.21.15.73:0/3686546323 >> v1:172.21.15.73:6789/0 conn(0x7f660c151480 legacy=0x7f660c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660be00640 1 -- 172.21.15.73:0/3686546323 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c15ab90 con 0x7f660c072090 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.171+0000 7f660aa00640 1 -- 172.21.15.73:0/3686546323 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053640405 0 0) 0x7f660c15b710 con 0x7f660c151480 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.172+0000 7f660be00640 1 --2- 172.21.15.73:0/3686546323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c158cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6604009e50 tx=0x7f660402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ab6f01b35f8737 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.172+0000 7f660aa00640 1 -- 172.21.15.73:0/3686546323 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660402cb90 con 0x7f660c072090 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.172+0000 7f660aa00640 1 -- 172.21.15.73:0/3686546323 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660402ccf0 con 0x7f660c072090 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.172+0000 7f660aa00640 1 -- 172.21.15.73:0/3686546323 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604034610 con 0x7f660c072090 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.173+0000 7f6612200640 1 -- 172.21.15.73:0/3686546323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 msgr2=0x7f660c158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.173+0000 7f6612200640 1 --2- 172.21.15.73:0/3686546323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c158cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6604009e50 tx=0x7f660402bff0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.173+0000 7f6612200640 1 -- 172.21.15.73:0/3686546323 shutdown_connections 2024-03-23T06:10:02.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.173+0000 7f6612200640 1 --2- 172.21.15.73:0/3686546323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 0x7f660c071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.173+0000 7f6612200640 1 --2- 172.21.15.73:0/3686546323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c158cf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.173+0000 7f6612200640 1 -- 172.21.15.73:0/3686546323 >> 172.21.15.73:0/3686546323 conn(0x7f660c069cb0 msgr2=0x7f660c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.173+0000 7f6612200640 1 -- 172.21.15.73:0/3686546323 shutdown_connections 2024-03-23T06:10:02.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.173+0000 7f6612200640 1 -- 172.21.15.73:0/3686546323 wait complete. 2024-03-23T06:10:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.175+0000 7f6612200640 1 Processor -- start 2024-03-23T06:10:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.175+0000 7f6612200640 1 -- start start 2024-03-23T06:10:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f6612200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c1ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f6612200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660c151480 0x7f660c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f6612200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 0x7f660c0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f6612200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0af4c0 con 0x7f660c072090 2024-03-23T06:10:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f6612200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c1efbf0 con 0x7f660c151480 2024-03-23T06:10:02.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f6612200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c0af8f0 con 0x7f660c157e60 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c1ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c1ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47146/0 (socket says 172.21.15.73:47146) 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660b400640 1 -- 172.21.15.73:0/4054648374 learned_addr learned my addr 172.21.15.73:0/4054648374 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f6602a00640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660c151480 0x7f660c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660be00640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 0x7f660c0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660b400640 1 -- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 msgr2=0x7f660c0ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660b400640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 0x7f660c0ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660b400640 1 -- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660c151480 msgr2=0x7f660c159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660b400640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660c151480 0x7f660c159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.176+0000 7f660b400640 1 -- 172.21.15.73:0/4054648374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604009b30 con 0x7f660c072090 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.177+0000 7f660b400640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c1ef6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00c4d0 tx=0x7f65fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:02.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.177+0000 7f6603e00640 1 -- 172.21.15.73:0/4054648374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0074e0 con 0x7f660c072090 2024-03-23T06:10:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.177+0000 7f6603e00640 1 -- 172.21.15.73:0/4054648374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc007660 con 0x7f660c072090 2024-03-23T06:10:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.177+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c156860 con 0x7f660c072090 2024-03-23T06:10:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.177+0000 7f6603e00640 1 -- 172.21.15.73:0/4054648374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc004a20 con 0x7f660c072090 2024-03-23T06:10:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.177+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c156e10 con 0x7f660c072090 2024-03-23T06:10:02.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.178+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c0cb860 con 0x7f660c072090 2024-03-23T06:10:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.179+0000 7f6603e00640 1 -- 172.21.15.73:0/4054648374 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f65fc004b80 con 0x7f660c072090 2024-03-23T06:10:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.180+0000 7f6603e00640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65e806ac00 0x7f65e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.180+0000 7f6603e00640 1 -- 172.21.15.73:0/4054648374 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f65fc088c00 con 0x7f660c072090 2024-03-23T06:10:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.180+0000 7f6602a00640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65e806ac00 0x7f65e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.181+0000 7f6602a00640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65e806ac00 0x7f65e806d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f660c0c1c60 tx=0x7f65f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:02.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.184+0000 7f6603e00640 1 -- 172.21.15.73:0/4054648374 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f65fc053a90 con 0x7f660c072090 2024-03-23T06:10:02.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.418+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f660c151860 con 0x7f660c072090 2024-03-23T06:10:02.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.425+0000 7f6603e00640 1 -- 172.21.15.73:0/4054648374 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) v1 ==== 137+0+0 (secure 0 0 0) 0x7f65fc018070 con 0x7f660c072090 2024-03-23T06:10:02.425 INFO:teuthology.orchestra.run.smithi073.stderr:added data pool 4 to fsmap 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.428+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65e806ac00 msgr2=0x7f65e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.428+0000 7f6612200640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65e806ac00 0x7f65e806d0c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f660c0c1c60 tx=0x7f65f4008040 comp rx=0 tx=0).stop 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.428+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 msgr2=0x7f660c1ef6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.428+0000 7f6612200640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c1ef6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00c4d0 tx=0x7f65fc00c990 comp rx=0 tx=0).stop 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.429+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 shutdown_connections 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.429+0000 7f6612200640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65e806ac00 0x7f65e806d0c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.429+0000 7f6612200640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f660c157e60 0x7f660c0ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.429+0000 7f6612200640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f660c151480 0x7f660c159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.429+0000 7f6612200640 1 --2- 172.21.15.73:0/4054648374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f660c072090 0x7f660c1ef6b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.429+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 >> 172.21.15.73:0/4054648374 conn(0x7f660c069cb0 msgr2=0x7f660c0bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.429+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 shutdown_connections 2024-03-23T06:10:02.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.429+0000 7f6612200640 1 -- 172.21.15.73:0/4054648374 wait complete. 2024-03-23T06:10:02.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:10:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.649+0000 7f197b200640 1 Processor -- start 2024-03-23T06:10:02.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.649+0000 7f197b200640 1 -- start start 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.650+0000 7f197b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19741513f0 0x7f19740c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.650+0000 7f197b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f1974071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.650+0000 7f197b200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19740c5f50 con 0x7f19741586b0 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.650+0000 7f197b200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1974157b60 con 0x7f19741513f0 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.650+0000 7f197b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19740c0570 con 0x7f1974158b20 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1973e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19741513f0 0x7f19740c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1973e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19741513f0 0x7f19740c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47148/0 (socket says 172.21.15.73:47148) 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1973e00640 1 -- 172.21.15.73:0/4067618218 learned_addr learned my addr 172.21.15.73:0/4067618218 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1979200640 1 --2- 172.21.15.73:0/4067618218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f1974071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1973e00640 1 -- 172.21.15.73:0/4067618218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 msgr2=0x7f1974071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1973e00640 1 --2- 172.21.15.73:0/4067618218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f1974071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1973e00640 1 -- 172.21.15.73:0/4067618218 >> v1:172.21.15.110:6789/0 conn(0x7f19741586b0 legacy=0x7f19740bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1973e00640 1 -- 172.21.15.73:0/4067618218 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19740c0830 con 0x7f19741513f0 2024-03-23T06:10:02.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.651+0000 7f1979200640 1 --2- 172.21.15.73:0/4067618218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f1974071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.652+0000 7f1973e00640 1 --2- 172.21.15.73:0/4067618218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f19740c5a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1964009e50 tx=0x7f196402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28cf8551fd5fb7f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.652+0000 7f1973400640 1 -- 172.21.15.73:0/4067618218 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196402cb90 con 0x7f19741513f0 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.652+0000 7f1973400640 1 -- 172.21.15.73:0/4067618218 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196402ccf0 con 0x7f19741513f0 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.652+0000 7f1973400640 1 -- 172.21.15.73:0/4067618218 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964034610 con 0x7f19741513f0 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.653+0000 7f197b200640 1 -- 172.21.15.73:0/4067618218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 msgr2=0x7f19740c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.653+0000 7f197b200640 1 --2- 172.21.15.73:0/4067618218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f19740c5a10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1964009e50 tx=0x7f196402bff0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.653+0000 7f197b200640 1 -- 172.21.15.73:0/4067618218 shutdown_connections 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.653+0000 7f197b200640 1 --2- 172.21.15.73:0/4067618218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f1974071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.653+0000 7f197b200640 1 --2- 172.21.15.73:0/4067618218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f19740c5a10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.653+0000 7f197b200640 1 -- 172.21.15.73:0/4067618218 >> 172.21.15.73:0/4067618218 conn(0x7f197406bb40 msgr2=0x7f197406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:02.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.653+0000 7f197b200640 1 -- 172.21.15.73:0/4067618218 shutdown_connections 2024-03-23T06:10:02.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.653+0000 7f197b200640 1 -- 172.21.15.73:0/4067618218 wait complete. 2024-03-23T06:10:02.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.655+0000 7f197b200640 1 Processor -- start 2024-03-23T06:10:02.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.655+0000 7f197b200640 1 -- start start 2024-03-23T06:10:02.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f197b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f1974070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f197b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19741586b0 0x7f19741dde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f197b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f19741e1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f197b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197414d2d0 con 0x7f19741513f0 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f197b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197414dd10 con 0x7f19741586b0 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f197b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19741f24a0 con 0x7f1974158b20 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1973e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f1974070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1973e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f1974070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47162/0 (socket says 172.21.15.73:47162) 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1973e00640 1 -- 172.21.15.73:0/4056681766 learned_addr learned my addr 172.21.15.73:0/4056681766 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1979200640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f19741e1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f196b400640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19741586b0 0x7f19741dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1973e00640 1 -- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 msgr2=0x7f19741e1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1973e00640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f19741e1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1973e00640 1 -- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19741586b0 msgr2=0x7f19741dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1973e00640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19741586b0 0x7f19741dde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1973e00640 1 -- 172.21.15.73:0/4056681766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009b30 con 0x7f19741513f0 2024-03-23T06:10:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f1979200640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f19741e1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.656+0000 7f196b400640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19741586b0 0x7f19741dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.657+0000 7f1973e00640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f1974070c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1964000f80 tx=0x7f1964004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.657+0000 7f1970c00640 1 -- 172.21.15.73:0/4056681766 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964009510 con 0x7f19741513f0 2024-03-23T06:10:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.657+0000 7f1970c00640 1 -- 172.21.15.73:0/4056681766 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196403e450 con 0x7f19741513f0 2024-03-23T06:10:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.657+0000 7f1970c00640 1 -- 172.21.15.73:0/4056681766 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196403e800 con 0x7f19741513f0 2024-03-23T06:10:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.657+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19741f2780 con 0x7f19741513f0 2024-03-23T06:10:02.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.657+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19741f2d40 con 0x7f19741513f0 2024-03-23T06:10:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.658+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197404e110 con 0x7f19741513f0 2024-03-23T06:10:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.659+0000 7f1970c00640 1 -- 172.21.15.73:0/4056681766 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f196403e960 con 0x7f19741513f0 2024-03-23T06:10:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.660+0000 7f1970c00640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195006ac00 0x7f195006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.660+0000 7f1970c00640 1 -- 172.21.15.73:0/4056681766 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f19640ac310 con 0x7f19741513f0 2024-03-23T06:10:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.660+0000 7f196b400640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195006ac00 0x7f195006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.661+0000 7f196b400640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195006ac00 0x7f195006d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f195c007fd0 tx=0x7f195c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:02.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.664+0000 7f1970c00640 1 -- 172.21.15.73:0/4056681766 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1964077160 con 0x7f19741513f0 2024-03-23T06:10:02.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.894+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19740c55d0 con 0x7f19741513f0 2024-03-23T06:10:02.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.895+0000 7f1970c00640 1 -- 172.21.15.73:0/4056681766 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6247 (secure 0 0 0) 0x7f196402ce60 con 0x7f19741513f0 2024-03-23T06:10:02.895 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:02.895 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:02.421184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:10:02.896 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-03-23T06:10:02.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195006ac00 msgr2=0x7f195006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195006ac00 0x7f195006d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f195c007fd0 tx=0x7f195c009040 comp rx=0 tx=0).stop 2024-03-23T06:10:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 msgr2=0x7f1974070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f1974070c40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1964000f80 tx=0x7f1964004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 shutdown_connections 2024-03-23T06:10:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195006ac00 0x7f195006d0c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1974158b20 0x7f19741e1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19741586b0 0x7f19741dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 --2- 172.21.15.73:0/4056681766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19741513f0 0x7f1974070c40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 >> 172.21.15.73:0/4056681766 conn(0x7f197406bb40 msgr2=0x7f19741e2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 shutdown_connections 2024-03-23T06:10:02.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:02.898+0000 7f197b200640 1 -- 172.21.15.73:0/4056681766 wait complete. 2024-03-23T06:10:02.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:03.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.103+0000 7f7e30800640 1 Processor -- start 2024-03-23T06:10:03.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.103+0000 7f7e30800640 1 -- start start 2024-03-23T06:10:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.104+0000 7f7e30800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e28153a80 0x7f7e280cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.104+0000 7f7e30800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e281594f0 0x7f7e280cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.104+0000 7f7e30800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e281599a0 con 0x7f7e281536a0 2024-03-23T06:10:03.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.104+0000 7f7e30800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2815a520 con 0x7f7e281594f0 2024-03-23T06:10:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.104+0000 7f7e30800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e28159c80 con 0x7f7e28153a80 2024-03-23T06:10:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2de00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7e281536a0 0x7f7e280ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46726/0 (socket says 172.21.15.73:46726) 2024-03-23T06:10:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2de00640 1 -- 172.21.15.73:0/4239165169 learned_addr learned my addr 172.21.15.73:0/4239165169 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2e800640 1 --2- 172.21.15.73:0/4239165169 >> v2:172.21.15.73:3300/0 conn(0x7f7e281594f0 0x7f7e280cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2d400640 1 --2- 172.21.15.73:0/4239165169 >> v2:172.21.15.110:3300/0 conn(0x7f7e28153a80 0x7f7e280cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2e800640 1 -- 172.21.15.73:0/4239165169 >> v2:172.21.15.110:3300/0 conn(0x7f7e28153a80 msgr2=0x7f7e280cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2e800640 1 --2- 172.21.15.73:0/4239165169 >> v2:172.21.15.110:3300/0 conn(0x7f7e28153a80 0x7f7e280cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2e800640 1 -- 172.21.15.73:0/4239165169 >> v1:172.21.15.73:6789/0 conn(0x7f7e281536a0 legacy=0x7f7e280ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2e800640 1 -- 172.21.15.73:0/4239165169 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e28159f60 con 0x7f7e281594f0 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2ca00640 1 -- 172.21.15.73:0/4239165169 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865582220 0 0) 0x7f7e281599a0 con 0x7f7e281536a0 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.105+0000 7f7e2d400640 1 --2- 172.21.15.73:0/4239165169 >> v2:172.21.15.110:3300/0 conn(0x7f7e28153a80 0x7f7e280cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.106+0000 7f7e2e800640 1 --2- 172.21.15.73:0/4239165169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281594f0 0x7f7e280cc3d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e280b2290 tx=0x7f7e2402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f443877f29e1c69 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.106+0000 7f7e2ca00640 1 -- 172.21.15.73:0/4239165169 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2402cc80 con 0x7f7e281594f0 2024-03-23T06:10:03.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.106+0000 7f7e2ca00640 1 -- 172.21.15.73:0/4239165169 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2402cde0 con 0x7f7e281594f0 2024-03-23T06:10:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.106+0000 7f7e2ca00640 1 -- 172.21.15.73:0/4239165169 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24034660 con 0x7f7e281594f0 2024-03-23T06:10:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.107+0000 7f7e30800640 1 -- 172.21.15.73:0/4239165169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281594f0 msgr2=0x7f7e280cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.107+0000 7f7e30800640 1 --2- 172.21.15.73:0/4239165169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281594f0 0x7f7e280cc3d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e280b2290 tx=0x7f7e2402bed0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.107+0000 7f7e30800640 1 -- 172.21.15.73:0/4239165169 shutdown_connections 2024-03-23T06:10:03.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.107+0000 7f7e30800640 1 --2- 172.21.15.73:0/4239165169 >> v2:172.21.15.110:3300/0 conn(0x7f7e28153a80 0x7f7e280cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.107+0000 7f7e30800640 1 --2- 172.21.15.73:0/4239165169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281594f0 0x7f7e280cc3d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.107+0000 7f7e30800640 1 -- 172.21.15.73:0/4239165169 >> 172.21.15.73:0/4239165169 conn(0x7f7e2806a060 msgr2=0x7f7e2806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.107+0000 7f7e30800640 1 -- 172.21.15.73:0/4239165169 shutdown_connections 2024-03-23T06:10:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.107+0000 7f7e30800640 1 -- 172.21.15.73:0/4239165169 wait complete. 2024-03-23T06:10:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.109+0000 7f7e30800640 1 Processor -- start 2024-03-23T06:10:03.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.109+0000 7f7e30800640 1 -- start start 2024-03-23T06:10:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.109+0000 7f7e30800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281536a0 0x7f7e280c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.109+0000 7f7e30800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e28153a80 0x7f7e281ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.109+0000 7f7e30800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e281594f0 0x7f7e280cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.109+0000 7f7e30800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e281eee30 con 0x7f7e281536a0 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e30800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e281f2f30 con 0x7f7e28153a80 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e30800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e281eeae0 con 0x7f7e281594f0 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281536a0 0x7f7e280c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281536a0 0x7f7e280c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47180/0 (socket says 172.21.15.73:47180) 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 -- 172.21.15.73:0/2872873983 learned_addr learned my addr 172.21.15.73:0/2872873983 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2e800640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e281594f0 0x7f7e280cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2d400640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e28153a80 0x7f7e281ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 -- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e281594f0 msgr2=0x7f7e280cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e281594f0 0x7f7e280cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 -- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e28153a80 msgr2=0x7f7e281ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e28153a80 0x7f7e281ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 -- 172.21.15.73:0/2872873983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24009a70 con 0x7f7e281536a0 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2d400640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e28153a80 0x7f7e281ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:03.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.110+0000 7f7e2de00640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281536a0 0x7f7e280c47c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c4d0 tx=0x7f7e1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.111+0000 7f7e22000640 1 -- 172.21.15.73:0/2872873983 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0074e0 con 0x7f7e281536a0 2024-03-23T06:10:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.111+0000 7f7e22000640 1 -- 172.21.15.73:0/2872873983 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c007660 con 0x7f7e281536a0 2024-03-23T06:10:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.111+0000 7f7e22000640 1 -- 172.21.15.73:0/2872873983 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c004a20 con 0x7f7e281536a0 2024-03-23T06:10:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.111+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e28154d30 con 0x7f7e281536a0 2024-03-23T06:10:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.111+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2814f050 con 0x7f7e281536a0 2024-03-23T06:10:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.112+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e280c9810 con 0x7f7e281536a0 2024-03-23T06:10:03.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.113+0000 7f7e22000640 1 -- 172.21.15.73:0/2872873983 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7e1c004b80 con 0x7f7e281536a0 2024-03-23T06:10:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.113+0000 7f7e22000640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7e0c06ac00 0x7f7e0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.113+0000 7f7e22000640 1 -- 172.21.15.73:0/2872873983 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e1c0887d0 con 0x7f7e281536a0 2024-03-23T06:10:03.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.114+0000 7f7e2d400640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7e0c06ac00 0x7f7e0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.114+0000 7f7e2d400640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7e0c06ac00 0x7f7e0c06d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e2814ebd0 tx=0x7f7e18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:03.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.118+0000 7f7e22000640 1 -- 172.21.15.73:0/2872873983 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7e1c053760 con 0x7f7e281536a0 2024-03-23T06:10:03.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.310+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e281eec50 con 0x7f7e281536a0 2024-03-23T06:10:03.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.312+0000 7f7e22000640 1 -- 172.21.15.73:0/2872873983 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f7e1c056d80 con 0x7f7e281536a0 2024-03-23T06:10:03.313 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7e0c06ac00 msgr2=0x7f7e0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7e0c06ac00 0x7f7e0c06d0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e2814ebd0 tx=0x7f7e18008040 comp rx=0 tx=0).stop 2024-03-23T06:10:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281536a0 msgr2=0x7f7e280c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281536a0 0x7f7e280c47c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00c4d0 tx=0x7f7e1c00c990 comp rx=0 tx=0).stop 2024-03-23T06:10:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 shutdown_connections 2024-03-23T06:10:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7e0c06ac00 0x7f7e0c06d0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e281594f0 0x7f7e280cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e28153a80 0x7f7e281ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 --2- 172.21.15.73:0/2872873983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e281536a0 0x7f7e280c47c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 >> 172.21.15.73:0/2872873983 conn(0x7f7e2806a060 msgr2=0x7f7e28158080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 shutdown_connections 2024-03-23T06:10:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.315+0000 7f7e30800640 1 -- 172.21.15.73:0/2872873983 wait complete. 2024-03-23T06:10:03.333 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:03.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.538+0000 7f6469800640 1 Processor -- start 2024-03-23T06:10:03.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.538+0000 7f6469800640 1 -- start start 2024-03-23T06:10:03.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6469800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f64640c5a10 0x7f64640bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6469800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64640c03a0 0x7f6464071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6469800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6464157b60 con 0x7f64641513f0 2024-03-23T06:10:03.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6469800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6464158dc0 con 0x7f64640c5a10 2024-03-23T06:10:03.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6469800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64640c0830 con 0x7f64640c03a0 2024-03-23T06:10:03.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6462000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f64640c5a10 0x7f64640bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6462000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f64640c5a10 0x7f64640bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47184/0 (socket says 172.21.15.73:47184) 2024-03-23T06:10:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6462000640 1 -- 172.21.15.73:0/792143554 learned_addr learned my addr 172.21.15.73:0/792143554 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6463400640 1 --2- 172.21.15.73:0/792143554 >> v2:172.21.15.110:3300/0 conn(0x7f64640c03a0 0x7f6464071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6462000640 1 -- 172.21.15.73:0/792143554 >> v2:172.21.15.110:3300/0 conn(0x7f64640c03a0 msgr2=0x7f6464071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6462000640 1 --2- 172.21.15.73:0/792143554 >> v2:172.21.15.110:3300/0 conn(0x7f64640c03a0 0x7f6464071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.540+0000 7f6462000640 1 -- 172.21.15.73:0/792143554 >> v1:172.21.15.73:6789/0 conn(0x7f64641513f0 legacy=0x7f64641586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.541+0000 7f6462000640 1 -- 172.21.15.73:0/792143554 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64640c0b10 con 0x7f64640c5a10 2024-03-23T06:10:03.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.541+0000 7f6461600640 1 -- 172.21.15.73:0/792143554 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390108932 0 0) 0x7f6464157b60 con 0x7f64641513f0 2024-03-23T06:10:03.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.542+0000 7f6462000640 1 --2- 172.21.15.73:0/792143554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64640c5a10 0x7f64640bfe60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6464066590 tx=0x7f644c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3664ad453df7633 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:03.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.542+0000 7f6461600640 1 -- 172.21.15.73:0/792143554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c02cbb0 con 0x7f64640c5a10 2024-03-23T06:10:03.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.542+0000 7f6461600640 1 -- 172.21.15.73:0/792143554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c02cd10 con 0x7f64640c5a10 2024-03-23T06:10:03.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.542+0000 7f6461600640 1 -- 172.21.15.73:0/792143554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c034610 con 0x7f64640c5a10 2024-03-23T06:10:03.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.542+0000 7f6469800640 1 -- 172.21.15.73:0/792143554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64640c5a10 msgr2=0x7f64640bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.542+0000 7f6469800640 1 --2- 172.21.15.73:0/792143554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64640c5a10 0x7f64640bfe60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6464066590 tx=0x7f644c02c010 comp rx=0 tx=0).stop 2024-03-23T06:10:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.542+0000 7f6469800640 1 -- 172.21.15.73:0/792143554 shutdown_connections 2024-03-23T06:10:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.543+0000 7f6469800640 1 --2- 172.21.15.73:0/792143554 >> v2:172.21.15.110:3300/0 conn(0x7f64640c03a0 0x7f6464071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.543+0000 7f6469800640 1 --2- 172.21.15.73:0/792143554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64640c5a10 0x7f64640bfe60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.543+0000 7f6469800640 1 -- 172.21.15.73:0/792143554 >> 172.21.15.73:0/792143554 conn(0x7f646406bb40 msgr2=0x7f646406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.543+0000 7f6469800640 1 -- 172.21.15.73:0/792143554 shutdown_connections 2024-03-23T06:10:03.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.543+0000 7f6469800640 1 -- 172.21.15.73:0/792143554 wait complete. 2024-03-23T06:10:03.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.544+0000 7f6469800640 1 Processor -- start 2024-03-23T06:10:03.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.544+0000 7f6469800640 1 -- start start 2024-03-23T06:10:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6469800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64640c5a10 0x7f64640c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6469800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64641513f0 0x7f6464071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6469800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6464071660 0x7f646414bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6469800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6464070c80 con 0x7f64641513f0 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6469800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64640c24a0 con 0x7f64640c5a10 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6469800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6464156780 con 0x7f6464071660 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6462000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64641513f0 0x7f6464071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6462000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64641513f0 0x7f6464071120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47196/0 (socket says 172.21.15.73:47196) 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6462000640 1 -- 172.21.15.73:0/3889644306 learned_addr learned my addr 172.21.15.73:0/3889644306 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.545+0000 7f6462a00640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64640c5a10 0x7f64640c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f6463400640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6464071660 0x7f646414bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f6462000640 1 -- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6464071660 msgr2=0x7f646414bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f6462000640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6464071660 0x7f646414bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f6462000640 1 -- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64640c5a10 msgr2=0x7f64640c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f6462000640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64640c5a10 0x7f64640c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f6462000640 1 -- 172.21.15.73:0/3889644306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c009b30 con 0x7f64641513f0 2024-03-23T06:10:03.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f6462000640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64641513f0 0x7f6464071120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f644c000f80 tx=0x7f644c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:03.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f645aa00640 1 -- 172.21.15.73:0/3889644306 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c009510 con 0x7f64641513f0 2024-03-23T06:10:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f645aa00640 1 -- 172.21.15.73:0/3889644306 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c03e450 con 0x7f64641513f0 2024-03-23T06:10:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6464155de0 con 0x7f64641513f0 2024-03-23T06:10:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.546+0000 7f645aa00640 1 -- 172.21.15.73:0/3889644306 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c03e800 con 0x7f64641513f0 2024-03-23T06:10:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.547+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6464156430 con 0x7f64641513f0 2024-03-23T06:10:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.548+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646404e110 con 0x7f64641513f0 2024-03-23T06:10:03.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.548+0000 7f645aa00640 1 -- 172.21.15.73:0/3889644306 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f644c03e960 con 0x7f64641513f0 2024-03-23T06:10:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.549+0000 7f645aa00640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f644006ac30 0x7f644006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.549+0000 7f645aa00640 1 -- 172.21.15.73:0/3889644306 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f644c0ac230 con 0x7f64641513f0 2024-03-23T06:10:03.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.550+0000 7f6462a00640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f644006ac30 0x7f644006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:03.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.550+0000 7f6462a00640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f644006ac30 0x7f644006d0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6454000f60 tx=0x7f6454009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:03.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.553+0000 7f645aa00640 1 -- 172.21.15.73:0/3889644306 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f644c077140 con 0x7f64641513f0 2024-03-23T06:10:03.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.746+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64640c55d0 con 0x7f64641513f0 2024-03-23T06:10:03.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.749+0000 7f645aa00640 1 -- 172.21.15.73:0/3889644306 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f644c07a760 con 0x7f64641513f0 2024-03-23T06:10:03.750 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:03.750 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f644006ac30 msgr2=0x7f644006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f644006ac30 0x7f644006d0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6454000f60 tx=0x7f6454009040 comp rx=0 tx=0).stop 2024-03-23T06:10:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64641513f0 msgr2=0x7f6464071120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64641513f0 0x7f6464071120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f644c000f80 tx=0x7f644c004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 shutdown_connections 2024-03-23T06:10:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f644006ac30 0x7f644006d0f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6464071660 0x7f646414bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64641513f0 0x7f6464071120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 --2- 172.21.15.73:0/3889644306 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64640c5a10 0x7f64640c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:03.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 >> 172.21.15.73:0/3889644306 conn(0x7f646406bb40 msgr2=0x7f646406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:03.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.752+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 shutdown_connections 2024-03-23T06:10:03.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.753+0000 7f6469800640 1 -- 172.21.15.73:0/3889644306 wait complete. 2024-03-23T06:10:03.788 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:10:03.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.999+0000 7ff5a2600640 1 Processor -- start 2024-03-23T06:10:03.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:03.999+0000 7ff5a2600640 1 -- start start 2024-03-23T06:10:04.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff5a2600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff5a2600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c06bee0 con 0x7ff59c0c6f10 2024-03-23T06:10:04.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff5a2600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c0c6a80 con 0x7ff59c151230 2024-03-23T06:10:04.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff5a2600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c06adc0 con 0x7ff59c06b3a0 2024-03-23T06:10:04.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff59aa00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff59c0c6f10 0x7ff59c0c5080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46732/0 (socket says 172.21.15.73:46732) 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff59aa00640 1 -- 172.21.15.73:0/1306926465 learned_addr learned my addr 172.21.15.73:0/1306926465 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff59be00640 1 --2- 172.21.15.73:0/1306926465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff59a000640 1 -- 172.21.15.73:0/1306926465 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049619269 0 0) 0x7ff59c0c6a80 con 0x7ff59c151230 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff59a000640 1 -- 172.21.15.73:0/1306926465 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff580003520 con 0x7ff59c151230 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.001+0000 7ff59a000640 1 -- 172.21.15.73:0/1306926465 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924513746 0 0) 0x7ff59c06bee0 con 0x7ff59c0c6f10 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.002+0000 7ff59a000640 1 -- 172.21.15.73:0/1306926465 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff59c0c6a80 con 0x7ff59c0c6f10 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.002+0000 7ff59be00640 1 -- 172.21.15.73:0/1306926465 >> v1:172.21.15.110:6789/0 conn(0x7ff59c151230 legacy=0x7ff59c0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.002+0000 7ff59be00640 1 -- 172.21.15.73:0/1306926465 >> v1:172.21.15.73:6789/0 conn(0x7ff59c0c6f10 legacy=0x7ff59c0c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.002+0000 7ff59be00640 1 -- 172.21.15.73:0/1306926465 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c0c7980 con 0x7ff59c06b3a0 2024-03-23T06:10:04.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.003+0000 7ff59be00640 1 --2- 172.21.15.73:0/1306926465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c0c7440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff594009dc0 tx=0x7ff59402bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f5ddf0bfa68cf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:04.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.003+0000 7ff59a000640 1 -- 172.21.15.73:0/1306926465 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59402cd50 con 0x7ff59c06b3a0 2024-03-23T06:10:04.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.003+0000 7ff59a000640 1 -- 172.21.15.73:0/1306926465 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594034440 con 0x7ff59c06b3a0 2024-03-23T06:10:04.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.003+0000 7ff59a000640 1 -- 172.21.15.73:0/1306926465 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940347d0 con 0x7ff59c06b3a0 2024-03-23T06:10:04.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.003+0000 7ff5a2600640 1 -- 172.21.15.73:0/1306926465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 msgr2=0x7ff59c0c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.003+0000 7ff5a2600640 1 --2- 172.21.15.73:0/1306926465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c0c7440 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff594009dc0 tx=0x7ff59402bfa0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.004+0000 7ff5a2600640 1 -- 172.21.15.73:0/1306926465 shutdown_connections 2024-03-23T06:10:04.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.004+0000 7ff5a2600640 1 --2- 172.21.15.73:0/1306926465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c0c7440 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.004+0000 7ff5a2600640 1 -- 172.21.15.73:0/1306926465 >> 172.21.15.73:0/1306926465 conn(0x7ff59c0cba10 msgr2=0x7ff59c0cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:04.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.004+0000 7ff5a2600640 1 -- 172.21.15.73:0/1306926465 shutdown_connections 2024-03-23T06:10:04.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.004+0000 7ff5a2600640 1 -- 172.21.15.73:0/1306926465 wait complete. 2024-03-23T06:10:04.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.005+0000 7ff5a2600640 1 Processor -- start 2024-03-23T06:10:04.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.006+0000 7ff5a2600640 1 -- start start 2024-03-23T06:10:04.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.006+0000 7ff5a2600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.006+0000 7ff5a2600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff59c0c6f10 0x7ff59c0bdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.006+0000 7ff5a2600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff59c151230 0x7ff59c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.006+0000 7ff5a2600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0c4b00 con 0x7ff59c151230 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.006+0000 7ff5a2600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0c3f60 con 0x7ff59c0c6f10 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.006+0000 7ff5a2600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0c4f90 con 0x7ff59c06b3a0 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff59c151230 0x7ff59c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff59c151230 0x7ff59c1537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47210/0 (socket says 172.21.15.73:47210) 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 -- 172.21.15.73:0/964197099 learned_addr learned my addr 172.21.15.73:0/964197099 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59b400640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59aa00640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff59c0c6f10 0x7ff59c0bdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 -- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 msgr2=0x7ff59c149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 -- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff59c0c6f10 msgr2=0x7ff59c0bdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff59c0c6f10 0x7ff59c0bdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 -- 172.21.15.73:0/964197099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594009a70 con 0x7ff59c151230 2024-03-23T06:10:04.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.007+0000 7ff59be00640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff59c151230 0x7ff59c1537d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff594037040 tx=0x7ff594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:04.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.008+0000 7ff593400640 1 -- 172.21.15.73:0/964197099 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594040450 con 0x7ff59c151230 2024-03-23T06:10:04.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.008+0000 7ff593400640 1 -- 172.21.15.73:0/964197099 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5940405b0 con 0x7ff59c151230 2024-03-23T06:10:04.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.008+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c0c14c0 con 0x7ff59c151230 2024-03-23T06:10:04.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.008+0000 7ff593400640 1 -- 172.21.15.73:0/964197099 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594040960 con 0x7ff59c151230 2024-03-23T06:10:04.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.008+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c0c44b0 con 0x7ff59c151230 2024-03-23T06:10:04.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.009+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c04e110 con 0x7ff59c151230 2024-03-23T06:10:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.010+0000 7ff593400640 1 -- 172.21.15.73:0/964197099 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff594040ac0 con 0x7ff59c151230 2024-03-23T06:10:04.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.011+0000 7ff593400640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff57c06ac80 0x7ff57c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.011+0000 7ff593400640 1 -- 172.21.15.73:0/964197099 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff5940abfa0 con 0x7ff59c151230 2024-03-23T06:10:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.011+0000 7ff59b400640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff57c06ac80 0x7ff57c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.012+0000 7ff59b400640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff57c06ac80 0x7ff57c06d140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0011e0 tx=0x7ff58c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:04.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.015+0000 7ff593400640 1 -- 172.21.15.73:0/964197099 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff594077040 con 0x7ff59c151230 2024-03-23T06:10:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.246+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff59c0cadc0 con 0x7ff59c151230 2024-03-23T06:10:04.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.248+0000 7ff593400640 1 -- 172.21.15.73:0/964197099 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6245 (secure 0 0 0) 0x7ff59407a660 con 0x7ff59c151230 2024-03-23T06:10:04.248 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:04.248 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4256,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:03.423799+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-23T06:10:04.248 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 7 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.250+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff57c06ac80 msgr2=0x7ff57c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.250+0000 7ff5a2600640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff57c06ac80 0x7ff57c06d140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff58c0011e0 tx=0x7ff58c009040 comp rx=0 tx=0).stop 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.250+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff59c151230 msgr2=0x7ff59c1537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.250+0000 7ff5a2600640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff59c151230 0x7ff59c1537d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff594037040 tx=0x7ff594004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.251+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 shutdown_connections 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.251+0000 7ff5a2600640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff59c151230 0x7ff59c1537d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.251+0000 7ff5a2600640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff59c0c6f10 0x7ff59c0bdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.251+0000 7ff5a2600640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff57c06ac80 0x7ff57c06d140 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.251+0000 7ff5a2600640 1 --2- 172.21.15.73:0/964197099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff59c06b3a0 0x7ff59c149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.251+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 >> 172.21.15.73:0/964197099 conn(0x7ff59c0cba10 msgr2=0x7ff59c14ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.251+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 shutdown_connections 2024-03-23T06:10:04.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.251+0000 7ff5a2600640 1 -- 172.21.15.73:0/964197099 wait complete. 2024-03-23T06:10:04.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.473+0000 7fe21dc00640 1 Processor -- start 2024-03-23T06:10:04.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.473+0000 7fe21dc00640 1 -- start start 2024-03-23T06:10:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe21dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe218153780 0x7fe2180cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe21dc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe218153b60 0x7fe2180ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe21dc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21815d940 con 0x7fe21815cb70 2024-03-23T06:10:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe21dc00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2180cb670 con 0x7fe218153b60 2024-03-23T06:10:04.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe21dc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180c4cc0 con 0x7fe218153780 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe216000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe218153b60 0x7fe2180ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe217400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe21815cb70 0x7fe2180c5150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48684/0 (socket says 172.21.15.73:48684) 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe217400640 1 -- 172.21.15.73:0/458443998 learned_addr learned my addr 172.21.15.73:0/458443998 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe216a00640 1 --2- 172.21.15.73:0/458443998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe218153780 0x7fe2180cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe215600640 1 -- 172.21.15.73:0/458443998 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754805471 0 0) 0x7fe21815d940 con 0x7fe21815cb70 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.475+0000 7fe215600640 1 -- 172.21.15.73:0/458443998 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1fc003520 con 0x7fe21815cb70 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.476+0000 7fe216000640 1 -- 172.21.15.73:0/458443998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe218153780 msgr2=0x7fe2180cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.476+0000 7fe216000640 1 --2- 172.21.15.73:0/458443998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe218153780 0x7fe2180cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.476+0000 7fe216000640 1 -- 172.21.15.73:0/458443998 >> v1:172.21.15.110:6789/0 conn(0x7fe21815cb70 legacy=0x7fe2180c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.476+0000 7fe216000640 1 -- 172.21.15.73:0/458443998 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2180c3db0 con 0x7fe218153b60 2024-03-23T06:10:04.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.476+0000 7fe216a00640 1 --2- 172.21.15.73:0/458443998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe218153780 0x7fe2180cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.477+0000 7fe216000640 1 --2- 172.21.15.73:0/458443998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153b60 0x7fe2180ca170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2000097a0 tx=0x7fe20002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d86b61cb8223dcb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.477+0000 7fe215600640 1 -- 172.21.15.73:0/458443998 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20002d040 con 0x7fe218153b60 2024-03-23T06:10:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.477+0000 7fe215600640 1 -- 172.21.15.73:0/458443998 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe200031810 con 0x7fe218153b60 2024-03-23T06:10:04.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.477+0000 7fe215600640 1 -- 172.21.15.73:0/458443998 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200031ba0 con 0x7fe218153b60 2024-03-23T06:10:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.478+0000 7fe21dc00640 1 -- 172.21.15.73:0/458443998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153b60 msgr2=0x7fe2180ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.478+0000 7fe21dc00640 1 --2- 172.21.15.73:0/458443998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153b60 0x7fe2180ca170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe2000097a0 tx=0x7fe20002b8b0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.478+0000 7fe21dc00640 1 -- 172.21.15.73:0/458443998 shutdown_connections 2024-03-23T06:10:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.478+0000 7fe21dc00640 1 --2- 172.21.15.73:0/458443998 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153b60 0x7fe2180ca170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.478+0000 7fe21dc00640 1 --2- 172.21.15.73:0/458443998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe218153780 0x7fe2180cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.478+0000 7fe21dc00640 1 -- 172.21.15.73:0/458443998 >> 172.21.15.73:0/458443998 conn(0x7fe2180cf410 msgr2=0x7fe2180cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.478+0000 7fe21dc00640 1 -- 172.21.15.73:0/458443998 shutdown_connections 2024-03-23T06:10:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.478+0000 7fe21dc00640 1 -- 172.21.15.73:0/458443998 wait complete. 2024-03-23T06:10:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.480+0000 7fe21dc00640 1 Processor -- start 2024-03-23T06:10:04.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.480+0000 7fe21dc00640 1 -- start start 2024-03-23T06:10:04.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe21dc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153780 0x7fe2181477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe21dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe218153b60 0x7fe218147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe21dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe21815cb70 0x7fe2180c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe21dc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21814fa00 con 0x7fe218153780 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe21dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2180c6770 con 0x7fe218153b60 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe21dc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2181ef280 con 0x7fe21815cb70 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153780 0x7fe2181477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153780 0x7fe2181477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47228/0 (socket says 172.21.15.73:47228) 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216a00640 1 -- 172.21.15.73:0/1037426450 learned_addr learned my addr 172.21.15.73:0/1037426450 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216000640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe218153b60 0x7fe218147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe217400640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe21815cb70 0x7fe2180c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216a00640 1 -- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe21815cb70 msgr2=0x7fe2180c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216a00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe21815cb70 0x7fe2180c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216a00640 1 -- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe218153b60 msgr2=0x7fe218147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216a00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe218153b60 0x7fe218147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.481+0000 7fe216a00640 1 -- 172.21.15.73:0/1037426450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210009a70 con 0x7fe218153780 2024-03-23T06:10:04.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.482+0000 7fe216a00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153780 0x7fe2181477e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe21000efc0 tx=0x7fe21000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.482+0000 7fe20ea00640 1 -- 172.21.15.73:0/1037426450 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210014680 con 0x7fe218153780 2024-03-23T06:10:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.482+0000 7fe20ea00640 1 -- 172.21.15.73:0/1037426450 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21000f040 con 0x7fe218153780 2024-03-23T06:10:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.482+0000 7fe20ea00640 1 -- 172.21.15.73:0/1037426450 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe210014a00 con 0x7fe218153780 2024-03-23T06:10:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.482+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe200009400 con 0x7fe218153780 2024-03-23T06:10:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.482+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2181ef520 con 0x7fe218153780 2024-03-23T06:10:04.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.483+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21804e110 con 0x7fe218153780 2024-03-23T06:10:04.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.484+0000 7fe20ea00640 1 -- 172.21.15.73:0/1037426450 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe210014b60 con 0x7fe218153780 2024-03-23T06:10:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.486+0000 7fe20ea00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1f406ac00 0x7fe1f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.486+0000 7fe20ea00640 1 -- 172.21.15.73:0/1037426450 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe21008a750 con 0x7fe218153780 2024-03-23T06:10:04.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.486+0000 7fe216000640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1f406ac00 0x7fe1f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:04.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.486+0000 7fe216000640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1f406ac00 0x7fe1f406d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe200036000 tx=0x7fe20003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:04.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.491+0000 7fe20ea00640 1 -- 172.21.15.73:0/1037426450 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe2100555c0 con 0x7fe218153780 2024-03-23T06:10:04.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.688+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2181ef800 con 0x7fe218153780 2024-03-23T06:10:04.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.690+0000 7fe20ea00640 1 -- 172.21.15.73:0/1037426450 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7fe210058be0 con 0x7fe218153780 2024-03-23T06:10:04.690 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:04.691 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:04.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1f406ac00 msgr2=0x7fe1f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1f406ac00 0x7fe1f406d0c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe200036000 tx=0x7fe20003c040 comp rx=0 tx=0).stop 2024-03-23T06:10:04.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153780 msgr2=0x7fe2181477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:04.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153780 0x7fe2181477e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe21000efc0 tx=0x7fe21000c490 comp rx=0 tx=0).stop 2024-03-23T06:10:04.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 shutdown_connections 2024-03-23T06:10:04.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1f406ac00 0x7fe1f406d0c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe21815cb70 0x7fe2180c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe218153b60 0x7fe218147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 --2- 172.21.15.73:0/1037426450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe218153780 0x7fe2181477e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:04.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.693+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 >> 172.21.15.73:0/1037426450 conn(0x7fe2180cf410 msgr2=0x7fe218150eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:04.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.694+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 shutdown_connections 2024-03-23T06:10:04.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:04.694+0000 7fe21dc00640 1 -- 172.21.15.73:0/1037426450 wait complete. 2024-03-23T06:10:05.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-23T06:09:57.917296+0000', 'modified': '2024-03-23T06:10:03.423799+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.110:6837/3132183330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 3132183330}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 3132183330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-03-23T06:10:05.316 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-23T06:10:05.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-23T06:10:05.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.537+0000 7f4b64800640 1 Processor -- start 2024-03-23T06:10:05.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.537+0000 7f4b64800640 1 -- start start 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.538+0000 7f4b64800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b5c151480 0x7f4b5c157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.538+0000 7f4b64800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c158cf0 0x7f4b5c159130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.538+0000 7f4b64800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c15b710 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.538+0000 7f4b64800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c1588d0 con 0x7f4b5c151480 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.538+0000 7f4b64800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c15a680 con 0x7f4b5c158cf0 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b61e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b5c151480 0x7f4b5c157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b61400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4b5c0c7e40 0x7f4b5c071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46734/0 (socket says 172.21.15.73:46734) 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b61e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b5c151480 0x7f4b5c157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47234/0 (socket says 172.21.15.73:47234) 2024-03-23T06:10:05.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b61400640 1 -- 172.21.15.73:0/3106757855 learned_addr learned my addr 172.21.15.73:0/3106757855 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:05.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b62800640 1 --2- 172.21.15.73:0/3106757855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c158cf0 0x7f4b5c159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b61e00640 1 -- 172.21.15.73:0/3106757855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c158cf0 msgr2=0x7f4b5c159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:05.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b61e00640 1 --2- 172.21.15.73:0/3106757855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c158cf0 0x7f4b5c159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b61e00640 1 -- 172.21.15.73:0/3106757855 >> v1:172.21.15.73:6789/0 conn(0x7f4b5c0c7e40 legacy=0x7f4b5c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:05.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b61e00640 1 -- 172.21.15.73:0/3106757855 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c15ab90 con 0x7f4b5c151480 2024-03-23T06:10:05.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.539+0000 7f4b60a00640 1 -- 172.21.15.73:0/3106757855 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369360892 0 0) 0x7f4b5c15b710 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.540+0000 7f4b61e00640 1 --2- 172.21.15.73:0/3106757855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c157e60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b500097a0 tx=0x7f4b5002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a20b349695d2ca server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.540+0000 7f4b60a00640 1 -- 172.21.15.73:0/3106757855 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50030800 con 0x7f4b5c151480 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b60a00640 1 -- 172.21.15.73:0/3106757855 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50030960 con 0x7f4b5c151480 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b60a00640 1 -- 172.21.15.73:0/3106757855 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50030cf0 con 0x7f4b5c151480 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b64800640 1 -- 172.21.15.73:0/3106757855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 msgr2=0x7f4b5c157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b64800640 1 --2- 172.21.15.73:0/3106757855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c157e60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b500097a0 tx=0x7f4b5002b940 comp rx=0 tx=0).stop 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b64800640 1 -- 172.21.15.73:0/3106757855 shutdown_connections 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b64800640 1 --2- 172.21.15.73:0/3106757855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c158cf0 0x7f4b5c159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b64800640 1 --2- 172.21.15.73:0/3106757855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c157e60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b64800640 1 -- 172.21.15.73:0/3106757855 >> 172.21.15.73:0/3106757855 conn(0x7f4b5c069cb0 msgr2=0x7f4b5c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:05.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b64800640 1 -- 172.21.15.73:0/3106757855 shutdown_connections 2024-03-23T06:10:05.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.541+0000 7f4b64800640 1 -- 172.21.15.73:0/3106757855 wait complete. 2024-03-23T06:10:05.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.543+0000 7f4b64800640 1 Processor -- start 2024-03-23T06:10:05.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.543+0000 7f4b64800640 1 -- start start 2024-03-23T06:10:05.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b64800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c0c7e40 0x7f4b5c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b64800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b64800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b5c158cf0 0x7f4b5c150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b64800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c151fd0 con 0x7f4b5c151480 2024-03-23T06:10:05.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b64800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1ee780 con 0x7f4b5c158cf0 2024-03-23T06:10:05.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b64800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1eea00 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b61400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c0c7e40 0x7f4b5c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b62800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b5c158cf0 0x7f4b5c150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b61400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47250/0 (socket says 172.21.15.73:47250) 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.544+0000 7f4b61400640 1 -- 172.21.15.73:0/1498013255 learned_addr learned my addr 172.21.15.73:0/1498013255 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b61e00640 1 -- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b5c158cf0 msgr2=0x7f4b5c150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b61e00640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b5c158cf0 0x7f4b5c150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b61e00640 1 -- 172.21.15.73:0/1498013255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 msgr2=0x7f4b5c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b61e00640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c150420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b61e00640 1 -- 172.21.15.73:0/1498013255 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50009400 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b62800640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b5c158cf0 0x7f4b5c150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b61400640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b61e00640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c0c7e40 0x7f4b5c0afc80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b50033000 tx=0x7f4b500046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b56000640 1 -- 172.21.15.73:0/1498013255 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50039c90 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b56000640 1 -- 172.21.15.73:0/1498013255 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5003f040 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b64800640 1 -- 172.21.15.73:0/1498013255 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c1eece0 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.545+0000 7f4b56000640 1 -- 172.21.15.73:0/1498013255 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50004030 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.546+0000 7f4b64800640 1 -- 172.21.15.73:0/1498013255 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c1ef2a0 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.548+0000 7f4b56000640 1 -- 172.21.15.73:0/1498013255 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4b500041b0 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.548+0000 7f4b56000640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4b4006ac30 0x7f4b4006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.549+0000 7f4b56000640 1 -- 172.21.15.73:0/1498013255 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b500ab460 con 0x7f4b5c0c7e40 2024-03-23T06:10:05.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.549+0000 7f4b61400640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4b4006ac30 0x7f4b4006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.549+0000 7f4b61400640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4b4006ac30 0x7f4b4006d0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c1597a0 tx=0x7f4b4c007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:05.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.549+0000 7f4b67568740 1 Processor -- start 2024-03-23T06:10:05.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.549+0000 7f4b67568740 1 -- start start 2024-03-23T06:10:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.550+0000 7f4b67568740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cdaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.550+0000 7f4b67568740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97cdb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.550+0000 7f4b67568740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97cd9160 0x562d97d19f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.550+0000 7f4b67568740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d97cb02c0 con 0x562d97cda700 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.550+0000 7f4b67568740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d97c458f0 con 0x562d97cd9160 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.550+0000 7f4b67568740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d97c43080 con 0x562d97d24580 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.550+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cdaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cdaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47254/0 (socket says 172.21.15.73:47254) 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61e00640 1 -- 172.21.15.73:0/1909509936 learned_addr learned my addr 172.21.15.73:0/1909509936 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61400640 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97cdb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b62800640 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97cd9160 0x562d97d19f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61e00640 1 -- 172.21.15.73:0/1909509936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 msgr2=0x562d97cdb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61e00640 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97cdb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61e00640 1 -- 172.21.15.73:0/1909509936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97cd9160 msgr2=0x562d97d19f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:05.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61e00640 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97cd9160 0x562d97d19f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61e00640 1 -- 172.21.15.73:0/1909509936 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d97c09a10 con 0x562d97cda700 2024-03-23T06:10:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b61e00640 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cdaae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b50032040 tx=0x7f4b500798f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8865f70e9ae82d25 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b4aa00640 1 -- 172.21.15.73:0/1909509936 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50082360 con 0x562d97cda700 2024-03-23T06:10:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b4aa00640 1 -- 172.21.15.73:0/1909509936 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b500780d0 con 0x562d97cda700 2024-03-23T06:10:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.551+0000 7f4b4aa00640 1 -- 172.21.15.73:0/1909509936 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500766a0 con 0x562d97cda700 2024-03-23T06:10:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 -- 172.21.15.73:0/1909509936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 msgr2=0x562d97cdaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:05.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cdaae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b50032040 tx=0x7f4b500798f0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 -- 172.21.15.73:0/1909509936 shutdown_connections 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97cd9160 0x562d97d19f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97cdb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 --2- 172.21.15.73:0/1909509936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cdaae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 -- 172.21.15.73:0/1909509936 >> 172.21.15.73:0/1909509936 conn(0x562d97cd6e70 msgr2=0x562d97cd97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 -- 172.21.15.73:0/1909509936 shutdown_connections 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.552+0000 7f4b67568740 1 -- 172.21.15.73:0/1909509936 wait complete. 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.553+0000 7f4b67568740 1 -- start start 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.553+0000 7f4b67568740 1 Processor -- start 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b67568740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cd4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b67568740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97d22800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b67568740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 0x562d97d02630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b67568740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d97c3e970 con 0x562d97cda700 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b67568740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d97be00a0 con 0x562d97d14570 2024-03-23T06:10:05.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b67568740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d97bdfd40 con 0x562d97d24580 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b67568740 10 client.0 _ll_register_callbacks cb 0x562d97c37fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cd4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cd4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47268/0 (socket says 172.21.15.73:47268) 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b61e00640 1 -- 172.21.15.73:0/4063608896 learned_addr learned my addr 172.21.15.73:0/4063608896 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b61400640 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97d22800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.554+0000 7f4b62800640 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 0x562d97d02630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b61e00640 1 -- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 msgr2=0x562d97d22800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b61e00640 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97d22800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b61e00640 1 -- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 msgr2=0x562d97d02630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b61e00640 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 0x562d97d02630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b61e00640 1 -- 172.21.15.73:0/4063608896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c1ef2a0 con 0x562d97cda700 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b61e00640 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cd4100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b500097a0 tx=0x7f4b5002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68d58e7d95dd7a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b3f400640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b3f400640 1 -- 172.21.15.73:0/4063608896 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500ab230 con 0x562d97cda700 2024-03-23T06:10:05.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b3f400640 1 -- 172.21.15.73:0/4063608896 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b50081ed0 con 0x562d97cda700 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.555+0000 7f4b67568740 1 -- 172.21.15.73:0/4063608896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d97c68b10 con 0x562d97cda700 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b3f400640 1 -- 172.21.15.73:0/4063608896 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b50082090 con 0x562d97cda700 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b67568740 10 client.4335 fetch_fsmap learned FSMap version 7 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b67568740 1 -- 172.21.15.73:0/4063608896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562d97c3cff0 con 0x562d97cda700 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b3f400640 1 -- 172.21.15.73:0/4063608896 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562d97c68b10 con 0x562d97cda700 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b3f400640 1 -- 172.21.15.73:0/4063608896 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f4b50042070 con 0x562d97cda700 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b67568740 10 client.4335 fetch_fsmap finished waiting for FSMap version 7 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b67568740 10 client.4335 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b67568740 20 client.4335 populate_metadata read hostname 'smithi073' 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b67568740 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d15e30 0x562d97d16210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b67568740 4 client.4335 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b67568740 1 -- 172.21.15.73:0/4063608896 --> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d979323c0 con 0x562d97d15e30 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.556+0000 7f4b61400640 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d15e30 0x562d97d16210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.557+0000 7f4b61400640 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d15e30 0x562d97d16210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4333ee517ff7e397 server_cookie=468a7b9d414ae4b in_seq=0 out_seq=0 2024-03-23T06:10:05.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:05.557+0000 7f4b3f400640 10 client.4335 ms_handle_connect on v2:172.21.15.110:6834/3132183330 2024-03-23T06:10:08.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.427+0000 7f4b3f400640 1 -- 172.21.15.73:0/4063608896 <== mds.0 v2:172.21.15.110:6834/3132183330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x562d979323c0 con 0x562d97d15e30 2024-03-23T06:10:08.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.427+0000 7f4b3f400640 10 client.4335 handle_command_reply: tid=0 2024-03-23T06:10:08.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 client.4335 shutdown 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 -- 172.21.15.73:0/4063608896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 msgr2=0x562d97cd4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cd4100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4b500097a0 tx=0x7f4b5002b940 comp rx=0 tx=0).stop 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 -- 172.21.15.73:0/4063608896 shutdown_connections 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d15e30 0x562d97d16210 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 0x562d97d02630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97d22800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 --2- 172.21.15.73:0/4063608896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97cd4100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b67568740 1 -- 172.21.15.73:0/4063608896 >> 172.21.15.73:0/4063608896 conn(0x562d97cd9160 msgr2=0x562d97cdaae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.428+0000 7f4b3f400640 0 client.4335 ms_handle_reset on v2:172.21.15.110:6834/3132183330 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.429+0000 7f4b67568740 1 -- 172.21.15.73:0/4063608896 shutdown_connections 2024-03-23T06:10:08.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.429+0000 7f4b67568740 1 -- 172.21.15.73:0/4063608896 wait complete. 2024-03-23T06:10:08.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.429+0000 7f4b67568740 20 client.4335 trim_cache size 0 max 16384 2024-03-23T06:10:08.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.460+0000 7f4b67568740 1 Processor -- start 2024-03-23T06:10:08.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.460+0000 7f4b67568740 1 -- start start 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b67568740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d22720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b67568740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 0x562d97d22c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b67568740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97cd9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b67568740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d97d19210 con 0x562d97cda700 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b67568740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d979a5f20 con 0x562d97d14570 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b67568740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d97d156d0 con 0x562d97d24580 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d22720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b61400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 0x562d97d22c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d22720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47274/0 (socket says 172.21.15.73:47274) 2024-03-23T06:10:08.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b61e00640 1 -- 172.21.15.73:0/3346227835 learned_addr learned my addr 172.21.15.73:0/3346227835 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:08.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.462+0000 7f4b62800640 1 --2- 172.21.15.73:0/3346227835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97cd9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.463+0000 7f4b61e00640 1 -- 172.21.15.73:0/3346227835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 msgr2=0x562d97cd9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.463+0000 7f4b61e00640 1 --2- 172.21.15.73:0/3346227835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97cd9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.463+0000 7f4b61e00640 1 -- 172.21.15.73:0/3346227835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 msgr2=0x562d97d22c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.463+0000 7f4b61e00640 1 --2- 172.21.15.73:0/3346227835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 0x562d97d22c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.463+0000 7f4b61e00640 1 -- 172.21.15.73:0/3346227835 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d97c727c0 con 0x562d97cda700 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.463+0000 7f4b61e00640 1 --2- 172.21.15.73:0/3346227835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d22720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b500769b0 tx=0x7f4b50030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecafb3ecd3e00e6d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.463+0000 7f4b4b400640 1 -- 172.21.15.73:0/3346227835 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50079f90 con 0x562d97cda700 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.464+0000 7f4b4b400640 1 -- 172.21.15.73:0/3346227835 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b50081ed0 con 0x562d97cda700 2024-03-23T06:10:08.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.464+0000 7f4b4b400640 1 -- 172.21.15.73:0/3346227835 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500ab230 con 0x562d97cda700 2024-03-23T06:10:08.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 -- 172.21.15.73:0/3346227835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 msgr2=0x562d97d22720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 --2- 172.21.15.73:0/3346227835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d22720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b500769b0 tx=0x7f4b50030f90 comp rx=0 tx=0).stop 2024-03-23T06:10:08.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 -- 172.21.15.73:0/3346227835 shutdown_connections 2024-03-23T06:10:08.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 --2- 172.21.15.73:0/3346227835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d24580 0x562d97cd9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 --2- 172.21.15.73:0/3346227835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d14570 0x562d97d22c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 --2- 172.21.15.73:0/3346227835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d22720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 -- 172.21.15.73:0/3346227835 >> 172.21.15.73:0/3346227835 conn(0x562d97cd9160 msgr2=0x562d97d193b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:08.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 -- 172.21.15.73:0/3346227835 shutdown_connections 2024-03-23T06:10:08.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.465+0000 7f4b67568740 1 -- 172.21.15.73:0/3346227835 wait complete. 2024-03-23T06:10:08.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.466+0000 7f4b67568740 1 -- start start 2024-03-23T06:10:08.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.467+0000 7f4b67568740 1 Processor -- start 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b67568740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d17bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b67568740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d14570 0x562d97d837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b67568740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d24580 0x562d97d83cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b67568740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d97d2b3c0 con 0x562d97cda700 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b67568740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d97d2b180 con 0x562d97d24580 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b67568740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d97cd04c0 con 0x562d97d14570 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b67568740 10 client.0 _ll_register_callbacks cb 0x562d97d15000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d17bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d17bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47290/0 (socket says 172.21.15.73:47290) 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.469+0000 7f4b61e00640 1 -- 172.21.15.73:0/306051031 learned_addr learned my addr 172.21.15.73:0/306051031 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:08.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b62800640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d24580 0x562d97d83cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b61400640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d14570 0x562d97d837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b61e00640 1 -- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d14570 msgr2=0x562d97d837b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b61e00640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d14570 0x562d97d837b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b61e00640 1 -- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d24580 msgr2=0x562d97d83cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b61e00640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d24580 0x562d97d83cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b61e00640 1 -- 172.21.15.73:0/306051031 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d97c3cff0 con 0x562d97cda700 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b61400640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d14570 0x562d97d837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b61e00640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d17bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b50079c90 tx=0x7f4b500aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba03329567d1ebb5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:08.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b3f400640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-23T06:10:08.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.470+0000 7f4b3f400640 1 -- 172.21.15.73:0/306051031 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b50082040 con 0x562d97cda700 2024-03-23T06:10:08.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b3f400640 1 -- 172.21.15.73:0/306051031 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b50079f90 con 0x562d97cda700 2024-03-23T06:10:08.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b67568740 1 -- 172.21.15.73:0/306051031 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b500780d0 con 0x562d97cda700 2024-03-23T06:10:08.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b3f400640 1 -- 172.21.15.73:0/306051031 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b50075d80 con 0x562d97cda700 2024-03-23T06:10:08.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b67568740 10 client.4341 fetch_fsmap learned FSMap version 7 2024-03-23T06:10:08.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b67568740 1 -- 172.21.15.73:0/306051031 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x562d97bdf2b0 con 0x562d97cda700 2024-03-23T06:10:08.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b3f400640 1 -- 172.21.15.73:0/306051031 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b500780d0 con 0x562d97cda700 2024-03-23T06:10:08.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b3f400640 1 -- 172.21.15.73:0/306051031 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f4b50098070 con 0x562d97cda700 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b67568740 10 client.4341 fetch_fsmap finished waiting for FSMap version 7 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.471+0000 7f4b67568740 10 client.4341 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.472+0000 7f4b67568740 20 client.4341 populate_metadata read hostname 'smithi073' 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.472+0000 7f4b67568740 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 0x562d97d128a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.472+0000 7f4b67568740 4 client.4341 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.472+0000 7f4b67568740 1 -- 172.21.15.73:0/306051031 --> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562d979436c0 con 0x562d97d2aa80 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.472+0000 7f4b61400640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 0x562d97d128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.473+0000 7f4b61400640 1 -- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 msgr2=0x562d97d128a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.473+0000 7f4b61400640 1 -- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 msgr2=0x562d97d128a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.473+0000 7f4b61400640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 0x562d97d128a0 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:10:08.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.473+0000 7f4b61400640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 0x562d97d128a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:10:08.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.674+0000 7f4b61400640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 0x562d97d128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.675+0000 7f4b61400640 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 0x562d97d128a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c03141a4c2d77cae server_cookie=57ea8e6ef0b159dd in_seq=0 out_seq=0 2024-03-23T06:10:08.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.675+0000 7f4b3f400640 10 client.4341 ms_handle_connect on v2:172.21.15.110:6834/3132183330 2024-03-23T06:10:08.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.675+0000 7f4b3f400640 1 -- 172.21.15.73:0/306051031 <== mds.0 v2:172.21.15.110:6834/3132183330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x562d979436c0 con 0x562d97d2aa80 2024-03-23T06:10:08.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.675+0000 7f4b3f400640 10 client.4341 handle_command_reply: tid=0 2024-03-23T06:10:08.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.675+0000 7f4b67568740 1 client.4341 shutdown 2024-03-23T06:10:08.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b67568740 1 -- 172.21.15.73:0/306051031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 msgr2=0x562d97d17bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b67568740 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d17bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b50079c90 tx=0x7f4b500aa000 comp rx=0 tx=0).stop 2024-03-23T06:10:08.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b67568740 1 -- 172.21.15.73:0/306051031 shutdown_connections 2024-03-23T06:10:08.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b67568740 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x562d97d2aa80 0x562d97d128a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b67568740 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562d97d24580 0x562d97d83cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b3f400640 0 client.4341 ms_handle_reset on v2:172.21.15.110:6834/3132183330 2024-03-23T06:10:08.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b67568740 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562d97d14570 0x562d97d837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b67568740 1 --2- 172.21.15.73:0/306051031 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d97cda700 0x562d97d17bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.676+0000 7f4b67568740 1 -- 172.21.15.73:0/306051031 >> 172.21.15.73:0/306051031 conn(0x562d97cd9160 msgr2=0x562d97d22720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:08.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.677+0000 7f4b67568740 1 -- 172.21.15.73:0/306051031 shutdown_connections 2024-03-23T06:10:08.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.677+0000 7f4b67568740 1 -- 172.21.15.73:0/306051031 wait complete. 2024-03-23T06:10:08.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.678+0000 7f4b67568740 20 client.4341 trim_cache size 0 max 16384 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4282, 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 10.755308598999999, 2024-03-23T06:10:08.678 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 6, 2024-03-23T06:10:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 25, 2024-03-23T06:10:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 25, 2024-03-23T06:10:08.679 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 15.625281727000001 2024-03-23T06:10:08.679 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 -- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4b4006ac30 msgr2=0x7f4b4006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4b4006ac30 0x7f4b4006d0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c1597a0 tx=0x7f4b4c007ea0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 -- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c0c7e40 msgr2=0x7f4b5c0afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c0c7e40 0x7f4b5c0afc80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b50033000 tx=0x7f4b500046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 -- 172.21.15.73:0/1498013255 shutdown_connections 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b5c158cf0 0x7f4b5c150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b5c151480 0x7f4b5c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4b4006ac30 0x7f4b4006d0f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 --2- 172.21.15.73:0/1498013255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b5c0c7e40 0x7f4b5c0afc80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 -- 172.21.15.73:0/1498013255 >> 172.21.15.73:0/1498013255 conn(0x7f4b5c069cb0 msgr2=0x7f4b5c155130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 -- 172.21.15.73:0/1498013255 shutdown_connections 2024-03-23T06:10:08.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.679+0000 7f4b64800640 1 -- 172.21.15.73:0/1498013255 wait complete. 2024-03-23T06:10:08.704 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-23T06:10:08.704 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-23T06:10:08.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-23T06:10:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.915+0000 7f76eca00640 1 Processor -- start 2024-03-23T06:10:08.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.916+0000 7f76eca00640 1 -- start start 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.917+0000 7f76eca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76e80c5a10 0x7f76e80bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.917+0000 7f76eca00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e8157b60 con 0x7f76e80c03a0 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.917+0000 7f76eca00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e80c0830 con 0x7f76e81513f0 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.917+0000 7f76eca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e8158dc0 con 0x7f76e80c5a10 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.917+0000 7f76e5400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76e80c5a10 0x7f76e80bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.918+0000 7f76e5400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76e80c5a10 0x7f76e80bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:58298/0 (socket says 172.21.15.73:58298) 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.918+0000 7f76e5e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f76e81513f0 0x7f76e81586b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48686/0 (socket says 172.21.15.73:48686) 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.918+0000 7f76e5400640 1 -- 172.21.15.73:0/979595356 learned_addr learned my addr 172.21.15.73:0/979595356 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.918+0000 7f76e5400640 1 -- 172.21.15.73:0/979595356 >> v1:172.21.15.110:6789/0 conn(0x7f76e81513f0 legacy=0x7f76e81586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.918+0000 7f76e5400640 1 -- 172.21.15.73:0/979595356 >> v1:172.21.15.73:6789/0 conn(0x7f76e80c03a0 legacy=0x7f76e8071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.918+0000 7f76e5400640 1 -- 172.21.15.73:0/979595356 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e80c0b10 con 0x7f76e80c5a10 2024-03-23T06:10:08.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.919+0000 7f76e5400640 1 --2- 172.21.15.73:0/979595356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 0x7f76e80bfe60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009870 tx=0x7f76d402bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8a4ed17c5029b87 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:08.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.920+0000 7f76e4a00640 1 -- 172.21.15.73:0/979595356 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d402d870 con 0x7f76e80c5a10 2024-03-23T06:10:08.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.920+0000 7f76e4a00640 1 -- 172.21.15.73:0/979595356 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d402d9d0 con 0x7f76e80c5a10 2024-03-23T06:10:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.920+0000 7f76e4a00640 1 -- 172.21.15.73:0/979595356 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d402dd60 con 0x7f76e80c5a10 2024-03-23T06:10:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.920+0000 7f76eca00640 1 -- 172.21.15.73:0/979595356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 msgr2=0x7f76e80bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.920+0000 7f76eca00640 1 --2- 172.21.15.73:0/979595356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 0x7f76e80bfe60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009870 tx=0x7f76d402bab0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.920+0000 7f76eca00640 1 -- 172.21.15.73:0/979595356 shutdown_connections 2024-03-23T06:10:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.920+0000 7f76eca00640 1 --2- 172.21.15.73:0/979595356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 0x7f76e80bfe60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.920+0000 7f76eca00640 1 -- 172.21.15.73:0/979595356 >> 172.21.15.73:0/979595356 conn(0x7f76e806bb40 msgr2=0x7f76e806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.921+0000 7f76eca00640 1 -- 172.21.15.73:0/979595356 shutdown_connections 2024-03-23T06:10:08.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.921+0000 7f76eca00640 1 -- 172.21.15.73:0/979595356 wait complete. 2024-03-23T06:10:08.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.922+0000 7f76eca00640 1 Processor -- start 2024-03-23T06:10:08.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.922+0000 7f76eca00640 1 -- start start 2024-03-23T06:10:08.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.923+0000 7f76eca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 0x7f76e80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.923+0000 7f76eca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76e81513f0 0x7f76e8154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.923+0000 7f76eca00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e806f9b0 0x7f76e806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.923+0000 7f76eca00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e80adc60 con 0x7f76e81513f0 2024-03-23T06:10:08.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.923+0000 7f76eca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e81ef180 con 0x7f76e80c5a10 2024-03-23T06:10:08.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.923+0000 7f76eca00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e8155720 con 0x7f76e806f9b0 2024-03-23T06:10:08.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76e81513f0 0x7f76e8154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76e81513f0 0x7f76e8154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47294/0 (socket says 172.21.15.73:47294) 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5400640 1 -- 172.21.15.73:0/123493940 learned_addr learned my addr 172.21.15.73:0/123493940 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5e00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 0x7f76e80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e6800640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e806f9b0 0x7f76e806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5400640 1 -- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e806f9b0 msgr2=0x7f76e806fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5400640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e806f9b0 0x7f76e806fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5400640 1 -- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 msgr2=0x7f76e80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5400640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 0x7f76e80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.924+0000 7f76e5400640 1 -- 172.21.15.73:0/123493940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d40094d0 con 0x7f76e81513f0 2024-03-23T06:10:08.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.925+0000 7f76e5400640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76e81513f0 0x7f76e8154e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009990 tx=0x7f76d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.925+0000 7f76de000640 1 -- 172.21.15.73:0/123493940 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d403c040 con 0x7f76e81513f0 2024-03-23T06:10:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.925+0000 7f76de000640 1 -- 172.21.15.73:0/123493940 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4037c60 con 0x7f76e81513f0 2024-03-23T06:10:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.925+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e81ef440 con 0x7f76e81513f0 2024-03-23T06:10:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.925+0000 7f76de000640 1 -- 172.21.15.73:0/123493940 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d402de40 con 0x7f76e81513f0 2024-03-23T06:10:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.925+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e81efa00 con 0x7f76e81513f0 2024-03-23T06:10:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.926+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e804e110 con 0x7f76e81513f0 2024-03-23T06:10:08.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.927+0000 7f76de000640 1 -- 172.21.15.73:0/123493940 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f76d4041390 con 0x7f76e81513f0 2024-03-23T06:10:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.929+0000 7f76de000640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f76c806ac30 0x7f76c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.929+0000 7f76de000640 1 -- 172.21.15.73:0/123493940 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76d4032070 con 0x7f76e81513f0 2024-03-23T06:10:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.929+0000 7f76e5e00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f76c806ac30 0x7f76c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.930+0000 7f76e5e00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f76c806ac30 0x7f76c806d0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000f60 tx=0x7f76d8000ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:08.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:08.933+0000 7f76de000640 1 -- 172.21.15.73:0/123493940 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f76d4076380 con 0x7f76e81513f0 2024-03-23T06:10:09.065 INFO:tasks.ceph.mds.f.smithi110.stderr:2024-03-23T06:10:09.065+0000 7fa39881c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-23T06:10:09.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.169+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76e80c55d0 con 0x7f76e81513f0 2024-03-23T06:10:09.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.169+0000 7f76de000640 1 -- 172.21.15.73:0/123493940 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f76d40799a0 con 0x7f76e81513f0 2024-03-23T06:10:09.169 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-23T06:10:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f76c806ac30 msgr2=0x7f76c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f76c806ac30 0x7f76c806d0f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000f60 tx=0x7f76d8000ed0 comp rx=0 tx=0).stop 2024-03-23T06:10:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76e81513f0 msgr2=0x7f76e8154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76e81513f0 0x7f76e8154e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009990 tx=0x7f76d4004730 comp rx=0 tx=0).stop 2024-03-23T06:10:09.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 shutdown_connections 2024-03-23T06:10:09.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f76c806ac30 0x7f76c806d0f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:09.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76e806f9b0 0x7f76e806fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:09.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76e81513f0 0x7f76e8154e00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:09.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 --2- 172.21.15.73:0/123493940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76e80c5a10 0x7f76e80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:09.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 >> 172.21.15.73:0/123493940 conn(0x7f76e806bb40 msgr2=0x7f76e8158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:09.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 shutdown_connections 2024-03-23T06:10:09.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:09.172+0000 7f76eca00640 1 -- 172.21.15.73:0/123493940 wait complete. 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-23T06:10:09.188 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-23T06:10:09.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:09.189 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-03-23T06:10:09.238 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42489sec preferred_lft 42489sec 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-03-23T06:10:09.239 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-23T06:10:09.240 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-23T06:10:09.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:09.241 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:09.241 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:09.241 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-03-23T06:10:09.241 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-03-23T06:10:09.241 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-03-23T06:10:09.241 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-23T06:10:09.241 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:09.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:09.677 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-23T06:10:09.754 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-03-23T06:10:09.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:09.758 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-03-23T06:10:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-03-23T06:10:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-23T06:10:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-23T06:10:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-23T06:10:09.823 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-23T06:10:09.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:09.825 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:09.825 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:09.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-23T06:10:09.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-23T06:10:09.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-23T06:10:09.825 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:10.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:10.487 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-23T06:10:10.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:10.531 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-03-23T06:10:10.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:10.617 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:10.617 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:10.617 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-23T06:10:10.617 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-23T06:10:10.617 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:10.772 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-23T06:10:10.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:10.773 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:10.773 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:10.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-23T06:10:10.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-23T06:10:10.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-23T06:10:10.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-23T06:10:10.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-23T06:10:10.773 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:11.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:11.023 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:11.023 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:11.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-03-23T06:10:11.023 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-03-23T06:10:11.024 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:11.170 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-23T06:10:11.170 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-23T06:10:11.170 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-23T06:10:11.211 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-23T06:10:11.211 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-23T06:10:11.211 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-23T06:10:11.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-03-23T06:10:11.429 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-23T06:10:11.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-03-23T06:10:11.494 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-03-23T06:10:11.496 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-23T06:10:11.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:11.497 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-03-23T06:10:11.533 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-23T06:10:11.533 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-23T06:10:11.579 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-03-23T06:10:11.652 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-23T06:10:11.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-03-23T06:10:11.716 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-03-23T06:10:11.718 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-23T06:10:11.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:11.719 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-03-23T06:10:11.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:2024-03-23T06:10:11.758+0000 7f9175e4c480 -1 init, newargv = 0x561e3984ee10 newargc=15 2024-03-23T06:10:11.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[43453]: starting ceph client 2024-03-23T06:10:11.768 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[43453]: starting fuse 2024-03-23T06:10:12.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-03-23T06:10:12.960 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-23T06:10:12.960 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-03-23T06:10:13.052 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-03-23T06:10:13.056 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-23T06:10:13.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:13.056 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-03-23T06:10:13.109 INFO:teuthology.orchestra.run.smithi073.stdout:40 2024-03-23T06:10:13.109 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-03-23T06:10:13.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-03-23T06:10:13.109 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> 2024-03-23T06:10:13.110 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.admin")) 2024-03-23T06:10:13.111 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-03-23T06:10:13.284 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.admin.43453.asok 2024-03-23T06:10:13.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43453.asok 2024-03-23T06:10:13.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:13.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43453.asok status 2024-03-23T06:10:13.700 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:10:13.700 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "82316b04821a6c2c1d458a881920454bbadb8837", 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 18.2.2-954-g82316b04 (82316b04821a6c2c1d458a881920454bbadb8837) reef (stable)", 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "admin", 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "43453", 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4353, 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-03-23T06:10:13.701 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4353 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 671497562 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 671497562 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:13.702 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4353 192.168.0.1:0/671497562", 2024-03-23T06:10:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/671497562", 2024-03-23T06:10:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-03-23T06:10:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 6, 2024-03-23T06:10:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 25, 2024-03-23T06:10:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-03-23T06:10:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-03-23T06:10:13.703 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-03-23T06:10:13.703 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:10:13.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:13.715 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-03-23T06:10:13.715 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-23T06:10:13.766 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-03-23T06:10:13.766 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-23T06:10:13.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:13.766 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-23T06:10:13.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:13.858 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-23T06:10:13.943 INFO:teuthology.orchestra.run.smithi073.stdout:# file: . 2024-03-23T06:10:13.943 INFO:teuthology.orchestra.run.smithi073.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-23T06:10:13.944 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:13.945 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:10:13.945 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T06:10:13.997 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:14.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.201+0000 7f784d600640 1 Processor -- start 2024-03-23T06:10:14.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.201+0000 7f784d600640 1 -- start start 2024-03-23T06:10:14.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.202+0000 7f784d600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78481513f0 0x7f78480c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.202+0000 7f784d600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481586b0 0x7f78480bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f784d600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f78480c03a0 0x7f7848071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f784d600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480c5f50 con 0x7f78481513f0 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f784d600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7848157b60 con 0x7f78480c03a0 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f784d600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78480c0830 con 0x7f78481586b0 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78481513f0 0x7f78480c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78481513f0 0x7f78480c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35890/0 (socket says 172.21.15.73:35890) 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846a00640 1 -- 172.21.15.73:0/2807497713 learned_addr learned my addr 172.21.15.73:0/2807497713 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7847400640 1 --2- 172.21.15.73:0/2807497713 >> v2:172.21.15.110:3300/0 conn(0x7f78480c03a0 0x7f7848071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846000640 1 --2- 172.21.15.73:0/2807497713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481586b0 0x7f78480bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846a00640 1 -- 172.21.15.73:0/2807497713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481586b0 msgr2=0x7f78480bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846a00640 1 --2- 172.21.15.73:0/2807497713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481586b0 0x7f78480bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846a00640 1 -- 172.21.15.73:0/2807497713 >> v2:172.21.15.110:3300/0 conn(0x7f78480c03a0 msgr2=0x7f7848071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846a00640 1 --2- 172.21.15.73:0/2807497713 >> v2:172.21.15.110:3300/0 conn(0x7f78480c03a0 0x7f7848071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7846a00640 1 -- 172.21.15.73:0/2807497713 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480c0b10 con 0x7f78481513f0 2024-03-23T06:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.203+0000 7f7847400640 1 --2- 172.21.15.73:0/2807497713 >> v2:172.21.15.110:3300/0 conn(0x7f78480c03a0 0x7f7848071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:14.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.204+0000 7f7846a00640 1 --2- 172.21.15.73:0/2807497713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481513f0 0x7f78480c5a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78480729a0 tx=0x7f783802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e783cf565f36b078 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.205+0000 7f7845600640 1 -- 172.21.15.73:0/2807497713 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838030850 con 0x7f78481513f0 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.205+0000 7f7845600640 1 -- 172.21.15.73:0/2807497713 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78380309b0 con 0x7f78481513f0 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.205+0000 7f7845600640 1 -- 172.21.15.73:0/2807497713 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838030d40 con 0x7f78481513f0 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.205+0000 7f784d600640 1 -- 172.21.15.73:0/2807497713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481513f0 msgr2=0x7f78480c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.205+0000 7f784d600640 1 --2- 172.21.15.73:0/2807497713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481513f0 0x7f78480c5a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78480729a0 tx=0x7f783802b990 comp rx=0 tx=0).stop 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.206+0000 7f784d600640 1 -- 172.21.15.73:0/2807497713 shutdown_connections 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.206+0000 7f784d600640 1 --2- 172.21.15.73:0/2807497713 >> v2:172.21.15.110:3300/0 conn(0x7f78480c03a0 0x7f7848071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.206+0000 7f784d600640 1 --2- 172.21.15.73:0/2807497713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481586b0 0x7f78480bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.206+0000 7f784d600640 1 --2- 172.21.15.73:0/2807497713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481513f0 0x7f78480c5a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.206+0000 7f784d600640 1 -- 172.21.15.73:0/2807497713 >> 172.21.15.73:0/2807497713 conn(0x7f784806bb40 msgr2=0x7f784806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.206+0000 7f784d600640 1 -- 172.21.15.73:0/2807497713 shutdown_connections 2024-03-23T06:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.206+0000 7f784d600640 1 -- 172.21.15.73:0/2807497713 wait complete. 2024-03-23T06:10:14.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.208+0000 7f784d600640 1 Processor -- start 2024-03-23T06:10:14.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.208+0000 7f784d600640 1 -- start start 2024-03-23T06:10:14.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f784d600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481513f0 0x7f784814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f784d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481586b0 0x7f7848153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f784d600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7848156570 0x7f7848156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f784d600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481efce0 con 0x7f78481586b0 2024-03-23T06:10:14.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f784d600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480afe70 con 0x7f7848156570 2024-03-23T06:10:14.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f784d600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784814fdd0 con 0x7f78481513f0 2024-03-23T06:10:14.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f7846000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481586b0 0x7f7848153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f7846a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481513f0 0x7f784814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f7846000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481586b0 0x7f7848153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35894/0 (socket says 172.21.15.73:35894) 2024-03-23T06:10:14.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f7846000640 1 -- 172.21.15.73:0/3659197616 learned_addr learned my addr 172.21.15.73:0/3659197616 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:14.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.209+0000 7f7847400640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7848156570 0x7f7848156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.210+0000 7f7846a00640 1 -- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7848156570 msgr2=0x7f7848156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.210+0000 7f7846a00640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7848156570 0x7f7848156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.210+0000 7f7846a00640 1 -- 172.21.15.73:0/3659197616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481586b0 msgr2=0x7f7848153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.210+0000 7f7846a00640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481586b0 0x7f7848153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.210+0000 7f7846a00640 1 -- 172.21.15.73:0/3659197616 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78380094d0 con 0x7f78481513f0 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.210+0000 7f7846000640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481586b0 0x7f7848153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.210+0000 7f7846a00640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481513f0 0x7f784814f890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7838033000 tx=0x7f7838004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.211+0000 7f783ea00640 1 -- 172.21.15.73:0/3659197616 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838039a90 con 0x7f78481513f0 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.211+0000 7f783ea00640 1 -- 172.21.15.73:0/3659197616 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7838039c10 con 0x7f78481513f0 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.211+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78481ef060 con 0x7f78481513f0 2024-03-23T06:10:14.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.211+0000 7f783ea00640 1 -- 172.21.15.73:0/3659197616 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838043410 con 0x7f78481513f0 2024-03-23T06:10:14.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.211+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78481ef620 con 0x7f78481513f0 2024-03-23T06:10:14.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.212+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7848151ab0 con 0x7f78481513f0 2024-03-23T06:10:14.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.213+0000 7f783ea00640 1 -- 172.21.15.73:0/3659197616 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f783802e070 con 0x7f78481513f0 2024-03-23T06:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.213+0000 7f783ea00640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f782806ac30 0x7f782806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.214+0000 7f783ea00640 1 -- 172.21.15.73:0/3659197616 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78380ab700 con 0x7f78481513f0 2024-03-23T06:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.214+0000 7f7846000640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f782806ac30 0x7f782806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.214+0000 7f7846000640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f782806ac30 0x7f782806d0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7848154d60 tx=0x7f7834008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:14.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.219+0000 7f783ea00640 1 -- 172.21.15.73:0/3659197616 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7848151ab0 con 0x7f78481513f0 2024-03-23T06:10:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.415+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7848151ab0 con 0x7f78481513f0 2024-03-23T06:10:14.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.416+0000 7f783ea00640 1 -- 172.21.15.73:0/3659197616 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f7848151ab0 con 0x7f78481513f0 2024-03-23T06:10:14.418 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:14.418 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f782806ac30 msgr2=0x7f782806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f782806ac30 0x7f782806d0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7848154d60 tx=0x7f7834008040 comp rx=0 tx=0).stop 2024-03-23T06:10:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481513f0 msgr2=0x7f784814f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481513f0 0x7f784814f890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7838033000 tx=0x7f7838004730 comp rx=0 tx=0).stop 2024-03-23T06:10:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 shutdown_connections 2024-03-23T06:10:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7848156570 0x7f7848156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78481586b0 0x7f7848153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f782806ac30 0x7f782806d0f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 --2- 172.21.15.73:0/3659197616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78481513f0 0x7f784814f890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.419+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 >> 172.21.15.73:0/3659197616 conn(0x7f784806bb40 msgr2=0x7f78480c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.420+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 shutdown_connections 2024-03-23T06:10:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.420+0000 7f784d600640 1 -- 172.21.15.73:0/3659197616 wait complete. 2024-03-23T06:10:14.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T06:09:56.066381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T06:09:56.917187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-23T06:09:59.981596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-23T06:10:14.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:10:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.652+0000 7f7a1d000640 1 Processor -- start 2024-03-23T06:10:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.652+0000 7f7a1d000640 1 -- start start 2024-03-23T06:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.653+0000 7f7a1d000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a18157e60 0x7f7a18071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.653+0000 7f7a1d000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a18072090 0x7f7a18158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.653+0000 7f7a1d000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1815b710 con 0x7f7a18151480 2024-03-23T06:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a1d000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a181588d0 con 0x7f7a18072090 2024-03-23T06:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a1d000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a181582d0 con 0x7f7a18157e60 2024-03-23T06:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a16800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a18072090 0x7f7a18158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a16800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a18072090 0x7f7a18158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35908/0 (socket says 172.21.15.73:35908) 2024-03-23T06:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a16800640 1 -- 172.21.15.73:0/213156321 learned_addr learned my addr 172.21.15.73:0/213156321 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a15400640 1 --2- 172.21.15.73:0/213156321 >> v2:172.21.15.110:3300/0 conn(0x7f7a18157e60 0x7f7a18071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a16800640 1 -- 172.21.15.73:0/213156321 >> v2:172.21.15.110:3300/0 conn(0x7f7a18157e60 msgr2=0x7f7a18071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a16800640 1 --2- 172.21.15.73:0/213156321 >> v2:172.21.15.110:3300/0 conn(0x7f7a18157e60 0x7f7a18071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a16800640 1 -- 172.21.15.73:0/213156321 >> v1:172.21.15.110:6789/0 conn(0x7f7a18151480 legacy=0x7f7a180c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a14a00640 1 -- 172.21.15.73:0/213156321 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801331717 0 0) 0x7f7a1815b710 con 0x7f7a18151480 2024-03-23T06:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.654+0000 7f7a16800640 1 -- 172.21.15.73:0/213156321 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1815ab90 con 0x7f7a18072090 2024-03-23T06:10:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.656+0000 7f7a16800640 1 --2- 172.21.15.73:0/213156321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a18158cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a180c7b90 tx=0x7f7a0802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93b3348165fa41 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.656+0000 7f7a14a00640 1 -- 172.21.15.73:0/213156321 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0802f850 con 0x7f7a18072090 2024-03-23T06:10:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.656+0000 7f7a14a00640 1 -- 172.21.15.73:0/213156321 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0802f9b0 con 0x7f7a18072090 2024-03-23T06:10:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.656+0000 7f7a14a00640 1 -- 172.21.15.73:0/213156321 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0802fd40 con 0x7f7a18072090 2024-03-23T06:10:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.656+0000 7f7a1d000640 1 -- 172.21.15.73:0/213156321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 msgr2=0x7f7a18158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.656+0000 7f7a1d000640 1 --2- 172.21.15.73:0/213156321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a18158cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a180c7b90 tx=0x7f7a0802ba30 comp rx=0 tx=0).stop 2024-03-23T06:10:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.657+0000 7f7a1d000640 1 -- 172.21.15.73:0/213156321 shutdown_connections 2024-03-23T06:10:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.657+0000 7f7a1d000640 1 --2- 172.21.15.73:0/213156321 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a18158cf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.657+0000 7f7a1d000640 1 --2- 172.21.15.73:0/213156321 >> v2:172.21.15.110:3300/0 conn(0x7f7a18157e60 0x7f7a18071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.657+0000 7f7a1d000640 1 -- 172.21.15.73:0/213156321 >> 172.21.15.73:0/213156321 conn(0x7f7a18069cb0 msgr2=0x7f7a1806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.657+0000 7f7a1d000640 1 -- 172.21.15.73:0/213156321 shutdown_connections 2024-03-23T06:10:14.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.657+0000 7f7a1d000640 1 -- 172.21.15.73:0/213156321 wait complete. 2024-03-23T06:10:14.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.658+0000 7f7a1d000640 1 Processor -- start 2024-03-23T06:10:14.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.659+0000 7f7a1d000640 1 -- start start 2024-03-23T06:10:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.659+0000 7f7a1d000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a181ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.659+0000 7f7a1d000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a18151480 0x7f7a180c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.659+0000 7f7a1d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a18157e60 0x7f7a18070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.659+0000 7f7a1d000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a180ade70 con 0x7f7a18072090 2024-03-23T06:10:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.659+0000 7f7a1d000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a180671c0 con 0x7f7a18157e60 2024-03-23T06:10:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.659+0000 7f7a1d000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a18071160 con 0x7f7a18151480 2024-03-23T06:10:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a181ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a16800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a18157e60 0x7f7a18070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a18151480 0x7f7a180c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a181ef820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35924/0 (socket says 172.21.15.73:35924) 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15e00640 1 -- 172.21.15.73:0/157799247 learned_addr learned my addr 172.21.15.73:0/157799247 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15e00640 1 -- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a18151480 msgr2=0x7f7a180c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15e00640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a18151480 0x7f7a180c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15e00640 1 -- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a18157e60 msgr2=0x7f7a18070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15e00640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a18157e60 0x7f7a18070270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a15e00640 1 -- 172.21.15.73:0/157799247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080094d0 con 0x7f7a18072090 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.660+0000 7f7a16800640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a18157e60 0x7f7a18070270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.661+0000 7f7a15e00640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a181ef820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000c890 tx=0x7f7a1000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.661+0000 7f7a0e000640 1 -- 172.21.15.73:0/157799247 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10003da0 con 0x7f7a18072090 2024-03-23T06:10:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.661+0000 7f7a0e000640 1 -- 172.21.15.73:0/157799247 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a10005070 con 0x7f7a18072090 2024-03-23T06:10:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.661+0000 7f7a0e000640 1 -- 172.21.15.73:0/157799247 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10005420 con 0x7f7a18072090 2024-03-23T06:10:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.661+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a18071970 con 0x7f7a18072090 2024-03-23T06:10:14.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.661+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a18071690 con 0x7f7a18072090 2024-03-23T06:10:14.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.662+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1815b130 con 0x7f7a18072090 2024-03-23T06:10:14.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.663+0000 7f7a0e000640 1 -- 172.21.15.73:0/157799247 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7a10005580 con 0x7f7a18072090 2024-03-23T06:10:14.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.664+0000 7f7a0e000640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f406ac00 0x7f79f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:14.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.664+0000 7f7a0e000640 1 -- 172.21.15.73:0/157799247 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a10088ec0 con 0x7f7a18072090 2024-03-23T06:10:14.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.664+0000 7f7a15400640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f406ac00 0x7f79f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:14.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.665+0000 7f7a15400640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f406ac00 0x7f79f406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a180c78a0 tx=0x7f7a00009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:14.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.669+0000 7f7a0e000640 1 -- 172.21.15.73:0/157799247 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7a1815b130 con 0x7f7a18072090 2024-03-23T06:10:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.868+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a1815b130 con 0x7f7a18072090 2024-03-23T06:10:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.869+0000 7f7a0e000640 1 -- 172.21.15.73:0/157799247 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a1815b130 con 0x7f7a18072090 2024-03-23T06:10:14.870 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:10:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f406ac00 msgr2=0x7f79f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f406ac00 0x7f79f406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a180c78a0 tx=0x7f7a00009190 comp rx=0 tx=0).stop 2024-03-23T06:10:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 msgr2=0x7f7a181ef820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a181ef820 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000c890 tx=0x7f7a1000cd50 comp rx=0 tx=0).stop 2024-03-23T06:10:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 shutdown_connections 2024-03-23T06:10:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a18157e60 0x7f7a18070270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f406ac00 0x7f79f406d0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a18151480 0x7f7a180c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 --2- 172.21.15.73:0/157799247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a18072090 0x7f7a181ef820 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 >> 172.21.15.73:0/157799247 conn(0x7f7a18069cb0 msgr2=0x7f7a180c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 shutdown_connections 2024-03-23T06:10:14.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:14.872+0000 7f7a1d000640 1 -- 172.21.15.73:0/157799247 wait complete. 2024-03-23T06:10:14.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T06:10:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.109+0000 7f095ca00640 1 Processor -- start 2024-03-23T06:10:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.110+0000 7f095ca00640 1 -- start start 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.111+0000 7f095ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0958153900 0x7f095815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.111+0000 7f095ca00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f095815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.111+0000 7f095ca00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095815cc20 con 0x7f0958159400 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.111+0000 7f095ca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095815a410 con 0x7f0958153900 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.111+0000 7f095ca00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0958159890 con 0x7f09580c5580 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f094ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0958159400 0x7f09580c6e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45892/0 (socket says 172.21.15.73:45892) 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f094ea00640 1 -- 172.21.15.73:0/1188538051 learned_addr learned my addr 172.21.15.73:0/1188538051 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f0957e00640 1 --2- 172.21.15.73:0/1188538051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f095815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f0957400640 1 --2- 172.21.15.73:0/1188538051 >> v2:172.21.15.110:3300/0 conn(0x7f0958153900 0x7f095815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f0956a00640 1 -- 172.21.15.73:0/1188538051 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940552923 0 0) 0x7f095815cc20 con 0x7f0958159400 2024-03-23T06:10:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f0956a00640 1 -- 172.21.15.73:0/1188538051 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f093c003520 con 0x7f0958159400 2024-03-23T06:10:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f0957e00640 1 -- 172.21.15.73:0/1188538051 >> v2:172.21.15.110:3300/0 conn(0x7f0958153900 msgr2=0x7f095815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f0957e00640 1 --2- 172.21.15.73:0/1188538051 >> v2:172.21.15.110:3300/0 conn(0x7f0958153900 0x7f095815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f0957e00640 1 -- 172.21.15.73:0/1188538051 >> v1:172.21.15.73:6789/0 conn(0x7f0958159400 legacy=0x7f09580c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.112+0000 7f0957e00640 1 -- 172.21.15.73:0/1188538051 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958159b70 con 0x7f09580c5580 2024-03-23T06:10:15.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.114+0000 7f0957e00640 1 --2- 172.21.15.73:0/1188538051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f095815d5f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09500097a0 tx=0x7f095002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9718fdfb773383bb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.114+0000 7f0956a00640 1 -- 172.21.15.73:0/1188538051 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950031830 con 0x7f09580c5580 2024-03-23T06:10:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.114+0000 7f0956a00640 1 -- 172.21.15.73:0/1188538051 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0950031990 con 0x7f09580c5580 2024-03-23T06:10:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.114+0000 7f0956a00640 1 -- 172.21.15.73:0/1188538051 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950031d20 con 0x7f09580c5580 2024-03-23T06:10:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.114+0000 7f095ca00640 1 -- 172.21.15.73:0/1188538051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 msgr2=0x7f095815d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.114+0000 7f095ca00640 1 --2- 172.21.15.73:0/1188538051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f095815d5f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09500097a0 tx=0x7f095002b8d0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.115+0000 7f095ca00640 1 -- 172.21.15.73:0/1188538051 shutdown_connections 2024-03-23T06:10:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.115+0000 7f095ca00640 1 --2- 172.21.15.73:0/1188538051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f095815d5f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.115+0000 7f095ca00640 1 --2- 172.21.15.73:0/1188538051 >> v2:172.21.15.110:3300/0 conn(0x7f0958153900 0x7f095815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.115+0000 7f095ca00640 1 -- 172.21.15.73:0/1188538051 >> 172.21.15.73:0/1188538051 conn(0x7f0958069cb0 msgr2=0x7f095806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.115+0000 7f095ca00640 1 -- 172.21.15.73:0/1188538051 shutdown_connections 2024-03-23T06:10:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.115+0000 7f095ca00640 1 -- 172.21.15.73:0/1188538051 wait complete. 2024-03-23T06:10:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.116+0000 7f095ca00640 1 Processor -- start 2024-03-23T06:10:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.117+0000 7f095ca00640 1 -- start start 2024-03-23T06:10:15.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.117+0000 7f095ca00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f09581e4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.117+0000 7f095ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0958153900 0x7f0958153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.117+0000 7f095ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09581e4010 0x7f09581545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.117+0000 7f095ca00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958157fc0 con 0x7f0958153900 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.117+0000 7f095ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09581e3b80 con 0x7f09581e4010 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.117+0000 7f095ca00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0958154b10 con 0x7f09580c5580 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f094ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0958153900 0x7f0958153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f094ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0958153900 0x7f0958153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35932/0 (socket says 172.21.15.73:35932) 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f094ea00640 1 -- 172.21.15.73:0/405627930 learned_addr learned my addr 172.21.15.73:0/405627930 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f0957e00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09581e4010 0x7f09581545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f0957400640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f09581e4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f094ea00640 1 -- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 msgr2=0x7f09581e4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f094ea00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f09581e4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f094ea00640 1 -- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09581e4010 msgr2=0x7f09581545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f094ea00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09581e4010 0x7f09581545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.118+0000 7f094ea00640 1 -- 172.21.15.73:0/405627930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950009400 con 0x7f0958153900 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.119+0000 7f094ea00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0958153900 0x7f0958153d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f094000c440 tx=0x7f094000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.119+0000 7f094fe00640 1 -- 172.21.15.73:0/405627930 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940005ce0 con 0x7f0958153900 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.119+0000 7f094fe00640 1 -- 172.21.15.73:0/405627930 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0940005e40 con 0x7f0958153900 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.119+0000 7f094fe00640 1 -- 172.21.15.73:0/405627930 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940007310 con 0x7f0958153900 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.119+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09581e3250 con 0x7f0958153900 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.119+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09581e3810 con 0x7f0958153900 2024-03-23T06:10:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.120+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09581e39a0 con 0x7f0958153900 2024-03-23T06:10:15.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.121+0000 7f094fe00640 1 -- 172.21.15.73:0/405627930 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0940007470 con 0x7f0958153900 2024-03-23T06:10:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.122+0000 7f094fe00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f093406ac00 0x7f093406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.122+0000 7f094fe00640 1 -- 172.21.15.73:0/405627930 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0940088bf0 con 0x7f0958153900 2024-03-23T06:10:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.122+0000 7f0957400640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f093406ac00 0x7f093406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.123+0000 7f0957400640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f093406ac00 0x7f093406d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f09480113e0 tx=0x7f094800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:15.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.127+0000 7f094fe00640 1 -- 172.21.15.73:0/405627930 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0940053c40 con 0x7f0958153900 2024-03-23T06:10:15.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.325+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0958067920 con 0x7f0958153900 2024-03-23T06:10:15.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.326+0000 7f094fe00640 1 -- 172.21.15.73:0/405627930 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0940017020 con 0x7f0958153900 2024-03-23T06:10:15.327 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.328+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f093406ac00 msgr2=0x7f093406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.328+0000 7f095ca00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f093406ac00 0x7f093406d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f09480113e0 tx=0x7f094800b040 comp rx=0 tx=0).stop 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.328+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0958153900 msgr2=0x7f0958153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.328+0000 7f095ca00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0958153900 0x7f0958153d50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f094000c440 tx=0x7f094000c900 comp rx=0 tx=0).stop 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.329+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 shutdown_connections 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.329+0000 7f095ca00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09581e4010 0x7f09581545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.329+0000 7f095ca00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0958153900 0x7f0958153d50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.329+0000 7f095ca00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f093406ac00 0x7f093406d0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.329+0000 7f095ca00640 1 --2- 172.21.15.73:0/405627930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09580c5580 0x7f09581e4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.329+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 >> 172.21.15.73:0/405627930 conn(0x7f0958069cb0 msgr2=0x7f09580c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:15.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.329+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 shutdown_connections 2024-03-23T06:10:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.329+0000 7f095ca00640 1 -- 172.21.15.73:0/405627930 wait complete. 2024-03-23T06:10:15.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T06:10:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.551+0000 7f9c73e00640 1 Processor -- start 2024-03-23T06:10:15.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.551+0000 7f9c73e00640 1 -- start start 2024-03-23T06:10:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.552+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c1536c0 0x7f9c6c159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.552+0000 7f9c73e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c15d920 con 0x7f9c6c0c8eb0 2024-03-23T06:10:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.552+0000 7f9c73e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c15cac0 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.552+0000 7f9c73e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c15cd10 con 0x7f9c6c1536c0 2024-03-23T06:10:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.552+0000 7f9c71e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9c6c0c8eb0 0x7f9c6c070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45900/0 (socket says 172.21.15.73:45900) 2024-03-23T06:10:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.552+0000 7f9c71e00640 1 -- 172.21.15.73:0/1219206315 learned_addr learned my addr 172.21.15.73:0/1219206315 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:15.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.552+0000 7f9c71400640 1 --2- 172.21.15.73:0/1219206315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c1536c0 0x7f9c6c159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.553+0000 7f9c6be00640 1 -- 172.21.15.73:0/1219206315 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932415764 0 0) 0x7f9c6c15cac0 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.553+0000 7f9c71400640 1 -- 172.21.15.73:0/1219206315 >> v1:172.21.15.110:6789/0 conn(0x7f9c6c0ca4d0 legacy=0x7f9c6c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.553+0000 7f9c71400640 1 -- 172.21.15.73:0/1219206315 >> v1:172.21.15.73:6789/0 conn(0x7f9c6c0c8eb0 legacy=0x7f9c6c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.553+0000 7f9c71400640 1 -- 172.21.15.73:0/1219206315 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c15cff0 con 0x7f9c6c1536c0 2024-03-23T06:10:15.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.554+0000 7f9c71400640 1 --2- 172.21.15.73:0/1219206315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c1536c0 0x7f9c6c159f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c600097d0 tx=0x7f9c6002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36bada46efb628f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:15.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.554+0000 7f9c6be00640 1 -- 172.21.15.73:0/1219206315 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60030800 con 0x7f9c6c1536c0 2024-03-23T06:10:15.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.554+0000 7f9c6be00640 1 -- 172.21.15.73:0/1219206315 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c60030960 con 0x7f9c6c1536c0 2024-03-23T06:10:15.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.554+0000 7f9c6be00640 1 -- 172.21.15.73:0/1219206315 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c60030cf0 con 0x7f9c6c1536c0 2024-03-23T06:10:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.555+0000 7f9c73e00640 1 -- 172.21.15.73:0/1219206315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c1536c0 msgr2=0x7f9c6c159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.555+0000 7f9c73e00640 1 --2- 172.21.15.73:0/1219206315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c1536c0 0x7f9c6c159f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c600097d0 tx=0x7f9c6002b940 comp rx=0 tx=0).stop 2024-03-23T06:10:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.555+0000 7f9c73e00640 1 -- 172.21.15.73:0/1219206315 shutdown_connections 2024-03-23T06:10:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.555+0000 7f9c73e00640 1 --2- 172.21.15.73:0/1219206315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c1536c0 0x7f9c6c159f00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.555+0000 7f9c73e00640 1 -- 172.21.15.73:0/1219206315 >> 172.21.15.73:0/1219206315 conn(0x7f9c6c069cb0 msgr2=0x7f9c6c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.555+0000 7f9c73e00640 1 -- 172.21.15.73:0/1219206315 shutdown_connections 2024-03-23T06:10:15.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.555+0000 7f9c73e00640 1 -- 172.21.15.73:0/1219206315 wait complete. 2024-03-23T06:10:15.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.557+0000 7f9c73e00640 1 Processor -- start 2024-03-23T06:10:15.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.557+0000 7f9c73e00640 1 -- start start 2024-03-23T06:10:15.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.558+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c0c8eb0 0x7f9c6c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.558+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c0ca4d0 0x7f9c6c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.558+0000 7f9c73e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c6c1536c0 0x7f9c6c1eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.558+0000 7f9c73e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c1501f0 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.558+0000 7f9c73e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c14d1d0 con 0x7f9c6c1536c0 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.558+0000 7f9c73e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0c4800 con 0x7f9c6c0c8eb0 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c70a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c0ca4d0 0x7f9c6c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c71400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c0c8eb0 0x7f9c6c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c71e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c6c1536c0 0x7f9c6c1eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c70a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c0ca4d0 0x7f9c6c157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35944/0 (socket says 172.21.15.73:35944) 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c70a00640 1 -- 172.21.15.73:0/383448073 learned_addr learned my addr 172.21.15.73:0/383448073 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:15.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c71400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c0c8eb0 0x7f9c6c14fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:34894/0 (socket says 172.21.15.73:34894) 2024-03-23T06:10:15.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c70a00640 1 -- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c0c8eb0 msgr2=0x7f9c6c14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c70a00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c0c8eb0 0x7f9c6c14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c70a00640 1 -- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c6c1536c0 msgr2=0x7f9c6c1eeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c70a00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c6c1536c0 0x7f9c6c1eeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.559+0000 7f9c70a00640 1 -- 172.21.15.73:0/383448073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60009400 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.560+0000 7f9c70a00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c0ca4d0 0x7f9c6c157110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800c460 tx=0x7f9c5800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.560+0000 7f9c69600640 1 -- 172.21.15.73:0/383448073 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58005480 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.560+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c0c3f10 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.560+0000 7f9c69600640 1 -- 172.21.15.73:0/383448073 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c580035f0 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.560+0000 7f9c69600640 1 -- 172.21.15.73:0/383448073 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c580039a0 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.560+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c0c41b0 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.561+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c04e110 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.562+0000 7f9c69600640 1 -- 172.21.15.73:0/383448073 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9c58003b00 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.563+0000 7f9c69600640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9c4c06ac00 0x7f9c4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.564+0000 7f9c69600640 1 -- 172.21.15.73:0/383448073 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c58089270 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.564+0000 7f9c71400640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9c4c06ac00 0x7f9c4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.565+0000 7f9c71400640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9c4c06ac00 0x7f9c4c06d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c60036000 tx=0x7f9c60008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:15.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.569+0000 7f9c69600640 1 -- 172.21.15.73:0/383448073 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9c58054060 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.762+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c6c0c9a10 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.763+0000 7f9c69600640 1 -- 172.21.15.73:0/383448073 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c58057680 con 0x7f9c6c0ca4d0 2024-03-23T06:10:15.764 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9c4c06ac00 msgr2=0x7f9c4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9c4c06ac00 0x7f9c4c06d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c60036000 tx=0x7f9c60008030 comp rx=0 tx=0).stop 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c0ca4d0 msgr2=0x7f9c6c157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c0ca4d0 0x7f9c6c157110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800c460 tx=0x7f9c5800c920 comp rx=0 tx=0).stop 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 shutdown_connections 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c6c1536c0 0x7f9c6c1eeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c6c0ca4d0 0x7f9c6c157110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9c4c06ac00 0x7f9c4c06d0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 --2- 172.21.15.73:0/383448073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c6c0c8eb0 0x7f9c6c14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 >> 172.21.15.73:0/383448073 conn(0x7f9c6c069cb0 msgr2=0x7f9c6c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:15.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 shutdown_connections 2024-03-23T06:10:15.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.766+0000 7f9c73e00640 1 -- 172.21.15.73:0/383448073 wait complete. 2024-03-23T06:10:15.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-23T06:10:15.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.992+0000 7f65fe200640 1 Processor -- start 2024-03-23T06:10:15.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.992+0000 7f65fe200640 1 -- start start 2024-03-23T06:10:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.993+0000 7f65fe200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f65f80ca4d0 0x7f65f8159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65fe200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f815d920 con 0x7f65f81536c0 2024-03-23T06:10:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65fe200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f815cac0 con 0x7f65f80c8eb0 2024-03-23T06:10:15.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65fe200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f815cd10 con 0x7f65f80ca4d0 2024-03-23T06:10:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65eea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f65f80ca4d0 0x7f65f8159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65f7400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f65f81536c0 0x7f65f80caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45912/0 (socket says 172.21.15.73:45912) 2024-03-23T06:10:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65f7400640 1 -- 172.21.15.73:0/1967482520 learned_addr learned my addr 172.21.15.73:0/1967482520 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65f7e00640 1 --1- 172.21.15.73:0/1967482520 >> v1:172.21.15.110:6789/0 conn(0x7f65f80c8eb0 0x7f65f8070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38908/0 (socket says 172.21.15.73:38908) 2024-03-23T06:10:15.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65eea00640 1 -- 172.21.15.73:0/1967482520 >> v1:172.21.15.110:6789/0 conn(0x7f65f80c8eb0 legacy=0x7f65f8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65eea00640 1 -- 172.21.15.73:0/1967482520 >> v1:172.21.15.73:6789/0 conn(0x7f65f81536c0 legacy=0x7f65f80caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.994+0000 7f65eea00640 1 -- 172.21.15.73:0/1967482520 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f815cff0 con 0x7f65f80ca4d0 2024-03-23T06:10:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.995+0000 7f65eea00640 1 --2- 172.21.15.73:0/1967482520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 0x7f65f8159f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097a0 tx=0x7f65e002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f802b3e912ed3b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:15.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.996+0000 7f65f6a00640 1 -- 172.21.15.73:0/1967482520 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0030610 con 0x7f65f80ca4d0 2024-03-23T06:10:15.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.996+0000 7f65f6a00640 1 -- 172.21.15.73:0/1967482520 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0030770 con 0x7f65f80ca4d0 2024-03-23T06:10:15.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.996+0000 7f65f6a00640 1 -- 172.21.15.73:0/1967482520 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0030b00 con 0x7f65f80ca4d0 2024-03-23T06:10:15.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.996+0000 7f65fe200640 1 -- 172.21.15.73:0/1967482520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 msgr2=0x7f65f8159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:15.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.996+0000 7f65fe200640 1 --2- 172.21.15.73:0/1967482520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 0x7f65f8159f00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097a0 tx=0x7f65e002b960 comp rx=0 tx=0).stop 2024-03-23T06:10:15.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.997+0000 7f65fe200640 1 -- 172.21.15.73:0/1967482520 shutdown_connections 2024-03-23T06:10:15.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.997+0000 7f65fe200640 1 --2- 172.21.15.73:0/1967482520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 0x7f65f8159f00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:15.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.997+0000 7f65fe200640 1 -- 172.21.15.73:0/1967482520 >> 172.21.15.73:0/1967482520 conn(0x7f65f8069cb0 msgr2=0x7f65f806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:15.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.997+0000 7f65fe200640 1 -- 172.21.15.73:0/1967482520 shutdown_connections 2024-03-23T06:10:15.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.997+0000 7f65fe200640 1 -- 172.21.15.73:0/1967482520 wait complete. 2024-03-23T06:10:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.999+0000 7f65fe200640 1 Processor -- start 2024-03-23T06:10:15.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:15.999+0000 7f65fe200640 1 -- start start 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65fe200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80c8eb0 0x7f65f81f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65fe200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 0x7f65f814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65fe200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f81536c0 0x7f65f81585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65fe200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f814c190 con 0x7f65f80c8eb0 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65fe200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f814c710 con 0x7f65f80ca4d0 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65fe200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f81f2db0 con 0x7f65f81536c0 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65f7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80c8eb0 0x7f65f81f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65f7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80c8eb0 0x7f65f81f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35958/0 (socket says 172.21.15.73:35958) 2024-03-23T06:10:16.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65f7400640 1 -- 172.21.15.73:0/4040796908 learned_addr learned my addr 172.21.15.73:0/4040796908 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65eea00640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 0x7f65f814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.000+0000 7f65f7e00640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f81536c0 0x7f65f81585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65f7400640 1 -- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f81536c0 msgr2=0x7f65f81585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65f7400640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f81536c0 0x7f65f81585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65f7400640 1 -- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 msgr2=0x7f65f814cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65f7400640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 0x7f65f814cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65f7400640 1 -- 172.21.15.73:0/4040796908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0009400 con 0x7f65f80c8eb0 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65f7400640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80c8eb0 0x7f65f81f2870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c480 tx=0x7f65e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:16.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65efe00640 1 -- 172.21.15.73:0/4040796908 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8005ce0 con 0x7f65f80c8eb0 2024-03-23T06:10:16.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65efe00640 1 -- 172.21.15.73:0/4040796908 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8005e40 con 0x7f65f80c8eb0 2024-03-23T06:10:16.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.001+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f815c1b0 con 0x7f65f80c8eb0 2024-03-23T06:10:16.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.002+0000 7f65efe00640 1 -- 172.21.15.73:0/4040796908 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e80072f0 con 0x7f65f80c8eb0 2024-03-23T06:10:16.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.002+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f815c730 con 0x7f65f80c8eb0 2024-03-23T06:10:16.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.003+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f804e110 con 0x7f65f80c8eb0 2024-03-23T06:10:16.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.004+0000 7f65efe00640 1 -- 172.21.15.73:0/4040796908 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f65e8007510 con 0x7f65f80c8eb0 2024-03-23T06:10:16.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.004+0000 7f65efe00640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65d406ac00 0x7f65d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.005+0000 7f65efe00640 1 -- 172.21.15.73:0/4040796908 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f65e8088b10 con 0x7f65f80c8eb0 2024-03-23T06:10:16.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.005+0000 7f65eea00640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65d406ac00 0x7f65d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.006+0000 7f65eea00640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65d406ac00 0x7f65d406d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65e0036000 tx=0x7f65e0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:16.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.009+0000 7f65efe00640 1 -- 172.21.15.73:0/4040796908 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f65e8053b40 con 0x7f65f80c8eb0 2024-03-23T06:10:16.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.199+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f65f80c9a10 con 0x7f65f80c8eb0 2024-03-23T06:10:16.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.200+0000 7f65efe00640 1 -- 172.21.15.73:0/4040796908 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f65e8017020 con 0x7f65f80c8eb0 2024-03-23T06:10:16.200 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65d406ac00 msgr2=0x7f65d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65d406ac00 0x7f65d406d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65e0036000 tx=0x7f65e0008030 comp rx=0 tx=0).stop 2024-03-23T06:10:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80c8eb0 msgr2=0x7f65f81f2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80c8eb0 0x7f65f81f2870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c480 tx=0x7f65e800c940 comp rx=0 tx=0).stop 2024-03-23T06:10:16.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 shutdown_connections 2024-03-23T06:10:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f65d406ac00 0x7f65d406d0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65f81536c0 0x7f65f81585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65f80ca4d0 0x7f65f814cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 --2- 172.21.15.73:0/4040796908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80c8eb0 0x7f65f81f2870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 >> 172.21.15.73:0/4040796908 conn(0x7f65f8069cb0 msgr2=0x7f65f806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 shutdown_connections 2024-03-23T06:10:16.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.203+0000 7f65fe200640 1 -- 172.21.15.73:0/4040796908 wait complete. 2024-03-23T06:10:16.221 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-23T06:10:16.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.426+0000 7f805aa00640 1 Processor -- start 2024-03-23T06:10:16.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.426+0000 7f805aa00640 1 -- start start 2024-03-23T06:10:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.427+0000 7f805aa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8054151480 0x7f8054157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.427+0000 7f805aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f8054159130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.427+0000 7f805aa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805415b710 con 0x7f80540c7e40 2024-03-23T06:10:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.427+0000 7f805aa00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80541588d0 con 0x7f8054151480 2024-03-23T06:10:16.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.427+0000 7f805aa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805415a680 con 0x7f8054158cf0 2024-03-23T06:10:16.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f804be00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f80540c7e40 0x7f8054071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38912/0 (socket says 172.21.15.73:38912) 2024-03-23T06:10:16.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f8053e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8054151480 0x7f8054157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f804be00640 1 -- 172.21.15.73:0/539098336 learned_addr learned my addr 172.21.15.73:0/539098336 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f8058a00640 1 --2- 172.21.15.73:0/539098336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f8054159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f8053400640 1 -- 172.21.15.73:0/539098336 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066676149 0 0) 0x7f805415b710 con 0x7f80540c7e40 2024-03-23T06:10:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f8058a00640 1 -- 172.21.15.73:0/539098336 >> v2:172.21.15.73:3300/0 conn(0x7f8054151480 msgr2=0x7f8054157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f8058a00640 1 --2- 172.21.15.73:0/539098336 >> v2:172.21.15.73:3300/0 conn(0x7f8054151480 0x7f8054157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f8058a00640 1 -- 172.21.15.73:0/539098336 >> v1:172.21.15.110:6789/0 conn(0x7f80540c7e40 legacy=0x7f8054071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.428+0000 7f8058a00640 1 -- 172.21.15.73:0/539098336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805415ab90 con 0x7f8054158cf0 2024-03-23T06:10:16.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.429+0000 7f8058a00640 1 --2- 172.21.15.73:0/539098336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f8054159130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f804c009d90 tx=0x7f804c02bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f74d6940193ffc4e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.429+0000 7f8053400640 1 -- 172.21.15.73:0/539098336 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c02cce0 con 0x7f8054158cf0 2024-03-23T06:10:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f8053400640 1 -- 172.21.15.73:0/539098336 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c02ce40 con 0x7f8054158cf0 2024-03-23T06:10:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f8053400640 1 -- 172.21.15.73:0/539098336 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c034660 con 0x7f8054158cf0 2024-03-23T06:10:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f805aa00640 1 -- 172.21.15.73:0/539098336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 msgr2=0x7f8054159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f805aa00640 1 --2- 172.21.15.73:0/539098336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f8054159130 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f804c009d90 tx=0x7f804c02bf30 comp rx=0 tx=0).stop 2024-03-23T06:10:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f805aa00640 1 -- 172.21.15.73:0/539098336 shutdown_connections 2024-03-23T06:10:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f805aa00640 1 --2- 172.21.15.73:0/539098336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f8054159130 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f805aa00640 1 --2- 172.21.15.73:0/539098336 >> v2:172.21.15.73:3300/0 conn(0x7f8054151480 0x7f8054157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f805aa00640 1 -- 172.21.15.73:0/539098336 >> 172.21.15.73:0/539098336 conn(0x7f8054069cb0 msgr2=0x7f805406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:16.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f805aa00640 1 -- 172.21.15.73:0/539098336 shutdown_connections 2024-03-23T06:10:16.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.430+0000 7f805aa00640 1 -- 172.21.15.73:0/539098336 wait complete. 2024-03-23T06:10:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.432+0000 7f805aa00640 1 Processor -- start 2024-03-23T06:10:16.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.432+0000 7f805aa00640 1 -- start start 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f805aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80540c7e40 0x7f80540af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f805aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8054151480 0x7f805406bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f805aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f80540712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f805aa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80540c3900 con 0x7f80540c7e40 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f805aa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80540b0120 con 0x7f8054151480 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f805aa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80540ad870 con 0x7f8054158cf0 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f8053e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80540c7e40 0x7f80540af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f8053e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80540c7e40 0x7f80540af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35972/0 (socket says 172.21.15.73:35972) 2024-03-23T06:10:16.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f8053e00640 1 -- 172.21.15.73:0/621936550 learned_addr learned my addr 172.21.15.73:0/621936550 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f8058a00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f80540712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.433+0000 7f804be00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8054151480 0x7f805406bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8053e00640 1 -- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 msgr2=0x7f80540712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8053e00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f80540712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8053e00640 1 -- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8054151480 msgr2=0x7f805406bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8053e00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8054151480 0x7f805406bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8053e00640 1 -- 172.21.15.73:0/621936550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c009a70 con 0x7f80540c7e40 2024-03-23T06:10:16.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8053e00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80540c7e40 0x7f80540af890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f804400e870 tx=0x7f804400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8050c00640 1 -- 172.21.15.73:0/621936550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80440094f0 con 0x7f80540c7e40 2024-03-23T06:10:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8050c00640 1 -- 172.21.15.73:0/621936550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804400c940 con 0x7f80540c7e40 2024-03-23T06:10:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80540adb50 con 0x7f80540c7e40 2024-03-23T06:10:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.434+0000 7f8050c00640 1 -- 172.21.15.73:0/621936550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804400ccf0 con 0x7f80540c7e40 2024-03-23T06:10:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.435+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80540ae110 con 0x7f80540c7e40 2024-03-23T06:10:16.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.436+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80540c3b70 con 0x7f80540c7e40 2024-03-23T06:10:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.437+0000 7f8050c00640 1 -- 172.21.15.73:0/621936550 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8044013470 con 0x7f80540c7e40 2024-03-23T06:10:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.437+0000 7f8050c00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803006ac00 0x7f803006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.438+0000 7f8050c00640 1 -- 172.21.15.73:0/621936550 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8044089760 con 0x7f80540c7e40 2024-03-23T06:10:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.438+0000 7f804be00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803006ac00 0x7f803006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.438+0000 7f804be00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803006ac00 0x7f803006d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80540b1240 tx=0x7f803c007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:16.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.442+0000 7f8050c00640 1 -- 172.21.15.73:0/621936550 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8044054660 con 0x7f80540c7e40 2024-03-23T06:10:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.651+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80540ae2a0 con 0x7f80540c7e40 2024-03-23T06:10:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.652+0000 7f8050c00640 1 -- 172.21.15.73:0/621936550 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8044057c80 con 0x7f80540c7e40 2024-03-23T06:10:16.651 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803006ac00 msgr2=0x7f803006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803006ac00 0x7f803006d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80540b1240 tx=0x7f803c007de0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80540c7e40 msgr2=0x7f80540af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80540c7e40 0x7f80540af890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f804400e870 tx=0x7f804400ed30 comp rx=0 tx=0).stop 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 shutdown_connections 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803006ac00 0x7f803006d0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8054158cf0 0x7f80540712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8054151480 0x7f805406bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 --2- 172.21.15.73:0/621936550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80540c7e40 0x7f80540af890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 >> 172.21.15.73:0/621936550 conn(0x7f8054069cb0 msgr2=0x7f8054159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 shutdown_connections 2024-03-23T06:10:16.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.655+0000 7f805aa00640 1 -- 172.21.15.73:0/621936550 wait complete. 2024-03-23T06:10:16.674 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:10:16.675 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T06:10:16.723 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:16.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.976+0000 7f4aa2e00640 1 Processor -- start 2024-03-23T06:10:16.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.976+0000 7f4aa2e00640 1 -- start start 2024-03-23T06:10:16.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.977+0000 7f4aa2e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4a9c0c5a10 0x7f4a9c0bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.977+0000 7f4aa2e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a9c0c03a0 0x7f4a9c071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.977+0000 7f4aa2e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c157b60 con 0x7f4a9c1513f0 2024-03-23T06:10:16.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.977+0000 7f4aa2e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c158dc0 con 0x7f4a9c0c03a0 2024-03-23T06:10:16.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.977+0000 7f4aa2e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c0c0830 con 0x7f4a9c0c5a10 2024-03-23T06:10:16.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.977+0000 7f4aa0e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a9c0c03a0 0x7f4a9c071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.978+0000 7f4aa0e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a9c0c03a0 0x7f4a9c071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35976/0 (socket says 172.21.15.73:35976) 2024-03-23T06:10:16.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.978+0000 7f4aa0e00640 1 -- 172.21.15.73:0/2808979844 learned_addr learned my addr 172.21.15.73:0/2808979844 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:16.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.978+0000 7f4a93400640 1 --2- 172.21.15.73:0/2808979844 >> v2:172.21.15.110:3300/0 conn(0x7f4a9c0c5a10 0x7f4a9c0bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.978+0000 7f4aa0e00640 1 -- 172.21.15.73:0/2808979844 >> v2:172.21.15.110:3300/0 conn(0x7f4a9c0c5a10 msgr2=0x7f4a9c0bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:16.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.978+0000 7f4aa0e00640 1 --2- 172.21.15.73:0/2808979844 >> v2:172.21.15.110:3300/0 conn(0x7f4a9c0c5a10 0x7f4a9c0bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.978+0000 7f4a9b400640 1 -- 172.21.15.73:0/2808979844 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39724416 0 0) 0x7f4a9c157b60 con 0x7f4a9c1513f0 2024-03-23T06:10:16.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.978+0000 7f4aa0e00640 1 -- 172.21.15.73:0/2808979844 >> v1:172.21.15.110:6789/0 conn(0x7f4a9c1513f0 legacy=0x7f4a9c1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.978+0000 7f4aa0e00640 1 -- 172.21.15.73:0/2808979844 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0c0b10 con 0x7f4a9c0c03a0 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.979+0000 7f4aa0e00640 1 --2- 172.21.15.73:0/2808979844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c0c03a0 0x7f4a9c071bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c072880 tx=0x7f4a9402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b978ea4bfcdb6968 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.979+0000 7f4a9b400640 1 -- 172.21.15.73:0/2808979844 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9402f850 con 0x7f4a9c0c03a0 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.979+0000 7f4a9b400640 1 -- 172.21.15.73:0/2808979844 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9402f9b0 con 0x7f4a9c0c03a0 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.979+0000 7f4a9b400640 1 -- 172.21.15.73:0/2808979844 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9402fd40 con 0x7f4a9c0c03a0 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.980+0000 7f4aa2e00640 1 -- 172.21.15.73:0/2808979844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c0c03a0 msgr2=0x7f4a9c071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.980+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/2808979844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c0c03a0 0x7f4a9c071bc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c072880 tx=0x7f4a9402ba30 comp rx=0 tx=0).stop 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.980+0000 7f4aa2e00640 1 -- 172.21.15.73:0/2808979844 shutdown_connections 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.980+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/2808979844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c0c03a0 0x7f4a9c071bc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.980+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/2808979844 >> v2:172.21.15.110:3300/0 conn(0x7f4a9c0c5a10 0x7f4a9c0bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.980+0000 7f4aa2e00640 1 -- 172.21.15.73:0/2808979844 >> 172.21.15.73:0/2808979844 conn(0x7f4a9c06bb40 msgr2=0x7f4a9c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.980+0000 7f4aa2e00640 1 -- 172.21.15.73:0/2808979844 shutdown_connections 2024-03-23T06:10:16.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.980+0000 7f4aa2e00640 1 -- 172.21.15.73:0/2808979844 wait complete. 2024-03-23T06:10:16.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.982+0000 7f4aa2e00640 1 Processor -- start 2024-03-23T06:10:16.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.982+0000 7f4aa2e00640 1 -- start start 2024-03-23T06:10:16.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa2e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c0c5a10 0x7f4a9c0ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa2e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a9c1513f0 0x7f4a9c1e4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa2e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c070530 0x7f4a9c14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa2e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0c77e0 con 0x7f4a9c070530 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa2e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0c7ac0 con 0x7f4a9c0c5a10 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa2e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c06fa50 con 0x7f4a9c1513f0 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa0e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c070530 0x7f4a9c14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4a9be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c0c5a10 0x7f4a9c0ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa0e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c070530 0x7f4a9c14f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35978/0 (socket says 172.21.15.73:35978) 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4aa0e00640 1 -- 172.21.15.73:0/1617733002 learned_addr learned my addr 172.21.15.73:0/1617733002 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.983+0000 7f4a93400640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a9c1513f0 0x7f4a9c1e4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4aa0e00640 1 -- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a9c1513f0 msgr2=0x7f4a9c1e4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4aa0e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a9c1513f0 0x7f4a9c1e4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4aa0e00640 1 -- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c0c5a10 msgr2=0x7f4a9c0ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4aa0e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c0c5a10 0x7f4a9c0ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:16.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4aa0e00640 1 -- 172.21.15.73:0/1617733002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a940094d0 con 0x7f4a9c070530 2024-03-23T06:10:16.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4aa0e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c070530 0x7f4a9c14f8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a9402ba70 tx=0x7f4a94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:16.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4a98c00640 1 -- 172.21.15.73:0/1617733002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94037c40 con 0x7f4a9c070530 2024-03-23T06:10:16.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4a98c00640 1 -- 172.21.15.73:0/1617733002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a94037dc0 con 0x7f4a9c070530 2024-03-23T06:10:16.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4a98c00640 1 -- 172.21.15.73:0/1617733002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94041640 con 0x7f4a9c070530 2024-03-23T06:10:16.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.984+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9c06fd30 con 0x7f4a9c070530 2024-03-23T06:10:16.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.985+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c0c7da0 con 0x7f4a9c070530 2024-03-23T06:10:16.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.986+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9c06fef0 con 0x7f4a9c070530 2024-03-23T06:10:16.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.986+0000 7f4a98c00640 1 -- 172.21.15.73:0/1617733002 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4a940417a0 con 0x7f4a9c070530 2024-03-23T06:10:16.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.987+0000 7f4a98c00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4a7806ac50 0x7f4a7806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:16.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.987+0000 7f4a98c00640 1 -- 172.21.15.73:0/1617733002 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a9403c070 con 0x7f4a9c070530 2024-03-23T06:10:16.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.988+0000 7f4a9be00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4a7806ac50 0x7f4a7806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:16.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.988+0000 7f4a9be00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4a7806ac50 0x7f4a7806d110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c000f60 tx=0x7f4a8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:16.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:16.992+0000 7f4a98c00640 1 -- 172.21.15.73:0/1617733002 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4a94077130 con 0x7f4a9c070530 2024-03-23T06:10:17.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.187+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a9c04e110 con 0x7f4a9c070530 2024-03-23T06:10:17.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.188+0000 7f4a98c00640 1 -- 172.21.15.73:0/1617733002 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f4a9407a750 con 0x7f4a9c070530 2024-03-23T06:10:17.189 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:17.189 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4a7806ac50 msgr2=0x7f4a7806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4a7806ac50 0x7f4a7806d110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c000f60 tx=0x7f4a8c009040 comp rx=0 tx=0).stop 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c070530 msgr2=0x7f4a9c14f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c070530 0x7f4a9c14f8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a9402ba70 tx=0x7f4a94004730 comp rx=0 tx=0).stop 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 shutdown_connections 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a9c070530 0x7f4a9c14f8b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4a7806ac50 0x7f4a7806d110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a9c1513f0 0x7f4a9c1e4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 --2- 172.21.15.73:0/1617733002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9c0c5a10 0x7f4a9c0ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.191+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 >> 172.21.15.73:0/1617733002 conn(0x7f4a9c06bb40 msgr2=0x7f4a9c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.192+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 shutdown_connections 2024-03-23T06:10:17.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.192+0000 7f4aa2e00640 1 -- 172.21.15.73:0/1617733002 wait complete. 2024-03-23T06:10:17.211 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T06:09:56.066381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T06:09:56.917187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-23T06:09:59.981596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-23T06:10:17.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:10:17.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.421+0000 7fb9f6000640 1 Processor -- start 2024-03-23T06:10:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.422+0000 7fb9f6000640 1 -- start start 2024-03-23T06:10:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.423+0000 7fb9f6000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9f015e340 0x7fb9f0169250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.423+0000 7fb9f6000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00c94d0 con 0x7fb9f0157b70 2024-03-23T06:10:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.423+0000 7fb9f6000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f00c9850 con 0x7fb9f00c5b60 2024-03-23T06:10:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.423+0000 7fb9f6000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f00c76f0 con 0x7fb9f015e340 2024-03-23T06:10:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.423+0000 7fb9ef400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb9f0157b70 0x7fb9f00c7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45916/0 (socket says 172.21.15.73:45916) 2024-03-23T06:10:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.423+0000 7fb9ef400640 1 -- 172.21.15.73:0/1774583264 learned_addr learned my addr 172.21.15.73:0/1774583264 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.424+0000 7fb9efe00640 1 --2- 172.21.15.73:0/1774583264 >> v2:172.21.15.110:3300/0 conn(0x7fb9f015e340 0x7fb9f0169250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.424+0000 7fb9efe00640 1 -- 172.21.15.73:0/1774583264 >> v1:172.21.15.110:6789/0 conn(0x7fb9f00c5b60 legacy=0x7fb9f00caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.424+0000 7fb9efe00640 1 -- 172.21.15.73:0/1774583264 >> v1:172.21.15.73:6789/0 conn(0x7fb9f0157b70 legacy=0x7fb9f00c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.424+0000 7fb9eea00640 1 -- 172.21.15.73:0/1774583264 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428686403 0 0) 0x7fb9f00c94d0 con 0x7fb9f0157b70 2024-03-23T06:10:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.424+0000 7fb9efe00640 1 -- 172.21.15.73:0/1774583264 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00c9c30 con 0x7fb9f015e340 2024-03-23T06:10:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.425+0000 7fb9efe00640 1 --2- 172.21.15.73:0/1774583264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f015e340 0x7fb9f0169250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009d90 tx=0x7fb9e802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c893277dc7c20101 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.425+0000 7fb9eea00640 1 -- 172.21.15.73:0/1774583264 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e802cd80 con 0x7fb9f015e340 2024-03-23T06:10:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.425+0000 7fb9eea00640 1 -- 172.21.15.73:0/1774583264 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8034440 con 0x7fb9f015e340 2024-03-23T06:10:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.425+0000 7fb9eea00640 1 -- 172.21.15.73:0/1774583264 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e80347d0 con 0x7fb9f015e340 2024-03-23T06:10:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.426+0000 7fb9f6000640 1 -- 172.21.15.73:0/1774583264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f015e340 msgr2=0x7fb9f0169250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.426+0000 7fb9f6000640 1 --2- 172.21.15.73:0/1774583264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f015e340 0x7fb9f0169250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009d90 tx=0x7fb9e802bfd0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.426+0000 7fb9f6000640 1 -- 172.21.15.73:0/1774583264 shutdown_connections 2024-03-23T06:10:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.426+0000 7fb9f6000640 1 --2- 172.21.15.73:0/1774583264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f015e340 0x7fb9f0169250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.426+0000 7fb9f6000640 1 -- 172.21.15.73:0/1774583264 >> 172.21.15.73:0/1774583264 conn(0x7fb9f0069cb0 msgr2=0x7fb9f006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.426+0000 7fb9f6000640 1 -- 172.21.15.73:0/1774583264 shutdown_connections 2024-03-23T06:10:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.426+0000 7fb9f6000640 1 -- 172.21.15.73:0/1774583264 wait complete. 2024-03-23T06:10:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.428+0000 7fb9f6000640 1 Processor -- start 2024-03-23T06:10:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.428+0000 7fb9f6000640 1 -- start start 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9f6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f00c5b60 0x7fb9f0161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9f6000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9f0157b70 0x7fb9f01f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9f6000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f015e340 0x7fb9f0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9f6000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f01607b0 con 0x7fb9f015e340 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9f6000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f015d480 con 0x7fb9f00c5b60 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9f6000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f015adb0 con 0x7fb9f0157b70 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9efe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f015e340 0x7fb9f0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9efe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f015e340 0x7fb9f0159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35982/0 (socket says 172.21.15.73:35982) 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9ef400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f00c5b60 0x7fb9f0161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9efe00640 1 -- 172.21.15.73:0/3007723707 learned_addr learned my addr 172.21.15.73:0/3007723707 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9e6a00640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9f0157b70 0x7fb9f01f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9efe00640 1 -- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9f0157b70 msgr2=0x7fb9f01f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9efe00640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9f0157b70 0x7fb9f01f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9efe00640 1 -- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f00c5b60 msgr2=0x7fb9f0161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9efe00640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f00c5b60 0x7fb9f0161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9efe00640 1 -- 172.21.15.73:0/3007723707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e8009a70 con 0x7fb9f015e340 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.429+0000 7fb9e6a00640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9f0157b70 0x7fb9f01f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.430+0000 7fb9efe00640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f015e340 0x7fb9f0159ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009d90 tx=0x7fb9e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.430+0000 7fb9e7e00640 1 -- 172.21.15.73:0/3007723707 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8040650 con 0x7fb9f015e340 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.430+0000 7fb9e7e00640 1 -- 172.21.15.73:0/3007723707 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e80407b0 con 0x7fb9f015e340 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.430+0000 7fb9e7e00640 1 -- 172.21.15.73:0/3007723707 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8040b60 con 0x7fb9f015e340 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.430+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f015b2a0 con 0x7fb9f015e340 2024-03-23T06:10:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.430+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f015afc0 con 0x7fb9f015e340 2024-03-23T06:10:17.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.431+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f00c5910 con 0x7fb9f015e340 2024-03-23T06:10:17.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.432+0000 7fb9e7e00640 1 -- 172.21.15.73:0/3007723707 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb9e8040cc0 con 0x7fb9f015e340 2024-03-23T06:10:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.433+0000 7fb9e7e00640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb9cc06ac30 0x7fb9cc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.433+0000 7fb9e7e00640 1 -- 172.21.15.73:0/3007723707 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9e80ac4f0 con 0x7fb9f015e340 2024-03-23T06:10:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.433+0000 7fb9ef400640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb9cc06ac30 0x7fb9cc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.434+0000 7fb9ef400640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb9cc06ac30 0x7fb9cc06d0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0000f60 tx=0x7fb9e0007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.437+0000 7fb9e7e00640 1 -- 172.21.15.73:0/3007723707 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb9e8077540 con 0x7fb9f015e340 2024-03-23T06:10:17.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.633+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9f004e110 con 0x7fb9f015e340 2024-03-23T06:10:17.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.634+0000 7fb9e7e00640 1 -- 172.21.15.73:0/3007723707 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9e807ab60 con 0x7fb9f015e340 2024-03-23T06:10:17.635 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:10:17.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb9cc06ac30 msgr2=0x7fb9cc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb9cc06ac30 0x7fb9cc06d0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0000f60 tx=0x7fb9e0007d50 comp rx=0 tx=0).stop 2024-03-23T06:10:17.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f015e340 msgr2=0x7fb9f0159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f015e340 0x7fb9f0159ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009d90 tx=0x7fb9e8004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:17.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 shutdown_connections 2024-03-23T06:10:17.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9f015e340 0x7fb9f0159ce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb9cc06ac30 0x7fb9cc06d0f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9f0157b70 0x7fb9f01f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 --2- 172.21.15.73:0/3007723707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9f00c5b60 0x7fb9f0161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 >> 172.21.15.73:0/3007723707 conn(0x7fb9f0069cb0 msgr2=0x7fb9f006c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:17.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 shutdown_connections 2024-03-23T06:10:17.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.637+0000 7fb9f6000640 1 -- 172.21.15.73:0/3007723707 wait complete. 2024-03-23T06:10:17.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T06:10:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.866+0000 7f4acd600640 1 Processor -- start 2024-03-23T06:10:17.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.866+0000 7f4acd600640 1 -- start start 2024-03-23T06:10:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.867+0000 7f4acd600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.867+0000 7f4acd600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac815b710 con 0x7f4ac8158cf0 2024-03-23T06:10:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.867+0000 7f4acd600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac815ab90 con 0x7f4ac80c7e40 2024-03-23T06:10:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.867+0000 7f4acd600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac81588d0 con 0x7f4ac8151480 2024-03-23T06:10:17.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac7400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4ac8158cf0 0x7f4ac8159130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45922/0 (socket says 172.21.15.73:45922) 2024-03-23T06:10:17.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac7400640 1 -- 172.21.15.73:0/1326724916 learned_addr learned my addr 172.21.15.73:0/1326724916 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:17.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac6a00640 1 --2- 172.21.15.73:0/1326724916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4abe000640 1 --1- 172.21.15.73:0/1326724916 >> v1:172.21.15.110:6789/0 conn(0x7f4ac80c7e40 0x7f4ac8071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38930/0 (socket says 172.21.15.73:38930) 2024-03-23T06:10:17.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac6000640 1 -- 172.21.15.73:0/1326724916 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808752989 0 0) 0x7f4ac815ab90 con 0x7f4ac80c7e40 2024-03-23T06:10:17.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac6000640 1 -- 172.21.15.73:0/1326724916 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aac003520 con 0x7f4ac80c7e40 2024-03-23T06:10:17.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac6000640 1 -- 172.21.15.73:0/1326724916 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030686805 0 0) 0x7f4ac815b710 con 0x7f4ac8158cf0 2024-03-23T06:10:17.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac6000640 1 -- 172.21.15.73:0/1326724916 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac815ab90 con 0x7f4ac8158cf0 2024-03-23T06:10:17.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac6a00640 1 -- 172.21.15.73:0/1326724916 >> v1:172.21.15.110:6789/0 conn(0x7f4ac80c7e40 legacy=0x7f4ac8071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac6a00640 1 -- 172.21.15.73:0/1326724916 >> v1:172.21.15.73:6789/0 conn(0x7f4ac8158cf0 legacy=0x7f4ac8159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.868+0000 7f4ac6a00640 1 -- 172.21.15.73:0/1326724916 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac815ae70 con 0x7f4ac8151480 2024-03-23T06:10:17.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.869+0000 7f4ac6a00640 1 --2- 172.21.15.73:0/1326724916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80097d0 tx=0x7f4ab802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc93cda8a4fac312 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:17.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4ac6000640 1 -- 172.21.15.73:0/1326724916 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8030880 con 0x7f4ac8151480 2024-03-23T06:10:17.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4ac6000640 1 -- 172.21.15.73:0/1326724916 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80309e0 con 0x7f4ac8151480 2024-03-23T06:10:17.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4ac6000640 1 -- 172.21.15.73:0/1326724916 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8030d70 con 0x7f4ac8151480 2024-03-23T06:10:17.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4acd600640 1 -- 172.21.15.73:0/1326724916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 msgr2=0x7f4ac8157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4acd600640 1 --2- 172.21.15.73:0/1326724916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80097d0 tx=0x7f4ab802b9c0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4acd600640 1 -- 172.21.15.73:0/1326724916 shutdown_connections 2024-03-23T06:10:17.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4acd600640 1 --2- 172.21.15.73:0/1326724916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157e60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4acd600640 1 -- 172.21.15.73:0/1326724916 >> 172.21.15.73:0/1326724916 conn(0x7f4ac8069cb0 msgr2=0x7f4ac806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:17.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4acd600640 1 -- 172.21.15.73:0/1326724916 shutdown_connections 2024-03-23T06:10:17.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.870+0000 7f4acd600640 1 -- 172.21.15.73:0/1326724916 wait complete. 2024-03-23T06:10:17.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.872+0000 7f4acd600640 1 Processor -- start 2024-03-23T06:10:17.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.872+0000 7f4acd600640 1 -- start start 2024-03-23T06:10:17.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4acd600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ac80c7e40 0x7f4ac8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4acd600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4acd600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac8158cf0 0x7f4ac8155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4acd600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8157680 con 0x7f4ac80c7e40 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4acd600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80caa00 con 0x7f4ac8158cf0 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4acd600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac80caca0 con 0x7f4ac8151480 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4ac6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ac80c7e40 0x7f4ac8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4ac6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ac80c7e40 0x7f4ac8156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35986/0 (socket says 172.21.15.73:35986) 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.873+0000 7f4ac6a00640 1 -- 172.21.15.73:0/3903933065 learned_addr learned my addr 172.21.15.73:0/3903933065 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4ac7400640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac8158cf0 0x7f4ac8155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4abe000640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4ac6a00640 1 -- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 msgr2=0x7f4ac8157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4ac6a00640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4ac6a00640 1 -- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac8158cf0 msgr2=0x7f4ac8155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4ac6a00640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac8158cf0 0x7f4ac8155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:17.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4ac6a00640 1 -- 172.21.15.73:0/3903933065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8009400 con 0x7f4ac80c7e40 2024-03-23T06:10:17.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4ac6a00640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ac80c7e40 0x7f4ac8156c00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80098f0 tx=0x7f4ab8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:17.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.874+0000 7f4abf400640 1 -- 172.21.15.73:0/3903933065 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab803e040 con 0x7f4ac80c7e40 2024-03-23T06:10:17.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.875+0000 7f4abf400640 1 -- 172.21.15.73:0/3903933065 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab8039cd0 con 0x7f4ac80c7e40 2024-03-23T06:10:17.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.875+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac8153e10 con 0x7f4ac80c7e40 2024-03-23T06:10:17.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.875+0000 7f4abf400640 1 -- 172.21.15.73:0/3903933065 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8044630 con 0x7f4ac80c7e40 2024-03-23T06:10:17.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.875+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac81543d0 con 0x7f4ac80c7e40 2024-03-23T06:10:17.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.876+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac804e110 con 0x7f4ac80c7e40 2024-03-23T06:10:17.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.877+0000 7f4abf400640 1 -- 172.21.15.73:0/3903933065 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4ab8044790 con 0x7f4ac80c7e40 2024-03-23T06:10:17.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.877+0000 7f4abf400640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:17.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.878+0000 7f4abf400640 1 -- 172.21.15.73:0/3903933065 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4ab80abae0 con 0x7f4ac80c7e40 2024-03-23T06:10:17.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.878+0000 7f4abe000640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:17.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.879+0000 7f4abe000640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4aa406ac00 0x7f4aa406d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ac806a8d0 tx=0x7f4ab0007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:17.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:17.882+0000 7f4abf400640 1 -- 172.21.15.73:0/3903933065 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4ab80768d0 con 0x7f4ac80c7e40 2024-03-23T06:10:18.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.087+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ac80c8ad0 con 0x7f4ac80c7e40 2024-03-23T06:10:18.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.088+0000 7f4abf400640 1 -- 172.21.15.73:0/3903933065 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ab8079ef0 con 0x7f4ac80c7e40 2024-03-23T06:10:18.088 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4aa406ac00 msgr2=0x7f4aa406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4aa406ac00 0x7f4aa406d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4ac806a8d0 tx=0x7f4ab0007d50 comp rx=0 tx=0).stop 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ac80c7e40 msgr2=0x7f4ac8156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ac80c7e40 0x7f4ac8156c00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80098f0 tx=0x7f4ab8004730 comp rx=0 tx=0).stop 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 shutdown_connections 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ac8158cf0 0x7f4ac8155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ac8151480 0x7f4ac8157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 --2- 172.21.15.73:0/3903933065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ac80c7e40 0x7f4ac8156c00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 >> 172.21.15.73:0/3903933065 conn(0x7f4ac8069cb0 msgr2=0x7f4ac814f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:18.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 shutdown_connections 2024-03-23T06:10:18.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.091+0000 7f4acd600640 1 -- 172.21.15.73:0/3903933065 wait complete. 2024-03-23T06:10:18.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T06:10:18.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.320+0000 7fc973200640 1 Processor -- start 2024-03-23T06:10:18.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.320+0000 7fc973200640 1 -- start start 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc973200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9740bf1f0 0x7fc9740c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc973200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9741571a0 0x7fc97415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc973200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc97415a770 con 0x7fc97415b420 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc973200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9740be5e0 con 0x7fc9741571a0 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc973200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9741576e0 con 0x7fc9740bf1f0 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc969400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9741571a0 0x7fc97415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc972800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc97415b420 0x7fc9740c3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45930/0 (socket says 172.21.15.73:45930) 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc972800640 1 -- 172.21.15.73:0/3944220917 learned_addr learned my addr 172.21.15.73:0/3944220917 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:18.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.322+0000 7fc971e00640 1 --2- 172.21.15.73:0/3944220917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9740bf1f0 0x7fc9740c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.323+0000 7fc971e00640 1 -- 172.21.15.73:0/3944220917 >> v2:172.21.15.73:3300/0 conn(0x7fc9741571a0 msgr2=0x7fc97415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:18.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.323+0000 7fc971e00640 1 --2- 172.21.15.73:0/3944220917 >> v2:172.21.15.73:3300/0 conn(0x7fc9741571a0 0x7fc97415aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.323+0000 7fc971e00640 1 -- 172.21.15.73:0/3944220917 >> v1:172.21.15.73:6789/0 conn(0x7fc97415b420 legacy=0x7fc9740c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.323+0000 7fc971e00640 1 -- 172.21.15.73:0/3944220917 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9741579c0 con 0x7fc9740bf1f0 2024-03-23T06:10:18.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.323+0000 7fc969400640 1 --2- 172.21.15.73:0/3944220917 >> v2:172.21.15.73:3300/0 conn(0x7fc9741571a0 0x7fc97415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:18.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.324+0000 7fc971e00640 1 --2- 172.21.15.73:0/3944220917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9740bf1f0 0x7fc9740c4fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc964009d90 tx=0x7fc96402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e982da47f589b279 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:18.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.324+0000 7fc971400640 1 -- 172.21.15.73:0/3944220917 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96402cbc0 con 0x7fc9740bf1f0 2024-03-23T06:10:18.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.324+0000 7fc971400640 1 -- 172.21.15.73:0/3944220917 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96402cd20 con 0x7fc9740bf1f0 2024-03-23T06:10:18.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.324+0000 7fc971400640 1 -- 172.21.15.73:0/3944220917 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964034660 con 0x7fc9740bf1f0 2024-03-23T06:10:18.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.325+0000 7fc973200640 1 -- 172.21.15.73:0/3944220917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9740bf1f0 msgr2=0x7fc9740c4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.325+0000 7fc973200640 1 --2- 172.21.15.73:0/3944220917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9740bf1f0 0x7fc9740c4fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc964009d90 tx=0x7fc96402be10 comp rx=0 tx=0).stop 2024-03-23T06:10:18.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.325+0000 7fc973200640 1 -- 172.21.15.73:0/3944220917 shutdown_connections 2024-03-23T06:10:18.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.325+0000 7fc973200640 1 --2- 172.21.15.73:0/3944220917 >> v2:172.21.15.73:3300/0 conn(0x7fc9741571a0 0x7fc97415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.325+0000 7fc973200640 1 --2- 172.21.15.73:0/3944220917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9740bf1f0 0x7fc9740c4fd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.325+0000 7fc973200640 1 -- 172.21.15.73:0/3944220917 >> 172.21.15.73:0/3944220917 conn(0x7fc974066080 msgr2=0x7fc97406d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:18.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.325+0000 7fc973200640 1 -- 172.21.15.73:0/3944220917 shutdown_connections 2024-03-23T06:10:18.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.325+0000 7fc973200640 1 -- 172.21.15.73:0/3944220917 wait complete. 2024-03-23T06:10:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.327+0000 7fc973200640 1 Processor -- start 2024-03-23T06:10:18.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.327+0000 7fc973200640 1 -- start start 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc973200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9740bf1f0 0x7fc9740c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc973200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9741571a0 0x7fc9741f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc973200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc97415b420 0x7fc974146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc973200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c3b10 con 0x7fc97415b420 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc973200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740bc6a0 con 0x7fc9740bf1f0 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc973200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9740c2700 con 0x7fc9741571a0 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc971e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9740bf1f0 0x7fc9740c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc972800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc97415b420 0x7fc974146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc971e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9740bf1f0 0x7fc9740c35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:48328/0 (socket says 172.21.15.73:48328) 2024-03-23T06:10:18.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc971e00640 1 -- 172.21.15.73:0/363154514 learned_addr learned my addr 172.21.15.73:0/363154514 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:18.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.329+0000 7fc969400640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9741571a0 0x7fc9741f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc971e00640 1 -- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9741571a0 msgr2=0x7fc9741f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc971e00640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9741571a0 0x7fc9741f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc971e00640 1 -- 172.21.15.73:0/363154514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc97415b420 msgr2=0x7fc974146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc971e00640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc97415b420 0x7fc974146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc971e00640 1 -- 172.21.15.73:0/363154514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009400 con 0x7fc9740bf1f0 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc969400640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9741571a0 0x7fc9741f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc971e00640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9740bf1f0 0x7fc9740c35d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc964009d90 tx=0x7fc964004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc96aa00640 1 -- 172.21.15.73:0/363154514 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96403e610 con 0x7fc9740bf1f0 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc96aa00640 1 -- 172.21.15.73:0/363154514 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96402ce90 con 0x7fc9740bf1f0 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc96aa00640 1 -- 172.21.15.73:0/363154514 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96403e9f0 con 0x7fc9740bf1f0 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc964009a70 con 0x7fc9740bf1f0 2024-03-23T06:10:18.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.330+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9740c7140 con 0x7fc9740bf1f0 2024-03-23T06:10:18.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.331+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9740c2c20 con 0x7fc9740bf1f0 2024-03-23T06:10:18.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.332+0000 7fc96aa00640 1 -- 172.21.15.73:0/363154514 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc96403b050 con 0x7fc9740bf1f0 2024-03-23T06:10:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.333+0000 7fc96aa00640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc95006ac00 0x7fc95006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.333+0000 7fc96aa00640 1 -- 172.21.15.73:0/363154514 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc9640ac080 con 0x7fc9740bf1f0 2024-03-23T06:10:18.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.334+0000 7fc969400640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc95006ac00 0x7fc95006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.334+0000 7fc969400640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc95006ac00 0x7fc95006d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9740c1480 tx=0x7fc95c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:18.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.338+0000 7fc96aa00640 1 -- 172.21.15.73:0/363154514 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc9640df580 con 0x7fc9740bf1f0 2024-03-23T06:10:18.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.534+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9741585c0 con 0x7fc9740bf1f0 2024-03-23T06:10:18.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.535+0000 7fc96aa00640 1 -- 172.21.15.73:0/363154514 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc96404e0a0 con 0x7fc9740bf1f0 2024-03-23T06:10:18.535 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-23T06:10:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc95006ac00 msgr2=0x7fc95006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc95006ac00 0x7fc95006d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc9740c1480 tx=0x7fc95c009190 comp rx=0 tx=0).stop 2024-03-23T06:10:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9740bf1f0 msgr2=0x7fc9740c35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9740bf1f0 0x7fc9740c35d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc964009d90 tx=0x7fc964004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 shutdown_connections 2024-03-23T06:10:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc97415b420 0x7fc974146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc95006ac00 0x7fc95006d0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9741571a0 0x7fc9741f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 --2- 172.21.15.73:0/363154514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9740bf1f0 0x7fc9740c35d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 >> 172.21.15.73:0/363154514 conn(0x7fc974066080 msgr2=0x7fc9740c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 shutdown_connections 2024-03-23T06:10:18.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.538+0000 7fc973200640 1 -- 172.21.15.73:0/363154514 wait complete. 2024-03-23T06:10:18.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-23T06:10:18.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.760+0000 7fbe61c00640 1 Processor -- start 2024-03-23T06:10:18.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.760+0000 7fbe61c00640 1 -- start start 2024-03-23T06:10:18.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe61c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe5c157c60 0x7fbe5c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe61c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe5c15de60 0x7fbe5c0c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe61c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c0714a0 0x7fbe5c0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe61c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c06e160 con 0x7fbe5c15de60 2024-03-23T06:10:18.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe61c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c071d30 con 0x7fbe5c157c60 2024-03-23T06:10:18.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe61c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c06eb70 con 0x7fbe5c0714a0 2024-03-23T06:10:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe5b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c0714a0 0x7fbe5c0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe5a000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbe5c15de60 0x7fbe5c0c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.762+0000 7fbe5aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe5c157c60 0x7fbe5c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.763+0000 7fbe5b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c0714a0 0x7fbe5c0c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:34984/0 (socket says 172.21.15.73:34984) 2024-03-23T06:10:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.763+0000 7fbe5b400640 1 -- 172.21.15.73:0/1516085691 learned_addr learned my addr 172.21.15.73:0/1516085691 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.763+0000 7fbe5b400640 1 -- 172.21.15.73:0/1516085691 >> v2:172.21.15.110:3300/0 conn(0x7fbe5c157c60 msgr2=0x7fbe5c15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.763+0000 7fbe5b400640 1 --2- 172.21.15.73:0/1516085691 >> v2:172.21.15.110:3300/0 conn(0x7fbe5c157c60 0x7fbe5c15d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.763+0000 7fbe5b400640 1 -- 172.21.15.73:0/1516085691 >> v2:172.21.15.73:3300/0 conn(0x7fbe5c15de60 msgr2=0x7fbe5c0c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:18.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.763+0000 7fbe5b400640 1 --2- 172.21.15.73:0/1516085691 >> v2:172.21.15.73:3300/0 conn(0x7fbe5c15de60 0x7fbe5c0c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.763+0000 7fbe5b400640 1 -- 172.21.15.73:0/1516085691 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c06baa0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.763+0000 7fbe5a000640 1 --2- 172.21.15.73:0/1516085691 >> v2:172.21.15.73:3300/0 conn(0x7fbe5c15de60 0x7fbe5c0c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:18.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.764+0000 7fbe5b400640 1 --2- 172.21.15.73:0/1516085691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c0714a0 0x7fbe5c0c13b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c06edc0 tx=0x7fbe5402bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381636f3148af812 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:18.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.764+0000 7fbe59600640 1 -- 172.21.15.73:0/1516085691 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5402c960 con 0x7fbe5c0714a0 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.764+0000 7fbe59600640 1 -- 172.21.15.73:0/1516085691 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5402cac0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.764+0000 7fbe59600640 1 -- 172.21.15.73:0/1516085691 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5402ce50 con 0x7fbe5c0714a0 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 -- 172.21.15.73:0/1516085691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c0714a0 msgr2=0x7fbe5c0c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1516085691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c0714a0 0x7fbe5c0c13b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c06edc0 tx=0x7fbe5402bdc0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 -- 172.21.15.73:0/1516085691 shutdown_connections 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1516085691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c0714a0 0x7fbe5c0c13b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1516085691 >> v2:172.21.15.73:3300/0 conn(0x7fbe5c15de60 0x7fbe5c0c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1516085691 >> v2:172.21.15.110:3300/0 conn(0x7fbe5c157c60 0x7fbe5c15d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 -- 172.21.15.73:0/1516085691 >> 172.21.15.73:0/1516085691 conn(0x7fbe5c0c88c0 msgr2=0x7fbe5c0c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:18.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 -- 172.21.15.73:0/1516085691 shutdown_connections 2024-03-23T06:10:18.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.765+0000 7fbe61c00640 1 -- 172.21.15.73:0/1516085691 wait complete. 2024-03-23T06:10:18.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.767+0000 7fbe61c00640 1 Processor -- start 2024-03-23T06:10:18.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.767+0000 7fbe61c00640 1 -- start start 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe61c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c0714a0 0x7fbe5c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe61c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c157c60 0x7fbe5c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe61c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c15de60 0x7fbe5c1f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe61c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0c7750 con 0x7fbe5c0714a0 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe61c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0c7190 con 0x7fbe5c15de60 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe61c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0c7470 con 0x7fbe5c157c60 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe5aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c0714a0 0x7fbe5c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe5aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c0714a0 0x7fbe5c15ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36034/0 (socket says 172.21.15.73:36034) 2024-03-23T06:10:18.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe5aa00640 1 -- 172.21.15.73:0/1576462018 learned_addr learned my addr 172.21.15.73:0/1576462018 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe5a000640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c157c60 0x7fbe5c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.768+0000 7fbe5b400640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c15de60 0x7fbe5c1f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe5aa00640 1 -- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c157c60 msgr2=0x7fbe5c1f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe5aa00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c157c60 0x7fbe5c1f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe5aa00640 1 -- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c15de60 msgr2=0x7fbe5c1f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe5aa00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c15de60 0x7fbe5c1f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe5aa00640 1 -- 172.21.15.73:0/1576462018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48009400 con 0x7fbe5c0714a0 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe5aa00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c0714a0 0x7fbe5c15ecf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00e870 tx=0x7fbe4c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe52a00640 1 -- 172.21.15.73:0/1576462018 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0094f0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe52a00640 1 -- 172.21.15.73:0/1576462018 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00c940 con 0x7fbe5c0714a0 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe52a00640 1 -- 172.21.15.73:0/1576462018 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00ccf0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe54009b30 con 0x7fbe5c0714a0 2024-03-23T06:10:18.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.769+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c160c40 con 0x7fbe5c0714a0 2024-03-23T06:10:18.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.771+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c1607c0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.771+0000 7fbe52a00640 1 -- 172.21.15.73:0/1576462018 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbe4c013470 con 0x7fbe5c0714a0 2024-03-23T06:10:18.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.772+0000 7fbe52a00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe3c06ac00 0x7fbe3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:18.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.772+0000 7fbe52a00640 1 -- 172.21.15.73:0/1576462018 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe4c089ad0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.773+0000 7fbe5a000640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe3c06ac00 0x7fbe3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:18.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.773+0000 7fbe5a000640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe3c06ac00 0x7fbe3c06d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c15b4d0 tx=0x7fbe48009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:18.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.776+0000 7fbe52a00640 1 -- 172.21.15.73:0/1576462018 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbe5c1607c0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.969+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbe5c1607c0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.970+0000 7fbe52a00640 1 -- 172.21.15.73:0/1576462018 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbe5c1607c0 con 0x7fbe5c0714a0 2024-03-23T06:10:18.970 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe3c06ac00 msgr2=0x7fbe3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe3c06ac00 0x7fbe3c06d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c15b4d0 tx=0x7fbe48009190 comp rx=0 tx=0).stop 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c0714a0 msgr2=0x7fbe5c15ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c0714a0 0x7fbe5c15ecf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00e870 tx=0x7fbe4c00ed30 comp rx=0 tx=0).stop 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 shutdown_connections 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c15de60 0x7fbe5c1f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe3c06ac00 0x7fbe3c06d0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c157c60 0x7fbe5c1f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 --2- 172.21.15.73:0/1576462018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe5c0714a0 0x7fbe5c15ecf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 >> 172.21.15.73:0/1576462018 conn(0x7fbe5c0c88c0 msgr2=0x7fbe5c06a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 shutdown_connections 2024-03-23T06:10:18.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:18.973+0000 7fbe61c00640 1 -- 172.21.15.73:0/1576462018 wait complete. 2024-03-23T06:10:18.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-23T06:10:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.196+0000 7f1305a00640 1 Processor -- start 2024-03-23T06:10:19.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.196+0000 7f1305a00640 1 -- start start 2024-03-23T06:10:19.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.197+0000 7f1305a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300151480 0x7f1300157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:19.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f1305a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13000c7e40 0x7f1300071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:19.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f1305a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130015b710 con 0x7f1300072090 2024-03-23T06:10:19.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f1305a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13001588d0 con 0x7f13000c7e40 2024-03-23T06:10:19.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f1305a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130015ab90 con 0x7f1300151480 2024-03-23T06:10:19.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f12fe000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13000c7e40 0x7f1300071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f12fe000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13000c7e40 0x7f1300071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36040/0 (socket says 172.21.15.73:36040) 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f12fe000640 1 -- 172.21.15.73:0/492465877 learned_addr learned my addr 172.21.15.73:0/492465877 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f12ff400640 1 --1- 172.21.15.73:0/492465877 >> v1:172.21.15.73:6789/0 conn(0x7f1300072090 0x7f13000c5490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45944/0 (socket says 172.21.15.73:45944) 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f12fea00640 1 --2- 172.21.15.73:0/492465877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300151480 0x7f1300157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f12fe000640 1 -- 172.21.15.73:0/492465877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300151480 msgr2=0x7f1300157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f12fe000640 1 --2- 172.21.15.73:0/492465877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300151480 0x7f1300157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.198+0000 7f12fe000640 1 -- 172.21.15.73:0/492465877 >> v1:172.21.15.73:6789/0 conn(0x7f1300072090 legacy=0x7f13000c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.199+0000 7f12fe000640 1 -- 172.21.15.73:0/492465877 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130015ae70 con 0x7f13000c7e40 2024-03-23T06:10:19.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.199+0000 7f12fd600640 1 -- 172.21.15.73:0/492465877 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691926387 0 0) 0x7f130015b710 con 0x7f1300072090 2024-03-23T06:10:19.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.200+0000 7f12fe000640 1 --2- 172.21.15.73:0/492465877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13000c7e40 0x7f1300071b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009870 tx=0x7f12ec02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590ec7e0ce8f4bfd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:19.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.200+0000 7f12fd600640 1 -- 172.21.15.73:0/492465877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec02f840 con 0x7f13000c7e40 2024-03-23T06:10:19.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.200+0000 7f12fd600640 1 -- 172.21.15.73:0/492465877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ec02f9a0 con 0x7f13000c7e40 2024-03-23T06:10:19.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.200+0000 7f12fd600640 1 -- 172.21.15.73:0/492465877 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ec02fd30 con 0x7f13000c7e40 2024-03-23T06:10:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.201+0000 7f1305a00640 1 -- 172.21.15.73:0/492465877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13000c7e40 msgr2=0x7f1300071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.201+0000 7f1305a00640 1 --2- 172.21.15.73:0/492465877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13000c7e40 0x7f1300071b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f12ec009870 tx=0x7f12ec02ba20 comp rx=0 tx=0).stop 2024-03-23T06:10:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.201+0000 7f1305a00640 1 -- 172.21.15.73:0/492465877 shutdown_connections 2024-03-23T06:10:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.201+0000 7f1305a00640 1 --2- 172.21.15.73:0/492465877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13000c7e40 0x7f1300071b50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.201+0000 7f1305a00640 1 --2- 172.21.15.73:0/492465877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300151480 0x7f1300157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.201+0000 7f1305a00640 1 -- 172.21.15.73:0/492465877 >> 172.21.15.73:0/492465877 conn(0x7f1300069cb0 msgr2=0x7f130006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.201+0000 7f1305a00640 1 -- 172.21.15.73:0/492465877 shutdown_connections 2024-03-23T06:10:19.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.201+0000 7f1305a00640 1 -- 172.21.15.73:0/492465877 wait complete. 2024-03-23T06:10:19.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.203+0000 7f1305a00640 1 Processor -- start 2024-03-23T06:10:19.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.203+0000 7f1305a00640 1 -- start start 2024-03-23T06:10:19.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.204+0000 7f1305a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300072090 0x7f13001f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:19.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.204+0000 7f1305a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13000c7e40 0x7f1300151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:19.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.204+0000 7f1305a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1300151480 0x7f13000c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.204+0000 7f1305a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13001f0720 con 0x7f1300151480 2024-03-23T06:10:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.204+0000 7f1305a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1300155e50 con 0x7f13000c7e40 2024-03-23T06:10:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.204+0000 7f1305a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13001555d0 con 0x7f1300072090 2024-03-23T06:10:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1300151480 0x7f13000c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1300151480 0x7f13000c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36044/0 (socket says 172.21.15.73:36044) 2024-03-23T06:10:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 -- 172.21.15.73:0/593315133 learned_addr learned my addr 172.21.15.73:0/593315133 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12fea00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300072090 0x7f13001f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:19.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12fe000640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13000c7e40 0x7f1300151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:19.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 -- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300072090 msgr2=0x7f13001f0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:19.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300072090 0x7f13001f0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 -- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13000c7e40 msgr2=0x7f1300151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:19.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13000c7e40 0x7f1300151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 -- 172.21.15.73:0/593315133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0094d0 con 0x7f1300151480 2024-03-23T06:10:19.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.205+0000 7f12ff400640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1300151480 0x7f13000c9d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c7e0 tx=0x7f12f800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:19.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.206+0000 7f12f6a00640 1 -- 172.21.15.73:0/593315133 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800a640 con 0x7f1300151480 2024-03-23T06:10:19.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.206+0000 7f12f6a00640 1 -- 172.21.15.73:0/593315133 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800a7c0 con 0x7f1300151480 2024-03-23T06:10:19.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.206+0000 7f12f6a00640 1 -- 172.21.15.73:0/593315133 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800ab70 con 0x7f1300151480 2024-03-23T06:10:19.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.206+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1300155890 con 0x7f1300151480 2024-03-23T06:10:19.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.206+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13001f0340 con 0x7f1300151480 2024-03-23T06:10:19.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.207+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13001f0860 con 0x7f1300151480 2024-03-23T06:10:19.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.208+0000 7f12f6a00640 1 -- 172.21.15.73:0/593315133 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f12f800acd0 con 0x7f1300151480 2024-03-23T06:10:19.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.209+0000 7f12f6a00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f12e006ac00 0x7f12e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:19.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.209+0000 7f12f6a00640 1 -- 172.21.15.73:0/593315133 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f12f8088c20 con 0x7f1300151480 2024-03-23T06:10:19.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.209+0000 7f12fea00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f12e006ac00 0x7f12e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:19.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.210+0000 7f12fea00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f12e006ac00 0x7f12e006d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009aa0 tx=0x7f12f0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:19.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.213+0000 7f12f6a00640 1 -- 172.21.15.73:0/593315133 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f13001f0860 con 0x7f1300151480 2024-03-23T06:10:19.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.423+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f13001f0860 con 0x7f1300151480 2024-03-23T06:10:19.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.424+0000 7f12f6a00640 1 -- 172.21.15.73:0/593315133 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f13001f0860 con 0x7f1300151480 2024-03-23T06:10:19.424 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.426+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f12e006ac00 msgr2=0x7f12e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.426+0000 7f1305a00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f12e006ac00 0x7f12e006d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009aa0 tx=0x7f12f0009190 comp rx=0 tx=0).stop 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1300151480 msgr2=0x7f13000c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1300151480 0x7f13000c9d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c7e0 tx=0x7f12f800cca0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 shutdown_connections 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1300151480 0x7f13000c9d40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13000c7e40 0x7f1300151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f12e006ac00 0x7f12e006d0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 --2- 172.21.15.73:0/593315133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1300072090 0x7f13001f0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 >> 172.21.15.73:0/593315133 conn(0x7f1300069cb0 msgr2=0x7f13000c1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 shutdown_connections 2024-03-23T06:10:19.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:19.427+0000 7f1305a00640 1 -- 172.21.15.73:0/593315133 wait complete. 2024-03-23T06:10:19.444 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-03-23T06:10:19.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:19.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-23T06:10:19.531 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi073.stderr:ceph-fuse[43453]: fuse finished with error 0 and tester_r 0 2024-03-23T06:10:19.539 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:10:24.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:10:25.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:10:25.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:10:25.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:25.641 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-23T06:10:25.706 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:25.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.921+0000 7f5887e00640 1 Processor -- start 2024-03-23T06:10:25.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.921+0000 7f5887e00640 1 -- start start 2024-03-23T06:10:25.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f5887e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58801513f0 0x7f58800c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:25.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f5887e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800c5f50 con 0x7f58801586b0 2024-03-23T06:10:25.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f5887e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5880157b60 con 0x7f5880158b20 2024-03-23T06:10:25.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f5887e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800c0570 con 0x7f58801513f0 2024-03-23T06:10:25.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f5884a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f58801586b0 0x7f58800bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33136/0 (socket says 172.21.15.73:33136) 2024-03-23T06:10:25.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f5884a00640 1 -- 172.21.15.73:0/431862802 learned_addr learned my addr 172.21.15.73:0/431862802 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:25.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f5885400640 1 --2- 172.21.15.73:0/431862802 >> v2:172.21.15.110:3300/0 conn(0x7f58801513f0 0x7f58800c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:25.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f587fe00640 1 -- 172.21.15.73:0/431862802 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134365589 0 0) 0x7f5880157b60 con 0x7f5880158b20 2024-03-23T06:10:25.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.923+0000 7f587fe00640 1 -- 172.21.15.73:0/431862802 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5868003520 con 0x7f5880158b20 2024-03-23T06:10:25.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.924+0000 7f587fe00640 1 -- 172.21.15.73:0/431862802 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227479993 0 0) 0x7f586c001110 con 0x7f58801586b0 2024-03-23T06:10:25.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.924+0000 7f5885400640 1 -- 172.21.15.73:0/431862802 >> v1:172.21.15.110:6789/0 conn(0x7f5880158b20 legacy=0x7f5880071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:25.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.924+0000 7f5885400640 1 -- 172.21.15.73:0/431862802 >> v1:172.21.15.73:6789/0 conn(0x7f58801586b0 legacy=0x7f58800bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:25.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.924+0000 7f5885400640 1 -- 172.21.15.73:0/431862802 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800c0830 con 0x7f58801513f0 2024-03-23T06:10:25.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.925+0000 7f5885400640 1 --2- 172.21.15.73:0/431862802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 0x7f58800c5a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58740097a0 tx=0x7f587402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d872007667343443 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:25.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.925+0000 7f587fe00640 1 -- 172.21.15.73:0/431862802 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587402f810 con 0x7f58801513f0 2024-03-23T06:10:25.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.925+0000 7f587fe00640 1 -- 172.21.15.73:0/431862802 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587402f970 con 0x7f58801513f0 2024-03-23T06:10:25.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.925+0000 7f587fe00640 1 -- 172.21.15.73:0/431862802 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587402fd00 con 0x7f58801513f0 2024-03-23T06:10:25.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.926+0000 7f5887e00640 1 -- 172.21.15.73:0/431862802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 msgr2=0x7f58800c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:25.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.926+0000 7f5887e00640 1 --2- 172.21.15.73:0/431862802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 0x7f58800c5a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f58740097a0 tx=0x7f587402b9f0 comp rx=0 tx=0).stop 2024-03-23T06:10:25.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.926+0000 7f5887e00640 1 -- 172.21.15.73:0/431862802 shutdown_connections 2024-03-23T06:10:25.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.926+0000 7f5887e00640 1 --2- 172.21.15.73:0/431862802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 0x7f58800c5a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:25.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.926+0000 7f5887e00640 1 -- 172.21.15.73:0/431862802 >> 172.21.15.73:0/431862802 conn(0x7f588006bb40 msgr2=0x7f588006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:25.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.926+0000 7f5887e00640 1 -- 172.21.15.73:0/431862802 shutdown_connections 2024-03-23T06:10:25.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.926+0000 7f5887e00640 1 -- 172.21.15.73:0/431862802 wait complete. 2024-03-23T06:10:25.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.927+0000 7f5887e00640 1 Processor -- start 2024-03-23T06:10:25.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.927+0000 7f5887e00640 1 -- start start 2024-03-23T06:10:25.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.928+0000 7f5887e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 0x7f58800aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.928+0000 7f5887e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58801586b0 0x7f58800b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.928+0000 7f5887e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5880158b20 0x7f58801e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.928+0000 7f5887e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800af180 con 0x7f58801586b0 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.928+0000 7f5887e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800af7b0 con 0x7f58801513f0 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.928+0000 7f5887e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800af360 con 0x7f5880158b20 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5884a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58801586b0 0x7f58800b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5884a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58801586b0 0x7f58800b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37412/0 (socket says 172.21.15.73:37412) 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5884a00640 1 -- 172.21.15.73:0/3970293420 learned_addr learned my addr 172.21.15.73:0/3970293420 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5885400640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 0x7f58800aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:25.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5885e00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5880158b20 0x7f58801e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:25.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5884a00640 1 -- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5880158b20 msgr2=0x7f58801e40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:25.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5884a00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5880158b20 0x7f58801e40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5884a00640 1 -- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 msgr2=0x7f58800aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5884a00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 0x7f58800aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5884a00640 1 -- 172.21.15.73:0/3970293420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874009400 con 0x7f58801586b0 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.929+0000 7f5885400640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 0x7f58800aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.930+0000 7f5884a00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58801586b0 0x7f58800b06c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c3f0 tx=0x7f586c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.930+0000 7f587d600640 1 -- 172.21.15.73:0/3970293420 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0074e0 con 0x7f58801586b0 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.930+0000 7f587d600640 1 -- 172.21.15.73:0/3970293420 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c007640 con 0x7f58801586b0 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.930+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58800ad910 con 0x7f58801586b0 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.930+0000 7f587d600640 1 -- 172.21.15.73:0/3970293420 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c004a00 con 0x7f58801586b0 2024-03-23T06:10:25.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.930+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58800aded0 con 0x7f58801586b0 2024-03-23T06:10:25.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.931+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588004e110 con 0x7f58801586b0 2024-03-23T06:10:25.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.932+0000 7f587d600640 1 -- 172.21.15.73:0/3970293420 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f586c004b60 con 0x7f58801586b0 2024-03-23T06:10:25.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.933+0000 7f587d600640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f586006ac30 0x7f586006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:25.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.933+0000 7f587d600640 1 -- 172.21.15.73:0/3970293420 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f586c0890a0 con 0x7f58801586b0 2024-03-23T06:10:25.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.933+0000 7f5885400640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f586006ac30 0x7f586006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:25.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.934+0000 7f5885400640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f586006ac30 0x7f586006d0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5874036000 tx=0x7f5874008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:25.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:25.938+0000 7f587d600640 1 -- 172.21.15.73:0/3970293420 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f586c054040 con 0x7f58801586b0 2024-03-23T06:10:26.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.137+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58800c5f50 con 0x7f58801586b0 2024-03-23T06:10:26.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.140+0000 7f587d600640 1 -- 172.21.15.73:0/3970293420 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f58800c5f50 con 0x7f58801586b0 2024-03-23T06:10:26.140 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:26.140 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f586006ac30 msgr2=0x7f586006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f586006ac30 0x7f586006d0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5874036000 tx=0x7f5874008030 comp rx=0 tx=0).stop 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58801586b0 msgr2=0x7f58800b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58801586b0 0x7f58800b06c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f586c00c3f0 tx=0x7f586c00c8b0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 shutdown_connections 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f586006ac30 0x7f586006d0f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5880158b20 0x7f58801e40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58801586b0 0x7f58800b06c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 --2- 172.21.15.73:0/3970293420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58801513f0 0x7f58800aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 >> 172.21.15.73:0/3970293420 conn(0x7f588006bb40 msgr2=0x7f58800c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 shutdown_connections 2024-03-23T06:10:26.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.143+0000 7f5887e00640 1 -- 172.21.15.73:0/3970293420 wait complete. 2024-03-23T06:10:26.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:26.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.370+0000 7f10ed000640 1 Processor -- start 2024-03-23T06:10:26.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.370+0000 7f10ed000640 1 -- start start 2024-03-23T06:10:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10ed000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f10e8153a80 0x7f10e80cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10ed000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81594f0 0x7f10e80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10ed000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e81599a0 con 0x7f10e81536a0 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10ed000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e815a520 con 0x7f10e8153a80 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10ed000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8159c80 con 0x7f10e81594f0 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10e5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f10e8153a80 0x7f10e80cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10e5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f10e8153a80 0x7f10e80cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37428/0 (socket says 172.21.15.73:37428) 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10e5400640 1 -- 172.21.15.73:0/2527101294 learned_addr learned my addr 172.21.15.73:0/2527101294 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10e5e00640 1 --1- 172.21.15.73:0/2527101294 >> v1:172.21.15.73:6789/0 conn(0x7f10e81536a0 0x7f10e80ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33148/0 (socket says 172.21.15.73:33148) 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.372+0000 7f10e6800640 1 --2- 172.21.15.73:0/2527101294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81594f0 0x7f10e80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.373+0000 7f10e5400640 1 -- 172.21.15.73:0/2527101294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81594f0 msgr2=0x7f10e80cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.373+0000 7f10e5400640 1 --2- 172.21.15.73:0/2527101294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81594f0 0x7f10e80cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.373+0000 7f10e5400640 1 -- 172.21.15.73:0/2527101294 >> v1:172.21.15.73:6789/0 conn(0x7f10e81536a0 legacy=0x7f10e80ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.373+0000 7f10e5400640 1 -- 172.21.15.73:0/2527101294 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8159f60 con 0x7f10e8153a80 2024-03-23T06:10:26.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.373+0000 7f10e4a00640 1 -- 172.21.15.73:0/2527101294 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350968196 0 0) 0x7f10e81599a0 con 0x7f10e81536a0 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.374+0000 7f10e5400640 1 --2- 172.21.15.73:0/2527101294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 0x7f10e80cbe90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009870 tx=0x7f10d402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2b5f08202b3188 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.374+0000 7f10e4a00640 1 -- 172.21.15.73:0/2527101294 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4030840 con 0x7f10e8153a80 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.374+0000 7f10e4a00640 1 -- 172.21.15.73:0/2527101294 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d40309a0 con 0x7f10e8153a80 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.374+0000 7f10e4a00640 1 -- 172.21.15.73:0/2527101294 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4030d30 con 0x7f10e8153a80 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.375+0000 7f10ed000640 1 -- 172.21.15.73:0/2527101294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 msgr2=0x7f10e80cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.375+0000 7f10ed000640 1 --2- 172.21.15.73:0/2527101294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 0x7f10e80cbe90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009870 tx=0x7f10d402b980 comp rx=0 tx=0).stop 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.375+0000 7f10ed000640 1 -- 172.21.15.73:0/2527101294 shutdown_connections 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.375+0000 7f10ed000640 1 --2- 172.21.15.73:0/2527101294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81594f0 0x7f10e80cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.375+0000 7f10ed000640 1 --2- 172.21.15.73:0/2527101294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 0x7f10e80cbe90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.375+0000 7f10ed000640 1 -- 172.21.15.73:0/2527101294 >> 172.21.15.73:0/2527101294 conn(0x7f10e806a060 msgr2=0x7f10e806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:26.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.375+0000 7f10ed000640 1 -- 172.21.15.73:0/2527101294 shutdown_connections 2024-03-23T06:10:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.375+0000 7f10ed000640 1 -- 172.21.15.73:0/2527101294 wait complete. 2024-03-23T06:10:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.376+0000 7f10ed000640 1 Processor -- start 2024-03-23T06:10:26.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.377+0000 7f10ed000640 1 -- start start 2024-03-23T06:10:26.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.377+0000 7f10ed000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81536a0 0x7f10e81f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.377+0000 7f10ed000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 0x7f10e8146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10ed000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10e81594f0 0x7f10e814e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10ed000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e81f28e0 con 0x7f10e8153a80 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10ed000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80ce740 con 0x7f10e81594f0 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10ed000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80cdf30 con 0x7f10e81536a0 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 0x7f10e8146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81536a0 0x7f10e81f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81536a0 0x7f10e81f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41734/0 (socket says 172.21.15.73:41734) 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5e00640 1 -- 172.21.15.73:0/2064042623 learned_addr learned my addr 172.21.15.73:0/2064042623 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e6800640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10e81594f0 0x7f10e814e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5e00640 1 -- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10e81594f0 msgr2=0x7f10e814e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5e00640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10e81594f0 0x7f10e814e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5e00640 1 -- 172.21.15.73:0/2064042623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 msgr2=0x7f10e8146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5e00640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 0x7f10e8146e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.378+0000 7f10e5e00640 1 -- 172.21.15.73:0/2064042623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40094d0 con 0x7f10e81536a0 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.379+0000 7f10e5e00640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81536a0 0x7f10e81f23a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c490 tx=0x7f10d800c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.379+0000 7f10de000640 1 -- 172.21.15.73:0/2064042623 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d80074e0 con 0x7f10e81536a0 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.379+0000 7f10de000640 1 -- 172.21.15.73:0/2064042623 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d8007660 con 0x7f10e81536a0 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.379+0000 7f10de000640 1 -- 172.21.15.73:0/2064042623 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8004a20 con 0x7f10e81536a0 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.379+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e806be40 con 0x7f10e81536a0 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.379+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e80ce180 con 0x7f10e81536a0 2024-03-23T06:10:26.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.380+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e806bca0 con 0x7f10e81536a0 2024-03-23T06:10:26.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.381+0000 7f10de000640 1 -- 172.21.15.73:0/2064042623 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f10d8004b80 con 0x7f10e81536a0 2024-03-23T06:10:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.382+0000 7f10de000640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f10c806ac00 0x7f10c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.382+0000 7f10de000640 1 -- 172.21.15.73:0/2064042623 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f10d8088710 con 0x7f10e81536a0 2024-03-23T06:10:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.382+0000 7f10e5400640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f10c806ac00 0x7f10c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.383+0000 7f10e5400640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f10c806ac00 0x7f10c806d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10d4036000 tx=0x7f10d4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:26.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.387+0000 7f10de000640 1 -- 172.21.15.73:0/2064042623 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f10e806bca0 con 0x7f10e81536a0 2024-03-23T06:10:26.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.587+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10e806bca0 con 0x7f10e81536a0 2024-03-23T06:10:26.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.589+0000 7f10de000640 1 -- 172.21.15.73:0/2064042623 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f10e806bca0 con 0x7f10e81536a0 2024-03-23T06:10:26.589 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:26.589 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f10c806ac00 msgr2=0x7f10c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f10c806ac00 0x7f10c806d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f10d4036000 tx=0x7f10d4008030 comp rx=0 tx=0).stop 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81536a0 msgr2=0x7f10e81f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81536a0 0x7f10e81f23a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10d800c490 tx=0x7f10d800c950 comp rx=0 tx=0).stop 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 shutdown_connections 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10e81594f0 0x7f10e814e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10e8153a80 0x7f10e8146e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f10c806ac00 0x7f10c806d0c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 --2- 172.21.15.73:0/2064042623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10e81536a0 0x7f10e81f23a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 >> 172.21.15.73:0/2064042623 conn(0x7f10e806a060 msgr2=0x7f10e80cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:26.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 shutdown_connections 2024-03-23T06:10:26.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.592+0000 7f10ed000640 1 -- 172.21.15.73:0/2064042623 wait complete. 2024-03-23T06:10:26.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-23T06:10:26.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.822+0000 7f6ee3200640 1 Processor -- start 2024-03-23T06:10:26.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.822+0000 7f6ee3200640 1 -- start start 2024-03-23T06:10:26.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6ee3200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6edc153760 0x7f6edc159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6ee3200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6edc0c9740 0x7f6edc0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6ee3200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc0cbd10 0x7f6edc0ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6ee3200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc06a2d0 con 0x7f6edc153760 2024-03-23T06:10:26.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6ee3200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc06a5b0 con 0x7f6edc0c9740 2024-03-23T06:10:26.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6ee3200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc06a890 con 0x7f6edc0cbd10 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6edbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6edc153760 0x7f6edc159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6ee1200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc0cbd10 0x7f6edc0ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6edb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6edc0c9740 0x7f6edc0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6edb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6edc0c9740 0x7f6edc0cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:53442/0 (socket says 172.21.15.73:53442) 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6edb400640 1 -- 172.21.15.73:0/3666930256 learned_addr learned my addr 172.21.15.73:0/3666930256 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.824+0000 7f6edbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6edc153760 0x7f6edc159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:37444/0 (socket says 172.21.15.73:37444) 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.825+0000 7f6edb400640 1 -- 172.21.15.73:0/3666930256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc0cbd10 msgr2=0x7f6edc0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.825+0000 7f6edb400640 1 --2- 172.21.15.73:0/3666930256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc0cbd10 0x7f6edc0ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.825+0000 7f6edb400640 1 -- 172.21.15.73:0/3666930256 >> v2:172.21.15.73:3300/0 conn(0x7f6edc153760 msgr2=0x7f6edc159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.825+0000 7f6edb400640 1 --2- 172.21.15.73:0/3666930256 >> v2:172.21.15.73:3300/0 conn(0x7f6edc153760 0x7f6edc159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.825+0000 7f6edb400640 1 -- 172.21.15.73:0/3666930256 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc06ab70 con 0x7f6edc0c9740 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.826+0000 7f6edb400640 1 --2- 172.21.15.73:0/3666930256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0c9740 0x7f6edc0cb7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0c5640 tx=0x7f6ec802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38a74c087c45115e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.826+0000 7f6edaa00640 1 -- 172.21.15.73:0/3666930256 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8031870 con 0x7f6edc0c9740 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.826+0000 7f6edaa00640 1 -- 172.21.15.73:0/3666930256 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec80319d0 con 0x7f6edc0c9740 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.826+0000 7f6edaa00640 1 -- 172.21.15.73:0/3666930256 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8031d60 con 0x7f6edc0c9740 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 -- 172.21.15.73:0/3666930256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0c9740 msgr2=0x7f6edc0cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 --2- 172.21.15.73:0/3666930256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0c9740 0x7f6edc0cb7d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0c5640 tx=0x7f6ec802b910 comp rx=0 tx=0).stop 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 -- 172.21.15.73:0/3666930256 shutdown_connections 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 --2- 172.21.15.73:0/3666930256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc0cbd10 0x7f6edc0ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 --2- 172.21.15.73:0/3666930256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0c9740 0x7f6edc0cb7d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 --2- 172.21.15.73:0/3666930256 >> v2:172.21.15.73:3300/0 conn(0x7f6edc153760 0x7f6edc159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 -- 172.21.15.73:0/3666930256 >> 172.21.15.73:0/3666930256 conn(0x7f6edc06c310 msgr2=0x7f6edc0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:26.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 -- 172.21.15.73:0/3666930256 shutdown_connections 2024-03-23T06:10:26.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.827+0000 7f6ee3200640 1 -- 172.21.15.73:0/3666930256 wait complete. 2024-03-23T06:10:26.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.829+0000 7f6ee3200640 1 Processor -- start 2024-03-23T06:10:26.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.829+0000 7f6ee3200640 1 -- start start 2024-03-23T06:10:26.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.830+0000 7f6ee3200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6edc0c9740 0x7f6edc0c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee3200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0cbd10 0x7f6edc0c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee3200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc153760 0x7f6edc1f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee3200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc1588a0 con 0x7f6edc0c9740 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee3200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc159850 con 0x7f6edc0cbd10 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee3200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc159af0 con 0x7f6edc153760 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee1200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc153760 0x7f6edc1f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6edb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0cbd10 0x7f6edc0c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6edbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6edc0c9740 0x7f6edc0c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee1200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc153760 0x7f6edc1f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41750/0 (socket says 172.21.15.73:41750) 2024-03-23T06:10:26.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee1200640 1 -- 172.21.15.73:0/467111720 learned_addr learned my addr 172.21.15.73:0/467111720 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:26.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee1200640 1 -- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0cbd10 msgr2=0x7f6edc0c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee1200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0cbd10 0x7f6edc0c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee1200640 1 -- 172.21.15.73:0/467111720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6edc0c9740 msgr2=0x7f6edc0c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee1200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6edc0c9740 0x7f6edc0c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.831+0000 7f6ee1200640 1 -- 172.21.15.73:0/467111720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80094d0 con 0x7f6edc153760 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.832+0000 7f6ee1200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc153760 0x7f6edc1f26d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400eed0 tx=0x7f6ed400b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.832+0000 7f6ed3e00640 1 -- 172.21.15.73:0/467111720 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4010040 con 0x7f6edc153760 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.832+0000 7f6ed3e00640 1 -- 172.21.15.73:0/467111720 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed4014400 con 0x7f6edc153760 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.832+0000 7f6ed3e00640 1 -- 172.21.15.73:0/467111720 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4009ea0 con 0x7f6edc153760 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.832+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc159dd0 con 0x7f6edc153760 2024-03-23T06:10:26.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.832+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc0c9100 con 0x7f6edc153760 2024-03-23T06:10:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.833+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc158320 con 0x7f6edc153760 2024-03-23T06:10:26.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.834+0000 7f6ed3e00640 1 -- 172.21.15.73:0/467111720 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6ed40147b0 con 0x7f6edc153760 2024-03-23T06:10:26.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.835+0000 7f6ed3e00640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:26.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.835+0000 7f6ed3e00640 1 -- 172.21.15.73:0/467111720 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ed4089d00 con 0x7f6edc153760 2024-03-23T06:10:26.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.835+0000 7f6edbe00640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:26.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.836+0000 7f6edbe00640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009aa0 tx=0x7f6ecc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:26.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:26.839+0000 7f6ed3e00640 1 -- 172.21.15.73:0/467111720 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6edc158320 con 0x7f6edc153760 2024-03-23T06:10:27.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.078+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6edc1589e0 con 0x7f6edc153760 2024-03-23T06:10:27.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.434+0000 7f6ed3e00640 1 -- 172.21.15.73:0/467111720 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6edc1589e0 con 0x7f6edc153760 2024-03-23T06:10:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ebc06ac00 msgr2=0x7f6ebc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc009aa0 tx=0x7f6ecc009190 comp rx=0 tx=0).stop 2024-03-23T06:10:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc153760 msgr2=0x7f6edc1f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc153760 0x7f6edc1f26d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400eed0 tx=0x7f6ed400b480 comp rx=0 tx=0).stop 2024-03-23T06:10:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 shutdown_connections 2024-03-23T06:10:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ebc06ac00 0x7f6ebc06d0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6edc153760 0x7f6edc1f26d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6edc0cbd10 0x7f6edc0c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 --2- 172.21.15.73:0/467111720 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6edc0c9740 0x7f6edc0c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.438+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 >> 172.21.15.73:0/467111720 conn(0x7f6edc06c310 msgr2=0x7f6edc152020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.439+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 shutdown_connections 2024-03-23T06:10:27.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.439+0000 7f6ee3200640 1 -- 172.21.15.73:0/467111720 wait complete. 2024-03-23T06:10:27.460 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-03-23T06:10:27.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-03-23T06:10:27.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.676+0000 7f2131a00640 1 Processor -- start 2024-03-23T06:10:27.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.676+0000 7f2131a00640 1 -- start start 2024-03-23T06:10:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f2131a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f212c159420 0x7f212c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f2131a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f212c0ca940 0x7f212c0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f2131a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c0c9c80 con 0x7f212c153760 2024-03-23T06:10:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f2131a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c159860 con 0x7f212c159420 2024-03-23T06:10:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f2131a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c0cb310 con 0x7f212c0ca940 2024-03-23T06:10:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f212b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f212c0ca940 0x7f212c0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:27.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f212aa00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f212c153760 0x7f212c0cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:44348/0 (socket says 172.21.15.73:44348) 2024-03-23T06:10:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f212aa00640 1 -- 172.21.15.73:0/3940104781 learned_addr learned my addr 172.21.15.73:0/3940104781 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.678+0000 7f2122000640 1 --2- 172.21.15.73:0/3940104781 >> v2:172.21.15.73:3300/0 conn(0x7f212c159420 0x7f212c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.679+0000 7f212b400640 1 -- 172.21.15.73:0/3940104781 >> v2:172.21.15.73:3300/0 conn(0x7f212c159420 msgr2=0x7f212c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.679+0000 7f212b400640 1 --2- 172.21.15.73:0/3940104781 >> v2:172.21.15.73:3300/0 conn(0x7f212c159420 0x7f212c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.679+0000 7f212b400640 1 -- 172.21.15.73:0/3940104781 >> v1:172.21.15.110:6789/0 conn(0x7f212c153760 legacy=0x7f212c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.679+0000 7f212b400640 1 -- 172.21.15.73:0/3940104781 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c06a2d0 con 0x7f212c0ca940 2024-03-23T06:10:27.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.679+0000 7f212a000640 1 -- 172.21.15.73:0/3940104781 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164063272 0 0) 0x7f211c001110 con 0x7f212c153760 2024-03-23T06:10:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.680+0000 7f212b400640 1 --2- 172.21.15.73:0/3940104781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c0ca940 0x7f212c0cadd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f212c06ba70 tx=0x7f212402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b979fce589af5648 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:27.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.680+0000 7f212a000640 1 -- 172.21.15.73:0/3940104781 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212402cc80 con 0x7f212c0ca940 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.680+0000 7f212a000640 1 -- 172.21.15.73:0/3940104781 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212402cde0 con 0x7f212c0ca940 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.680+0000 7f212a000640 1 -- 172.21.15.73:0/3940104781 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124034660 con 0x7f212c0ca940 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.681+0000 7f2131a00640 1 -- 172.21.15.73:0/3940104781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c0ca940 msgr2=0x7f212c0cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.681+0000 7f2131a00640 1 --2- 172.21.15.73:0/3940104781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c0ca940 0x7f212c0cadd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f212c06ba70 tx=0x7f212402bed0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.681+0000 7f2131a00640 1 -- 172.21.15.73:0/3940104781 shutdown_connections 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.681+0000 7f2131a00640 1 --2- 172.21.15.73:0/3940104781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c0ca940 0x7f212c0cadd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.681+0000 7f2131a00640 1 --2- 172.21.15.73:0/3940104781 >> v2:172.21.15.73:3300/0 conn(0x7f212c159420 0x7f212c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.681+0000 7f2131a00640 1 -- 172.21.15.73:0/3940104781 >> 172.21.15.73:0/3940104781 conn(0x7f212c06c310 msgr2=0x7f212c0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.681+0000 7f2131a00640 1 -- 172.21.15.73:0/3940104781 shutdown_connections 2024-03-23T06:10:27.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.681+0000 7f2131a00640 1 -- 172.21.15.73:0/3940104781 wait complete. 2024-03-23T06:10:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.683+0000 7f2131a00640 1 Processor -- start 2024-03-23T06:10:27.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.683+0000 7f2131a00640 1 -- start start 2024-03-23T06:10:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.683+0000 7f2131a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f212c0ca940 0x7f212c1f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.683+0000 7f2131a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f212c153760 0x7f212c14d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f2131a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c159420 0x7f212c1ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f2131a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c1ef9c0 con 0x7f212c153760 2024-03-23T06:10:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f2131a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0b3c80 con 0x7f212c159420 2024-03-23T06:10:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f2131a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0b3f20 con 0x7f212c0ca940 2024-03-23T06:10:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f2122000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f212c153760 0x7f212c14d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:27.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c159420 0x7f212c1ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f212c0ca940 0x7f212c1f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c159420 0x7f212c1ef480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:53466/0 (socket says 172.21.15.73:53466) 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212b400640 1 -- 172.21.15.73:0/944915740 learned_addr learned my addr 172.21.15.73:0/944915740 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212b400640 1 -- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f212c0ca940 msgr2=0x7f212c1f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212b400640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f212c0ca940 0x7f212c1f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212b400640 1 -- 172.21.15.73:0/944915740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f212c153760 msgr2=0x7f212c14d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212b400640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f212c153760 0x7f212c14d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.684+0000 7f212b400640 1 -- 172.21.15.73:0/944915740 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009a70 con 0x7f212c159420 2024-03-23T06:10:27.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.685+0000 7f212b400640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c159420 0x7f212c1ef480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2124009e80 tx=0x7f2124004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.685+0000 7f2123400640 1 -- 172.21.15.73:0/944915740 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212403e610 con 0x7f212c159420 2024-03-23T06:10:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.685+0000 7f2123400640 1 -- 172.21.15.73:0/944915740 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212403e770 con 0x7f212c159420 2024-03-23T06:10:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.685+0000 7f2123400640 1 -- 172.21.15.73:0/944915740 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212403eb60 con 0x7f212c159420 2024-03-23T06:10:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.685+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c0b4200 con 0x7f212c159420 2024-03-23T06:10:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.685+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c1f22f0 con 0x7f212c159420 2024-03-23T06:10:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.686+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c04e110 con 0x7f212c159420 2024-03-23T06:10:27.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.687+0000 7f2123400640 1 -- 172.21.15.73:0/944915740 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f212403b050 con 0x7f212c159420 2024-03-23T06:10:27.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.688+0000 7f2123400640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f210806ac30 0x7f210806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:27.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.688+0000 7f2123400640 1 -- 172.21.15.73:0/944915740 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21240abad0 con 0x7f212c159420 2024-03-23T06:10:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.688+0000 7f212aa00640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f210806ac30 0x7f210806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:27.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.689+0000 7f212aa00640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f210806ac30 0x7f210806d0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f60 tx=0x7f211c007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:27.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.693+0000 7f2123400640 1 -- 172.21.15.73:0/944915740 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2124076940 con 0x7f212c159420 2024-03-23T06:10:27.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:27.924+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f212c0c44a0 con 0x7f212c159420 2024-03-23T06:10:28.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.438+0000 7f2123400640 1 -- 172.21.15.73:0/944915740 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f2124039020 con 0x7f212c159420 2024-03-23T06:10:28.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f210806ac30 msgr2=0x7f210806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f210806ac30 0x7f210806d0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f60 tx=0x7f211c007b90 comp rx=0 tx=0).stop 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c159420 msgr2=0x7f212c1ef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c159420 0x7f212c1ef480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2124009e80 tx=0x7f2124004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 shutdown_connections 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f212c159420 0x7f212c1ef480 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f212c153760 0x7f212c14d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f210806ac30 0x7f210806d0f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 --2- 172.21.15.73:0/944915740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f212c0ca940 0x7f212c1f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.441+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 >> 172.21.15.73:0/944915740 conn(0x7f212c06c310 msgr2=0x7f212c148990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.442+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 shutdown_connections 2024-03-23T06:10:28.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.442+0000 7f2131a00640 1 -- 172.21.15.73:0/944915740 wait complete. 2024-03-23T06:10:28.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-23T06:10:28.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.665+0000 7fc582000640 1 Processor -- start 2024-03-23T06:10:28.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.665+0000 7fc582000640 1 -- start start 2024-03-23T06:10:28.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc582000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:28.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc582000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc57c0ca940 0x7fc57c0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:28.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc582000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57c0cb310 con 0x7fc57c0c9740 2024-03-23T06:10:28.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc582000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57c06a2d0 con 0x7fc57c0ca940 2024-03-23T06:10:28.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc582000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c06a5b0 con 0x7fc57c153760 2024-03-23T06:10:28.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57aa00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc57c0c9740 0x7fc57c0cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33154/0 (socket says 172.21.15.73:33154) 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57aa00640 1 -- 172.21.15.73:0/2339363822 learned_addr learned my addr 172.21.15.73:0/2339363822 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57b400640 1 --2- 172.21.15.73:0/2339363822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57be00640 1 --2- 172.21.15.73:0/2339363822 >> v2:172.21.15.110:3300/0 conn(0x7fc57c0ca940 0x7fc57c0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57a000640 1 -- 172.21.15.73:0/2339363822 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186086956 0 0) 0x7fc57c0cb310 con 0x7fc57c0c9740 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57b400640 1 -- 172.21.15.73:0/2339363822 >> v2:172.21.15.110:3300/0 conn(0x7fc57c0ca940 msgr2=0x7fc57c0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57b400640 1 --2- 172.21.15.73:0/2339363822 >> v2:172.21.15.110:3300/0 conn(0x7fc57c0ca940 0x7fc57c0cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57b400640 1 -- 172.21.15.73:0/2339363822 >> v1:172.21.15.73:6789/0 conn(0x7fc57c0c9740 legacy=0x7fc57c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.667+0000 7fc57b400640 1 -- 172.21.15.73:0/2339363822 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c06a890 con 0x7fc57c153760 2024-03-23T06:10:28.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.668+0000 7fc57be00640 1 --2- 172.21.15.73:0/2339363822 >> v2:172.21.15.110:3300/0 conn(0x7fc57c0ca940 0x7fc57c0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:28.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.669+0000 7fc57b400640 1 --2- 172.21.15.73:0/2339363822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c159420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0097d0 tx=0x7fc56c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549e1f2b5fa9a278 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:28.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.669+0000 7fc57a000640 1 -- 172.21.15.73:0/2339363822 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c02d040 con 0x7fc57c153760 2024-03-23T06:10:28.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.669+0000 7fc57a000640 1 -- 172.21.15.73:0/2339363822 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c031810 con 0x7fc57c153760 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.669+0000 7fc57a000640 1 -- 172.21.15.73:0/2339363822 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c031ba0 con 0x7fc57c153760 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.669+0000 7fc582000640 1 -- 172.21.15.73:0/2339363822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 msgr2=0x7fc57c159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.669+0000 7fc582000640 1 --2- 172.21.15.73:0/2339363822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c159420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0097d0 tx=0x7fc56c02b8b0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.670+0000 7fc582000640 1 -- 172.21.15.73:0/2339363822 shutdown_connections 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.670+0000 7fc582000640 1 --2- 172.21.15.73:0/2339363822 >> v2:172.21.15.110:3300/0 conn(0x7fc57c0ca940 0x7fc57c0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.670+0000 7fc582000640 1 --2- 172.21.15.73:0/2339363822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c159420 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.670+0000 7fc582000640 1 -- 172.21.15.73:0/2339363822 >> 172.21.15.73:0/2339363822 conn(0x7fc57c06c310 msgr2=0x7fc57c0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.670+0000 7fc582000640 1 -- 172.21.15.73:0/2339363822 shutdown_connections 2024-03-23T06:10:28.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.670+0000 7fc582000640 1 -- 172.21.15.73:0/2339363822 wait complete. 2024-03-23T06:10:28.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.671+0000 7fc582000640 1 Processor -- start 2024-03-23T06:10:28.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.672+0000 7fc582000640 1 -- start start 2024-03-23T06:10:28.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.672+0000 7fc582000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c0c9740 0x7fc57c1efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:28.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.672+0000 7fc582000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57c0ca940 0x7fc57c1f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:28.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.672+0000 7fc582000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:28.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc582000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c157bc0 con 0x7fc57c0ca940 2024-03-23T06:10:28.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc582000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c1547e0 con 0x7fc57c0c9740 2024-03-23T06:10:28.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc582000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c159540 con 0x7fc57c153760 2024-03-23T06:10:28.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57c0ca940 0x7fc57c1f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:28.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c0c9740 0x7fc57c1efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c0c9740 0x7fc57c1efb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:53482/0 (socket says 172.21.15.73:53482) 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57b400640 1 -- 172.21.15.73:0/4027046920 learned_addr learned my addr 172.21.15.73:0/4027046920 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57be00640 1 -- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c0c9740 msgr2=0x7fc57c1efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57be00640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c0c9740 0x7fc57c1efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57be00640 1 -- 172.21.15.73:0/4027046920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57c0ca940 msgr2=0x7fc57c1f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57be00640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57c0ca940 0x7fc57c1f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.673+0000 7fc57be00640 1 -- 172.21.15.73:0/4027046920 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009a70 con 0x7fc57c153760 2024-03-23T06:10:28.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.674+0000 7fc57be00640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c149aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc57400efc0 tx=0x7fc57400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:28.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.674+0000 7fc573400640 1 -- 172.21.15.73:0/4027046920 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400cd30 con 0x7fc57c153760 2024-03-23T06:10:28.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.674+0000 7fc573400640 1 -- 172.21.15.73:0/4027046920 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57400f040 con 0x7fc57c153760 2024-03-23T06:10:28.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.674+0000 7fc573400640 1 -- 172.21.15.73:0/4027046920 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574003bd0 con 0x7fc57c153760 2024-03-23T06:10:28.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.674+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56c009400 con 0x7fc57c153760 2024-03-23T06:10:28.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.674+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57c159260 con 0x7fc57c153760 2024-03-23T06:10:28.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.675+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57c157d00 con 0x7fc57c153760 2024-03-23T06:10:28.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.676+0000 7fc573400640 1 -- 172.21.15.73:0/4027046920 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc574014480 con 0x7fc57c153760 2024-03-23T06:10:28.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.677+0000 7fc573400640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc55c06ac00 0x7fc55c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.677+0000 7fc573400640 1 -- 172.21.15.73:0/4027046920 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc57408a170 con 0x7fc57c153760 2024-03-23T06:10:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.677+0000 7fc57b400640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc55c06ac00 0x7fc55c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:28.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.678+0000 7fc57b400640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc55c06ac00 0x7fc55c06d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc56c02b8f0 tx=0x7fc56c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:28.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.681+0000 7fc573400640 1 -- 172.21.15.73:0/4027046920 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc57c157d00 con 0x7fc57c153760 2024-03-23T06:10:28.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:28.917+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc57c157d00 con 0x7fc57c153760 2024-03-23T06:10:29.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.453+0000 7fc573400640 1 -- 172.21.15.73:0/4027046920 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc57c157d00 con 0x7fc57c153760 2024-03-23T06:10:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc55c06ac00 msgr2=0x7fc55c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:29.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc55c06ac00 0x7fc55c06d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc56c02b8f0 tx=0x7fc56c03c040 comp rx=0 tx=0).stop 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 msgr2=0x7fc57c149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c149aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc57400efc0 tx=0x7fc57400c490 comp rx=0 tx=0).stop 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 shutdown_connections 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc55c06ac00 0x7fc55c06d0c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc57c153760 0x7fc57c149aa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc57c0ca940 0x7fc57c1f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 --2- 172.21.15.73:0/4027046920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c0c9740 0x7fc57c1efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.457+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 >> 172.21.15.73:0/4027046920 conn(0x7fc57c06c310 msgr2=0x7fc57c152960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.458+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 shutdown_connections 2024-03-23T06:10:29.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.458+0000 7fc582000640 1 -- 172.21.15.73:0/4027046920 wait complete. 2024-03-23T06:10:29.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-23T06:10:29.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.689+0000 7f8a29e00640 1 Processor -- start 2024-03-23T06:10:29.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.689+0000 7f8a29e00640 1 -- start start 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a29e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a2406b410 0x7f8a2406f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a29e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406df30 0x7f8a2406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a29e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a240c7af0 con 0x7f8a2406b030 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a29e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2406daa0 con 0x7f8a2406b410 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a29e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2406e920 con 0x7f8a2406df30 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a22a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8a2406b030 0x7f8a24159fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33156/0 (socket says 172.21.15.73:33156) 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a22a00640 1 -- 172.21.15.73:0/3186890305 learned_addr learned my addr 172.21.15.73:0/3186890305 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a22000640 1 --2- 172.21.15.73:0/3186890305 >> v2:172.21.15.110:3300/0 conn(0x7f8a2406b410 0x7f8a2406f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:29.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.691+0000 7f8a23400640 1 --2- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406df30 0x7f8a2406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.692+0000 7f8a22000640 1 -- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406df30 msgr2=0x7f8a2406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.692+0000 7f8a22000640 1 --2- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406df30 0x7f8a2406e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.692+0000 7f8a22000640 1 -- 172.21.15.73:0/3186890305 >> v1:172.21.15.73:6789/0 conn(0x7f8a2406b030 legacy=0x7f8a24159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.692+0000 7f8a22000640 1 -- 172.21.15.73:0/3186890305 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2406d740 con 0x7f8a2406b410 2024-03-23T06:10:29.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.692+0000 7f8a23400640 1 --2- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406df30 0x7f8a2406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:29.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.692+0000 7f8a21600640 1 -- 172.21.15.73:0/3186890305 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376105706 0 0) 0x7f8a240c7af0 con 0x7f8a2406b030 2024-03-23T06:10:29.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.693+0000 7f8a22000640 1 --2- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2406f270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009d90 tx=0x7f8a0c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcf6a09b537d51d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:29.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.693+0000 7f8a21600640 1 -- 172.21.15.73:0/3186890305 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c02cc60 con 0x7f8a2406b410 2024-03-23T06:10:29.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.693+0000 7f8a21600640 1 -- 172.21.15.73:0/3186890305 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c02cdc0 con 0x7f8a2406b410 2024-03-23T06:10:29.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.693+0000 7f8a21600640 1 -- 172.21.15.73:0/3186890305 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c034660 con 0x7f8a2406b410 2024-03-23T06:10:29.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.694+0000 7f8a29e00640 1 -- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 msgr2=0x7f8a2406f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:29.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.694+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2406f270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009d90 tx=0x7f8a0c02beb0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.694+0000 7f8a29e00640 1 -- 172.21.15.73:0/3186890305 shutdown_connections 2024-03-23T06:10:29.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.694+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406df30 0x7f8a2406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.694+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3186890305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2406f270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.694+0000 7f8a29e00640 1 -- 172.21.15.73:0/3186890305 >> 172.21.15.73:0/3186890305 conn(0x7f8a240ccdd0 msgr2=0x7f8a240cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:29.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.694+0000 7f8a29e00640 1 -- 172.21.15.73:0/3186890305 shutdown_connections 2024-03-23T06:10:29.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.694+0000 7f8a29e00640 1 -- 172.21.15.73:0/3186890305 wait complete. 2024-03-23T06:10:29.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.696+0000 7f8a29e00640 1 Processor -- start 2024-03-23T06:10:29.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.696+0000 7f8a29e00640 1 -- start start 2024-03-23T06:10:29.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a29e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406b030 0x7f8a241e1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:29.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a29e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2413f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a29e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a2406df30 0x7f8a24153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a29e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241e1980 con 0x7f8a2406df30 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a29e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241555c0 con 0x7f8a2406b410 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a29e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241e0880 con 0x7f8a2406b030 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a22a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406b030 0x7f8a241e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a23400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a2406df30 0x7f8a24153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a22000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2413f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a22000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2413f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:53498/0 (socket says 172.21.15.73:53498) 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.697+0000 7f8a22000640 1 -- 172.21.15.73:0/3153230734 learned_addr learned my addr 172.21.15.73:0/3153230734 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a22000640 1 -- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406b030 msgr2=0x7f8a241e1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a22000640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406b030 0x7f8a241e1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a22000640 1 -- 172.21.15.73:0/3153230734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a2406df30 msgr2=0x7f8a24153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a22000640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a2406df30 0x7f8a24153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:29.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a22000640 1 -- 172.21.15.73:0/3153230734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009400 con 0x7f8a2406b410 2024-03-23T06:10:29.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a22a00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406b030 0x7f8a241e1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:29.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a22000640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2413f950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009d90 tx=0x7f8a0c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:29.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a1b400640 1 -- 172.21.15.73:0/3153230734 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c040650 con 0x7f8a2406b410 2024-03-23T06:10:29.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a1b400640 1 -- 172.21.15.73:0/3153230734 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c0407b0 con 0x7f8a2406b410 2024-03-23T06:10:29.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c009a70 con 0x7f8a2406b410 2024-03-23T06:10:29.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a1b400640 1 -- 172.21.15.73:0/3153230734 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c040b60 con 0x7f8a2406b410 2024-03-23T06:10:29.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.698+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a241efa30 con 0x7f8a2406b410 2024-03-23T06:10:29.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.699+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a241efea0 con 0x7f8a2406b410 2024-03-23T06:10:29.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.700+0000 7f8a1b400640 1 -- 172.21.15.73:0/3153230734 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8a0c040cc0 con 0x7f8a2406b410 2024-03-23T06:10:29.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.701+0000 7f8a1b400640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8a0006ac00 0x7f8a0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:29.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.701+0000 7f8a1b400640 1 -- 172.21.15.73:0/3153230734 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a0c0ac550 con 0x7f8a2406b410 2024-03-23T06:10:29.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.701+0000 7f8a22a00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8a0006ac00 0x7f8a0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:29.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.702+0000 7f8a22a00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8a0006ac00 0x7f8a0006d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c007fd0 tx=0x7f8a1c007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:29.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.706+0000 7f8a1b400640 1 -- 172.21.15.73:0/3153230734 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8a241efea0 con 0x7f8a2406b410 2024-03-23T06:10:29.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:29.938+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f8a241efea0 con 0x7f8a2406b410 2024-03-23T06:10:30.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.455+0000 7f8a1b400640 1 -- 172.21.15.73:0/3153230734 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) v1 ==== 115+0+0 (secure 0 0 0) 0x7f8a241efea0 con 0x7f8a2406b410 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.458+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8a0006ac00 msgr2=0x7f8a0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.458+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8a0006ac00 0x7f8a0006d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c007fd0 tx=0x7f8a1c007de0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.458+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 msgr2=0x7f8a2413f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.458+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2413f950 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009d90 tx=0x7f8a0c004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.458+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 shutdown_connections 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.458+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a2406df30 0x7f8a24153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.459+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a2406b410 0x7f8a2413f950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.459+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8a0006ac00 0x7f8a0006d0c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.459+0000 7f8a29e00640 1 --2- 172.21.15.73:0/3153230734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a2406b030 0x7f8a241e1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.459+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 >> 172.21.15.73:0/3153230734 conn(0x7f8a240ccdd0 msgr2=0x7f8a240cac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.459+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 shutdown_connections 2024-03-23T06:10:30.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.459+0000 7f8a29e00640 1 -- 172.21.15.73:0/3153230734 wait complete. 2024-03-23T06:10:30.477 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-23T06:10:30.477 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:10:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.669+0000 7f80b6400640 1 Processor -- start 2024-03-23T06:10:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.670+0000 7f80b6400640 1 -- start start 2024-03-23T06:10:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.671+0000 7f80b6400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80b00c7e10 0x7f80b0156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.671+0000 7f80b6400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80b01565b0 0x7f80b0071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.671+0000 7f80b6400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b006f9b0 con 0x7f80b0150100 2024-03-23T06:10:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.671+0000 7f80b6400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b0070250 con 0x7f80b01565b0 2024-03-23T06:10:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.671+0000 7f80b6400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b00c0150 con 0x7f80b00c7e10 2024-03-23T06:10:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.671+0000 7f80afe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80b01565b0 0x7f80b0071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.671+0000 7f80a6a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80b00c7e10 0x7f80b0156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.672+0000 7f80afe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80b01565b0 0x7f80b0071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34364/0 (socket says 172.21.15.73:34364) 2024-03-23T06:10:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.672+0000 7f80af400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f80b0150100 0x7f80b00c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38646/0 (socket says 172.21.15.73:38646) 2024-03-23T06:10:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.672+0000 7f80afe00640 1 -- 172.21.15.73:0/640990888 learned_addr learned my addr 172.21.15.73:0/640990888 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:30.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.672+0000 7f80aea00640 1 -- 172.21.15.73:0/640990888 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354014341 0 0) 0x7f80b006f9b0 con 0x7f80b0150100 2024-03-23T06:10:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.672+0000 7f80afe00640 1 -- 172.21.15.73:0/640990888 >> v2:172.21.15.110:3300/0 conn(0x7f80b00c7e10 msgr2=0x7f80b0156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.672+0000 7f80afe00640 1 --2- 172.21.15.73:0/640990888 >> v2:172.21.15.110:3300/0 conn(0x7f80b00c7e10 0x7f80b0156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.672+0000 7f80afe00640 1 -- 172.21.15.73:0/640990888 >> v1:172.21.15.110:6789/0 conn(0x7f80b0150100 legacy=0x7f80b00c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.672+0000 7f80afe00640 1 -- 172.21.15.73:0/640990888 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b00c71b0 con 0x7f80b01565b0 2024-03-23T06:10:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.673+0000 7f80afe00640 1 --2- 172.21.15.73:0/640990888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b01565b0 0x7f80b0071d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f80b00b11b0 tx=0x7f80a802db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ae35f757fc5487 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80aea00640 1 -- 172.21.15.73:0/640990888 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a802f8e0 con 0x7f80b01565b0 2024-03-23T06:10:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80aea00640 1 -- 172.21.15.73:0/640990888 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a802fa40 con 0x7f80b01565b0 2024-03-23T06:10:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80aea00640 1 -- 172.21.15.73:0/640990888 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a802fdd0 con 0x7f80b01565b0 2024-03-23T06:10:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80b6400640 1 -- 172.21.15.73:0/640990888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b01565b0 msgr2=0x7f80b0071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80b6400640 1 --2- 172.21.15.73:0/640990888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b01565b0 0x7f80b0071d20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f80b00b11b0 tx=0x7f80a802db20 comp rx=0 tx=0).stop 2024-03-23T06:10:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80b6400640 1 -- 172.21.15.73:0/640990888 shutdown_connections 2024-03-23T06:10:30.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80b6400640 1 --2- 172.21.15.73:0/640990888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b01565b0 0x7f80b0071d20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80b6400640 1 --2- 172.21.15.73:0/640990888 >> v2:172.21.15.110:3300/0 conn(0x7f80b00c7e10 0x7f80b0156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80b6400640 1 -- 172.21.15.73:0/640990888 >> 172.21.15.73:0/640990888 conn(0x7f80b006bb40 msgr2=0x7f80b006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80b6400640 1 -- 172.21.15.73:0/640990888 shutdown_connections 2024-03-23T06:10:30.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.674+0000 7f80b6400640 1 -- 172.21.15.73:0/640990888 wait complete. 2024-03-23T06:10:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.676+0000 7f80b6400640 1 Processor -- start 2024-03-23T06:10:30.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.676+0000 7f80b6400640 1 -- start start 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80b6400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b00c7e10 0x7f80b015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80b6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b0150100 0x7f80b01ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80b6400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b01565b0 0x7f80b01e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80b6400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0159df0 con 0x7f80b00c7e10 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80b6400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b0158150 con 0x7f80b0150100 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80b6400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b01572d0 con 0x7f80b01565b0 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80af400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b00c7e10 0x7f80b015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80af400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b00c7e10 0x7f80b015a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34376/0 (socket says 172.21.15.73:34376) 2024-03-23T06:10:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80af400640 1 -- 172.21.15.73:0/1970721113 learned_addr learned my addr 172.21.15.73:0/1970721113 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80afe00640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b01565b0 0x7f80b01e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.677+0000 7f80a6a00640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b0150100 0x7f80b01ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80af400640 1 -- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b01565b0 msgr2=0x7f80b01e1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80af400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b01565b0 0x7f80b01e1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80af400640 1 -- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b0150100 msgr2=0x7f80b01ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80af400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b0150100 0x7f80b01ea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80af400640 1 -- 172.21.15.73:0/1970721113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a80094d0 con 0x7f80b00c7e10 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80af400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b00c7e10 0x7f80b015a0e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80a000c7f0 tx=0x7f80a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80a7e00640 1 -- 172.21.15.73:0/1970721113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000a640 con 0x7f80b00c7e10 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80a7e00640 1 -- 172.21.15.73:0/1970721113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a000a7c0 con 0x7f80b00c7e10 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80a7e00640 1 -- 172.21.15.73:0/1970721113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000ab70 con 0x7f80b00c7e10 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b00b0b20 con 0x7f80b00c7e10 2024-03-23T06:10:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.678+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b0157820 con 0x7f80b00c7e10 2024-03-23T06:10:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.679+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b004e110 con 0x7f80b00c7e10 2024-03-23T06:10:30.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.681+0000 7f80a7e00640 1 -- 172.21.15.73:0/1970721113 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f80a000acd0 con 0x7f80b00c7e10 2024-03-23T06:10:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.681+0000 7f80a7e00640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f808c06ac00 0x7f808c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.681+0000 7f80a7e00640 1 -- 172.21.15.73:0/1970721113 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f80a0088be0 con 0x7f80b00c7e10 2024-03-23T06:10:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.682+0000 7f80a6a00640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f808c06ac00 0x7f808c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.682+0000 7f80a6a00640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f808c06ac00 0x7f808c06d0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80b014e3d0 tx=0x7f8098009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:30.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.686+0000 7f80a7e00640 1 -- 172.21.15.73:0/1970721113 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f80a0053a50 con 0x7f80b00c7e10 2024-03-23T06:10:30.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.915+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80b00bff30 con 0x7f80b00c7e10 2024-03-23T06:10:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.916+0000 7f80a7e00640 1 -- 172.21.15.73:0/1970721113 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6265 (secure 0 0 0) 0x7f80a0018070 con 0x7f80b00c7e10 2024-03-23T06:10:30.916 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:30.916 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:30.448967+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4282,"mds_1":4256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4256":{"gid":4256,"name":"e","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:10:30.916 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 12 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.918+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f808c06ac00 msgr2=0x7f808c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.918+0000 7f80b6400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f808c06ac00 0x7f808c06d0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f80b014e3d0 tx=0x7f8098009190 comp rx=0 tx=0).stop 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.918+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b00c7e10 msgr2=0x7f80b015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.918+0000 7f80b6400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b00c7e10 0x7f80b015a0e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80a000c7f0 tx=0x7f80a000ccb0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.919+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 shutdown_connections 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.919+0000 7f80b6400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f808c06ac00 0x7f808c06d0c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.919+0000 7f80b6400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b01565b0 0x7f80b01e1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.919+0000 7f80b6400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b0150100 0x7f80b01ea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.919+0000 7f80b6400640 1 --2- 172.21.15.73:0/1970721113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b00c7e10 0x7f80b015a0e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.919+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 >> 172.21.15.73:0/1970721113 conn(0x7f80b006bb40 msgr2=0x7f80b00c6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.919+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 shutdown_connections 2024-03-23T06:10:30.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:30.919+0000 7f80b6400640 1 -- 172.21.15.73:0/1970721113 wait complete. 2024-03-23T06:10:30.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:31.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.137+0000 7f4c90600640 1 Processor -- start 2024-03-23T06:10:31.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.138+0000 7f4c90600640 1 -- start start 2024-03-23T06:10:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.139+0000 7f4c90600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4c88150100 0x7f4c880c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.139+0000 7f4c90600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c880c7e10 0x7f4c88071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.139+0000 7f4c90600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8806f9b0 con 0x7f4c880c6fe0 2024-03-23T06:10:31.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.139+0000 7f4c90600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c88070250 con 0x7f4c880c7e10 2024-03-23T06:10:31.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.139+0000 7f4c90600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c880c0150 con 0x7f4c88150100 2024-03-23T06:10:31.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c8e600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c880c7e10 0x7f4c88071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c8d200640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4c880c6fe0 0x7f4c88156070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38650/0 (socket says 172.21.15.73:38650) 2024-03-23T06:10:31.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c8d200640 1 -- 172.21.15.73:0/1203280563 learned_addr learned my addr 172.21.15.73:0/1203280563 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:31.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c8dc00640 1 --2- 172.21.15.73:0/1203280563 >> v2:172.21.15.110:3300/0 conn(0x7f4c88150100 0x7f4c880c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c87e00640 1 -- 172.21.15.73:0/1203280563 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161485688 0 0) 0x7f4c8806f9b0 con 0x7f4c880c6fe0 2024-03-23T06:10:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c87e00640 1 -- 172.21.15.73:0/1203280563 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c70005730 con 0x7f4c880c6fe0 2024-03-23T06:10:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c8dc00640 1 -- 172.21.15.73:0/1203280563 >> v2:172.21.15.73:3300/0 conn(0x7f4c880c7e10 msgr2=0x7f4c88071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c8dc00640 1 --2- 172.21.15.73:0/1203280563 >> v2:172.21.15.73:3300/0 conn(0x7f4c880c7e10 0x7f4c88071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c8dc00640 1 -- 172.21.15.73:0/1203280563 >> v1:172.21.15.110:6789/0 conn(0x7f4c880c6fe0 legacy=0x7f4c88156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.140+0000 7f4c8dc00640 1 -- 172.21.15.73:0/1203280563 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880c03f0 con 0x7f4c88150100 2024-03-23T06:10:31.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.141+0000 7f4c8dc00640 1 --2- 172.21.15.73:0/1203280563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88150100 0x7f4c880c6aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c8806c9a0 tx=0x7f4c7c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e7007e5806e0fe5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:31.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c87e00640 1 -- 172.21.15.73:0/1203280563 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c02e070 con 0x7f4c88150100 2024-03-23T06:10:31.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c87e00640 1 -- 172.21.15.73:0/1203280563 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7c0315a0 con 0x7f4c88150100 2024-03-23T06:10:31.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c87e00640 1 -- 172.21.15.73:0/1203280563 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c031930 con 0x7f4c88150100 2024-03-23T06:10:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c90600640 1 -- 172.21.15.73:0/1203280563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88150100 msgr2=0x7f4c880c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c90600640 1 --2- 172.21.15.73:0/1203280563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88150100 0x7f4c880c6aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4c8806c9a0 tx=0x7f4c7c02b840 comp rx=0 tx=0).stop 2024-03-23T06:10:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c90600640 1 -- 172.21.15.73:0/1203280563 shutdown_connections 2024-03-23T06:10:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c90600640 1 --2- 172.21.15.73:0/1203280563 >> v2:172.21.15.73:3300/0 conn(0x7f4c880c7e10 0x7f4c88071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c90600640 1 --2- 172.21.15.73:0/1203280563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88150100 0x7f4c880c6aa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c90600640 1 -- 172.21.15.73:0/1203280563 >> 172.21.15.73:0/1203280563 conn(0x7f4c8806bb40 msgr2=0x7f4c8806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c90600640 1 -- 172.21.15.73:0/1203280563 shutdown_connections 2024-03-23T06:10:31.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.142+0000 7f4c90600640 1 -- 172.21.15.73:0/1203280563 wait complete. 2024-03-23T06:10:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.144+0000 7f4c90600640 1 Processor -- start 2024-03-23T06:10:31.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.144+0000 7f4c90600640 1 -- start start 2024-03-23T06:10:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c90600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c880c7e10 0x7f4c881e07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c90600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c88150100 0x7f4c88152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c90600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88156b30 0x7f4c88152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c90600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880c9260 con 0x7f4c88150100 2024-03-23T06:10:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c90600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881eed70 con 0x7f4c88156b30 2024-03-23T06:10:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c90600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881efbf0 con 0x7f4c880c7e10 2024-03-23T06:10:31.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c8d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c88150100 0x7f4c88152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c8d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c88150100 0x7f4c88152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34396/0 (socket says 172.21.15.73:34396) 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c8d200640 1 -- 172.21.15.73:0/2496570312 learned_addr learned my addr 172.21.15.73:0/2496570312 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c8e600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88156b30 0x7f4c88152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c8dc00640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c880c7e10 0x7f4c881e07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c8d200640 1 -- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c880c7e10 msgr2=0x7f4c881e07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.145+0000 7f4c8d200640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c880c7e10 0x7f4c881e07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c8d200640 1 -- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88156b30 msgr2=0x7f4c88152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c8d200640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88156b30 0x7f4c88152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c8d200640 1 -- 172.21.15.73:0/2496570312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c009400 con 0x7f4c88150100 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c8e600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88156b30 0x7f4c88152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c8d200640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c88150100 0x7f4c88152580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400c440 tx=0x7f4c7400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c85600640 1 -- 172.21.15.73:0/2496570312 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c74005ce0 con 0x7f4c88150100 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c85600640 1 -- 172.21.15.73:0/2496570312 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c74005e40 con 0x7f4c88150100 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c881eefe0 con 0x7f4c88150100 2024-03-23T06:10:31.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c85600640 1 -- 172.21.15.73:0/2496570312 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c740072b0 con 0x7f4c88150100 2024-03-23T06:10:31.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.146+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c881ef5a0 con 0x7f4c88150100 2024-03-23T06:10:31.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.147+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c881522e0 con 0x7f4c88150100 2024-03-23T06:10:31.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.148+0000 7f4c85600640 1 -- 172.21.15.73:0/2496570312 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4c74007410 con 0x7f4c88150100 2024-03-23T06:10:31.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.149+0000 7f4c85600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c6806ac30 0x7f4c6806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.150+0000 7f4c85600640 1 -- 172.21.15.73:0/2496570312 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c74088c30 con 0x7f4c88150100 2024-03-23T06:10:31.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.150+0000 7f4c8dc00640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c6806ac30 0x7f4c6806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.151+0000 7f4c8dc00640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c6806ac30 0x7f4c6806d0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c036000 tx=0x7f4c7c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:31.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.154+0000 7f4c85600640 1 -- 172.21.15.73:0/2496570312 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4c7408f080 con 0x7f4c88150100 2024-03-23T06:10:31.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.339+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c8804e110 con 0x7f4c88150100 2024-03-23T06:10:31.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.341+0000 7f4c85600640 1 -- 172.21.15.73:0/2496570312 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f4c74017070 con 0x7f4c88150100 2024-03-23T06:10:31.341 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:31.341 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.343+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c6806ac30 msgr2=0x7f4c6806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.343+0000 7f4c90600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c6806ac30 0x7f4c6806d0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c036000 tx=0x7f4c7c03d040 comp rx=0 tx=0).stop 2024-03-23T06:10:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c88150100 msgr2=0x7f4c88152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c88150100 0x7f4c88152580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4c7400c440 tx=0x7f4c7400c900 comp rx=0 tx=0).stop 2024-03-23T06:10:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 shutdown_connections 2024-03-23T06:10:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c88156b30 0x7f4c88152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c88150100 0x7f4c88152580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c6806ac30 0x7f4c6806d0f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 --2- 172.21.15.73:0/2496570312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c880c7e10 0x7f4c881e07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 >> 172.21.15.73:0/2496570312 conn(0x7f4c8806bb40 msgr2=0x7f4c8814d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 shutdown_connections 2024-03-23T06:10:31.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.344+0000 7f4c90600640 1 -- 172.21.15.73:0/2496570312 wait complete. 2024-03-23T06:10:31.362 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-23T06:10:31.362 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:10:31.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.556+0000 7f0d31000640 1 Processor -- start 2024-03-23T06:10:31.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.556+0000 7f0d31000640 1 -- start start 2024-03-23T06:10:31.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d31000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d2c1536a0 0x7f0d2c0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d31000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d2c153a80 0x7f0d2c0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d31000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d31000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c15a520 con 0x7f0d2c153a80 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d31000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d2c0cab20 con 0x7f0d2c1536a0 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d31000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c1599a0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d21400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d2c153a80 0x7f0d2c0cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d21400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d2c153a80 0x7f0d2c0cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34412/0 (socket says 172.21.15.73:34412) 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d21400640 1 -- 172.21.15.73:0/1054531366 learned_addr learned my addr 172.21.15.73:0/1054531366 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d2a800640 1 --2- 172.21.15.73:0/1054531366 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.558+0000 7f0d29e00640 1 --2- 172.21.15.73:0/1054531366 >> v2:172.21.15.110:3300/0 conn(0x7f0d2c1536a0 0x7f0d2c0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.559+0000 7f0d21400640 1 -- 172.21.15.73:0/1054531366 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 msgr2=0x7f0d2c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.559+0000 7f0d21400640 1 --2- 172.21.15.73:0/1054531366 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.559+0000 7f0d21400640 1 -- 172.21.15.73:0/1054531366 >> v2:172.21.15.110:3300/0 conn(0x7f0d2c1536a0 msgr2=0x7f0d2c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:31.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.559+0000 7f0d21400640 1 --2- 172.21.15.73:0/1054531366 >> v2:172.21.15.110:3300/0 conn(0x7f0d2c1536a0 0x7f0d2c0ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.559+0000 7f0d21400640 1 -- 172.21.15.73:0/1054531366 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c159c80 con 0x7f0d2c153a80 2024-03-23T06:10:31.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.559+0000 7f0d2a800640 1 --2- 172.21.15.73:0/1054531366 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:31.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.561+0000 7f0d21400640 1 --2- 172.21.15.73:0/1054531366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 0x7f0d2c0cbe90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009870 tx=0x7f0d1402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0f99e84e46e14e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:31.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.561+0000 7f0d29400640 1 -- 172.21.15.73:0/1054531366 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14031640 con 0x7f0d2c153a80 2024-03-23T06:10:31.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.561+0000 7f0d29400640 1 -- 172.21.15.73:0/1054531366 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d140317a0 con 0x7f0d2c153a80 2024-03-23T06:10:31.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.561+0000 7f0d29400640 1 -- 172.21.15.73:0/1054531366 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14031b30 con 0x7f0d2c153a80 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 -- 172.21.15.73:0/1054531366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 msgr2=0x7f0d2c0cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 --2- 172.21.15.73:0/1054531366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 0x7f0d2c0cbe90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009870 tx=0x7f0d1402b8f0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 -- 172.21.15.73:0/1054531366 shutdown_connections 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 --2- 172.21.15.73:0/1054531366 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 --2- 172.21.15.73:0/1054531366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 0x7f0d2c0cbe90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 --2- 172.21.15.73:0/1054531366 >> v2:172.21.15.110:3300/0 conn(0x7f0d2c1536a0 0x7f0d2c0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 -- 172.21.15.73:0/1054531366 >> 172.21.15.73:0/1054531366 conn(0x7f0d2c06a060 msgr2=0x7f0d2c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 -- 172.21.15.73:0/1054531366 shutdown_connections 2024-03-23T06:10:31.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.562+0000 7f0d31000640 1 -- 172.21.15.73:0/1054531366 wait complete. 2024-03-23T06:10:31.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.563+0000 7f0d31000640 1 Processor -- start 2024-03-23T06:10:31.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.564+0000 7f0d31000640 1 -- start start 2024-03-23T06:10:31.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.564+0000 7f0d31000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d2c1536a0 0x7f0d2c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d31000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 0x7f0d2c1f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d31000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d31000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c14f0d0 con 0x7f0d2c153a80 2024-03-23T06:10:31.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d31000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c1f2cf0 con 0x7f0d2c1536a0 2024-03-23T06:10:31.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d31000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c156ea0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d21400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 0x7f0d2c1f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d2a800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d21400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 0x7f0d2c1f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34414/0 (socket says 172.21.15.73:34414) 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d29e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d2c1536a0 0x7f0d2c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d21400640 1 -- 172.21.15.73:0/2704841481 learned_addr learned my addr 172.21.15.73:0/2704841481 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d2a800640 1 -- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d2c1536a0 msgr2=0x7f0d2c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d2a800640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d2c1536a0 0x7f0d2c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d2a800640 1 -- 172.21.15.73:0/2704841481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 msgr2=0x7f0d2c1f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d2a800640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 0x7f0d2c1f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.565+0000 7f0d2a800640 1 -- 172.21.15.73:0/2704841481 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24009a70 con 0x7f0d2c1594f0 2024-03-23T06:10:31.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.566+0000 7f0d2a800640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cf430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400ef90 tx=0x7f0d2400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:31.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.566+0000 7f0d22a00640 1 -- 172.21.15.73:0/2704841481 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400ccd0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.566+0000 7f0d22a00640 1 -- 172.21.15.73:0/2704841481 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2400f040 con 0x7f0d2c1594f0 2024-03-23T06:10:31.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.566+0000 7f0d22a00640 1 -- 172.21.15.73:0/2704841481 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24003bd0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.566+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d140094d0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.566+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c1542a0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.567+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c0cb4b0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.568+0000 7f0d22a00640 1 -- 172.21.15.73:0/2704841481 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0d24014480 con 0x7f0d2c1594f0 2024-03-23T06:10:31.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.568+0000 7f0d22a00640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d0806ac00 0x7f0d0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:31.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.569+0000 7f0d22a00640 1 -- 172.21.15.73:0/2704841481 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d2408a0a0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.569+0000 7f0d29e00640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d0806ac00 0x7f0d0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:31.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.569+0000 7f0d29e00640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d0806ac00 0x7f0d0806d0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009ac0 tx=0x7f0d1c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:31.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.573+0000 7f0d22a00640 1 -- 172.21.15.73:0/2704841481 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0d24054fa0 con 0x7f0d2c1594f0 2024-03-23T06:10:31.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.762+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d2c0cb970 con 0x7f0d0806ac00 2024-03-23T06:10:31.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.773+0000 7f0d22a00640 1 -- 172.21.15.73:0/2704841481 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345220 (secure 0 0 0) 0x7f0d1c0119e0 con 0x7f0d0806ac00 2024-03-23T06:10:31.778 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:31.780 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:10:31.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d0806ac00 msgr2=0x7f0d0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d0806ac00 0x7f0d0806d0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009ac0 tx=0x7f0d1c009190 comp rx=0 tx=0).stop 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 msgr2=0x7f0d2c0cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cf430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400ef90 tx=0x7f0d2400c490 comp rx=0 tx=0).stop 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 shutdown_connections 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d0806ac00 0x7f0d0806d0c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d2c1594f0 0x7f0d2c0cf430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d2c153a80 0x7f0d2c1f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 --2- 172.21.15.73:0/2704841481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d2c1536a0 0x7f0d2c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 >> 172.21.15.73:0/2704841481 conn(0x7f0d2c06a060 msgr2=0x7f0d2c0c3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 shutdown_connections 2024-03-23T06:10:31.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:31.779+0000 7f0d31000640 1 -- 172.21.15.73:0/2704841481 wait complete. 2024-03-23T06:10:31.796 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-03-23T06:10:30.617209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":3350528,"data_stored":2016634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003528"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.938317+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:10:02.938317+0000","last_peered":"2024-03-23T06:10:02.938317+0000","last_clean":"2024-03-23T06:10:02.938317+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:10:02.938317+0000","last_undegraded":"2024-03-23T06:10:02.938317+0000","last_fullsized":"2024-03-23T06:10:02.938317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948197+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:10:01.948197+0000","last_peered":"2024-03-23T06:10:01.948197+0000","last_clean":"2024-03-23T06:10:01.948197+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:10:01.948197+0000","last_undegraded":"2024-03-23T06:10:01.948197+0000","last_fullsized":"2024-03-23T06:10:01.948197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929155+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:10:02.929155+0000","last_peered":"2024-03-23T06:10:02.929155+0000","last_clean":"2024-03-23T06:10:02.929155+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:10:02.929155+0000","last_undegraded":"2024-03-23T06:10:02.929155+0000","last_fullsized":"2024-03-23T06:10:02.929155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932040+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:10:02.932040+0000","last_peered":"2024-03-23T06:10:02.932040+0000","last_clean":"2024-03-23T06:10:02.932040+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:10:02.932040+0000","last_undegraded":"2024-03-23T06:10:02.932040+0000","last_fullsized":"2024-03-23T06:10:02.932040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948557+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:10:01.948557+0000","last_peered":"2024-03-23T06:10:01.948557+0000","last_clean":"2024-03-23T06:10:01.948557+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:10:01.948557+0000","last_undegraded":"2024-03-23T06:10:01.948557+0000","last_fullsized":"2024-03-23T06:10:01.948557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.979095+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:10:01.979095+0000","last_peered":"2024-03-23T06:10:01.979095+0000","last_clean":"2024-03-23T06:10:01.979095+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:10:01.979095+0000","last_undegraded":"2024-03-23T06:10:01.979095+0000","last_fullsized":"2024-03-23T06:10:01.979095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932874+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:10:02.932874+0000","last_peered":"2024-03-23T06:10:02.932874+0000","last_clean":"2024-03-23T06:10:02.932874+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:10:02.932874+0000","last_undegraded":"2024-03-23T06:10:02.932874+0000","last_fullsized":"2024-03-23T06:10:02.932874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960659+0000","last_change":"2024-03-23T06:09:57.945661+0000","last_active":"2024-03-23T06:10:01.960659+0000","last_peered":"2024-03-23T06:10:01.960659+0000","last_clean":"2024-03-23T06:10:01.960659+0000","last_became_active":"2024-03-23T06:09:57.945374+0000","last_became_peered":"2024-03-23T06:09:57.945374+0000","last_unstale":"2024-03-23T06:10:01.960659+0000","last_undegraded":"2024-03-23T06:10:01.960659+0000","last_fullsized":"2024-03-23T06:10:01.960659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:20:55.180098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.981444+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:10:01.981444+0000","last_peered":"2024-03-23T06:10:01.981444+0000","last_clean":"2024-03-23T06:10:01.981444+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:10:01.981444+0000","last_undegraded":"2024-03-23T06:10:01.981444+0000","last_fullsized":"2024-03-23T06:10:01.981444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.936447+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:10:02.936447+0000","last_peered":"2024-03-23T06:10:02.936447+0000","last_clean":"2024-03-23T06:10:02.936447+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:10:02.936447+0000","last_undegraded":"2024-03-23T06:10:02.936447+0000","last_fullsized":"2024-03-23T06:10:02.936447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956142+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:10:01.956142+0000","last_peered":"2024-03-23T06:10:01.956142+0000","last_clean":"2024-03-23T06:10:01.956142+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:10:01.956142+0000","last_undegraded":"2024-03-23T06:10:01.956142+0000","last_fullsized":"2024-03-23T06:10:01.956142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.986981+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:10:01.986981+0000","last_peered":"2024-03-23T06:10:01.986981+0000","last_clean":"2024-03-23T06:10:01.986981+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:10:01.986981+0000","last_undegraded":"2024-03-23T06:10:01.986981+0000","last_fullsized":"2024-03-23T06:10:01.986981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947842+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:10:01.947842+0000","last_peered":"2024-03-23T06:10:01.947842+0000","last_clean":"2024-03-23T06:10:01.947842+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:10:01.947842+0000","last_undegraded":"2024-03-23T06:10:01.947842+0000","last_fullsized":"2024-03-23T06:10:01.947842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.937883+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:10:02.937883+0000","last_peered":"2024-03-23T06:10:02.937883+0000","last_clean":"2024-03-23T06:10:02.937883+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:10:02.937883+0000","last_undegraded":"2024-03-23T06:10:02.937883+0000","last_fullsized":"2024-03-23T06:10:02.937883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.977132+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:10:01.977132+0000","last_peered":"2024-03-23T06:10:01.977132+0000","last_clean":"2024-03-23T06:10:01.977132+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:10:01.977132+0000","last_undegraded":"2024-03-23T06:10:01.977132+0000","last_fullsized":"2024-03-23T06:10:01.977132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944424+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:10:01.944424+0000","last_peered":"2024-03-23T06:10:01.944424+0000","last_clean":"2024-03-23T06:10:01.944424+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:10:01.944424+0000","last_undegraded":"2024-03-23T06:10:01.944424+0000","last_fullsized":"2024-03-23T06:10:01.944424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938236+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:10:01.938236+0000","last_peered":"2024-03-23T06:10:01.938236+0000","last_clean":"2024-03-23T06:10:01.938236+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:10:01.938236+0000","last_undegraded":"2024-03-23T06:10:01.938236+0000","last_fullsized":"2024-03-23T06:10:01.938236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.974726+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:10:01.974726+0000","last_peered":"2024-03-23T06:10:01.974726+0000","last_clean":"2024-03-23T06:10:01.974726+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:10:01.974726+0000","last_undegraded":"2024-03-23T06:10:01.974726+0000","last_fullsized":"2024-03-23T06:10:01.974726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938551+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:10:01.938551+0000","last_peered":"2024-03-23T06:10:01.938551+0000","last_clean":"2024-03-23T06:10:01.938551+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:10:01.938551+0000","last_undegraded":"2024-03-23T06:10:01.938551+0000","last_fullsized":"2024-03-23T06:10:01.938551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938930+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:10:01.938930+0000","last_peered":"2024-03-23T06:10:01.938930+0000","last_clean":"2024-03-23T06:10:01.938930+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:10:01.938930+0000","last_undegraded":"2024-03-23T06:10:01.938930+0000","last_fullsized":"2024-03-23T06:10:01.938930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930440+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:10:02.930440+0000","last_peered":"2024-03-23T06:10:02.930440+0000","last_clean":"2024-03-23T06:10:02.930440+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:10:02.930440+0000","last_undegraded":"2024-03-23T06:10:02.930440+0000","last_fullsized":"2024-03-23T06:10:02.930440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946405+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:10:01.946405+0000","last_peered":"2024-03-23T06:10:01.946405+0000","last_clean":"2024-03-23T06:10:01.946405+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:10:01.946405+0000","last_undegraded":"2024-03-23T06:10:01.946405+0000","last_fullsized":"2024-03-23T06:10:01.946405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956205+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:10:01.956205+0000","last_peered":"2024-03-23T06:10:01.956205+0000","last_clean":"2024-03-23T06:10:01.956205+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:10:01.956205+0000","last_undegraded":"2024-03-23T06:10:01.956205+0000","last_fullsized":"2024-03-23T06:10:01.956205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982640+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:10:01.982640+0000","last_peered":"2024-03-23T06:10:01.982640+0000","last_clean":"2024-03-23T06:10:01.982640+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:10:01.982640+0000","last_undegraded":"2024-03-23T06:10:01.982640+0000","last_fullsized":"2024-03-23T06:10:01.982640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938356+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:10:01.938356+0000","last_peered":"2024-03-23T06:10:01.938356+0000","last_clean":"2024-03-23T06:10:01.938356+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:10:01.938356+0000","last_undegraded":"2024-03-23T06:10:01.938356+0000","last_fullsized":"2024-03-23T06:10:01.938356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.936241+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:10:02.936241+0000","last_peered":"2024-03-23T06:10:02.936241+0000","last_clean":"2024-03-23T06:10:02.936241+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:10:02.936241+0000","last_undegraded":"2024-03-23T06:10:02.936241+0000","last_fullsized":"2024-03-23T06:10:02.936241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982776+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:10:01.982776+0000","last_peered":"2024-03-23T06:10:01.982776+0000","last_clean":"2024-03-23T06:10:01.982776+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:10:01.982776+0000","last_undegraded":"2024-03-23T06:10:01.982776+0000","last_fullsized":"2024-03-23T06:10:01.982776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936925+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:10:01.936925+0000","last_peered":"2024-03-23T06:10:01.936925+0000","last_clean":"2024-03-23T06:10:01.936925+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:10:01.936925+0000","last_undegraded":"2024-03-23T06:10:01.936925+0000","last_fullsized":"2024-03-23T06:10:01.936925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427809+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:10:02.427809+0000","last_peered":"2024-03-23T06:10:02.427809+0000","last_clean":"2024-03-23T06:10:02.427809+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:10:02.427809+0000","last_undegraded":"2024-03-23T06:10:02.427809+0000","last_fullsized":"2024-03-23T06:10:02.427809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427188+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:10:02.427188+0000","last_peered":"2024-03-23T06:10:02.427188+0000","last_clean":"2024-03-23T06:10:02.427188+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:10:02.427188+0000","last_undegraded":"2024-03-23T06:10:02.427188+0000","last_fullsized":"2024-03-23T06:10:02.427188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938375+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:10:01.938375+0000","last_peered":"2024-03-23T06:10:01.938375+0000","last_clean":"2024-03-23T06:10:01.938375+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:10:01.938375+0000","last_undegraded":"2024-03-23T06:10:01.938375+0000","last_fullsized":"2024-03-23T06:10:01.938375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956068+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:10:01.956068+0000","last_peered":"2024-03-23T06:10:01.956068+0000","last_clean":"2024-03-23T06:10:01.956068+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:10:01.956068+0000","last_undegraded":"2024-03-23T06:10:01.956068+0000","last_fullsized":"2024-03-23T06:10:01.956068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426879+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:10:02.426879+0000","last_peered":"2024-03-23T06:10:02.426879+0000","last_clean":"2024-03-23T06:10:02.426879+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:10:02.426879+0000","last_undegraded":"2024-03-23T06:10:02.426879+0000","last_fullsized":"2024-03-23T06:10:02.426879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.962945+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:10:01.962945+0000","last_peered":"2024-03-23T06:10:01.962945+0000","last_clean":"2024-03-23T06:10:01.962945+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:10:01.962945+0000","last_undegraded":"2024-03-23T06:10:01.962945+0000","last_fullsized":"2024-03-23T06:10:01.962945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947204+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:10:01.947204+0000","last_peered":"2024-03-23T06:10:01.947204+0000","last_clean":"2024-03-23T06:10:01.947204+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:10:01.947204+0000","last_undegraded":"2024-03-23T06:10:01.947204+0000","last_fullsized":"2024-03-23T06:10:01.947204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426681+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:10:02.426681+0000","last_peered":"2024-03-23T06:10:02.426681+0000","last_clean":"2024-03-23T06:10:02.426681+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:10:02.426681+0000","last_undegraded":"2024-03-23T06:10:02.426681+0000","last_fullsized":"2024-03-23T06:10:02.426681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956957+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:10:01.956957+0000","last_peered":"2024-03-23T06:10:01.956957+0000","last_clean":"2024-03-23T06:10:01.956957+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:10:01.956957+0000","last_undegraded":"2024-03-23T06:10:01.956957+0000","last_fullsized":"2024-03-23T06:10:01.956957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951233+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:10:01.951233+0000","last_peered":"2024-03-23T06:10:01.951233+0000","last_clean":"2024-03-23T06:10:01.951233+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:10:01.951233+0000","last_undegraded":"2024-03-23T06:10:01.951233+0000","last_fullsized":"2024-03-23T06:10:01.951233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427177+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:10:02.427177+0000","last_peered":"2024-03-23T06:10:02.427177+0000","last_clean":"2024-03-23T06:10:02.427177+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:10:02.427177+0000","last_undegraded":"2024-03-23T06:10:02.427177+0000","last_fullsized":"2024-03-23T06:10:02.427177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947571+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:10:01.947571+0000","last_peered":"2024-03-23T06:10:01.947571+0000","last_clean":"2024-03-23T06:10:01.947571+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:10:01.947571+0000","last_undegraded":"2024-03-23T06:10:01.947571+0000","last_fullsized":"2024-03-23T06:10:01.947571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944396+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:10:01.944396+0000","last_peered":"2024-03-23T06:10:01.944396+0000","last_clean":"2024-03-23T06:10:01.944396+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:10:01.944396+0000","last_undegraded":"2024-03-23T06:10:01.944396+0000","last_fullsized":"2024-03-23T06:10:01.944396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427599+0000","last_change":"2024-03-23T06:10:01.967435+0000","last_active":"2024-03-23T06:10:02.427599+0000","last_peered":"2024-03-23T06:10:02.427599+0000","last_clean":"2024-03-23T06:10:02.427599+0000","last_became_active":"2024-03-23T06:10:01.967059+0000","last_became_peered":"2024-03-23T06:10:01.967059+0000","last_unstale":"2024-03-23T06:10:02.427599+0000","last_undegraded":"2024-03-23T06:10:02.427599+0000","last_fullsized":"2024-03-23T06:10:02.427599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:51:56.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936633+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:10:01.936633+0000","last_peered":"2024-03-23T06:10:01.936633+0000","last_clean":"2024-03-23T06:10:01.936633+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:01.936633+0000","last_undegraded":"2024-03-23T06:10:01.936633+0000","last_fullsized":"2024-03-23T06:10:01.936633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.950342+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:10:01.950342+0000","last_peered":"2024-03-23T06:10:01.950342+0000","last_clean":"2024-03-23T06:10:01.950342+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:10:01.950342+0000","last_undegraded":"2024-03-23T06:10:01.950342+0000","last_fullsized":"2024-03-23T06:10:01.950342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931695+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:10:02.931695+0000","last_peered":"2024-03-23T06:10:02.931695+0000","last_clean":"2024-03-23T06:10:02.931695+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:10:02.931695+0000","last_undegraded":"2024-03-23T06:10:02.931695+0000","last_fullsized":"2024-03-23T06:10:02.931695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938499+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:10:01.938499+0000","last_peered":"2024-03-23T06:10:01.938499+0000","last_clean":"2024-03-23T06:10:01.938499+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:10:01.938499+0000","last_undegraded":"2024-03-23T06:10:01.938499+0000","last_fullsized":"2024-03-23T06:10:01.938499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954702+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:10:01.954702+0000","last_peered":"2024-03-23T06:10:01.954702+0000","last_clean":"2024-03-23T06:10:01.954702+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:10:01.954702+0000","last_undegraded":"2024-03-23T06:10:01.954702+0000","last_fullsized":"2024-03-23T06:10:01.954702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955598+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:10:01.955598+0000","last_peered":"2024-03-23T06:10:01.955598+0000","last_clean":"2024-03-23T06:10:01.955598+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:10:01.955598+0000","last_undegraded":"2024-03-23T06:10:01.955598+0000","last_fullsized":"2024-03-23T06:10:01.955598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982185+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:10:01.982185+0000","last_peered":"2024-03-23T06:10:01.982185+0000","last_clean":"2024-03-23T06:10:01.982185+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:10:01.982185+0000","last_undegraded":"2024-03-23T06:10:01.982185+0000","last_fullsized":"2024-03-23T06:10:01.982185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955865+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:10:01.955865+0000","last_peered":"2024-03-23T06:10:01.955865+0000","last_clean":"2024-03-23T06:10:01.955865+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:10:01.955865+0000","last_undegraded":"2024-03-23T06:10:01.955865+0000","last_fullsized":"2024-03-23T06:10:01.955865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938453+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:10:01.938453+0000","last_peered":"2024-03-23T06:10:01.938453+0000","last_clean":"2024-03-23T06:10:01.938453+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:10:01.938453+0000","last_undegraded":"2024-03-23T06:10:01.938453+0000","last_fullsized":"2024-03-23T06:10:01.938453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.980947+0000","last_change":"2024-03-23T06:10:01.975352+0000","last_active":"2024-03-23T06:10:01.980947+0000","last_peered":"2024-03-23T06:10:01.980947+0000","last_clean":"2024-03-23T06:10:01.980947+0000","last_became_active":"2024-03-23T06:10:01.974177+0000","last_became_peered":"2024-03-23T06:10:01.974177+0000","last_unstale":"2024-03-23T06:10:01.980947+0000","last_undegraded":"2024-03-23T06:10:01.980947+0000","last_fullsized":"2024-03-23T06:10:01.980947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:33.405804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958813+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:10:01.958813+0000","last_peered":"2024-03-23T06:10:01.958813+0000","last_clean":"2024-03-23T06:10:01.958813+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:10:01.958813+0000","last_undegraded":"2024-03-23T06:10:01.958813+0000","last_fullsized":"2024-03-23T06:10:01.958813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931676+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:10:02.931676+0000","last_peered":"2024-03-23T06:10:02.931676+0000","last_clean":"2024-03-23T06:10:02.931676+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:10:02.931676+0000","last_undegraded":"2024-03-23T06:10:02.931676+0000","last_fullsized":"2024-03-23T06:10:02.931676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930842+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:10:02.930842+0000","last_peered":"2024-03-23T06:10:02.930842+0000","last_clean":"2024-03-23T06:10:02.930842+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:10:02.930842+0000","last_undegraded":"2024-03-23T06:10:02.930842+0000","last_fullsized":"2024-03-23T06:10:02.930842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955953+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:10:01.955953+0000","last_peered":"2024-03-23T06:10:01.955953+0000","last_clean":"2024-03-23T06:10:01.955953+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:10:01.955953+0000","last_undegraded":"2024-03-23T06:10:01.955953+0000","last_fullsized":"2024-03-23T06:10:01.955953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930322+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:10:02.930322+0000","last_peered":"2024-03-23T06:10:02.930322+0000","last_clean":"2024-03-23T06:10:02.930322+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:10:02.930322+0000","last_undegraded":"2024-03-23T06:10:02.930322+0000","last_fullsized":"2024-03-23T06:10:02.930322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.978341+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:10:01.978341+0000","last_peered":"2024-03-23T06:10:01.978341+0000","last_clean":"2024-03-23T06:10:01.978341+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:10:01.978341+0000","last_undegraded":"2024-03-23T06:10:01.978341+0000","last_fullsized":"2024-03-23T06:10:01.978341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961138+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:10:01.961138+0000","last_peered":"2024-03-23T06:10:01.961138+0000","last_clean":"2024-03-23T06:10:01.961138+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:10:01.961138+0000","last_undegraded":"2024-03-23T06:10:01.961138+0000","last_fullsized":"2024-03-23T06:10:01.961138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932726+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:10:02.932726+0000","last_peered":"2024-03-23T06:10:02.932726+0000","last_clean":"2024-03-23T06:10:02.932726+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:10:02.932726+0000","last_undegraded":"2024-03-23T06:10:02.932726+0000","last_fullsized":"2024-03-23T06:10:02.932726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.987273+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:10:01.987273+0000","last_peered":"2024-03-23T06:10:01.987273+0000","last_clean":"2024-03-23T06:10:01.987273+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:10:01.987273+0000","last_undegraded":"2024-03-23T06:10:01.987273+0000","last_fullsized":"2024-03-23T06:10:01.987273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946483+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:10:01.946483+0000","last_peered":"2024-03-23T06:10:01.946483+0000","last_clean":"2024-03-23T06:10:01.946483+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:10:01.946483+0000","last_undegraded":"2024-03-23T06:10:01.946483+0000","last_fullsized":"2024-03-23T06:10:01.946483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.933010+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:10:02.933010+0000","last_peered":"2024-03-23T06:10:02.933010+0000","last_clean":"2024-03-23T06:10:02.933010+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:10:02.933010+0000","last_undegraded":"2024-03-23T06:10:02.933010+0000","last_fullsized":"2024-03-23T06:10:02.933010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931833+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:10:02.931833+0000","last_peered":"2024-03-23T06:10:02.931833+0000","last_clean":"2024-03-23T06:10:02.931833+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:10:02.931833+0000","last_undegraded":"2024-03-23T06:10:02.931833+0000","last_fullsized":"2024-03-23T06:10:02.931833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955456+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:10:01.955456+0000","last_peered":"2024-03-23T06:10:01.955456+0000","last_clean":"2024-03-23T06:10:01.955456+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:10:01.955456+0000","last_undegraded":"2024-03-23T06:10:01.955456+0000","last_fullsized":"2024-03-23T06:10:01.955456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958080+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:10:01.958080+0000","last_peered":"2024-03-23T06:10:01.958080+0000","last_clean":"2024-03-23T06:10:01.958080+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:10:01.958080+0000","last_undegraded":"2024-03-23T06:10:01.958080+0000","last_fullsized":"2024-03-23T06:10:01.958080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931864+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:10:02.931864+0000","last_peered":"2024-03-23T06:10:02.931864+0000","last_clean":"2024-03-23T06:10:02.931864+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:10:02.931864+0000","last_undegraded":"2024-03-23T06:10:02.931864+0000","last_fullsized":"2024-03-23T06:10:02.931864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954582+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:10:01.954582+0000","last_peered":"2024-03-23T06:10:01.954582+0000","last_clean":"2024-03-23T06:10:01.954582+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:10:01.954582+0000","last_undegraded":"2024-03-23T06:10:01.954582+0000","last_fullsized":"2024-03-23T06:10:01.954582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951101+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:10:01.951101+0000","last_peered":"2024-03-23T06:10:01.951101+0000","last_clean":"2024-03-23T06:10:01.951101+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:10:01.951101+0000","last_undegraded":"2024-03-23T06:10:01.951101+0000","last_fullsized":"2024-03-23T06:10:01.951101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427019+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:10:02.427019+0000","last_peered":"2024-03-23T06:10:02.427019+0000","last_clean":"2024-03-23T06:10:02.427019+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:10:02.427019+0000","last_undegraded":"2024-03-23T06:10:02.427019+0000","last_fullsized":"2024-03-23T06:10:02.427019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.937969+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:10:01.937969+0000","last_peered":"2024-03-23T06:10:01.937969+0000","last_clean":"2024-03-23T06:10:01.937969+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:10:01.937969+0000","last_undegraded":"2024-03-23T06:10:01.937969+0000","last_fullsized":"2024-03-23T06:10:01.937969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.936244+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:10:02.936244+0000","last_peered":"2024-03-23T06:10:02.936244+0000","last_clean":"2024-03-23T06:10:02.936244+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:10:02.936244+0000","last_undegraded":"2024-03-23T06:10:02.936244+0000","last_fullsized":"2024-03-23T06:10:02.936244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.977106+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:10:01.977106+0000","last_peered":"2024-03-23T06:10:01.977106+0000","last_clean":"2024-03-23T06:10:01.977106+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:10:01.977106+0000","last_undegraded":"2024-03-23T06:10:01.977106+0000","last_fullsized":"2024-03-23T06:10:01.977106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960157+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:10:01.960157+0000","last_peered":"2024-03-23T06:10:01.960157+0000","last_clean":"2024-03-23T06:10:01.960157+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:10:01.960157+0000","last_undegraded":"2024-03-23T06:10:01.960157+0000","last_fullsized":"2024-03-23T06:10:01.960157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:19.536398+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:10:19.536398+0000","last_peered":"2024-03-23T06:10:19.536398+0000","last_clean":"2024-03-23T06:10:19.536398+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:10:19.536398+0000","last_undegraded":"2024-03-23T06:10:19.536398+0000","last_fullsized":"2024-03-23T06:10:19.536398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426645+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:10:02.426645+0000","last_peered":"2024-03-23T06:10:02.426645+0000","last_clean":"2024-03-23T06:10:02.426645+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:10:02.426645+0000","last_undegraded":"2024-03-23T06:10:02.426645+0000","last_fullsized":"2024-03-23T06:10:02.426645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951611+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:10:01.951611+0000","last_peered":"2024-03-23T06:10:01.951611+0000","last_clean":"2024-03-23T06:10:01.951611+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:10:01.951611+0000","last_undegraded":"2024-03-23T06:10:01.951611+0000","last_fullsized":"2024-03-23T06:10:01.951611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.933436+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:10:02.933436+0000","last_peered":"2024-03-23T06:10:02.933436+0000","last_clean":"2024-03-23T06:10:02.933436+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:10:02.933436+0000","last_undegraded":"2024-03-23T06:10:02.933436+0000","last_fullsized":"2024-03-23T06:10:02.933436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.981424+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:10:01.981424+0000","last_peered":"2024-03-23T06:10:01.981424+0000","last_clean":"2024-03-23T06:10:01.981424+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:10:01.981424+0000","last_undegraded":"2024-03-23T06:10:01.981424+0000","last_fullsized":"2024-03-23T06:10:01.981424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948637+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:10:01.948637+0000","last_peered":"2024-03-23T06:10:01.948637+0000","last_clean":"2024-03-23T06:10:01.948637+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:10:01.948637+0000","last_undegraded":"2024-03-23T06:10:01.948637+0000","last_fullsized":"2024-03-23T06:10:01.948637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955501+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:10:01.955501+0000","last_peered":"2024-03-23T06:10:01.955501+0000","last_clean":"2024-03-23T06:10:01.955501+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:10:01.955501+0000","last_undegraded":"2024-03-23T06:10:01.955501+0000","last_fullsized":"2024-03-23T06:10:01.955501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929041+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:10:02.929041+0000","last_peered":"2024-03-23T06:10:02.929041+0000","last_clean":"2024-03-23T06:10:02.929041+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:10:02.929041+0000","last_undegraded":"2024-03-23T06:10:02.929041+0000","last_fullsized":"2024-03-23T06:10:02.929041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961066+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:10:01.961066+0000","last_peered":"2024-03-23T06:10:01.961066+0000","last_clean":"2024-03-23T06:10:01.961066+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:10:01.961066+0000","last_undegraded":"2024-03-23T06:10:01.961066+0000","last_fullsized":"2024-03-23T06:10:01.961066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960584+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:10:01.960584+0000","last_peered":"2024-03-23T06:10:01.960584+0000","last_clean":"2024-03-23T06:10:01.960584+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:10:01.960584+0000","last_undegraded":"2024-03-23T06:10:01.960584+0000","last_fullsized":"2024-03-23T06:10:01.960584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427056+0000","last_change":"2024-03-23T06:10:01.963116+0000","last_active":"2024-03-23T06:10:02.427056+0000","last_peered":"2024-03-23T06:10:02.427056+0000","last_clean":"2024-03-23T06:10:02.427056+0000","last_became_active":"2024-03-23T06:10:01.962746+0000","last_became_peered":"2024-03-23T06:10:01.962746+0000","last_unstale":"2024-03-23T06:10:02.427056+0000","last_undegraded":"2024-03-23T06:10:02.427056+0000","last_fullsized":"2024-03-23T06:10:02.427056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:51:03.948467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427647+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:10:02.427647+0000","last_peered":"2024-03-23T06:10:02.427647+0000","last_clean":"2024-03-23T06:10:02.427647+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:10:02.427647+0000","last_undegraded":"2024-03-23T06:10:02.427647+0000","last_fullsized":"2024-03-23T06:10:02.427647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938885+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:10:01.938885+0000","last_peered":"2024-03-23T06:10:01.938885+0000","last_clean":"2024-03-23T06:10:01.938885+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:10:01.938885+0000","last_undegraded":"2024-03-23T06:10:01.938885+0000","last_fullsized":"2024-03-23T06:10:01.938885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.950111+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:10:01.950111+0000","last_peered":"2024-03-23T06:10:01.950111+0000","last_clean":"2024-03-23T06:10:01.950111+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:10:01.950111+0000","last_undegraded":"2024-03-23T06:10:01.950111+0000","last_fullsized":"2024-03-23T06:10:01.950111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982125+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:10:01.982125+0000","last_peered":"2024-03-23T06:10:01.982125+0000","last_clean":"2024-03-23T06:10:01.982125+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:10:01.982125+0000","last_undegraded":"2024-03-23T06:10:01.982125+0000","last_fullsized":"2024-03-23T06:10:01.982125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947907+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:10:01.947907+0000","last_peered":"2024-03-23T06:10:01.947907+0000","last_clean":"2024-03-23T06:10:01.947907+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:10:01.947907+0000","last_undegraded":"2024-03-23T06:10:01.947907+0000","last_fullsized":"2024-03-23T06:10:01.947907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936901+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:10:01.936901+0000","last_peered":"2024-03-23T06:10:01.936901+0000","last_clean":"2024-03-23T06:10:01.936901+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:10:01.936901+0000","last_undegraded":"2024-03-23T06:10:01.936901+0000","last_fullsized":"2024-03-23T06:10:01.936901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.428499+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:10:02.428499+0000","last_peered":"2024-03-23T06:10:02.428499+0000","last_clean":"2024-03-23T06:10:02.428499+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:10:02.428499+0000","last_undegraded":"2024-03-23T06:10:02.428499+0000","last_fullsized":"2024-03-23T06:10:02.428499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936867+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:10:01.936867+0000","last_peered":"2024-03-23T06:10:01.936867+0000","last_clean":"2024-03-23T06:10:01.936867+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:10:01.936867+0000","last_undegraded":"2024-03-23T06:10:01.936867+0000","last_fullsized":"2024-03-23T06:10:01.936867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427526+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:10:02.427526+0000","last_peered":"2024-03-23T06:10:02.427526+0000","last_clean":"2024-03-23T06:10:02.427526+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:10:02.427526+0000","last_undegraded":"2024-03-23T06:10:02.427526+0000","last_fullsized":"2024-03-23T06:10:02.427526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.928596+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:10:02.928596+0000","last_peered":"2024-03-23T06:10:02.928596+0000","last_clean":"2024-03-23T06:10:02.928596+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:10:02.928596+0000","last_undegraded":"2024-03-23T06:10:02.928596+0000","last_fullsized":"2024-03-23T06:10:02.928596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959100+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:10:01.959100+0000","last_peered":"2024-03-23T06:10:01.959100+0000","last_clean":"2024-03-23T06:10:01.959100+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:10:01.959100+0000","last_undegraded":"2024-03-23T06:10:01.959100+0000","last_fullsized":"2024-03-23T06:10:01.959100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929722+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:10:02.929722+0000","last_peered":"2024-03-23T06:10:02.929722+0000","last_clean":"2024-03-23T06:10:02.929722+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:10:02.929722+0000","last_undegraded":"2024-03-23T06:10:02.929722+0000","last_fullsized":"2024-03-23T06:10:02.929722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960026+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:10:01.960026+0000","last_peered":"2024-03-23T06:10:01.960026+0000","last_clean":"2024-03-23T06:10:01.960026+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:10:01.960026+0000","last_undegraded":"2024-03-23T06:10:01.960026+0000","last_fullsized":"2024-03-23T06:10:01.960026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944307+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:10:01.944307+0000","last_peered":"2024-03-23T06:10:01.944307+0000","last_clean":"2024-03-23T06:10:01.944307+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:10:01.944307+0000","last_undegraded":"2024-03-23T06:10:01.944307+0000","last_fullsized":"2024-03-23T06:10:01.944307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951291+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:10:01.951291+0000","last_peered":"2024-03-23T06:10:01.951291+0000","last_clean":"2024-03-23T06:10:01.951291+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:10:01.951291+0000","last_undegraded":"2024-03-23T06:10:01.951291+0000","last_fullsized":"2024-03-23T06:10:01.951291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947547+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:10:01.947547+0000","last_peered":"2024-03-23T06:10:01.947547+0000","last_clean":"2024-03-23T06:10:01.947547+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:10:01.947547+0000","last_undegraded":"2024-03-23T06:10:01.947547+0000","last_fullsized":"2024-03-23T06:10:01.947547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938289+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:10:01.938289+0000","last_peered":"2024-03-23T06:10:01.938289+0000","last_clean":"2024-03-23T06:10:01.938289+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:10:01.938289+0000","last_undegraded":"2024-03-23T06:10:01.938289+0000","last_fullsized":"2024-03-23T06:10:01.938289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938341+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:10:01.938341+0000","last_peered":"2024-03-23T06:10:01.938341+0000","last_clean":"2024-03-23T06:10:01.938341+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:10:01.938341+0000","last_undegraded":"2024-03-23T06:10:01.938341+0000","last_fullsized":"2024-03-23T06:10:01.938341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960989+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:10:01.960989+0000","last_peered":"2024-03-23T06:10:01.960989+0000","last_clean":"2024-03-23T06:10:01.960989+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:10:01.960989+0000","last_undegraded":"2024-03-23T06:10:01.960989+0000","last_fullsized":"2024-03-23T06:10:01.960989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948453+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:01.948453+0000","last_peered":"2024-03-23T06:10:01.948453+0000","last_clean":"2024-03-23T06:10:01.948453+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:10:01.948453+0000","last_undegraded":"2024-03-23T06:10:01.948453+0000","last_fullsized":"2024-03-23T06:10:01.948453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951149+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:10:01.951149+0000","last_peered":"2024-03-23T06:10:01.951149+0000","last_clean":"2024-03-23T06:10:01.951149+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:10:01.951149+0000","last_undegraded":"2024-03-23T06:10:01.951149+0000","last_fullsized":"2024-03-23T06:10:01.951149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947028+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:10:01.947028+0000","last_peered":"2024-03-23T06:10:01.947028+0000","last_clean":"2024-03-23T06:10:01.947028+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:01.947028+0000","last_undegraded":"2024-03-23T06:10:01.947028+0000","last_fullsized":"2024-03-23T06:10:01.947028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959084+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:10:01.959084+0000","last_peered":"2024-03-23T06:10:01.959084+0000","last_clean":"2024-03-23T06:10:01.959084+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:10:01.959084+0000","last_undegraded":"2024-03-23T06:10:01.959084+0000","last_fullsized":"2024-03-23T06:10:01.959084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936782+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:10:01.936782+0000","last_peered":"2024-03-23T06:10:01.936782+0000","last_clean":"2024-03-23T06:10:01.936782+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:10:01.936782+0000","last_undegraded":"2024-03-23T06:10:01.936782+0000","last_fullsized":"2024-03-23T06:10:01.936782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958727+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:10:01.958727+0000","last_peered":"2024-03-23T06:10:01.958727+0000","last_clean":"2024-03-23T06:10:01.958727+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:10:01.958727+0000","last_undegraded":"2024-03-23T06:10:01.958727+0000","last_fullsized":"2024-03-23T06:10:01.958727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955979+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:10:01.955979+0000","last_peered":"2024-03-23T06:10:01.955979+0000","last_clean":"2024-03-23T06:10:01.955979+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:10:01.955979+0000","last_undegraded":"2024-03-23T06:10:01.955979+0000","last_fullsized":"2024-03-23T06:10:01.955979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.942778+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:10:01.942778+0000","last_peered":"2024-03-23T06:10:01.942778+0000","last_clean":"2024-03-23T06:10:01.942778+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:10:01.942778+0000","last_undegraded":"2024-03-23T06:10:01.942778+0000","last_fullsized":"2024-03-23T06:10:01.942778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954107+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:10:01.954107+0000","last_peered":"2024-03-23T06:10:01.954107+0000","last_clean":"2024-03-23T06:10:01.954107+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:10:01.954107+0000","last_undegraded":"2024-03-23T06:10:01.954107+0000","last_fullsized":"2024-03-23T06:10:01.954107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947698+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:01.947698+0000","last_peered":"2024-03-23T06:10:01.947698+0000","last_clean":"2024-03-23T06:10:01.947698+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:10:01.947698+0000","last_undegraded":"2024-03-23T06:10:01.947698+0000","last_fullsized":"2024-03-23T06:10:01.947698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946933+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:10:01.946933+0000","last_peered":"2024-03-23T06:10:01.946933+0000","last_clean":"2024-03-23T06:10:01.946933+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:10:01.946933+0000","last_undegraded":"2024-03-23T06:10:01.946933+0000","last_fullsized":"2024-03-23T06:10:01.946933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.937864+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:10:01.937864+0000","last_peered":"2024-03-23T06:10:01.937864+0000","last_clean":"2024-03-23T06:10:01.937864+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:10:01.937864+0000","last_undegraded":"2024-03-23T06:10:01.937864+0000","last_fullsized":"2024-03-23T06:10:01.937864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938183+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:10:01.938183+0000","last_peered":"2024-03-23T06:10:01.938183+0000","last_clean":"2024-03-23T06:10:01.938183+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:10:01.938183+0000","last_undegraded":"2024-03-23T06:10:01.938183+0000","last_fullsized":"2024-03-23T06:10:01.938183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959302+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:10:01.959302+0000","last_peered":"2024-03-23T06:10:01.959302+0000","last_clean":"2024-03-23T06:10:01.959302+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:10:01.959302+0000","last_undegraded":"2024-03-23T06:10:01.959302+0000","last_fullsized":"2024-03-23T06:10:01.959302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960084+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:10:01.960084+0000","last_peered":"2024-03-23T06:10:01.960084+0000","last_clean":"2024-03-23T06:10:01.960084+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:10:01.960084+0000","last_undegraded":"2024-03-23T06:10:01.960084+0000","last_fullsized":"2024-03-23T06:10:01.960084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955366+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:10:01.955366+0000","last_peered":"2024-03-23T06:10:01.955366+0000","last_clean":"2024-03-23T06:10:01.955366+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:10:01.955366+0000","last_undegraded":"2024-03-23T06:10:01.955366+0000","last_fullsized":"2024-03-23T06:10:01.955366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961295+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:10:01.961295+0000","last_peered":"2024-03-23T06:10:01.961295+0000","last_clean":"2024-03-23T06:10:01.961295+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:10:01.961295+0000","last_undegraded":"2024-03-23T06:10:01.961295+0000","last_fullsized":"2024-03-23T06:10:01.961295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947495+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:10:01.947495+0000","last_peered":"2024-03-23T06:10:01.947495+0000","last_clean":"2024-03-23T06:10:01.947495+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:10:01.947495+0000","last_undegraded":"2024-03-23T06:10:01.947495+0000","last_fullsized":"2024-03-23T06:10:01.947495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.957968+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:10:01.957968+0000","last_peered":"2024-03-23T06:10:01.957968+0000","last_clean":"2024-03-23T06:10:01.957968+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:10:01.957968+0000","last_undegraded":"2024-03-23T06:10:01.957968+0000","last_fullsized":"2024-03-23T06:10:01.957968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.970135+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:10:01.970135+0000","last_peered":"2024-03-23T06:10:01.970135+0000","last_clean":"2024-03-23T06:10:01.970135+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:10:01.970135+0000","last_undegraded":"2024-03-23T06:10:01.970135+0000","last_fullsized":"2024-03-23T06:10:01.970135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.957139+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:10:01.957139+0000","last_peered":"2024-03-23T06:10:01.957139+0000","last_clean":"2024-03-23T06:10:01.957139+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:10:01.957139+0000","last_undegraded":"2024-03-23T06:10:01.957139+0000","last_fullsized":"2024-03-23T06:10:01.957139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956477+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:10:01.956477+0000","last_peered":"2024-03-23T06:10:01.956477+0000","last_clean":"2024-03-23T06:10:01.956477+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:10:01.956477+0000","last_undegraded":"2024-03-23T06:10:01.956477+0000","last_fullsized":"2024-03-23T06:10:01.956477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947435+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:10:01.947435+0000","last_peered":"2024-03-23T06:10:01.947435+0000","last_clean":"2024-03-23T06:10:01.947435+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:10:01.947435+0000","last_undegraded":"2024-03-23T06:10:01.947435+0000","last_fullsized":"2024-03-23T06:10:01.947435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948381+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:10:01.948381+0000","last_peered":"2024-03-23T06:10:01.948381+0000","last_clean":"2024-03-23T06:10:01.948381+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:10:01.948381+0000","last_undegraded":"2024-03-23T06:10:01.948381+0000","last_fullsized":"2024-03-23T06:10:01.948381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955839+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:10:01.955839+0000","last_peered":"2024-03-23T06:10:01.955839+0000","last_clean":"2024-03-23T06:10:01.955839+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:10:01.955839+0000","last_undegraded":"2024-03-23T06:10:01.955839+0000","last_fullsized":"2024-03-23T06:10:01.955839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":103921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":693777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":270336,"data_stored":103463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":103339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":864256,"data_stored":693799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":282624,"data_stored":107806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:10:31.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:10:32.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.026+0000 7fa42ae00640 1 Processor -- start 2024-03-23T06:10:32.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.026+0000 7fa42ae00640 1 -- start start 2024-03-23T06:10:32.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.027+0000 7fa42ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241536a0 0x7fa4240ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.027+0000 7fa42ae00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4240cab20 con 0x7fa4241594f0 2024-03-23T06:10:32.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.027+0000 7fa42ae00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4241599a0 con 0x7fa424153a80 2024-03-23T06:10:32.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.027+0000 7fa42ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42415a520 con 0x7fa4241536a0 2024-03-23T06:10:32.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa428e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa4241594f0 0x7fa4240cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55134/0 (socket says 172.21.15.73:55134) 2024-03-23T06:10:32.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa428e00640 1 -- 172.21.15.73:0/3891317689 learned_addr learned my addr 172.21.15.73:0/3891317689 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:32.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa423e00640 1 --2- 172.21.15.73:0/3891317689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241536a0 0x7fa4240ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa422a00640 1 -- 172.21.15.73:0/3891317689 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090606540 0 0) 0x7fa4240cab20 con 0x7fa4241594f0 2024-03-23T06:10:32.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa422a00640 1 -- 172.21.15.73:0/3891317689 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa408003520 con 0x7fa4241594f0 2024-03-23T06:10:32.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa423e00640 1 -- 172.21.15.73:0/3891317689 >> v1:172.21.15.110:6789/0 conn(0x7fa424153a80 legacy=0x7fa4240cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa422a00640 1 -- 172.21.15.73:0/3891317689 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060017639 0 0) 0x7fa4241599a0 con 0x7fa424153a80 2024-03-23T06:10:32.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa423e00640 1 -- 172.21.15.73:0/3891317689 >> v1:172.21.15.73:6789/0 conn(0x7fa4241594f0 legacy=0x7fa4240cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.028+0000 7fa423e00640 1 -- 172.21.15.73:0/3891317689 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa424159c80 con 0x7fa4241536a0 2024-03-23T06:10:32.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.029+0000 7fa423e00640 1 --2- 172.21.15.73:0/3891317689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241536a0 0x7fa4240ca5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4140097d0 tx=0x7fa41402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=945737108265bff9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa422a00640 1 -- 172.21.15.73:0/3891317689 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414031890 con 0x7fa4241536a0 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa422a00640 1 -- 172.21.15.73:0/3891317689 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4140319f0 con 0x7fa4241536a0 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa422a00640 1 -- 172.21.15.73:0/3891317689 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414031d80 con 0x7fa4241536a0 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa42ae00640 1 -- 172.21.15.73:0/3891317689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241536a0 msgr2=0x7fa4240ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa42ae00640 1 --2- 172.21.15.73:0/3891317689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241536a0 0x7fa4240ca5e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa4140097d0 tx=0x7fa41402b930 comp rx=0 tx=0).stop 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa42ae00640 1 -- 172.21.15.73:0/3891317689 shutdown_connections 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa42ae00640 1 --2- 172.21.15.73:0/3891317689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241536a0 0x7fa4240ca5e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa42ae00640 1 -- 172.21.15.73:0/3891317689 >> 172.21.15.73:0/3891317689 conn(0x7fa42406a060 msgr2=0x7fa42406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa42ae00640 1 -- 172.21.15.73:0/3891317689 shutdown_connections 2024-03-23T06:10:32.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.030+0000 7fa42ae00640 1 -- 172.21.15.73:0/3891317689 wait complete. 2024-03-23T06:10:32.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.032+0000 7fa42ae00640 1 Processor -- start 2024-03-23T06:10:32.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.032+0000 7fa42ae00640 1 -- start start 2024-03-23T06:10:32.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa42ae00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241536a0 0x7fa4241489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa42ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa424153a80 0x7fa424149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa42ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241594f0 0x7fa424156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa42ae00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa424148000 con 0x7fa4241536a0 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa42ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42414a500 con 0x7fa424153a80 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa42ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4240ce7c0 con 0x7fa4241594f0 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa423e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241536a0 0x7fa4241489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa423e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241536a0 0x7fa4241489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34426/0 (socket says 172.21.15.73:34426) 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.033+0000 7fa423e00640 1 -- 172.21.15.73:0/2346798569 learned_addr learned my addr 172.21.15.73:0/2346798569 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa428e00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241594f0 0x7fa424156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa423400640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa424153a80 0x7fa424149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa423e00640 1 -- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241594f0 msgr2=0x7fa424156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa423e00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241594f0 0x7fa424156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa423e00640 1 -- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa424153a80 msgr2=0x7fa424149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa423e00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa424153a80 0x7fa424149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa423e00640 1 -- 172.21.15.73:0/2346798569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa414009400 con 0x7fa4241536a0 2024-03-23T06:10:32.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa423e00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241536a0 0x7fa4241489f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4140097d0 tx=0x7fa4140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa41be00640 1 -- 172.21.15.73:0/2346798569 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414004230 con 0x7fa4241536a0 2024-03-23T06:10:32.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa41be00640 1 -- 172.21.15.73:0/2346798569 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414004390 con 0x7fa4241536a0 2024-03-23T06:10:32.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa41be00640 1 -- 172.21.15.73:0/2346798569 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41403ba20 con 0x7fa4241536a0 2024-03-23T06:10:32.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.034+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa424147590 con 0x7fa4241536a0 2024-03-23T06:10:32.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.035+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa424147850 con 0x7fa4241536a0 2024-03-23T06:10:32.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.036+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa424152640 con 0x7fa4241536a0 2024-03-23T06:10:32.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.037+0000 7fa41be00640 1 -- 172.21.15.73:0/2346798569 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa414043070 con 0x7fa4241536a0 2024-03-23T06:10:32.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.037+0000 7fa41be00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa40406ac00 0x7fa40406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.037+0000 7fa41be00640 1 -- 172.21.15.73:0/2346798569 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4140ab6d0 con 0x7fa4241536a0 2024-03-23T06:10:32.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.038+0000 7fa423400640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa40406ac00 0x7fa40406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.038+0000 7fa423400640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa40406ac00 0x7fa40406d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa424155fa0 tx=0x7fa410009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.042+0000 7fa41be00640 1 -- 172.21.15.73:0/2346798569 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa414076790 con 0x7fa4241536a0 2024-03-23T06:10:32.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.224+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4240cb970 con 0x7fa40406ac00 2024-03-23T06:10:32.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.233+0000 7fa41be00640 1 -- 172.21.15.73:0/2346798569 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345220 (secure 0 0 0) 0x7fa41000f820 con 0x7fa40406ac00 2024-03-23T06:10:32.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:32.240 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.240+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa40406ac00 msgr2=0x7fa40406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa40406ac00 0x7fa40406d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa424155fa0 tx=0x7fa410009040 comp rx=0 tx=0).stop 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241536a0 msgr2=0x7fa4241489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241536a0 0x7fa4241489f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4140097d0 tx=0x7fa4140046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 shutdown_connections 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa40406ac00 0x7fa40406d0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4241594f0 0x7fa424156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa424153a80 0x7fa424149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 --2- 172.21.15.73:0/2346798569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4241536a0 0x7fa4241489f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 >> 172.21.15.73:0/2346798569 conn(0x7fa42406a060 msgr2=0x7fa424157e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 shutdown_connections 2024-03-23T06:10:32.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.241+0000 7fa42ae00640 1 -- 172.21.15.73:0/2346798569 wait complete. 2024-03-23T06:10:32.257 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-03-23T06:10:30.617209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":3350528,"data_stored":2016634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003528"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.938317+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:10:02.938317+0000","last_peered":"2024-03-23T06:10:02.938317+0000","last_clean":"2024-03-23T06:10:02.938317+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:10:02.938317+0000","last_undegraded":"2024-03-23T06:10:02.938317+0000","last_fullsized":"2024-03-23T06:10:02.938317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948197+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:10:01.948197+0000","last_peered":"2024-03-23T06:10:01.948197+0000","last_clean":"2024-03-23T06:10:01.948197+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:10:01.948197+0000","last_undegraded":"2024-03-23T06:10:01.948197+0000","last_fullsized":"2024-03-23T06:10:01.948197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929155+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:10:02.929155+0000","last_peered":"2024-03-23T06:10:02.929155+0000","last_clean":"2024-03-23T06:10:02.929155+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:10:02.929155+0000","last_undegraded":"2024-03-23T06:10:02.929155+0000","last_fullsized":"2024-03-23T06:10:02.929155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932040+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:10:02.932040+0000","last_peered":"2024-03-23T06:10:02.932040+0000","last_clean":"2024-03-23T06:10:02.932040+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:10:02.932040+0000","last_undegraded":"2024-03-23T06:10:02.932040+0000","last_fullsized":"2024-03-23T06:10:02.932040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948557+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:10:01.948557+0000","last_peered":"2024-03-23T06:10:01.948557+0000","last_clean":"2024-03-23T06:10:01.948557+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:10:01.948557+0000","last_undegraded":"2024-03-23T06:10:01.948557+0000","last_fullsized":"2024-03-23T06:10:01.948557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.979095+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:10:01.979095+0000","last_peered":"2024-03-23T06:10:01.979095+0000","last_clean":"2024-03-23T06:10:01.979095+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:10:01.979095+0000","last_undegraded":"2024-03-23T06:10:01.979095+0000","last_fullsized":"2024-03-23T06:10:01.979095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932874+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:10:02.932874+0000","last_peered":"2024-03-23T06:10:02.932874+0000","last_clean":"2024-03-23T06:10:02.932874+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:10:02.932874+0000","last_undegraded":"2024-03-23T06:10:02.932874+0000","last_fullsized":"2024-03-23T06:10:02.932874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960659+0000","last_change":"2024-03-23T06:09:57.945661+0000","last_active":"2024-03-23T06:10:01.960659+0000","last_peered":"2024-03-23T06:10:01.960659+0000","last_clean":"2024-03-23T06:10:01.960659+0000","last_became_active":"2024-03-23T06:09:57.945374+0000","last_became_peered":"2024-03-23T06:09:57.945374+0000","last_unstale":"2024-03-23T06:10:01.960659+0000","last_undegraded":"2024-03-23T06:10:01.960659+0000","last_fullsized":"2024-03-23T06:10:01.960659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:20:55.180098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.981444+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:10:01.981444+0000","last_peered":"2024-03-23T06:10:01.981444+0000","last_clean":"2024-03-23T06:10:01.981444+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:10:01.981444+0000","last_undegraded":"2024-03-23T06:10:01.981444+0000","last_fullsized":"2024-03-23T06:10:01.981444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.936447+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:10:02.936447+0000","last_peered":"2024-03-23T06:10:02.936447+0000","last_clean":"2024-03-23T06:10:02.936447+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:10:02.936447+0000","last_undegraded":"2024-03-23T06:10:02.936447+0000","last_fullsized":"2024-03-23T06:10:02.936447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956142+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:10:01.956142+0000","last_peered":"2024-03-23T06:10:01.956142+0000","last_clean":"2024-03-23T06:10:01.956142+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:10:01.956142+0000","last_undegraded":"2024-03-23T06:10:01.956142+0000","last_fullsized":"2024-03-23T06:10:01.956142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.986981+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:10:01.986981+0000","last_peered":"2024-03-23T06:10:01.986981+0000","last_clean":"2024-03-23T06:10:01.986981+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:10:01.986981+0000","last_undegraded":"2024-03-23T06:10:01.986981+0000","last_fullsized":"2024-03-23T06:10:01.986981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947842+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:10:01.947842+0000","last_peered":"2024-03-23T06:10:01.947842+0000","last_clean":"2024-03-23T06:10:01.947842+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:10:01.947842+0000","last_undegraded":"2024-03-23T06:10:01.947842+0000","last_fullsized":"2024-03-23T06:10:01.947842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.937883+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:10:02.937883+0000","last_peered":"2024-03-23T06:10:02.937883+0000","last_clean":"2024-03-23T06:10:02.937883+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:10:02.937883+0000","last_undegraded":"2024-03-23T06:10:02.937883+0000","last_fullsized":"2024-03-23T06:10:02.937883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.977132+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:10:01.977132+0000","last_peered":"2024-03-23T06:10:01.977132+0000","last_clean":"2024-03-23T06:10:01.977132+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:10:01.977132+0000","last_undegraded":"2024-03-23T06:10:01.977132+0000","last_fullsized":"2024-03-23T06:10:01.977132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944424+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:10:01.944424+0000","last_peered":"2024-03-23T06:10:01.944424+0000","last_clean":"2024-03-23T06:10:01.944424+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:10:01.944424+0000","last_undegraded":"2024-03-23T06:10:01.944424+0000","last_fullsized":"2024-03-23T06:10:01.944424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938236+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:10:01.938236+0000","last_peered":"2024-03-23T06:10:01.938236+0000","last_clean":"2024-03-23T06:10:01.938236+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:10:01.938236+0000","last_undegraded":"2024-03-23T06:10:01.938236+0000","last_fullsized":"2024-03-23T06:10:01.938236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.974726+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:10:01.974726+0000","last_peered":"2024-03-23T06:10:01.974726+0000","last_clean":"2024-03-23T06:10:01.974726+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:10:01.974726+0000","last_undegraded":"2024-03-23T06:10:01.974726+0000","last_fullsized":"2024-03-23T06:10:01.974726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938551+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:10:01.938551+0000","last_peered":"2024-03-23T06:10:01.938551+0000","last_clean":"2024-03-23T06:10:01.938551+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:10:01.938551+0000","last_undegraded":"2024-03-23T06:10:01.938551+0000","last_fullsized":"2024-03-23T06:10:01.938551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938930+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:10:01.938930+0000","last_peered":"2024-03-23T06:10:01.938930+0000","last_clean":"2024-03-23T06:10:01.938930+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:10:01.938930+0000","last_undegraded":"2024-03-23T06:10:01.938930+0000","last_fullsized":"2024-03-23T06:10:01.938930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930440+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:10:02.930440+0000","last_peered":"2024-03-23T06:10:02.930440+0000","last_clean":"2024-03-23T06:10:02.930440+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:10:02.930440+0000","last_undegraded":"2024-03-23T06:10:02.930440+0000","last_fullsized":"2024-03-23T06:10:02.930440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946405+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:10:01.946405+0000","last_peered":"2024-03-23T06:10:01.946405+0000","last_clean":"2024-03-23T06:10:01.946405+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:10:01.946405+0000","last_undegraded":"2024-03-23T06:10:01.946405+0000","last_fullsized":"2024-03-23T06:10:01.946405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956205+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:10:01.956205+0000","last_peered":"2024-03-23T06:10:01.956205+0000","last_clean":"2024-03-23T06:10:01.956205+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:10:01.956205+0000","last_undegraded":"2024-03-23T06:10:01.956205+0000","last_fullsized":"2024-03-23T06:10:01.956205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982640+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:10:01.982640+0000","last_peered":"2024-03-23T06:10:01.982640+0000","last_clean":"2024-03-23T06:10:01.982640+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:10:01.982640+0000","last_undegraded":"2024-03-23T06:10:01.982640+0000","last_fullsized":"2024-03-23T06:10:01.982640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938356+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:10:01.938356+0000","last_peered":"2024-03-23T06:10:01.938356+0000","last_clean":"2024-03-23T06:10:01.938356+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:10:01.938356+0000","last_undegraded":"2024-03-23T06:10:01.938356+0000","last_fullsized":"2024-03-23T06:10:01.938356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.936241+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:10:02.936241+0000","last_peered":"2024-03-23T06:10:02.936241+0000","last_clean":"2024-03-23T06:10:02.936241+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:10:02.936241+0000","last_undegraded":"2024-03-23T06:10:02.936241+0000","last_fullsized":"2024-03-23T06:10:02.936241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982776+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:10:01.982776+0000","last_peered":"2024-03-23T06:10:01.982776+0000","last_clean":"2024-03-23T06:10:01.982776+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:10:01.982776+0000","last_undegraded":"2024-03-23T06:10:01.982776+0000","last_fullsized":"2024-03-23T06:10:01.982776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936925+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:10:01.936925+0000","last_peered":"2024-03-23T06:10:01.936925+0000","last_clean":"2024-03-23T06:10:01.936925+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:10:01.936925+0000","last_undegraded":"2024-03-23T06:10:01.936925+0000","last_fullsized":"2024-03-23T06:10:01.936925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427809+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:10:02.427809+0000","last_peered":"2024-03-23T06:10:02.427809+0000","last_clean":"2024-03-23T06:10:02.427809+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:10:02.427809+0000","last_undegraded":"2024-03-23T06:10:02.427809+0000","last_fullsized":"2024-03-23T06:10:02.427809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427188+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:10:02.427188+0000","last_peered":"2024-03-23T06:10:02.427188+0000","last_clean":"2024-03-23T06:10:02.427188+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:10:02.427188+0000","last_undegraded":"2024-03-23T06:10:02.427188+0000","last_fullsized":"2024-03-23T06:10:02.427188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938375+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:10:01.938375+0000","last_peered":"2024-03-23T06:10:01.938375+0000","last_clean":"2024-03-23T06:10:01.938375+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:10:01.938375+0000","last_undegraded":"2024-03-23T06:10:01.938375+0000","last_fullsized":"2024-03-23T06:10:01.938375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956068+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:10:01.956068+0000","last_peered":"2024-03-23T06:10:01.956068+0000","last_clean":"2024-03-23T06:10:01.956068+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:10:01.956068+0000","last_undegraded":"2024-03-23T06:10:01.956068+0000","last_fullsized":"2024-03-23T06:10:01.956068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426879+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:10:02.426879+0000","last_peered":"2024-03-23T06:10:02.426879+0000","last_clean":"2024-03-23T06:10:02.426879+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:10:02.426879+0000","last_undegraded":"2024-03-23T06:10:02.426879+0000","last_fullsized":"2024-03-23T06:10:02.426879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.962945+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:10:01.962945+0000","last_peered":"2024-03-23T06:10:01.962945+0000","last_clean":"2024-03-23T06:10:01.962945+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:10:01.962945+0000","last_undegraded":"2024-03-23T06:10:01.962945+0000","last_fullsized":"2024-03-23T06:10:01.962945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947204+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:10:01.947204+0000","last_peered":"2024-03-23T06:10:01.947204+0000","last_clean":"2024-03-23T06:10:01.947204+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:10:01.947204+0000","last_undegraded":"2024-03-23T06:10:01.947204+0000","last_fullsized":"2024-03-23T06:10:01.947204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426681+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:10:02.426681+0000","last_peered":"2024-03-23T06:10:02.426681+0000","last_clean":"2024-03-23T06:10:02.426681+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:10:02.426681+0000","last_undegraded":"2024-03-23T06:10:02.426681+0000","last_fullsized":"2024-03-23T06:10:02.426681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956957+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:10:01.956957+0000","last_peered":"2024-03-23T06:10:01.956957+0000","last_clean":"2024-03-23T06:10:01.956957+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:10:01.956957+0000","last_undegraded":"2024-03-23T06:10:01.956957+0000","last_fullsized":"2024-03-23T06:10:01.956957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951233+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:10:01.951233+0000","last_peered":"2024-03-23T06:10:01.951233+0000","last_clean":"2024-03-23T06:10:01.951233+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:10:01.951233+0000","last_undegraded":"2024-03-23T06:10:01.951233+0000","last_fullsized":"2024-03-23T06:10:01.951233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427177+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:10:02.427177+0000","last_peered":"2024-03-23T06:10:02.427177+0000","last_clean":"2024-03-23T06:10:02.427177+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:10:02.427177+0000","last_undegraded":"2024-03-23T06:10:02.427177+0000","last_fullsized":"2024-03-23T06:10:02.427177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947571+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:10:01.947571+0000","last_peered":"2024-03-23T06:10:01.947571+0000","last_clean":"2024-03-23T06:10:01.947571+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:10:01.947571+0000","last_undegraded":"2024-03-23T06:10:01.947571+0000","last_fullsized":"2024-03-23T06:10:01.947571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944396+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:10:01.944396+0000","last_peered":"2024-03-23T06:10:01.944396+0000","last_clean":"2024-03-23T06:10:01.944396+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:10:01.944396+0000","last_undegraded":"2024-03-23T06:10:01.944396+0000","last_fullsized":"2024-03-23T06:10:01.944396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427599+0000","last_change":"2024-03-23T06:10:01.967435+0000","last_active":"2024-03-23T06:10:02.427599+0000","last_peered":"2024-03-23T06:10:02.427599+0000","last_clean":"2024-03-23T06:10:02.427599+0000","last_became_active":"2024-03-23T06:10:01.967059+0000","last_became_peered":"2024-03-23T06:10:01.967059+0000","last_unstale":"2024-03-23T06:10:02.427599+0000","last_undegraded":"2024-03-23T06:10:02.427599+0000","last_fullsized":"2024-03-23T06:10:02.427599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:51:56.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936633+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:10:01.936633+0000","last_peered":"2024-03-23T06:10:01.936633+0000","last_clean":"2024-03-23T06:10:01.936633+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:01.936633+0000","last_undegraded":"2024-03-23T06:10:01.936633+0000","last_fullsized":"2024-03-23T06:10:01.936633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.950342+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:10:01.950342+0000","last_peered":"2024-03-23T06:10:01.950342+0000","last_clean":"2024-03-23T06:10:01.950342+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:10:01.950342+0000","last_undegraded":"2024-03-23T06:10:01.950342+0000","last_fullsized":"2024-03-23T06:10:01.950342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931695+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:10:02.931695+0000","last_peered":"2024-03-23T06:10:02.931695+0000","last_clean":"2024-03-23T06:10:02.931695+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:10:02.931695+0000","last_undegraded":"2024-03-23T06:10:02.931695+0000","last_fullsized":"2024-03-23T06:10:02.931695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938499+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:10:01.938499+0000","last_peered":"2024-03-23T06:10:01.938499+0000","last_clean":"2024-03-23T06:10:01.938499+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:10:01.938499+0000","last_undegraded":"2024-03-23T06:10:01.938499+0000","last_fullsized":"2024-03-23T06:10:01.938499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954702+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:10:01.954702+0000","last_peered":"2024-03-23T06:10:01.954702+0000","last_clean":"2024-03-23T06:10:01.954702+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:10:01.954702+0000","last_undegraded":"2024-03-23T06:10:01.954702+0000","last_fullsized":"2024-03-23T06:10:01.954702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955598+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:10:01.955598+0000","last_peered":"2024-03-23T06:10:01.955598+0000","last_clean":"2024-03-23T06:10:01.955598+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:10:01.955598+0000","last_undegraded":"2024-03-23T06:10:01.955598+0000","last_fullsized":"2024-03-23T06:10:01.955598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982185+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:10:01.982185+0000","last_peered":"2024-03-23T06:10:01.982185+0000","last_clean":"2024-03-23T06:10:01.982185+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:10:01.982185+0000","last_undegraded":"2024-03-23T06:10:01.982185+0000","last_fullsized":"2024-03-23T06:10:01.982185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955865+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:10:01.955865+0000","last_peered":"2024-03-23T06:10:01.955865+0000","last_clean":"2024-03-23T06:10:01.955865+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:10:01.955865+0000","last_undegraded":"2024-03-23T06:10:01.955865+0000","last_fullsized":"2024-03-23T06:10:01.955865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938453+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:10:01.938453+0000","last_peered":"2024-03-23T06:10:01.938453+0000","last_clean":"2024-03-23T06:10:01.938453+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:10:01.938453+0000","last_undegraded":"2024-03-23T06:10:01.938453+0000","last_fullsized":"2024-03-23T06:10:01.938453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.980947+0000","last_change":"2024-03-23T06:10:01.975352+0000","last_active":"2024-03-23T06:10:01.980947+0000","last_peered":"2024-03-23T06:10:01.980947+0000","last_clean":"2024-03-23T06:10:01.980947+0000","last_became_active":"2024-03-23T06:10:01.974177+0000","last_became_peered":"2024-03-23T06:10:01.974177+0000","last_unstale":"2024-03-23T06:10:01.980947+0000","last_undegraded":"2024-03-23T06:10:01.980947+0000","last_fullsized":"2024-03-23T06:10:01.980947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:33.405804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958813+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:10:01.958813+0000","last_peered":"2024-03-23T06:10:01.958813+0000","last_clean":"2024-03-23T06:10:01.958813+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:10:01.958813+0000","last_undegraded":"2024-03-23T06:10:01.958813+0000","last_fullsized":"2024-03-23T06:10:01.958813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931676+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:10:02.931676+0000","last_peered":"2024-03-23T06:10:02.931676+0000","last_clean":"2024-03-23T06:10:02.931676+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:10:02.931676+0000","last_undegraded":"2024-03-23T06:10:02.931676+0000","last_fullsized":"2024-03-23T06:10:02.931676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930842+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:10:02.930842+0000","last_peered":"2024-03-23T06:10:02.930842+0000","last_clean":"2024-03-23T06:10:02.930842+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:10:02.930842+0000","last_undegraded":"2024-03-23T06:10:02.930842+0000","last_fullsized":"2024-03-23T06:10:02.930842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955953+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:10:01.955953+0000","last_peered":"2024-03-23T06:10:01.955953+0000","last_clean":"2024-03-23T06:10:01.955953+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:10:01.955953+0000","last_undegraded":"2024-03-23T06:10:01.955953+0000","last_fullsized":"2024-03-23T06:10:01.955953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930322+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:10:02.930322+0000","last_peered":"2024-03-23T06:10:02.930322+0000","last_clean":"2024-03-23T06:10:02.930322+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:10:02.930322+0000","last_undegraded":"2024-03-23T06:10:02.930322+0000","last_fullsized":"2024-03-23T06:10:02.930322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.978341+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:10:01.978341+0000","last_peered":"2024-03-23T06:10:01.978341+0000","last_clean":"2024-03-23T06:10:01.978341+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:10:01.978341+0000","last_undegraded":"2024-03-23T06:10:01.978341+0000","last_fullsized":"2024-03-23T06:10:01.978341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961138+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:10:01.961138+0000","last_peered":"2024-03-23T06:10:01.961138+0000","last_clean":"2024-03-23T06:10:01.961138+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:10:01.961138+0000","last_undegraded":"2024-03-23T06:10:01.961138+0000","last_fullsized":"2024-03-23T06:10:01.961138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932726+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:10:02.932726+0000","last_peered":"2024-03-23T06:10:02.932726+0000","last_clean":"2024-03-23T06:10:02.932726+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:10:02.932726+0000","last_undegraded":"2024-03-23T06:10:02.932726+0000","last_fullsized":"2024-03-23T06:10:02.932726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.987273+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:10:01.987273+0000","last_peered":"2024-03-23T06:10:01.987273+0000","last_clean":"2024-03-23T06:10:01.987273+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:10:01.987273+0000","last_undegraded":"2024-03-23T06:10:01.987273+0000","last_fullsized":"2024-03-23T06:10:01.987273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946483+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:10:01.946483+0000","last_peered":"2024-03-23T06:10:01.946483+0000","last_clean":"2024-03-23T06:10:01.946483+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:10:01.946483+0000","last_undegraded":"2024-03-23T06:10:01.946483+0000","last_fullsized":"2024-03-23T06:10:01.946483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.933010+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:10:02.933010+0000","last_peered":"2024-03-23T06:10:02.933010+0000","last_clean":"2024-03-23T06:10:02.933010+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:10:02.933010+0000","last_undegraded":"2024-03-23T06:10:02.933010+0000","last_fullsized":"2024-03-23T06:10:02.933010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931833+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:10:02.931833+0000","last_peered":"2024-03-23T06:10:02.931833+0000","last_clean":"2024-03-23T06:10:02.931833+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:10:02.931833+0000","last_undegraded":"2024-03-23T06:10:02.931833+0000","last_fullsized":"2024-03-23T06:10:02.931833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955456+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:10:01.955456+0000","last_peered":"2024-03-23T06:10:01.955456+0000","last_clean":"2024-03-23T06:10:01.955456+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:10:01.955456+0000","last_undegraded":"2024-03-23T06:10:01.955456+0000","last_fullsized":"2024-03-23T06:10:01.955456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958080+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:10:01.958080+0000","last_peered":"2024-03-23T06:10:01.958080+0000","last_clean":"2024-03-23T06:10:01.958080+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:10:01.958080+0000","last_undegraded":"2024-03-23T06:10:01.958080+0000","last_fullsized":"2024-03-23T06:10:01.958080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931864+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:10:02.931864+0000","last_peered":"2024-03-23T06:10:02.931864+0000","last_clean":"2024-03-23T06:10:02.931864+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:10:02.931864+0000","last_undegraded":"2024-03-23T06:10:02.931864+0000","last_fullsized":"2024-03-23T06:10:02.931864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954582+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:10:01.954582+0000","last_peered":"2024-03-23T06:10:01.954582+0000","last_clean":"2024-03-23T06:10:01.954582+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:10:01.954582+0000","last_undegraded":"2024-03-23T06:10:01.954582+0000","last_fullsized":"2024-03-23T06:10:01.954582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951101+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:10:01.951101+0000","last_peered":"2024-03-23T06:10:01.951101+0000","last_clean":"2024-03-23T06:10:01.951101+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:10:01.951101+0000","last_undegraded":"2024-03-23T06:10:01.951101+0000","last_fullsized":"2024-03-23T06:10:01.951101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427019+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:10:02.427019+0000","last_peered":"2024-03-23T06:10:02.427019+0000","last_clean":"2024-03-23T06:10:02.427019+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:10:02.427019+0000","last_undegraded":"2024-03-23T06:10:02.427019+0000","last_fullsized":"2024-03-23T06:10:02.427019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.937969+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:10:01.937969+0000","last_peered":"2024-03-23T06:10:01.937969+0000","last_clean":"2024-03-23T06:10:01.937969+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:10:01.937969+0000","last_undegraded":"2024-03-23T06:10:01.937969+0000","last_fullsized":"2024-03-23T06:10:01.937969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.936244+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:10:02.936244+0000","last_peered":"2024-03-23T06:10:02.936244+0000","last_clean":"2024-03-23T06:10:02.936244+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:10:02.936244+0000","last_undegraded":"2024-03-23T06:10:02.936244+0000","last_fullsized":"2024-03-23T06:10:02.936244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.977106+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:10:01.977106+0000","last_peered":"2024-03-23T06:10:01.977106+0000","last_clean":"2024-03-23T06:10:01.977106+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:10:01.977106+0000","last_undegraded":"2024-03-23T06:10:01.977106+0000","last_fullsized":"2024-03-23T06:10:01.977106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960157+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:10:01.960157+0000","last_peered":"2024-03-23T06:10:01.960157+0000","last_clean":"2024-03-23T06:10:01.960157+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:10:01.960157+0000","last_undegraded":"2024-03-23T06:10:01.960157+0000","last_fullsized":"2024-03-23T06:10:01.960157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:19.536398+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:10:19.536398+0000","last_peered":"2024-03-23T06:10:19.536398+0000","last_clean":"2024-03-23T06:10:19.536398+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:10:19.536398+0000","last_undegraded":"2024-03-23T06:10:19.536398+0000","last_fullsized":"2024-03-23T06:10:19.536398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426645+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:10:02.426645+0000","last_peered":"2024-03-23T06:10:02.426645+0000","last_clean":"2024-03-23T06:10:02.426645+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:10:02.426645+0000","last_undegraded":"2024-03-23T06:10:02.426645+0000","last_fullsized":"2024-03-23T06:10:02.426645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951611+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:10:01.951611+0000","last_peered":"2024-03-23T06:10:01.951611+0000","last_clean":"2024-03-23T06:10:01.951611+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:10:01.951611+0000","last_undegraded":"2024-03-23T06:10:01.951611+0000","last_fullsized":"2024-03-23T06:10:01.951611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.933436+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:10:02.933436+0000","last_peered":"2024-03-23T06:10:02.933436+0000","last_clean":"2024-03-23T06:10:02.933436+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:10:02.933436+0000","last_undegraded":"2024-03-23T06:10:02.933436+0000","last_fullsized":"2024-03-23T06:10:02.933436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.981424+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:10:01.981424+0000","last_peered":"2024-03-23T06:10:01.981424+0000","last_clean":"2024-03-23T06:10:01.981424+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:10:01.981424+0000","last_undegraded":"2024-03-23T06:10:01.981424+0000","last_fullsized":"2024-03-23T06:10:01.981424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948637+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:10:01.948637+0000","last_peered":"2024-03-23T06:10:01.948637+0000","last_clean":"2024-03-23T06:10:01.948637+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:10:01.948637+0000","last_undegraded":"2024-03-23T06:10:01.948637+0000","last_fullsized":"2024-03-23T06:10:01.948637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955501+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:10:01.955501+0000","last_peered":"2024-03-23T06:10:01.955501+0000","last_clean":"2024-03-23T06:10:01.955501+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:10:01.955501+0000","last_undegraded":"2024-03-23T06:10:01.955501+0000","last_fullsized":"2024-03-23T06:10:01.955501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929041+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:10:02.929041+0000","last_peered":"2024-03-23T06:10:02.929041+0000","last_clean":"2024-03-23T06:10:02.929041+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:10:02.929041+0000","last_undegraded":"2024-03-23T06:10:02.929041+0000","last_fullsized":"2024-03-23T06:10:02.929041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961066+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:10:01.961066+0000","last_peered":"2024-03-23T06:10:01.961066+0000","last_clean":"2024-03-23T06:10:01.961066+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:10:01.961066+0000","last_undegraded":"2024-03-23T06:10:01.961066+0000","last_fullsized":"2024-03-23T06:10:01.961066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960584+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:10:01.960584+0000","last_peered":"2024-03-23T06:10:01.960584+0000","last_clean":"2024-03-23T06:10:01.960584+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:10:01.960584+0000","last_undegraded":"2024-03-23T06:10:01.960584+0000","last_fullsized":"2024-03-23T06:10:01.960584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427056+0000","last_change":"2024-03-23T06:10:01.963116+0000","last_active":"2024-03-23T06:10:02.427056+0000","last_peered":"2024-03-23T06:10:02.427056+0000","last_clean":"2024-03-23T06:10:02.427056+0000","last_became_active":"2024-03-23T06:10:01.962746+0000","last_became_peered":"2024-03-23T06:10:01.962746+0000","last_unstale":"2024-03-23T06:10:02.427056+0000","last_undegraded":"2024-03-23T06:10:02.427056+0000","last_fullsized":"2024-03-23T06:10:02.427056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:51:03.948467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427647+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:10:02.427647+0000","last_peered":"2024-03-23T06:10:02.427647+0000","last_clean":"2024-03-23T06:10:02.427647+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:10:02.427647+0000","last_undegraded":"2024-03-23T06:10:02.427647+0000","last_fullsized":"2024-03-23T06:10:02.427647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938885+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:10:01.938885+0000","last_peered":"2024-03-23T06:10:01.938885+0000","last_clean":"2024-03-23T06:10:01.938885+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:10:01.938885+0000","last_undegraded":"2024-03-23T06:10:01.938885+0000","last_fullsized":"2024-03-23T06:10:01.938885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.950111+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:10:01.950111+0000","last_peered":"2024-03-23T06:10:01.950111+0000","last_clean":"2024-03-23T06:10:01.950111+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:10:01.950111+0000","last_undegraded":"2024-03-23T06:10:01.950111+0000","last_fullsized":"2024-03-23T06:10:01.950111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982125+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:10:01.982125+0000","last_peered":"2024-03-23T06:10:01.982125+0000","last_clean":"2024-03-23T06:10:01.982125+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:10:01.982125+0000","last_undegraded":"2024-03-23T06:10:01.982125+0000","last_fullsized":"2024-03-23T06:10:01.982125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947907+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:10:01.947907+0000","last_peered":"2024-03-23T06:10:01.947907+0000","last_clean":"2024-03-23T06:10:01.947907+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:10:01.947907+0000","last_undegraded":"2024-03-23T06:10:01.947907+0000","last_fullsized":"2024-03-23T06:10:01.947907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936901+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:10:01.936901+0000","last_peered":"2024-03-23T06:10:01.936901+0000","last_clean":"2024-03-23T06:10:01.936901+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:10:01.936901+0000","last_undegraded":"2024-03-23T06:10:01.936901+0000","last_fullsized":"2024-03-23T06:10:01.936901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.428499+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:10:02.428499+0000","last_peered":"2024-03-23T06:10:02.428499+0000","last_clean":"2024-03-23T06:10:02.428499+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:10:02.428499+0000","last_undegraded":"2024-03-23T06:10:02.428499+0000","last_fullsized":"2024-03-23T06:10:02.428499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936867+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:10:01.936867+0000","last_peered":"2024-03-23T06:10:01.936867+0000","last_clean":"2024-03-23T06:10:01.936867+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:10:01.936867+0000","last_undegraded":"2024-03-23T06:10:01.936867+0000","last_fullsized":"2024-03-23T06:10:01.936867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427526+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:10:02.427526+0000","last_peered":"2024-03-23T06:10:02.427526+0000","last_clean":"2024-03-23T06:10:02.427526+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:10:02.427526+0000","last_undegraded":"2024-03-23T06:10:02.427526+0000","last_fullsized":"2024-03-23T06:10:02.427526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.928596+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:10:02.928596+0000","last_peered":"2024-03-23T06:10:02.928596+0000","last_clean":"2024-03-23T06:10:02.928596+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:10:02.928596+0000","last_undegraded":"2024-03-23T06:10:02.928596+0000","last_fullsized":"2024-03-23T06:10:02.928596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959100+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:10:01.959100+0000","last_peered":"2024-03-23T06:10:01.959100+0000","last_clean":"2024-03-23T06:10:01.959100+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:10:01.959100+0000","last_undegraded":"2024-03-23T06:10:01.959100+0000","last_fullsized":"2024-03-23T06:10:01.959100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929722+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:10:02.929722+0000","last_peered":"2024-03-23T06:10:02.929722+0000","last_clean":"2024-03-23T06:10:02.929722+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:10:02.929722+0000","last_undegraded":"2024-03-23T06:10:02.929722+0000","last_fullsized":"2024-03-23T06:10:02.929722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960026+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:10:01.960026+0000","last_peered":"2024-03-23T06:10:01.960026+0000","last_clean":"2024-03-23T06:10:01.960026+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:10:01.960026+0000","last_undegraded":"2024-03-23T06:10:01.960026+0000","last_fullsized":"2024-03-23T06:10:01.960026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944307+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:10:01.944307+0000","last_peered":"2024-03-23T06:10:01.944307+0000","last_clean":"2024-03-23T06:10:01.944307+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:10:01.944307+0000","last_undegraded":"2024-03-23T06:10:01.944307+0000","last_fullsized":"2024-03-23T06:10:01.944307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951291+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:10:01.951291+0000","last_peered":"2024-03-23T06:10:01.951291+0000","last_clean":"2024-03-23T06:10:01.951291+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:10:01.951291+0000","last_undegraded":"2024-03-23T06:10:01.951291+0000","last_fullsized":"2024-03-23T06:10:01.951291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947547+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:10:01.947547+0000","last_peered":"2024-03-23T06:10:01.947547+0000","last_clean":"2024-03-23T06:10:01.947547+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:10:01.947547+0000","last_undegraded":"2024-03-23T06:10:01.947547+0000","last_fullsized":"2024-03-23T06:10:01.947547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938289+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:10:01.938289+0000","last_peered":"2024-03-23T06:10:01.938289+0000","last_clean":"2024-03-23T06:10:01.938289+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:10:01.938289+0000","last_undegraded":"2024-03-23T06:10:01.938289+0000","last_fullsized":"2024-03-23T06:10:01.938289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938341+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:10:01.938341+0000","last_peered":"2024-03-23T06:10:01.938341+0000","last_clean":"2024-03-23T06:10:01.938341+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:10:01.938341+0000","last_undegraded":"2024-03-23T06:10:01.938341+0000","last_fullsized":"2024-03-23T06:10:01.938341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960989+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:10:01.960989+0000","last_peered":"2024-03-23T06:10:01.960989+0000","last_clean":"2024-03-23T06:10:01.960989+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:10:01.960989+0000","last_undegraded":"2024-03-23T06:10:01.960989+0000","last_fullsized":"2024-03-23T06:10:01.960989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948453+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:01.948453+0000","last_peered":"2024-03-23T06:10:01.948453+0000","last_clean":"2024-03-23T06:10:01.948453+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:10:01.948453+0000","last_undegraded":"2024-03-23T06:10:01.948453+0000","last_fullsized":"2024-03-23T06:10:01.948453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951149+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:10:01.951149+0000","last_peered":"2024-03-23T06:10:01.951149+0000","last_clean":"2024-03-23T06:10:01.951149+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:10:01.951149+0000","last_undegraded":"2024-03-23T06:10:01.951149+0000","last_fullsized":"2024-03-23T06:10:01.951149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947028+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:10:01.947028+0000","last_peered":"2024-03-23T06:10:01.947028+0000","last_clean":"2024-03-23T06:10:01.947028+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:01.947028+0000","last_undegraded":"2024-03-23T06:10:01.947028+0000","last_fullsized":"2024-03-23T06:10:01.947028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959084+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:10:01.959084+0000","last_peered":"2024-03-23T06:10:01.959084+0000","last_clean":"2024-03-23T06:10:01.959084+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:10:01.959084+0000","last_undegraded":"2024-03-23T06:10:01.959084+0000","last_fullsized":"2024-03-23T06:10:01.959084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936782+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:10:01.936782+0000","last_peered":"2024-03-23T06:10:01.936782+0000","last_clean":"2024-03-23T06:10:01.936782+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:10:01.936782+0000","last_undegraded":"2024-03-23T06:10:01.936782+0000","last_fullsized":"2024-03-23T06:10:01.936782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958727+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:10:01.958727+0000","last_peered":"2024-03-23T06:10:01.958727+0000","last_clean":"2024-03-23T06:10:01.958727+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:10:01.958727+0000","last_undegraded":"2024-03-23T06:10:01.958727+0000","last_fullsized":"2024-03-23T06:10:01.958727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955979+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:10:01.955979+0000","last_peered":"2024-03-23T06:10:01.955979+0000","last_clean":"2024-03-23T06:10:01.955979+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:10:01.955979+0000","last_undegraded":"2024-03-23T06:10:01.955979+0000","last_fullsized":"2024-03-23T06:10:01.955979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.942778+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:10:01.942778+0000","last_peered":"2024-03-23T06:10:01.942778+0000","last_clean":"2024-03-23T06:10:01.942778+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:10:01.942778+0000","last_undegraded":"2024-03-23T06:10:01.942778+0000","last_fullsized":"2024-03-23T06:10:01.942778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954107+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:10:01.954107+0000","last_peered":"2024-03-23T06:10:01.954107+0000","last_clean":"2024-03-23T06:10:01.954107+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:10:01.954107+0000","last_undegraded":"2024-03-23T06:10:01.954107+0000","last_fullsized":"2024-03-23T06:10:01.954107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947698+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:01.947698+0000","last_peered":"2024-03-23T06:10:01.947698+0000","last_clean":"2024-03-23T06:10:01.947698+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:10:01.947698+0000","last_undegraded":"2024-03-23T06:10:01.947698+0000","last_fullsized":"2024-03-23T06:10:01.947698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946933+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:10:01.946933+0000","last_peered":"2024-03-23T06:10:01.946933+0000","last_clean":"2024-03-23T06:10:01.946933+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:10:01.946933+0000","last_undegraded":"2024-03-23T06:10:01.946933+0000","last_fullsized":"2024-03-23T06:10:01.946933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.937864+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:10:01.937864+0000","last_peered":"2024-03-23T06:10:01.937864+0000","last_clean":"2024-03-23T06:10:01.937864+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:10:01.937864+0000","last_undegraded":"2024-03-23T06:10:01.937864+0000","last_fullsized":"2024-03-23T06:10:01.937864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938183+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:10:01.938183+0000","last_peered":"2024-03-23T06:10:01.938183+0000","last_clean":"2024-03-23T06:10:01.938183+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:10:01.938183+0000","last_undegraded":"2024-03-23T06:10:01.938183+0000","last_fullsized":"2024-03-23T06:10:01.938183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959302+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:10:01.959302+0000","last_peered":"2024-03-23T06:10:01.959302+0000","last_clean":"2024-03-23T06:10:01.959302+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:10:01.959302+0000","last_undegraded":"2024-03-23T06:10:01.959302+0000","last_fullsized":"2024-03-23T06:10:01.959302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960084+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:10:01.960084+0000","last_peered":"2024-03-23T06:10:01.960084+0000","last_clean":"2024-03-23T06:10:01.960084+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:10:01.960084+0000","last_undegraded":"2024-03-23T06:10:01.960084+0000","last_fullsized":"2024-03-23T06:10:01.960084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955366+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:10:01.955366+0000","last_peered":"2024-03-23T06:10:01.955366+0000","last_clean":"2024-03-23T06:10:01.955366+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:10:01.955366+0000","last_undegraded":"2024-03-23T06:10:01.955366+0000","last_fullsized":"2024-03-23T06:10:01.955366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961295+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:10:01.961295+0000","last_peered":"2024-03-23T06:10:01.961295+0000","last_clean":"2024-03-23T06:10:01.961295+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:10:01.961295+0000","last_undegraded":"2024-03-23T06:10:01.961295+0000","last_fullsized":"2024-03-23T06:10:01.961295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947495+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:10:01.947495+0000","last_peered":"2024-03-23T06:10:01.947495+0000","last_clean":"2024-03-23T06:10:01.947495+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:10:01.947495+0000","last_undegraded":"2024-03-23T06:10:01.947495+0000","last_fullsized":"2024-03-23T06:10:01.947495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.957968+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:10:01.957968+0000","last_peered":"2024-03-23T06:10:01.957968+0000","last_clean":"2024-03-23T06:10:01.957968+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:10:01.957968+0000","last_undegraded":"2024-03-23T06:10:01.957968+0000","last_fullsized":"2024-03-23T06:10:01.957968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.970135+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:10:01.970135+0000","last_peered":"2024-03-23T06:10:01.970135+0000","last_clean":"2024-03-23T06:10:01.970135+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:10:01.970135+0000","last_undegraded":"2024-03-23T06:10:01.970135+0000","last_fullsized":"2024-03-23T06:10:01.970135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.957139+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:10:01.957139+0000","last_peered":"2024-03-23T06:10:01.957139+0000","last_clean":"2024-03-23T06:10:01.957139+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:10:01.957139+0000","last_undegraded":"2024-03-23T06:10:01.957139+0000","last_fullsized":"2024-03-23T06:10:01.957139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956477+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:10:01.956477+0000","last_peered":"2024-03-23T06:10:01.956477+0000","last_clean":"2024-03-23T06:10:01.956477+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:10:01.956477+0000","last_undegraded":"2024-03-23T06:10:01.956477+0000","last_fullsized":"2024-03-23T06:10:01.956477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947435+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:10:01.947435+0000","last_peered":"2024-03-23T06:10:01.947435+0000","last_clean":"2024-03-23T06:10:01.947435+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:10:01.947435+0000","last_undegraded":"2024-03-23T06:10:01.947435+0000","last_fullsized":"2024-03-23T06:10:01.947435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948381+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:10:01.948381+0000","last_peered":"2024-03-23T06:10:01.948381+0000","last_clean":"2024-03-23T06:10:01.948381+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:10:01.948381+0000","last_undegraded":"2024-03-23T06:10:01.948381+0000","last_fullsized":"2024-03-23T06:10:01.948381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955839+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:10:01.955839+0000","last_peered":"2024-03-23T06:10:01.955839+0000","last_clean":"2024-03-23T06:10:01.955839+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:10:01.955839+0000","last_undegraded":"2024-03-23T06:10:01.955839+0000","last_fullsized":"2024-03-23T06:10:01.955839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":103921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":693777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":103395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":270336,"data_stored":103463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":262144,"data_stored":103339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":864256,"data_stored":693799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":282624,"data_stored":107806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:10:32.262 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-23T06:10:32.262 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-23T06:10:32.262 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-23T06:10:32.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-23T06:10:32.263 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-23T06:10:32.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.497+0000 7f4dd3200640 1 Processor -- start 2024-03-23T06:10:32.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.497+0000 7f4dd3200640 1 -- start start 2024-03-23T06:10:32.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.498+0000 7f4dd3200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4dcc15a350 0x7f4dcc0c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.498+0000 7f4dd3200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc150820 con 0x7f4dcc150440 2024-03-23T06:10:32.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.498+0000 7f4dd3200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc156210 con 0x7f4dcc0c6e60 2024-03-23T06:10:32.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.498+0000 7f4dd3200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dcc0c3840 con 0x7f4dcc15a350 2024-03-23T06:10:32.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.499+0000 7f4dd1e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4dcc150440 0x7f4dcc0c8390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55148/0 (socket says 172.21.15.73:55148) 2024-03-23T06:10:32.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.499+0000 7f4dd1e00640 1 -- 172.21.15.73:0/1575310044 learned_addr learned my addr 172.21.15.73:0/1575310044 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:32.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.499+0000 7f4dd1400640 1 --2- 172.21.15.73:0/1575310044 >> v2:172.21.15.110:3300/0 conn(0x7f4dcc15a350 0x7f4dcc0c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.499+0000 7f4dd0a00640 1 -- 172.21.15.73:0/1575310044 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834394498 0 0) 0x7f4dcc150820 con 0x7f4dcc150440 2024-03-23T06:10:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.499+0000 7f4dd0a00640 1 -- 172.21.15.73:0/1575310044 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db4003520 con 0x7f4dcc150440 2024-03-23T06:10:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.499+0000 7f4dd1400640 1 -- 172.21.15.73:0/1575310044 >> v1:172.21.15.110:6789/0 conn(0x7f4dcc0c6e60 legacy=0x7f4dcc0c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.499+0000 7f4dd1400640 1 -- 172.21.15.73:0/1575310044 >> v1:172.21.15.73:6789/0 conn(0x7f4dcc150440 legacy=0x7f4dcc0c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.499+0000 7f4dd1400640 1 -- 172.21.15.73:0/1575310044 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc1564f0 con 0x7f4dcc15a350 2024-03-23T06:10:32.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.500+0000 7f4dd1400640 1 --2- 172.21.15.73:0/1575310044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 0x7f4dcc0c6920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0097a0 tx=0x7f4dbc02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff1dc2fff979ee3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd0a00640 1 -- 172.21.15.73:0/1575310044 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc02f810 con 0x7f4dcc15a350 2024-03-23T06:10:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd0a00640 1 -- 172.21.15.73:0/1575310044 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc02f970 con 0x7f4dcc15a350 2024-03-23T06:10:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd0a00640 1 -- 172.21.15.73:0/1575310044 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc02fd00 con 0x7f4dcc15a350 2024-03-23T06:10:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd3200640 1 -- 172.21.15.73:0/1575310044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 msgr2=0x7f4dcc0c6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd3200640 1 --2- 172.21.15.73:0/1575310044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 0x7f4dcc0c6920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0097a0 tx=0x7f4dbc02b9f0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd3200640 1 -- 172.21.15.73:0/1575310044 shutdown_connections 2024-03-23T06:10:32.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd3200640 1 --2- 172.21.15.73:0/1575310044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 0x7f4dcc0c6920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd3200640 1 -- 172.21.15.73:0/1575310044 >> 172.21.15.73:0/1575310044 conn(0x7f4dcc06bed0 msgr2=0x7f4dcc06c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:32.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd3200640 1 -- 172.21.15.73:0/1575310044 shutdown_connections 2024-03-23T06:10:32.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.501+0000 7f4dd3200640 1 -- 172.21.15.73:0/1575310044 wait complete. 2024-03-23T06:10:32.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.503+0000 7f4dd3200640 1 Processor -- start 2024-03-23T06:10:32.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.503+0000 7f4dd3200640 1 -- start start 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd3200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dcc0c6e60 0x7f4dcc1495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd3200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dcc150440 0x7f4dcc149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd3200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 0x7f4dcc0c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd3200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc147160 con 0x7f4dcc150440 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd3200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc148210 con 0x7f4dcc15a350 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd3200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc1473b0 con 0x7f4dcc0c6e60 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dcc150440 0x7f4dcc149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd1400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dcc150440 0x7f4dcc149b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34438/0 (socket says 172.21.15.73:34438) 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd1400640 1 -- 172.21.15.73:0/2334048449 learned_addr learned my addr 172.21.15.73:0/2334048449 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd2800640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 0x7f4dcc0c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.504+0000 7f4dd1e00640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dcc0c6e60 0x7f4dcc1495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.505+0000 7f4dd1400640 1 -- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dcc0c6e60 msgr2=0x7f4dcc1495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.505+0000 7f4dd1400640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dcc0c6e60 0x7f4dcc1495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.505+0000 7f4dd1400640 1 -- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 msgr2=0x7f4dcc0c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.505+0000 7f4dd1400640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 0x7f4dcc0c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.505+0000 7f4dd1400640 1 -- 172.21.15.73:0/2334048449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc009400 con 0x7f4dcc150440 2024-03-23T06:10:32.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.505+0000 7f4dd2800640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 0x7f4dcc0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:32.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.505+0000 7f4dd1400640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dcc150440 0x7f4dcc149b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc02c000 tx=0x7f4dbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.505+0000 7f4dc6000640 1 -- 172.21.15.73:0/2334048449 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc03c040 con 0x7f4dcc150440 2024-03-23T06:10:32.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.506+0000 7f4dc6000640 1 -- 172.21.15.73:0/2334048449 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc0378f0 con 0x7f4dcc150440 2024-03-23T06:10:32.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.506+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc147690 con 0x7f4dcc150440 2024-03-23T06:10:32.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.506+0000 7f4dc6000640 1 -- 172.21.15.73:0/2334048449 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc037ca0 con 0x7f4dcc150440 2024-03-23T06:10:32.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.506+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc0bf8e0 con 0x7f4dcc150440 2024-03-23T06:10:32.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.507+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc149310 con 0x7f4dcc150440 2024-03-23T06:10:32.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.508+0000 7f4dc6000640 1 -- 172.21.15.73:0/2334048449 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4dbc04b3b0 con 0x7f4dcc150440 2024-03-23T06:10:32.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.509+0000 7f4dc6000640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4db006ac00 0x7f4db006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.509+0000 7f4dc6000640 1 -- 172.21.15.73:0/2334048449 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4dbc0ab3d0 con 0x7f4dcc150440 2024-03-23T06:10:32.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.509+0000 7f4dd1e00640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4db006ac00 0x7f4db006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.510+0000 7f4dd1e00640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4db006ac00 0x7f4db006d0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00011e0 tx=0x7f4dc0007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.513+0000 7f4dc6000640 1 -- 172.21.15.73:0/2334048449 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4dbc076370 con 0x7f4dcc150440 2024-03-23T06:10:32.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.758+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4dcc04e030 con 0x7f4dcc150440 2024-03-23T06:10:32.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.762+0000 7f4dc6000640 1 -- 172.21.15.73:0/2334048449 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170932 (secure 0 0 0) 0x7f4dbc079990 con 0x7f4dcc150440 2024-03-23T06:10:32.763 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:32.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4db006ac00 msgr2=0x7f4db006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4db006ac00 0x7f4db006d0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4dc00011e0 tx=0x7f4dc0007d30 comp rx=0 tx=0).stop 2024-03-23T06:10:32.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dcc150440 msgr2=0x7f4dcc149b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dcc150440 0x7f4dcc149b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc02c000 tx=0x7f4dbc004730 comp rx=0 tx=0).stop 2024-03-23T06:10:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 shutdown_connections 2024-03-23T06:10:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dcc15a350 0x7f4dcc0c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dcc150440 0x7f4dcc149b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4db006ac00 0x7f4db006d0c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 --2- 172.21.15.73:0/2334048449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dcc0c6e60 0x7f4dcc1495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.765+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 >> 172.21.15.73:0/2334048449 conn(0x7f4dcc06bed0 msgr2=0x7f4dcc0c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.766+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 shutdown_connections 2024-03-23T06:10:32.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.766+0000 7f4dd3200640 1 -- 172.21.15.73:0/2334048449 wait complete. 2024-03-23T06:10:32.782 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":37697},{"type":"v1","addr":"172.21.15.110:6833","nonce":37697}]},"active_addr":"172.21.15.110:6833/37697","active_change":"2024-03-23T06:09:38.597366+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2931166761}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":213544995}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":610331000}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2801049441}]}]} 2024-03-23T06:10:32.785 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-23T06:10:32.785 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-23T06:10:32.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:32.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.982+0000 7f84b5e00640 1 Processor -- start 2024-03-23T06:10:32.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.982+0000 7f84b5e00640 1 -- start start 2024-03-23T06:10:32.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.983+0000 7f84b5e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84b01513f0 0x7f84b00c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.983+0000 7f84b5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01586b0 0x7f84b00bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.983+0000 7f84b5e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00c5f50 con 0x7f84b00c03a0 2024-03-23T06:10:32.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.983+0000 7f84b5e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b0157b60 con 0x7f84b01513f0 2024-03-23T06:10:32.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.983+0000 7f84b5e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00c0830 con 0x7f84b01586b0 2024-03-23T06:10:32.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84af400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f84b00c03a0 0x7f84b0071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55154/0 (socket says 172.21.15.73:55154) 2024-03-23T06:10:32.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84af400640 1 -- 172.21.15.73:0/2555093601 learned_addr learned my addr 172.21.15.73:0/2555093601 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:32.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84aea00640 1 --2- 172.21.15.73:0/2555093601 >> v2:172.21.15.110:3300/0 conn(0x7f84b01513f0 0x7f84b00c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84a7e00640 1 --2- 172.21.15.73:0/2555093601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01586b0 0x7f84b00bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84ae000640 1 -- 172.21.15.73:0/2555093601 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719318590 0 0) 0x7f84a8001490 con 0x7f84b00c03a0 2024-03-23T06:10:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84a7e00640 1 -- 172.21.15.73:0/2555093601 >> v2:172.21.15.110:3300/0 conn(0x7f84b01513f0 msgr2=0x7f84b00c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84a7e00640 1 --2- 172.21.15.73:0/2555093601 >> v2:172.21.15.110:3300/0 conn(0x7f84b01513f0 0x7f84b00c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84a7e00640 1 -- 172.21.15.73:0/2555093601 >> v1:172.21.15.73:6789/0 conn(0x7f84b00c03a0 legacy=0x7f84b0071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.984+0000 7f84a7e00640 1 -- 172.21.15.73:0/2555093601 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00c0b10 con 0x7f84b01586b0 2024-03-23T06:10:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.985+0000 7f84a7e00640 1 --2- 172.21.15.73:0/2555093601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01586b0 0x7f84b00bfe60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84980097a0 tx=0x7f849802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f716e6be24bf398 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84ae000640 1 -- 172.21.15.73:0/2555093601 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498030610 con 0x7f84b01586b0 2024-03-23T06:10:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84ae000640 1 -- 172.21.15.73:0/2555093601 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8498030770 con 0x7f84b01586b0 2024-03-23T06:10:32.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84ae000640 1 -- 172.21.15.73:0/2555093601 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498030b00 con 0x7f84b01586b0 2024-03-23T06:10:32.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84b5e00640 1 -- 172.21.15.73:0/2555093601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01586b0 msgr2=0x7f84b00bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84b5e00640 1 --2- 172.21.15.73:0/2555093601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01586b0 0x7f84b00bfe60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84980097a0 tx=0x7f849802b960 comp rx=0 tx=0).stop 2024-03-23T06:10:32.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84b5e00640 1 -- 172.21.15.73:0/2555093601 shutdown_connections 2024-03-23T06:10:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84b5e00640 1 --2- 172.21.15.73:0/2555093601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01586b0 0x7f84b00bfe60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84b5e00640 1 --2- 172.21.15.73:0/2555093601 >> v2:172.21.15.110:3300/0 conn(0x7f84b01513f0 0x7f84b00c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84b5e00640 1 -- 172.21.15.73:0/2555093601 >> 172.21.15.73:0/2555093601 conn(0x7f84b006bb40 msgr2=0x7f84b006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84b5e00640 1 -- 172.21.15.73:0/2555093601 shutdown_connections 2024-03-23T06:10:32.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.986+0000 7f84b5e00640 1 -- 172.21.15.73:0/2555093601 wait complete. 2024-03-23T06:10:32.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.988+0000 7f84b5e00640 1 Processor -- start 2024-03-23T06:10:32.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.988+0000 7f84b5e00640 1 -- start start 2024-03-23T06:10:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84b5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01513f0 0x7f84b00c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84b5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b01586b0 0x7f84b0153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84b5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84b0154080 0x7f84b01efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84b5e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b01ef900 con 0x7f84b01586b0 2024-03-23T06:10:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84b5e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b01522c0 con 0x7f84b0154080 2024-03-23T06:10:32.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84b5e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00c3090 con 0x7f84b01513f0 2024-03-23T06:10:32.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b01586b0 0x7f84b0153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b01586b0 0x7f84b0153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34448/0 (socket says 172.21.15.73:34448) 2024-03-23T06:10:32.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.989+0000 7f84a7e00640 1 -- 172.21.15.73:0/189925043 learned_addr learned my addr 172.21.15.73:0/189925043 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:32.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84af400640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84b0154080 0x7f84b01efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84aea00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01513f0 0x7f84b00c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7e00640 1 -- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01513f0 msgr2=0x7f84b00c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01513f0 0x7f84b00c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7e00640 1 -- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84b0154080 msgr2=0x7f84b01efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84b0154080 0x7f84b01efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7e00640 1 -- 172.21.15.73:0/189925043 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498009400 con 0x7f84b01586b0 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b01586b0 0x7f84b0153b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8498000c00 tx=0x7f84980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7400640 1 -- 172.21.15.73:0/189925043 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849803f070 con 0x7f84b01586b0 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7400640 1 -- 172.21.15.73:0/189925043 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8498030e30 con 0x7f84b01586b0 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84a7400640 1 -- 172.21.15.73:0/189925043 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8498004250 con 0x7f84b01586b0 2024-03-23T06:10:32.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.990+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b0152560 con 0x7f84b01586b0 2024-03-23T06:10:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.991+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b0152b20 con 0x7f84b01586b0 2024-03-23T06:10:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.991+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00c1a60 con 0x7f84b01586b0 2024-03-23T06:10:32.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.992+0000 7f84a7400640 1 -- 172.21.15.73:0/189925043 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8498043070 con 0x7f84b01586b0 2024-03-23T06:10:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.993+0000 7f84a7400640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f848c06ac30 0x7f848c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.993+0000 7f84a7400640 1 -- 172.21.15.73:0/189925043 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84980ab1b0 con 0x7f84b01586b0 2024-03-23T06:10:32.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.994+0000 7f84aea00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f848c06ac30 0x7f848c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:32.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.994+0000 7f84aea00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f848c06ac30 0x7f848c06d0f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009aa0 tx=0x7f84a0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:32.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:32.998+0000 7f84a7400640 1 -- 172.21.15.73:0/189925043 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8498076020 con 0x7f84b01586b0 2024-03-23T06:10:33.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.193+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84b006d510 con 0x7f84b01586b0 2024-03-23T06:10:33.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.195+0000 7f84a7400640 1 -- 172.21.15.73:0/189925043 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f8498034090 con 0x7f84b01586b0 2024-03-23T06:10:33.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:33.196 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:33.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.198+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f848c06ac30 msgr2=0x7f848c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.198+0000 7f84b5e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f848c06ac30 0x7f848c06d0f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009aa0 tx=0x7f84a0009190 comp rx=0 tx=0).stop 2024-03-23T06:10:33.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.198+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b01586b0 msgr2=0x7f84b0153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.198+0000 7f84b5e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b01586b0 0x7f84b0153b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8498000c00 tx=0x7f84980046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.199+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 shutdown_connections 2024-03-23T06:10:33.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.199+0000 7f84b5e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84b0154080 0x7f84b01efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.199+0000 7f84b5e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84b01586b0 0x7f84b0153b40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.199+0000 7f84b5e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f848c06ac30 0x7f848c06d0f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.199+0000 7f84b5e00640 1 --2- 172.21.15.73:0/189925043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b01513f0 0x7f84b00c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.199+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 >> 172.21.15.73:0/189925043 conn(0x7f84b006bb40 msgr2=0x7f84b00c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:33.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.199+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 shutdown_connections 2024-03-23T06:10:33.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.199+0000 7f84b5e00640 1 -- 172.21.15.73:0/189925043 wait complete. 2024-03-23T06:10:33.215 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-23T06:10:33.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:33.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.409+0000 7f1680400640 1 Processor -- start 2024-03-23T06:10:33.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.409+0000 7f1680400640 1 -- start start 2024-03-23T06:10:33.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f1680400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16781513f0 0x7f16780c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f1680400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16781586b0 0x7f16780bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f1680400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16780c5f50 con 0x7f16780c03a0 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f1680400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1678157b60 con 0x7f16781513f0 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f1680400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16780c0830 con 0x7f16781586b0 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f167da00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16781513f0 0x7f16780c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f167da00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16781513f0 0x7f16780c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34458/0 (socket says 172.21.15.73:34458) 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f167da00640 1 -- 172.21.15.73:0/2837599634 learned_addr learned my addr 172.21.15.73:0/2837599634 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f167e400640 1 --1- 172.21.15.73:0/2837599634 >> v1:172.21.15.73:6789/0 conn(0x7f16780c03a0 0x7f1678071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55160/0 (socket says 172.21.15.73:55160) 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.411+0000 7f167d000640 1 --2- 172.21.15.73:0/2837599634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16781586b0 0x7f16780bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.412+0000 7f167da00640 1 -- 172.21.15.73:0/2837599634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16781586b0 msgr2=0x7f16780bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.412+0000 7f167da00640 1 --2- 172.21.15.73:0/2837599634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16781586b0 0x7f16780bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.412+0000 7f167da00640 1 -- 172.21.15.73:0/2837599634 >> v1:172.21.15.73:6789/0 conn(0x7f16780c03a0 legacy=0x7f1678071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.412+0000 7f1677e00640 1 -- 172.21.15.73:0/2837599634 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808727301 0 0) 0x7f1670001490 con 0x7f16780c03a0 2024-03-23T06:10:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.412+0000 7f167da00640 1 -- 172.21.15.73:0/2837599634 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16780c0b10 con 0x7f16781513f0 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.413+0000 7f167da00640 1 --2- 172.21.15.73:0/2837599634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781513f0 0x7f16780c5a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1668009870 tx=0x7f166802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25483bf43d8fda12 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.413+0000 7f1677e00640 1 -- 172.21.15.73:0/2837599634 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166802f840 con 0x7f16781513f0 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.413+0000 7f1677e00640 1 -- 172.21.15.73:0/2837599634 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166802f9a0 con 0x7f16781513f0 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.413+0000 7f1677e00640 1 -- 172.21.15.73:0/2837599634 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166802fd30 con 0x7f16781513f0 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.414+0000 7f1680400640 1 -- 172.21.15.73:0/2837599634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781513f0 msgr2=0x7f16780c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.414+0000 7f1680400640 1 --2- 172.21.15.73:0/2837599634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781513f0 0x7f16780c5a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1668009870 tx=0x7f166802ba20 comp rx=0 tx=0).stop 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.414+0000 7f1680400640 1 -- 172.21.15.73:0/2837599634 shutdown_connections 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.414+0000 7f1680400640 1 --2- 172.21.15.73:0/2837599634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16781586b0 0x7f16780bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.414+0000 7f1680400640 1 --2- 172.21.15.73:0/2837599634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781513f0 0x7f16780c5a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.414+0000 7f1680400640 1 -- 172.21.15.73:0/2837599634 >> 172.21.15.73:0/2837599634 conn(0x7f167806bb40 msgr2=0x7f167806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.414+0000 7f1680400640 1 -- 172.21.15.73:0/2837599634 shutdown_connections 2024-03-23T06:10:33.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.414+0000 7f1680400640 1 -- 172.21.15.73:0/2837599634 wait complete. 2024-03-23T06:10:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.416+0000 7f1680400640 1 Processor -- start 2024-03-23T06:10:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.416+0000 7f1680400640 1 -- start start 2024-03-23T06:10:33.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f1680400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16781513f0 0x7f16781544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f1680400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781586b0 0x7f167814c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f1680400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1678151af0 0x7f167814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f1680400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16780aa3c0 con 0x7f16781586b0 2024-03-23T06:10:33.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f1680400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167814cdd0 con 0x7f16781513f0 2024-03-23T06:10:33.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f1680400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167806d420 con 0x7f1678151af0 2024-03-23T06:10:33.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16781513f0 0x7f16781544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167d000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781586b0 0x7f167814c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16781513f0 0x7f16781544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52368/0 (socket says 172.21.15.73:52368) 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167da00640 1 -- 172.21.15.73:0/2206588576 learned_addr learned my addr 172.21.15.73:0/2206588576 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167e400640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1678151af0 0x7f167814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167da00640 1 -- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1678151af0 msgr2=0x7f167814c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167da00640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1678151af0 0x7f167814c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167da00640 1 -- 172.21.15.73:0/2206588576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781586b0 msgr2=0x7f167814c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167da00640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781586b0 0x7f167814c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167da00640 1 -- 172.21.15.73:0/2206588576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680094d0 con 0x7f16781513f0 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167e400640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1678151af0 0x7f167814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.417+0000 7f167d000640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781586b0 0x7f167814c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.418+0000 7f167da00640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16781513f0 0x7f16781544f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f166802ba60 tx=0x7f1668004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.418+0000 7f1675600640 1 -- 172.21.15.73:0/2206588576 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668037c40 con 0x7f16781513f0 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.418+0000 7f1675600640 1 -- 172.21.15.73:0/2206588576 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668037da0 con 0x7f16781513f0 2024-03-23T06:10:33.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.418+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16780b0580 con 0x7f16781513f0 2024-03-23T06:10:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.418+0000 7f1675600640 1 -- 172.21.15.73:0/2206588576 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680426c0 con 0x7f16781513f0 2024-03-23T06:10:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.418+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1678153770 con 0x7f16781513f0 2024-03-23T06:10:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.420+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167814ff20 con 0x7f16781513f0 2024-03-23T06:10:33.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.420+0000 7f1675600640 1 -- 172.21.15.73:0/2206588576 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f166802d3d0 con 0x7f16781513f0 2024-03-23T06:10:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.421+0000 7f1675600640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f165806ac30 0x7f165806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.421+0000 7f1675600640 1 -- 172.21.15.73:0/2206588576 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f166803c070 con 0x7f16781513f0 2024-03-23T06:10:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.421+0000 7f167d000640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f165806ac30 0x7f165806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.422+0000 7f167d000640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f165806ac30 0x7f165806d0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16780c9da0 tx=0x7f1664009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.426+0000 7f1675600640 1 -- 172.21.15.73:0/2206588576 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1668076c90 con 0x7f16781513f0 2024-03-23T06:10:33.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.631+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f167804e110 con 0x7f16781513f0 2024-03-23T06:10:33.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.633+0000 7f1675600640 1 -- 172.21.15.73:0/2206588576 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f1668047020 con 0x7f16781513f0 2024-03-23T06:10:33.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:33.633 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:33.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f165806ac30 msgr2=0x7f165806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f165806ac30 0x7f165806d0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16780c9da0 tx=0x7f1664009190 comp rx=0 tx=0).stop 2024-03-23T06:10:33.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16781513f0 msgr2=0x7f16781544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16781513f0 0x7f16781544f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f166802ba60 tx=0x7f1668004730 comp rx=0 tx=0).stop 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 shutdown_connections 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f165806ac30 0x7f165806d0f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1678151af0 0x7f167814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16781586b0 0x7f167814c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 --2- 172.21.15.73:0/2206588576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16781513f0 0x7f16781544f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 >> 172.21.15.73:0/2206588576 conn(0x7f167806bb40 msgr2=0x7f16780b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 shutdown_connections 2024-03-23T06:10:33.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.635+0000 7f1680400640 1 -- 172.21.15.73:0/2206588576 wait complete. 2024-03-23T06:10:33.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-23T06:10:33.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-23T06:10:33.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-23T06:10:33.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-23T06:10:33.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-23T06:10:33.654 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-23T06:10:33.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-23T06:10:33.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-23T06:10:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.950+0000 7f70a2800640 1 Processor -- start 2024-03-23T06:10:33.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.951+0000 7f70a2800640 1 -- start start 2024-03-23T06:10:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.950+0000 7f93cf200640 1 Processor -- start 2024-03-23T06:10:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.951+0000 7f93cf200640 1 -- start start 2024-03-23T06:10:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.952+0000 7f93cf200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93d00cad90 0x7f93d015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.952+0000 7f93cf200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93d006aa60 0x7f93d0069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.953+0000 7f93cf200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d00b3d60 con 0x7f93d00c6f30 2024-03-23T06:10:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.953+0000 7f93cf200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d00b2e70 con 0x7f93d00cad90 2024-03-23T06:10:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.953+0000 7f93cf200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d00b3150 con 0x7f93d006aa60 2024-03-23T06:10:33.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f70a2800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f709c159420 0x7f709c0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f70a2800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f709c0ca940 0x7f709c0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f93cd400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f93d00c6f30 0x7f93d00b41f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55174/0 (socket says 172.21.15.73:55174) 2024-03-23T06:10:33.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f93cd400640 1 -- 172.21.15.73:0/83027449 learned_addr learned my addr 172.21.15.73:0/83027449 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f93ce800640 1 --2- 172.21.15.73:0/83027449 >> v2:172.21.15.110:3300/0 conn(0x7f93d006aa60 0x7f93d0069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f93cde00640 1 --2- 172.21.15.73:0/83027449 >> v2:172.21.15.73:3300/0 conn(0x7f93d00cad90 0x7f93d015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f70a2800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0c9c80 con 0x7f709c153760 2024-03-23T06:10:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f70a2800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c159860 con 0x7f709c0ca940 2024-03-23T06:10:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f70a2800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0cb310 con 0x7f709c159420 2024-03-23T06:10:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f709aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f709c159420 0x7f709c0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f709be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f709c0ca940 0x7f709c0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f709be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f709c0ca940 0x7f709c0cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34492/0 (socket says 172.21.15.73:34492) 2024-03-23T06:10:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f709be00640 1 -- 172.21.15.73:0/37202043 learned_addr learned my addr 172.21.15.73:0/37202043 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7f709aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f709c159420 0x7f709c0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52388/0 (socket says 172.21.15.73:52388) 2024-03-23T06:10:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7ff12a200640 1 Processor -- start 2024-03-23T06:10:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.954+0000 7ff12a200640 1 -- start start 2024-03-23T06:10:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.956+0000 7ff12a200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff11c0dd420 0x7ff11c04b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.956+0000 7ff12a200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff11c0e6740 0x7ff11c0e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.956+0000 7f709a000640 1 -- 172.21.15.73:0/37202043 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780526011 0 0) 0x7f7088001110 con 0x7f709c153760 2024-03-23T06:10:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.956+0000 7ff12a200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11c007620 con 0x7ff11c0452a0 2024-03-23T06:10:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.956+0000 7ff12a200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11c04baa0 con 0x7ff11c0e6740 2024-03-23T06:10:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.956+0000 7ff12a200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff11c04b810 con 0x7ff11c0dd420 2024-03-23T06:10:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.956+0000 7f709a000640 1 -- 172.21.15.73:0/37202043 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7080003520 con 0x7f709c153760 2024-03-23T06:10:33.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7ff128e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff11c0dd420 0x7ff11c04b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7ff128e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff11c0dd420 0x7ff11c04b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52390/0 (socket says 172.21.15.73:52390) 2024-03-23T06:10:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7ff128e00640 1 -- 172.21.15.73:0/2041827943 learned_addr learned my addr 172.21.15.73:0/2041827943 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7f709be00640 1 -- 172.21.15.73:0/37202043 >> v2:172.21.15.110:3300/0 conn(0x7f709c159420 msgr2=0x7f709c0c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7f709be00640 1 --2- 172.21.15.73:0/37202043 >> v2:172.21.15.110:3300/0 conn(0x7f709c159420 0x7f709c0c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7f709be00640 1 -- 172.21.15.73:0/37202043 >> v1:172.21.15.73:6789/0 conn(0x7f709c153760 legacy=0x7f709c0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7f709be00640 1 -- 172.21.15.73:0/37202043 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c06a2d0 con 0x7f709c0ca940 2024-03-23T06:10:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.955+0000 7f93cde00640 1 -- 172.21.15.73:0/83027449 >> v2:172.21.15.110:3300/0 conn(0x7f93d006aa60 msgr2=0x7f93d0069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7ff129800640 1 --2- 172.21.15.73:0/2041827943 >> v2:172.21.15.73:3300/0 conn(0x7ff11c0e6740 0x7ff11c0e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7ff128e00640 1 -- 172.21.15.73:0/2041827943 >> v2:172.21.15.73:3300/0 conn(0x7ff11c0e6740 msgr2=0x7ff11c0e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7ff128e00640 1 --2- 172.21.15.73:0/2041827943 >> v2:172.21.15.73:3300/0 conn(0x7ff11c0e6740 0x7ff11c0e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7ff128e00640 1 -- 172.21.15.73:0/2041827943 >> v1:172.21.15.73:6789/0 conn(0x7ff11c0452a0 legacy=0x7ff11c0456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7ff128e00640 1 -- 172.21.15.73:0/2041827943 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c006a10 con 0x7ff11c0dd420 2024-03-23T06:10:33.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.955+0000 7f93cde00640 1 --2- 172.21.15.73:0/83027449 >> v2:172.21.15.110:3300/0 conn(0x7f93d006aa60 0x7f93d0069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.955+0000 7f93cde00640 1 -- 172.21.15.73:0/83027449 >> v1:172.21.15.73:6789/0 conn(0x7f93d00c6f30 legacy=0x7f93d00b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.955+0000 7f93cde00640 1 -- 172.21.15.73:0/83027449 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d00b3430 con 0x7f93d00cad90 2024-03-23T06:10:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.957+0000 7f93ce800640 1 --2- 172.21.15.73:0/83027449 >> v2:172.21.15.110:3300/0 conn(0x7f93d006aa60 0x7f93d0069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.958+0000 7fb3c3800640 1 Processor -- start 2024-03-23T06:10:33.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.958+0000 7fb3c3800640 1 -- start start 2024-03-23T06:10:33.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.958+0000 7f93cde00640 1 --2- 172.21.15.73:0/83027449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d00cad90 0x7f93d015e2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93d006bc10 tx=0x7f93c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0db33942ac456f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.959+0000 7f93cca00640 1 -- 172.21.15.73:0/83027449 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0031640 con 0x7f93d00cad90 2024-03-23T06:10:33.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.959+0000 7f93cca00640 1 -- 172.21.15.73:0/83027449 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c00317a0 con 0x7f93d00cad90 2024-03-23T06:10:33.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.959+0000 7ff128e00640 1 --2- 172.21.15.73:0/2041827943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0dd420 0x7ff11c04b2d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff11c007990 tx=0x7ff11002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e09c24df54047dfd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.959+0000 7f709be00640 1 --2- 172.21.15.73:0/37202043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c0ca940 0x7f709c0cadd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f709c0c5640 tx=0x7f709402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a982f43002d1e0f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7ff123400640 1 -- 172.21.15.73:0/2041827943 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110030860 con 0x7ff11c0dd420 2024-03-23T06:10:33.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7fb3c3800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc1536c0 0x7fb3bc159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7fb3c3800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3bc0ca4d0 0x7fb3bc0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7fb3c3800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3bc15d920 con 0x7fb3bc0c8eb0 2024-03-23T06:10:33.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7fb3c3800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc0703e0 con 0x7fb3bc0ca4d0 2024-03-23T06:10:33.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7fb3c3800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc15cac0 con 0x7fb3bc1536c0 2024-03-23T06:10:33.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7f709a000640 1 -- 172.21.15.73:0/37202043 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709402cb10 con 0x7f709c0ca940 2024-03-23T06:10:33.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7f709a000640 1 -- 172.21.15.73:0/37202043 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709402cc70 con 0x7f709c0ca940 2024-03-23T06:10:33.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7f709a000640 1 -- 172.21.15.73:0/37202043 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70940343f0 con 0x7f709c0ca940 2024-03-23T06:10:33.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.960+0000 7f93cca00640 1 -- 172.21.15.73:0/83027449 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0031b70 con 0x7f93d00cad90 2024-03-23T06:10:33.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7f93cf200640 1 -- 172.21.15.73:0/83027449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d00cad90 msgr2=0x7f93d015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7f93cf200640 1 --2- 172.21.15.73:0/83027449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d00cad90 0x7f93d015e2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93d006bc10 tx=0x7f93c002b8f0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7f93cf200640 1 -- 172.21.15.73:0/83027449 shutdown_connections 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7f93cf200640 1 --2- 172.21.15.73:0/83027449 >> v2:172.21.15.110:3300/0 conn(0x7f93d006aa60 0x7f93d0069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7f93cf200640 1 --2- 172.21.15.73:0/83027449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d00cad90 0x7f93d015e2e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7f93cf200640 1 -- 172.21.15.73:0/83027449 >> 172.21.15.73:0/83027449 conn(0x7f93d00ceb80 msgr2=0x7f93d00cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7fb3c0e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc1536c0 0x7fb3bc159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7fb3c0e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc1536c0 0x7fb3bc159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49290/0 (socket says 172.21.15.73:49290) 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7fb3c0e00640 1 -- 172.21.15.73:0/663144806 learned_addr learned my addr 172.21.15.73:0/663144806 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7fb3bbe00640 1 --2- 172.21.15.73:0/663144806 >> v2:172.21.15.110:3300/0 conn(0x7fb3bc0ca4d0 0x7fb3bc0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.961+0000 7fae83200640 1 Processor -- start 2024-03-23T06:10:33.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.962+0000 7f93cf200640 1 -- 172.21.15.73:0/83027449 shutdown_connections 2024-03-23T06:10:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.962+0000 7fb3c0e00640 1 -- 172.21.15.73:0/663144806 >> v2:172.21.15.110:3300/0 conn(0x7fb3bc0ca4d0 msgr2=0x7fb3bc0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.962+0000 7fb3c0e00640 1 --2- 172.21.15.73:0/663144806 >> v2:172.21.15.110:3300/0 conn(0x7fb3bc0ca4d0 0x7fb3bc0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.962+0000 7fb3c0e00640 1 -- 172.21.15.73:0/663144806 >> v1:172.21.15.110:6789/0 conn(0x7fb3bc0c8eb0 legacy=0x7fb3bc070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.962+0000 7fb3c0e00640 1 -- 172.21.15.73:0/663144806 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc15cd10 con 0x7fb3bc1536c0 2024-03-23T06:10:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f70a2800640 1 -- 172.21.15.73:0/37202043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c0ca940 msgr2=0x7f709c0cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f70a2800640 1 --2- 172.21.15.73:0/37202043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c0ca940 0x7f709c0cadd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f709c0c5640 tx=0x7f709402bf70 comp rx=0 tx=0).stop 2024-03-23T06:10:33.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f70a2800640 1 -- 172.21.15.73:0/37202043 shutdown_connections 2024-03-23T06:10:33.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7ff123400640 1 -- 172.21.15.73:0/2041827943 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1100309c0 con 0x7ff11c0dd420 2024-03-23T06:10:33.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f70a2800640 1 --2- 172.21.15.73:0/37202043 >> v2:172.21.15.110:3300/0 conn(0x7f709c159420 0x7f709c0c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7ff123400640 1 -- 172.21.15.73:0/2041827943 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110030d50 con 0x7ff11c0dd420 2024-03-23T06:10:33.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f70a2800640 1 --2- 172.21.15.73:0/37202043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c0ca940 0x7f709c0cadd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f70a2800640 1 -- 172.21.15.73:0/37202043 >> 172.21.15.73:0/37202043 conn(0x7f709c06c310 msgr2=0x7f709c0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:33.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.962+0000 7fae83200640 1 -- start start 2024-03-23T06:10:33.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f70a2800640 1 -- 172.21.15.73:0/37202043 shutdown_connections 2024-03-23T06:10:33.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f70a2800640 1 -- 172.21.15.73:0/37202043 wait complete. 2024-03-23T06:10:33.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.963+0000 7f93cf200640 1 -- 172.21.15.73:0/83027449 wait complete. 2024-03-23T06:10:33.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.964+0000 7ff12a200640 1 -- 172.21.15.73:0/2041827943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0dd420 msgr2=0x7ff11c04b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.964+0000 7ff12a200640 1 --2- 172.21.15.73:0/2041827943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0dd420 0x7ff11c04b2d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff11c007990 tx=0x7ff11002b9a0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.965+0000 7fb3c0e00640 1 --2- 172.21.15.73:0/663144806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc1536c0 0x7fb3bc159f00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009870 tx=0x7fb3a802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d16eb77035b4cd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.965+0000 7fae83200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0ca540 0x7fae7c1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.965+0000 7fae83200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c15a1f0 con 0x7fae7c0cb130 2024-03-23T06:10:33.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.965+0000 7f93cf200640 1 Processor -- start 2024-03-23T06:10:33.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.965+0000 7fd906200640 1 Processor -- start 2024-03-23T06:10:33.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7fae83200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c0c5430 con 0x7fae7c0c5050 2024-03-23T06:10:33.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7fae83200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c159950 con 0x7fae7c0ca540 2024-03-23T06:10:33.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7f70a2800640 1 Processor -- start 2024-03-23T06:10:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7f93cf200640 1 -- start start 2024-03-23T06:10:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7ff12a200640 1 -- 172.21.15.73:0/2041827943 shutdown_connections 2024-03-23T06:10:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7ff12a200640 1 --2- 172.21.15.73:0/2041827943 >> v2:172.21.15.73:3300/0 conn(0x7ff11c0e6740 0x7ff11c0e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7ff12a200640 1 --2- 172.21.15.73:0/2041827943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0dd420 0x7ff11c04b2d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7ff12a200640 1 -- 172.21.15.73:0/2041827943 >> 172.21.15.73:0/2041827943 conn(0x7ff11c050150 msgr2=0x7ff11c050560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7fae81400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fae7c0cb130 0x7fae7c0c9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55202/0 (socket says 172.21.15.73:55202) 2024-03-23T06:10:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7fae81400640 1 -- 172.21.15.73:0/1576394385 learned_addr learned my addr 172.21.15.73:0/1576394385 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7f70a2800640 1 -- start start 2024-03-23T06:10:33.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7fae82800640 1 --2- 172.21.15.73:0/1576394385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0ca540 0x7fae7c1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.965+0000 7fb3bb400640 1 -- 172.21.15.73:0/663144806 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8030840 con 0x7fb3bc1536c0 2024-03-23T06:10:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.966+0000 7fd906200640 1 -- start start 2024-03-23T06:10:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.967+0000 7fae82800640 1 -- 172.21.15.73:0/1576394385 >> v1:172.21.15.110:6789/0 conn(0x7fae7c0c5050 legacy=0x7fae7c069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.967+0000 7fae82800640 1 -- 172.21.15.73:0/1576394385 >> v1:172.21.15.73:6789/0 conn(0x7fae7c0cb130 legacy=0x7fae7c0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.967+0000 7fae82800640 1 -- 172.21.15.73:0/1576394385 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c159c30 con 0x7fae7c0ca540 2024-03-23T06:10:33.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.967+0000 7fe1ede00640 1 Processor -- start 2024-03-23T06:10:33.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.967+0000 7f70a2800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c0ca940 0x7f709c0c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.967+0000 7f70a2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f709c153760 0x7f709c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7f70a2800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f709c159420 0x7f709c0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7f70a2800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c15b510 con 0x7f709c0ca940 2024-03-23T06:10:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7f70a2800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1efde0 con 0x7f709c153760 2024-03-23T06:10:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7f70a2800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c15a620 con 0x7f709c159420 2024-03-23T06:10:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7f709be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f709c159420 0x7f709c0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7f709be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f709c159420 0x7f709c0ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49302/0 (socket says 172.21.15.73:49302) 2024-03-23T06:10:33.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7f709be00640 1 -- 172.21.15.73:0/2612322389 learned_addr learned my addr 172.21.15.73:0/2612322389 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.967+0000 7fb3bb400640 1 -- 172.21.15.73:0/663144806 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a80309a0 con 0x7fb3bc1536c0 2024-03-23T06:10:33.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.967+0000 7fb3bb400640 1 -- 172.21.15.73:0/663144806 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8030d30 con 0x7fb3bc1536c0 2024-03-23T06:10:33.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7fb3c3800640 1 -- 172.21.15.73:0/663144806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc1536c0 msgr2=0x7fb3bc159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7fb3c3800640 1 --2- 172.21.15.73:0/663144806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc1536c0 0x7fb3bc159f00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8009870 tx=0x7fb3a802b980 comp rx=0 tx=0).stop 2024-03-23T06:10:33.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7fe1ede00640 1 -- start start 2024-03-23T06:10:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7f709b400640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c0ca940 0x7f709c0c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7f709aa00640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f709c153760 0x7f709c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7f93cf200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d006aa60 0x7f93d015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7f93cf200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93d00c6f30 0x7f93d015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7f93cf200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93d00cad90 0x7f93d006e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7f93cf200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00aca90 con 0x7f93d006aa60 2024-03-23T06:10:33.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7ff12a200640 1 -- 172.21.15.73:0/2041827943 shutdown_connections 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7ff12a200640 1 -- 172.21.15.73:0/2041827943 wait complete. 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7fd906200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9000c9350 0x7fd9000710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7fd906200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000ca960 0x7fd9000cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7fd906200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000ca090 con 0x7fd90006a7d0 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7fd906200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000cb310 con 0x7fd9000c9350 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.968+0000 7fd906200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90014fd50 con 0x7fd9000ca960 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7fd8ffe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000ca960 0x7fd9000cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7fd8ffe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000ca960 0x7fd9000cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49304/0 (socket says 172.21.15.73:49304) 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7fd8ffe00640 1 -- 172.21.15.73:0/3160833963 learned_addr learned my addr 172.21.15.73:0/3160833963 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f709be00640 1 -- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f709c153760 msgr2=0x7f709c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f709be00640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f709c153760 0x7f709c15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f709be00640 1 -- 172.21.15.73:0/2612322389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c0ca940 msgr2=0x7f709c0c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f709be00640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c0ca940 0x7f709c0c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f709be00640 1 -- 172.21.15.73:0/2612322389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7094009b30 con 0x7f709c159420 2024-03-23T06:10:33.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7f93cf200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d014b0b0 con 0x7f93d00c6f30 2024-03-23T06:10:33.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.969+0000 7f93cf200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d014a4a0 con 0x7f93d00cad90 2024-03-23T06:10:33.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7fd8ffe00640 1 -- 172.21.15.73:0/3160833963 >> v2:172.21.15.73:3300/0 conn(0x7fd9000c9350 msgr2=0x7fd9000710a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:33.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7fb3c3800640 1 -- 172.21.15.73:0/663144806 shutdown_connections 2024-03-23T06:10:33.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7fb3c3800640 1 --2- 172.21.15.73:0/663144806 >> v2:172.21.15.110:3300/0 conn(0x7fb3bc0ca4d0 0x7fb3bc0caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7fb3c3800640 1 --2- 172.21.15.73:0/663144806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc1536c0 0x7fb3bc159f00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7fb3c3800640 1 -- 172.21.15.73:0/663144806 >> 172.21.15.73:0/663144806 conn(0x7fb3bc069cb0 msgr2=0x7fb3bc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:33.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f709be00640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f709c159420 0x7f709c0ce190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7094036040 tx=0x7f7094004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f93cd400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93d00c6f30 0x7f93d015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7fae82800640 1 --2- 172.21.15.73:0/1576394385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0ca540 0x7fae7c1592a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae78009dc0 tx=0x7fae7802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c98d63779d14f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f93cd400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93d00c6f30 0x7f93d015cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52410/0 (socket says 172.21.15.73:52410) 2024-03-23T06:10:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f93cd400640 1 -- 172.21.15.73:0/3954518234 learned_addr learned my addr 172.21.15.73:0/3954518234 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.970+0000 7f93cde00640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d006aa60 0x7f93d015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094007e20 con 0x7f709c159420 2024-03-23T06:10:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709403e450 con 0x7f709c159420 2024-03-23T06:10:33.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709403e800 con 0x7f709c159420 2024-03-23T06:10:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fae80a00640 1 -- 172.21.15.73:0/1576394385 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7802cc40 con 0x7fae7c0ca540 2024-03-23T06:10:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fae80a00640 1 -- 172.21.15.73:0/1576394385 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7802cda0 con 0x7fae7c0ca540 2024-03-23T06:10:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fae80a00640 1 -- 172.21.15.73:0/1576394385 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae78034660 con 0x7fae7c0ca540 2024-03-23T06:10:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7f4816400640 1 Processor -- start 2024-03-23T06:10:33.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7f4816400640 1 -- start start 2024-03-23T06:10:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1ede00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1e8157b70 0x7fe1e80c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1ede00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80caa20 0x7fe1e80caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1ede00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e80c94d0 con 0x7fe1e815e340 2024-03-23T06:10:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1ede00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e80c76f0 con 0x7fe1e8157b70 2024-03-23T06:10:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1ede00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c9850 con 0x7fe1e80caa20 2024-03-23T06:10:33.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7f93ce800640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93d00cad90 0x7f93d006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1e6a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1e8157b70 0x7fe1e80c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1e6a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1e8157b70 0x7fe1e80c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52414/0 (socket says 172.21.15.73:52414) 2024-03-23T06:10:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1e6a00640 1 -- 172.21.15.73:0/1598528839 learned_addr learned my addr 172.21.15.73:0/1598528839 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c15a900 con 0x7f709c159420 2024-03-23T06:10:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c15aec0 con 0x7f709c159420 2024-03-23T06:10:33.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fe1e7400640 1 --2- 172.21.15.73:0/1598528839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80caa20 0x7fe1e80caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.971+0000 7fb3c3800640 1 -- 172.21.15.73:0/663144806 shutdown_connections 2024-03-23T06:10:33.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7ff12a200640 1 Processor -- start 2024-03-23T06:10:33.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7f93cd400640 1 -- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93d00cad90 msgr2=0x7f93d006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7f93cd400640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93d00cad90 0x7f93d006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7f93cd400640 1 -- 172.21.15.73:0/3954518234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d006aa60 msgr2=0x7f93d015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7f93cd400640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d006aa60 0x7f93d015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7f93cd400640 1 -- 172.21.15.73:0/3954518234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0009400 con 0x7f93d00c6f30 2024-03-23T06:10:33.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7ff12a200640 1 -- start start 2024-03-23T06:10:33.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7f93ce800640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93d00cad90 0x7f93d006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:33.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7f93cd400640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93d00c6f30 0x7f93d015cbb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00c4a0 tx=0x7f93bc00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.973+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f709c06ab70 con 0x7f709c159420 2024-03-23T06:10:33.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.973+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc005ce0 con 0x7f93d00c6f30 2024-03-23T06:10:33.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.973+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc005e40 con 0x7f93d00c6f30 2024-03-23T06:10:33.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.973+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc007270 con 0x7f93d00c6f30 2024-03-23T06:10:33.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7fb3c3800640 1 -- 172.21.15.73:0/663144806 wait complete. 2024-03-23T06:10:33.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7fd8ffe00640 1 --2- 172.21.15.73:0/3160833963 >> v2:172.21.15.73:3300/0 conn(0x7fd9000c9350 0x7fd9000710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7fd8ffe00640 1 -- 172.21.15.73:0/3160833963 >> v1:172.21.15.73:6789/0 conn(0x7fd90006a7d0 legacy=0x7fd90014f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.972+0000 7fd8ffe00640 1 -- 172.21.15.73:0/3160833963 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900155e90 con 0x7fd9000ca960 2024-03-23T06:10:33.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fe1e6a00640 1 -- 172.21.15.73:0/1598528839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80caa20 msgr2=0x7fe1e80caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fe1e6a00640 1 --2- 172.21.15.73:0/1598528839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80caa20 0x7fe1e80caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fe1e6a00640 1 -- 172.21.15.73:0/1598528839 >> v1:172.21.15.73:6789/0 conn(0x7fe1e815e340 legacy=0x7fe1e80c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7ff12a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0452a0 0x7ff11c04f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7ff12a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff11c0dd420 0x7ff11c0e5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fae83200640 1 -- 172.21.15.73:0/1576394385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0ca540 msgr2=0x7fae7c1592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fae83200640 1 --2- 172.21.15.73:0/1576394385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0ca540 0x7fae7c1592a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fae78009dc0 tx=0x7fae7802be90 comp rx=0 tx=0).stop 2024-03-23T06:10:33.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fd8ffe00640 1 --2- 172.21.15.73:0/3160833963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000ca960 0x7fd9000cadd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009e50 tx=0x7fd8f802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa64488e3221b7ab server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7ff12a200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0e6740 0x7ff11c185050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fe1e6a00640 1 -- 172.21.15.73:0/1598528839 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e80c9c30 con 0x7fe1e8157b70 2024-03-23T06:10:33.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7ff128e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0452a0 0x7ff11c04f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7ff128e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0452a0 0x7ff11c04f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52424/0 (socket says 172.21.15.73:52424) 2024-03-23T06:10:33.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.973+0000 7f4816400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48080343a0 0x7f4808034810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.973+0000 7f4816400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480804b900 con 0x7f480804c440 2024-03-23T06:10:33.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.973+0000 7f4816400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48080e03d0 con 0x7f48080d6ff0 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.973+0000 7f4816400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4808047110 con 0x7f48080343a0 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7f480fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f480804c440 0x7f4808033c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55226/0 (socket says 172.21.15.73:55226) 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7f480fe00640 1 -- 172.21.15.73:0/3312177854 learned_addr learned my addr 172.21.15.73:0/3312177854 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964582222 0 0) 0x7f480804b900 con 0x7f480804c440 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f8003520 con 0x7f480804c440 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 385349371 0 0) 0x7f47f8003520 con 0x7f480804c440 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 >> v2:172.21.15.73:3300/0 conn(0x7f48080343a0 msgr2=0x7f4808034810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 --2- 172.21.15.73:0/3312177854 >> v2:172.21.15.73:3300/0 conn(0x7f48080343a0 0x7f4808034810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 >> v1:172.21.15.110:6789/0 conn(0x7f48080d6ff0 legacy=0x7f48080e0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480804bb50 con 0x7f480804c440 2024-03-23T06:10:33.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f47fc001670 con 0x7f480804c440 2024-03-23T06:10:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fd8fe000640 1 -- 172.21.15.73:0/3160833963 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f802cb00 con 0x7fd9000ca960 2024-03-23T06:10:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.974+0000 7fd8fe000640 1 -- 172.21.15.73:0/3160833963 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f802cc60 con 0x7fd9000ca960 2024-03-23T06:10:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7fd8fe000640 1 -- 172.21.15.73:0/3160833963 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f80343f0 con 0x7fd9000ca960 2024-03-23T06:10:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 >> v1:172.21.15.73:6789/0 conn(0x7f480804c440 legacy=0x7f4808033c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f8003970 0x7f47f8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f80047c0 0x7f47f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47f80052a0 0x7f47f801c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4808047110 con 0x7f47f8003970 2024-03-23T06:10:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f801d1a0 con 0x7f47f80047c0 2024-03-23T06:10:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f801d360 con 0x7f47f80052a0 2024-03-23T06:10:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.975+0000 7f4815a00640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47f80052a0 0x7f47f801c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7ff129800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0e6740 0x7ff11c185050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7ff129800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0e6740 0x7ff11c185050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34540/0 (socket says 172.21.15.73:34540) 2024-03-23T06:10:33.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7ff12a200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0359c0 con 0x7ff11c0e6740 2024-03-23T06:10:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7ff123e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff11c0dd420 0x7ff11c0e5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7fd906200640 1 -- 172.21.15.73:0/3160833963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000ca960 msgr2=0x7fd9000cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d014a780 con 0x7f93d00c6f30 2024-03-23T06:10:33.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7ff123e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff11c0dd420 0x7ff11c0e5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49340/0 (socket says 172.21.15.73:49340) 2024-03-23T06:10:33.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7ff123e00640 1 -- 172.21.15.73:0/2584936832 learned_addr learned my addr 172.21.15.73:0/2584936832 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:33.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c0346a0 con 0x7ff11c0452a0 2024-03-23T06:10:33.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7fe1e6a00640 1 --2- 172.21.15.73:0/1598528839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e8157b70 0x7fe1e80c5b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009870 tx=0x7fe1d002ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6602ad3edbaac23 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:33.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c176c40 con 0x7ff11c0dd420 2024-03-23T06:10:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7fae83200640 1 -- 172.21.15.73:0/1576394385 shutdown_connections 2024-03-23T06:10:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7fae83200640 1 --2- 172.21.15.73:0/1576394385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0ca540 0x7fae7c1592a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7fae83200640 1 -- 172.21.15.73:0/1576394385 >> 172.21.15.73:0/1576394385 conn(0x7fae7c0ceb80 msgr2=0x7fae7c0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fae83200640 1 -- 172.21.15.73:0/1576394385 shutdown_connections 2024-03-23T06:10:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fae83200640 1 -- 172.21.15.73:0/1576394385 wait complete. 2024-03-23T06:10:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7f4815a00640 1 -- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f80047c0 msgr2=0x7f47f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7f4815a00640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47f80047c0 0x7f47f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7f4815a00640 1 -- 172.21.15.73:0/3312177854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f8003970 msgr2=0x7f47f8003d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7f4815a00640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f8003970 0x7f47f8003d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7f4815a00640 1 -- 172.21.15.73:0/3312177854 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480804bb50 con 0x7f47f80052a0 2024-03-23T06:10:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7f4815a00640 1 -- 172.21.15.73:0/3312177854 reap_dead start 2024-03-23T06:10:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.976+0000 7fd906200640 1 --2- 172.21.15.73:0/3160833963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000ca960 0x7fd9000cadd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009e50 tx=0x7fd8f802bf60 comp rx=0 tx=0).stop 2024-03-23T06:10:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fd906200640 1 -- 172.21.15.73:0/3160833963 shutdown_connections 2024-03-23T06:10:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fd906200640 1 --2- 172.21.15.73:0/3160833963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000ca960 0x7fd9000cadd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fd906200640 1 --2- 172.21.15.73:0/3160833963 >> v2:172.21.15.73:3300/0 conn(0x7fd9000c9350 0x7fd9000710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fd906200640 1 -- 172.21.15.73:0/3160833963 >> 172.21.15.73:0/3160833963 conn(0x7fd900069cb0 msgr2=0x7fd90006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fd906200640 1 -- 172.21.15.73:0/3160833963 shutdown_connections 2024-03-23T06:10:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7ff129800640 1 -- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff11c0dd420 msgr2=0x7ff11c0e5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7ff129800640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff11c0dd420 0x7ff11c0e5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7ff129800640 1 -- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0452a0 msgr2=0x7ff11c04f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7ff129800640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff11c0452a0 0x7ff11c04f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7ff129800640 1 -- 172.21.15.73:0/2584936832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1100094d0 con 0x7ff11c0e6740 2024-03-23T06:10:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7ff129800640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0e6740 0x7ff11c185050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff124063640 tx=0x7ff124067930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240723e0 con 0x7ff11c0e6740 2024-03-23T06:10:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7fae83200640 1 Processor -- start 2024-03-23T06:10:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1240725a0 con 0x7ff11c0e6740 2024-03-23T06:10:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124094470 con 0x7ff11c0e6740 2024-03-23T06:10:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff11c0343c0 con 0x7ff11c0e6740 2024-03-23T06:10:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.979+0000 7fae83200640 1 -- start start 2024-03-23T06:10:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d014ad40 con 0x7f93d00c6f30 2024-03-23T06:10:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fe1e5600640 1 -- 172.21.15.73:0/1598528839 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d002f830 con 0x7fe1e8157b70 2024-03-23T06:10:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7f4815a00640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47f80052a0 0x7f47f801c990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4810063b00 tx=0x7f47f80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b2c24153140565 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.979+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48100ad600 con 0x7f47f80052a0 2024-03-23T06:10:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.979+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48100a9050 con 0x7f47f80052a0 2024-03-23T06:10:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.979+0000 7f480f400640 1 -- 172.21.15.73:0/3312177854 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48100ada00 con 0x7f47f80052a0 2024-03-23T06:10:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fe1e5600640 1 -- 172.21.15.73:0/1598528839 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d002f990 con 0x7fe1e8157b70 2024-03-23T06:10:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fe1e5600640 1 -- 172.21.15.73:0/1598528839 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d002fd20 con 0x7fe1e8157b70 2024-03-23T06:10:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.979+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c035530 con 0x7ff11c0e6740 2024-03-23T06:10:34.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.980+0000 7ff123e00640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff11c0dd420 0x7ff11c0e5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:34.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7fe1ede00640 1 -- 172.21.15.73:0/1598528839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e8157b70 msgr2=0x7fe1e80c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7fe1ede00640 1 --2- 172.21.15.73:0/1598528839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e8157b70 0x7fe1e80c5b60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009870 tx=0x7fe1d002ba10 comp rx=0 tx=0).stop 2024-03-23T06:10:34.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7fe1ede00640 1 -- 172.21.15.73:0/1598528839 shutdown_connections 2024-03-23T06:10:34.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7fe1ede00640 1 --2- 172.21.15.73:0/1598528839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80caa20 0x7fe1e80caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7fe1ede00640 1 --2- 172.21.15.73:0/1598528839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e8157b70 0x7fe1e80c5b60 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009870 tx=0x7fe1d002ba10 comp rx=0 tx=0).stop 2024-03-23T06:10:34.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.978+0000 7fe1ede00640 1 -- 172.21.15.73:0/1598528839 >> 172.21.15.73:0/1598528839 conn(0x7fe1e8069cb0 msgr2=0x7fe1e806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.977+0000 7fd906200640 1 -- 172.21.15.73:0/3160833963 wait complete. 2024-03-23T06:10:34.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.980+0000 7fe1ede00640 1 -- 172.21.15.73:0/1598528839 shutdown_connections 2024-03-23T06:10:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.979+0000 7fd906200640 1 Processor -- start 2024-03-23T06:10:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.980+0000 7fd906200640 1 -- start start 2024-03-23T06:10:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.980+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff11c0072b0 con 0x7ff11c0e6740 2024-03-23T06:10:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93d00b39f0 con 0x7f93d00c6f30 2024-03-23T06:10:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.980+0000 7f4816400640 1 -- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47f80052a0 msgr2=0x7f47f801c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.980+0000 7f4816400640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47f80052a0 0x7f47f801c990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4810063b00 tx=0x7f47f80057f0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7f4816400640 1 -- 172.21.15.73:0/3312177854 shutdown_connections 2024-03-23T06:10:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7f4816400640 1 --2- 172.21.15.73:0/3312177854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47f80052a0 0x7f47f801c990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7f4816400640 1 -- 172.21.15.73:0/3312177854 >> 172.21.15.73:0/3312177854 conn(0x7f4808050150 msgr2=0x7f4808050560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7fd906200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90006a7d0 0x7fd9001482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7fd906200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000c9350 0x7fd900152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fd906200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ca960 0x7fd900137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fd8ff400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90006a7d0 0x7fd9001482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fd8ff400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90006a7d0 0x7fd9001482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52440/0 (socket says 172.21.15.73:52440) 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fd8ff400640 1 -- 172.21.15.73:0/4236504551 learned_addr learned my addr 172.21.15.73:0/4236504551 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9001f49e0 con 0x7fd9000ca960 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900148be0 con 0x7fd90006a7d0 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.980+0000 7fe1ede00640 1 -- 172.21.15.73:0/1598528839 wait complete. 2024-03-23T06:10:34.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7f4816400640 1 -- 172.21.15.73:0/3312177854 shutdown_connections 2024-03-23T06:10:34.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9001370a0 con 0x7fd9000c9350 2024-03-23T06:10:34.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fd8fea00640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000c9350 0x7fd900152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fe1ede00640 1 Processor -- start 2024-03-23T06:10:34.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7f4816400640 1 -- 172.21.15.73:0/3312177854 wait complete. 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.984+0000 7fd8ffe00640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ca960 0x7fd900137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7fae83200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae7c0c5050 0x7fae7c1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7fae83200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0ca540 0x7fae7c146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7fae83200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0cb130 0x7fae7c1f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7fae83200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c147550 con 0x7fae7c0ca540 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7fae83200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c06b250 con 0x7fae7c0c5050 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.982+0000 7fae83200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c1549f0 con 0x7fae7c0cb130 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fae81e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae7c0c5050 0x7fae7c1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fae81e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae7c0c5050 0x7fae7c1544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52450/0 (socket says 172.21.15.73:52450) 2024-03-23T06:10:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fae81e00640 1 -- 172.21.15.73:0/1520559908 learned_addr learned my addr 172.21.15.73:0/1520559908 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fae81e00640 1 -- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0cb130 msgr2=0x7fae7c1f3000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:10:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fae81e00640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae7c0cb130 0x7fae7c1f3000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fae81e00640 1 -- 172.21.15.73:0/1520559908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0ca540 msgr2=0x7fae7c146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fae81e00640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae7c0ca540 0x7fae7c146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fae81e00640 1 -- 172.21.15.73:0/1520559908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78009a70 con 0x7fae7c0c5050 2024-03-23T06:10:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.984+0000 7fe1ede00640 1 -- start start 2024-03-23T06:10:34.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.983+0000 7fb3c3800640 1 Processor -- start 2024-03-23T06:10:34.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.984+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff124091070 con 0x7ff11c0e6740 2024-03-23T06:10:34.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.984+0000 7fb3c3800640 1 -- start start 2024-03-23T06:10:34.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f709403e960 con 0x7f709c159420 2024-03-23T06:10:34.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7ff120c00640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff10406ac00 0x7ff10406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fd8ff400640 1 -- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000c9350 msgr2=0x7fd900152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fd8ff400640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000c9350 0x7fd900152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fd8ff400640 1 -- 172.21.15.73:0/4236504551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ca960 msgr2=0x7fd900137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fd8ff400640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ca960 0x7fd900137810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7f4816400640 1 Processor -- start 2024-03-23T06:10:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fd8ff400640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8009b30 con 0x7fd90006a7d0 2024-03-23T06:10:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fd8fea00640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9000c9350 0x7fd900152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7f4816400640 1 -- start start 2024-03-23T06:10:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fe1ede00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1e80caa20 0x7fe1e81f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fe1ede00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e815e340 0x7fe1e8156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fe1ede00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80c0400 0x7fe1e8157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fe1ede00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c39b0 con 0x7fe1e80caa20 2024-03-23T06:10:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fe1ede00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e8158e00 con 0x7fe1e815e340 2024-03-23T06:10:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fe1ede00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81eed90 con 0x7fe1e80c0400 2024-03-23T06:10:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fae81e00640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae7c0c5050 0x7fae7c1544b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c3c0 tx=0x7fae7000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fd8ffe00640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9000ca960 0x7fd900137810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:34.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80c0400 0x7fe1e8157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80c0400 0x7fe1e8157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49366/0 (socket says 172.21.15.73:49366) 2024-03-23T06:10:34.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e7400640 1 -- 172.21.15.73:0/4025660350 learned_addr learned my addr 172.21.15.73:0/4025660350 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e6a00640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1e80caa20 0x7fe1e81f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fd8ff400640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90006a7d0 0x7fd9001482e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c430 tx=0x7fd8ec00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e6000640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e815e340 0x7fe1e8156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0052d0 con 0x7fd90006a7d0 2024-03-23T06:10:34.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e7400640 1 -- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e815e340 msgr2=0x7fe1e8156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e7400640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1e815e340 0x7fe1e8156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e7400640 1 -- 172.21.15.73:0/4025660350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1e80caa20 msgr2=0x7fe1e81f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e7400640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1e80caa20 0x7fe1e81f2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fe1e7400640 1 -- 172.21.15.73:0/4025660350 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d00094d0 con 0x7fe1e80c0400 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec005430 con 0x7fd90006a7d0 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd900148e30 con 0x7fd90006a7d0 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9001493f0 con 0x7fd90006a7d0 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7f7093400640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707c06acd0 0x7f707c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f70940ac440 con 0x7f709c159420 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.986+0000 7f709b400640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707c06acd0 0x7f707c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7f7093400640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f707c074310 0x7f707c076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 --> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f707c076e20 con 0x7f707c074310 2024-03-23T06:10:34.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70940ac7f0 con 0x7f709c159420 2024-03-23T06:10:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec003830 con 0x7fd90006a7d0 2024-03-23T06:10:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7f709b400640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707c06acd0 0x7f707c06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7088007fd0 tx=0x7f7088009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7f709aa00640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f707c074310 0x7f707c076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.985+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700050d0 con 0x7fae7c0c5050 2024-03-23T06:10:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c146fe0 con 0x7fae7c0c5050 2024-03-23T06:10:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70005250 con 0x7fae7c0c5050 2024-03-23T06:10:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.987+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70007020 con 0x7fae7c0c5050 2024-03-23T06:10:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c155fc0 con 0x7fae7c0c5050 2024-03-23T06:10:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7fb3c3800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc0c8eb0 0x7fb3bc15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7fb3c3800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3bc0ca4d0 0x7fb3bc1f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff124105150 con 0x7ff11c0e6740 2024-03-23T06:10:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7ff120c00640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7ff1040741c0 0x7ff104076600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 --> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff104076cd0 con 0x7ff1040741c0 2024-03-23T06:10:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff124105500 con 0x7ff11c0e6740 2024-03-23T06:10:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7ff128e00640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff10406ac00 0x7ff10406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8d8000fc0 con 0x7fd90006a7d0 2024-03-23T06:10:34.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae7c0c9910 con 0x7fae7c0c5050 2024-03-23T06:10:34.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f93bc007490 con 0x7f93d00c6f30 2024-03-23T06:10:34.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7f93c6000640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f93b006ac50 0x7f93b006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f93bc088eb0 con 0x7f93d00c6f30 2024-03-23T06:10:34.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7f93cde00640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f93b006ac50 0x7f93b006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fe1e7400640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80c0400 0x7fe1e8157050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0007ea0 tx=0x7fe1e0007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7ff123e00640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7ff1040741c0 0x7ff104076600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0014620 con 0x7fe1e80c0400 2024-03-23T06:10:34.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00147a0 con 0x7fe1e80c0400 2024-03-23T06:10:34.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0014b50 con 0x7fe1e80c0400 2024-03-23T06:10:34.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e81ed4f0 con 0x7fe1e80c0400 2024-03-23T06:10:34.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fb3c3800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3bc1536c0 0x7fb3bc1f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fb3c3800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc155150 con 0x7fb3bc0ca4d0 2024-03-23T06:10:34.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fb3c3800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc1f63a0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fb3c3800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc15c790 con 0x7fb3bc0c8eb0 2024-03-23T06:10:34.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fb3c0e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc0c8eb0 0x7fb3bc15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7f93cde00640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f93b006ac50 0x7f93b006d110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93c0036000 tx=0x7f93c003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e81edab0 con 0x7fe1e80c0400 2024-03-23T06:10:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7fb3bbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3bc0ca4d0 0x7fb3bc1f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7fb3c1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3bc1536c0 0x7fb3bc1f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7fb3c1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3bc1536c0 0x7fb3bc1f3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52488/0 (socket says 172.21.15.73:52488) 2024-03-23T06:10:34.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7fb3c1800640 1 -- 172.21.15.73:0/2081290742 learned_addr learned my addr 172.21.15.73:0/2081290742 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7f93c6000640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f93b0074210 0x7f93b0076650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 --> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93b0076d20 con 0x7f93b0074210 2024-03-23T06:10:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7f93ce800640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f93b0074210 0x7f93b0076650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7fb3c1800640 1 -- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc0c8eb0 msgr2=0x7fb3bc15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7fb3c1800640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc0c8eb0 0x7fb3bc15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7fb3c1800640 1 -- 172.21.15.73:0/2081290742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3bc0ca4d0 msgr2=0x7fb3bc1f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7fb3c1800640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3bc0ca4d0 0x7fb3bc1f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7f93ce800640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f93b0074210 0x7f93b0076650 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7fb3c1800640 1 -- 172.21.15.73:0/2081290742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80094d0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7ff128e00640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff10406ac00 0x7ff10406d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff110036000 tx=0x7ff110008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7fb3bbe00640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3bc0ca4d0 0x7fb3bc1f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7fb3c0e00640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3bc0c8eb0 0x7fb3bc15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd8ec003990 con 0x7fd90006a7d0 2024-03-23T06:10:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.991+0000 7fd8f7400640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd8e006ac80 0x7fd8e006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7f4816400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f80052a0 0x7f48080d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7f4816400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48080ddc00 0x7f4808170530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7f4816400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48080df8b0 0x7f4808170a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7f4816400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48080df510 con 0x7f47f80052a0 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7f4816400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4808170050 con 0x7f48080df8b0 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.988+0000 7f4816400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48080def70 con 0x7f48080ddc00 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.989+0000 7f480fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48080ddc00 0x7f4808170530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7f4815a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48080df8b0 0x7f4808170a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7f480fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48080ddc00 0x7f4808170530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49368/0 (socket says 172.21.15.73:49368) 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7f480fe00640 1 -- 172.21.15.73:0/439898919 learned_addr learned my addr 172.21.15.73:0/439898919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7f4815000640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f80052a0 0x7f48080d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1c0000fc0 con 0x7fe1e80c0400 2024-03-23T06:10:34.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe1e0014cb0 con 0x7fe1e80c0400 2024-03-23T06:10:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.990+0000 7f709aa00640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f707c074310 0x7f707c076750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 <== osd.0 v2:172.21.15.73:6817/36879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f707c076e20 con 0x7f707c074310 2024-03-23T06:10:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93bc001200 con 0x7f93d00c6f30 2024-03-23T06:10:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7fb3c1800640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3bc1536c0 0x7fb3bc1f3370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400c3c0 tx=0x7fb3b400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7ff123e00640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7ff1040741c0 0x7ff104076600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7f480fe00640 1 -- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48080df8b0 msgr2=0x7f4808170a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7f480fe00640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48080df8b0 0x7f4808170a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7f480fe00640 1 -- 172.21.15.73:0/439898919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f80052a0 msgr2=0x7f48080d5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7f480fe00640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f80052a0 0x7f48080d5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7f480fe00640 1 -- 172.21.15.73:0/439898919 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48080cc9b0 con 0x7f48080ddc00 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7f4815000640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47f80052a0 0x7f48080d5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd8ec0576e0 con 0x7fd90006a7d0 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7fd8fea00640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd8e006ac80 0x7fd8e006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7fd8f7400640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7fd8e0074f10 0x7fd8e00773b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8e0077a80 con 0x7fd8e0074f10 2024-03-23T06:10:34.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 <== osd.1 v2:172.21.15.73:6805/36878 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f93b0076d20 con 0x7f93b0074210 2024-03-23T06:10:34.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.992+0000 7fd8ffe00640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7fd8e0074f10 0x7fd8e00773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7fe1df400640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1c406ac80 0x7fe1c406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7fd8fea00640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd8e006ac80 0x7fd8e006d140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd900150090 tx=0x7fd8f0009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1e000ee80 con 0x7fe1e80c0400 2024-03-23T06:10:34.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fe1df400640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fe1c4074fe0 0x7fe1c4077480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fd8ffe00640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7fd8e0074f10 0x7fd8e00773b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 --> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1c4077b50 con 0x7fe1c4074fe0 2024-03-23T06:10:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1e0058920 con 0x7fe1e80c0400 2024-03-23T06:10:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fe1e6000640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fe1c4074fe0 0x7fe1c4077480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8ec001140 con 0x7fd90006a7d0 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7f480fe00640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48080ddc00 0x7f4808170530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00c7f0 tx=0x7f47fc00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc0074e0 con 0x7f48080ddc00 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc007640 con 0x7f48080ddc00 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc004a00 con 0x7f48080ddc00 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48080df230 con 0x7f48080ddc00 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.993+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4808174340 con 0x7f48080ddc00 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40052d0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4005450 con 0x7fb3bc1536c0 2024-03-23T06:10:34.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4007260 con 0x7fb3bc1536c0 2024-03-23T06:10:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fe1e6a00640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1c406ac80 0x7fe1c406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.995+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 <== osd.3 v2:172.21.15.73:6813/36880 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7ff104076cd0 con 0x7ff1040741c0 2024-03-23T06:10:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.995+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 <== osd.7 v2:172.21.15.110:6824/38285 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fd8e0077a80 con 0x7fd8e0074f10 2024-03-23T06:10:34.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.995+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47ec000fc0 con 0x7f48080ddc00 2024-03-23T06:10:34.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.995+0000 7fe1e6000640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fe1c4074fe0 0x7fe1c4077480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.994+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fae700071a0 con 0x7fae7c0c5050 2024-03-23T06:10:34.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.996+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 <== osd.6 v2:172.21.15.110:6802/38267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fe1c4077b50 con 0x7fe1c4074fe0 2024-03-23T06:10:34.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.996+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc1f65f0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.996+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc1f6bb0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.996+0000 7fae76000640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fae6006ac00 0x7fae6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.996+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae7009a0e0 con 0x7fae7c0c5050 2024-03-23T06:10:34.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.997+0000 7fae76000640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fae60074240 0x7fae60076680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.997+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 --> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae60076d50 con 0x7fae60074240 2024-03-23T06:10:34.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.997+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae7009a490 con 0x7fae7c0c5050 2024-03-23T06:10:34.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.997+0000 7fae82800640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fae60074240 0x7fae60076680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.997+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3bc15d5b0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.998+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f47fc004b60 con 0x7f48080ddc00 2024-03-23T06:10:34.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.998+0000 7fae81400640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fae6006ac00 0x7fae6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.998+0000 7fae82800640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fae60074240 0x7fae60076680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.999+0000 7fae81400640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fae6006ac00 0x7fae6006d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0c80d0 tx=0x7fae6c007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.999+0000 7fe1e6a00640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1c406ac80 0x7fe1c406d140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0036000 tx=0x7fe1d0039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.999+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 <== osd.4 v2:172.21.15.110:6800/38266 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fae60076d50 con 0x7fae60074240 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:33.999+0000 7f480cc00640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f47f006ac30 0x7f47f006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.000+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47fc089320 con 0x7f48080ddc00 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.000+0000 7f4815000640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f47f006ac30 0x7f47f006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.000+0000 7f480cc00640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7f47f00741f0 0x7f47f0076630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.000+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 --> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47f0076d00 con 0x7f47f00741f0 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.000+0000 7f4815a00640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7f47f00741f0 0x7f47f0076630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.000+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47fc089690 con 0x7f48080ddc00 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.001+0000 7f4815000640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f47f006ac30 0x7f47f006d0f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4804003e30 tx=0x7f4804009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.001+0000 7f4815a00640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7f47f00741f0 0x7f47f0076630 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.000+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb3b40073c0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.001+0000 7fb3b8c00640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb39c06acd0 0x7fb39c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.002+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3b40888f0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.002+0000 7fb3b8c00640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fb39c074310 0x7fb39c076750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.002+0000 7fb3c0e00640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb39c06acd0 0x7fb39c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.002+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 --> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb39c076e20 con 0x7fb39c074310 2024-03-23T06:10:34.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.002+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b408d2a0 con 0x7fb3bc1536c0 2024-03-23T06:10:34.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.002+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 <== osd.5 v2:172.21.15.110:6816/38268 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f47f0076d00 con 0x7f47f00741f0 2024-03-23T06:10:34.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.002+0000 7fb3bbe00640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fb39c074310 0x7fb39c076750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.003+0000 7fb3c0e00640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb39c06acd0 0x7fb39c06d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8036000 tx=0x7fb3a8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.003+0000 7fb3bbe00640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fb39c074310 0x7fb39c076750 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.006+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 <== osd.2 v2:172.21.15.73:6800/36881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fb39c076e20 con 0x7fb39c074310 2024-03-23T06:10:34.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.013+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 --> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff11c006fd0 con 0x7ff1040741c0 2024-03-23T06:10:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.018+0000 7ff120c00640 1 -- 172.21.15.73:0/2584936832 <== osd.3 v2:172.21.15.73:6813/36880 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff118001990 con 0x7ff1040741c0 2024-03-23T06:10:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.018+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7ff1040741c0 msgr2=0x7ff104076600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.018+0000 7ff12a200640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7ff1040741c0 0x7ff104076600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.019+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff10406ac00 msgr2=0x7ff10406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.019+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 --> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f709c06a890 con 0x7f707c074310 2024-03-23T06:10:34.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.019+0000 7ff12a200640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff10406ac00 0x7ff10406d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff110036000 tx=0x7ff110008030 comp rx=0 tx=0).stop 2024-03-23T06:10:34.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.019+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0e6740 msgr2=0x7ff11c185050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.019+0000 7ff12a200640 1 --2- 172.21.15.73:0/2584936832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff11c0e6740 0x7ff11c185050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff124063640 tx=0x7ff124067930 comp rx=0 tx=0).stop 2024-03-23T06:10:34.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.019+0000 7ff129800640 1 -- 172.21.15.73:0/2584936832 reap_dead start 2024-03-23T06:10:34.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.020+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 shutdown_connections 2024-03-23T06:10:34.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.020+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 >> 172.21.15.73:0/2584936832 conn(0x7ff11c050150 msgr2=0x7ff11c0db5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.020+0000 7f7093400640 1 -- 172.21.15.73:0/2612322389 <== osd.0 v2:172.21.15.73:6817/36879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f708c009bd0 con 0x7f707c074310 2024-03-23T06:10:34.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.020+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 shutdown_connections 2024-03-23T06:10:34.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.020+0000 7ff12a200640 1 -- 172.21.15.73:0/2584936832 wait complete. 2024-03-23T06:10:34.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.021+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f707c074310 msgr2=0x7f707c076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.021+0000 7f70a2800640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f707c074310 0x7f707c076750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.024+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707c06acd0 msgr2=0x7f707c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.024+0000 7f70a2800640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f707c06acd0 0x7f707c06d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7088007fd0 tx=0x7f7088009040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.024+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f709c159420 msgr2=0x7f709c0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.024+0000 7f70a2800640 1 --2- 172.21.15.73:0/2612322389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f709c159420 0x7f709c0ce190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7094036040 tx=0x7f7094004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.024+0000 7f709be00640 1 -- 172.21.15.73:0/2612322389 reap_dead start 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.024+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 shutdown_connections 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.024+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 >> 172.21.15.73:0/2612322389 conn(0x7f709c06c310 msgr2=0x7f709c1487f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.025+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 shutdown_connections 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.025+0000 7f70a2800640 1 -- 172.21.15.73:0/2612322389 wait complete. 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.025+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 --> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8d8002cb0 con 0x7fd8e0074f10 2024-03-23T06:10:34.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.026+0000 7fd8f7400640 1 -- 172.21.15.73:0/4236504551 <== osd.7 v2:172.21.15.110:6824/38285 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd8d8002cb0 con 0x7fd8e0074f10 2024-03-23T06:10:34.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.027+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7fd8e0074f10 msgr2=0x7fd8e00773b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.027+0000 7fd906200640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7fd8e0074f10 0x7fd8e00773b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.027+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd8e006ac80 msgr2=0x7fd8e006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.027+0000 7fd906200640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd8e006ac80 0x7fd8e006d140 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd900150090 tx=0x7fd8f0009110 comp rx=0 tx=0).stop 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.027+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90006a7d0 msgr2=0x7fd9001482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.027+0000 7fd906200640 1 --2- 172.21.15.73:0/4236504551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90006a7d0 0x7fd9001482e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c430 tx=0x7fd8ec00c830 comp rx=0 tx=0).stop 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.028+0000 7fd8ffe00640 1 -- 172.21.15.73:0/4236504551 reap_dead start 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.028+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 shutdown_connections 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.028+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 >> 172.21.15.73:0/4236504551 conn(0x7fd900069cb0 msgr2=0x7fd900072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.030+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 shutdown_connections 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.030+0000 7fd906200640 1 -- 172.21.15.73:0/4236504551 wait complete. 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.031+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 --> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47ec002cb0 con 0x7f47f00741f0 2024-03-23T06:10:34.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7f480cc00640 1 -- 172.21.15.73:0/439898919 <== osd.5 v2:172.21.15.110:6816/38268 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f47ec002cb0 con 0x7f47f00741f0 2024-03-23T06:10:34.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 --> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1c0002cb0 con 0x7fe1c4074fe0 2024-03-23T06:10:34.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 --> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae7c0c9630 con 0x7fae60074240 2024-03-23T06:10:34.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7fe1df400640 1 -- 172.21.15.73:0/4025660350 <== osd.6 v2:172.21.15.110:6802/38267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe1c0002cb0 con 0x7fe1c4074fe0 2024-03-23T06:10:34.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7f47f00741f0 msgr2=0x7f47f0076630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7f4816400640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7f47f00741f0 0x7f47f0076630 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f47f006ac30 msgr2=0x7f47f006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7f4816400640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f47f006ac30 0x7f47f006d0f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4804003e30 tx=0x7f4804009040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48080ddc00 msgr2=0x7f4808170530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.032+0000 7f4816400640 1 --2- 172.21.15.73:0/439898919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48080ddc00 0x7f4808170530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00c7f0 tx=0x7f47fc00ccb0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7f4815a00640 1 -- 172.21.15.73:0/439898919 reap_dead start 2024-03-23T06:10:34.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 --> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93d004e030 con 0x7f93b0074210 2024-03-23T06:10:34.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 shutdown_connections 2024-03-23T06:10:34.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7fae76000640 1 -- 172.21.15.73:0/1520559908 <== osd.4 v2:172.21.15.110:6800/38266 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae78034440 con 0x7fae60074240 2024-03-23T06:10:34.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 >> 172.21.15.73:0/439898919 conn(0x7f4808050150 msgr2=0x7f4808005570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 shutdown_connections 2024-03-23T06:10:34.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fe1c4074fe0 msgr2=0x7fe1c4077480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7f4816400640 1 -- 172.21.15.73:0/439898919 wait complete. 2024-03-23T06:10:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7fe1ede00640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fe1c4074fe0 0x7fe1c4077480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1c406ac80 msgr2=0x7fe1c406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7fe1ede00640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1c406ac80 0x7fe1c406d140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0036000 tx=0x7fe1d0039040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80c0400 msgr2=0x7fe1e8157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.033+0000 7fe1ede00640 1 --2- 172.21.15.73:0/4025660350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1e80c0400 0x7fe1e8157050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0007ea0 tx=0x7fe1e0007f90 comp rx=0 tx=0).stop 2024-03-23T06:10:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7fe1e7400640 1 -- 172.21.15.73:0/4025660350 reap_dead start 2024-03-23T06:10:34.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7f93c6000640 1 -- 172.21.15.73:0/3954518234 <== osd.1 v2:172.21.15.73:6805/36878 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93d004e030 con 0x7f93b0074210 2024-03-23T06:10:34.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 shutdown_connections 2024-03-23T06:10:34.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 >> 172.21.15.73:0/4025660350 conn(0x7fe1e8069cb0 msgr2=0x7fe1e80730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fae60074240 msgr2=0x7fae60076680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7fae83200640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fae60074240 0x7fae60076680 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f93b0074210 msgr2=0x7f93b0076650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7f93cf200640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f93b0074210 0x7f93b0076650 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.034+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 shutdown_connections 2024-03-23T06:10:34.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f93b006ac50 msgr2=0x7f93b006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93cf200640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f93b006ac50 0x7f93b006d110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93c0036000 tx=0x7f93c003c040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93d00c6f30 msgr2=0x7f93d015cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93cf200640 1 --2- 172.21.15.73:0/3954518234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93d00c6f30 0x7f93d015cbb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00c4a0 tx=0x7f93bc00c960 comp rx=0 tx=0).stop 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93ce800640 1 -- 172.21.15.73:0/3954518234 reap_dead start 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fae6006ac00 msgr2=0x7fae6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7fae83200640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fae6006ac00 0x7fae6006d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0c80d0 tx=0x7fae6c007a40 comp rx=0 tx=0).stop 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae7c0c5050 msgr2=0x7fae7c1544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7fae83200640 1 --2- 172.21.15.73:0/1520559908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae7c0c5050 0x7fae7c1544b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c3c0 tx=0x7fae7000c880 comp rx=0 tx=0).stop 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7fae82800640 1 -- 172.21.15.73:0/1520559908 reap_dead start 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 shutdown_connections 2024-03-23T06:10:34.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 >> 172.21.15.73:0/1520559908 conn(0x7fae7c0ceb80 msgr2=0x7fae7c1530c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7fe1ede00640 1 -- 172.21.15.73:0/4025660350 wait complete. 2024-03-23T06:10:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 shutdown_connections 2024-03-23T06:10:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 >> 172.21.15.73:0/3954518234 conn(0x7f93d00ceb80 msgr2=0x7f93d00ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 shutdown_connections 2024-03-23T06:10:34.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.035+0000 7f93cf200640 1 -- 172.21.15.73:0/3954518234 wait complete. 2024-03-23T06:10:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.037+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 shutdown_connections 2024-03-23T06:10:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.038+0000 7fae83200640 1 -- 172.21.15.73:0/1520559908 wait complete. 2024-03-23T06:10:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.039+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 --> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3bc15d2d0 con 0x7fb39c074310 2024-03-23T06:10:34.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.040+0000 7fb3b8c00640 1 -- 172.21.15.73:0/2081290742 <== osd.2 v2:172.21.15.73:6800/36881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb3ac003fb0 con 0x7fb39c074310 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.041+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fb39c074310 msgr2=0x7fb39c076750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.041+0000 7fb3c3800640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fb39c074310 0x7fb39c076750 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.041+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb39c06acd0 msgr2=0x7fb39c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.041+0000 7fb3c3800640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb39c06acd0 0x7fb39c06d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8036000 tx=0x7fb3a8008030 comp rx=0 tx=0).stop 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.041+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3bc1536c0 msgr2=0x7fb3bc1f3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.041+0000 7fb3c3800640 1 --2- 172.21.15.73:0/2081290742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3bc1536c0 0x7fb3bc1f3370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400c3c0 tx=0x7fb3b400c880 comp rx=0 tx=0).stop 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.041+0000 7fb3c1800640 1 -- 172.21.15.73:0/2081290742 reap_dead start 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.042+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 shutdown_connections 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.042+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 >> 172.21.15.73:0/2081290742 conn(0x7fb3bc069cb0 msgr2=0x7fb3bc0caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.045+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 shutdown_connections 2024-03-23T06:10:34.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.045+0000 7fb3c3800640 1 -- 172.21.15.73:0/2081290742 wait complete. 2024-03-23T06:10:34.064 INFO:teuthology.orchestra.run.smithi073.stdout:60129542156 2024-03-23T06:10:34.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-23T06:10:34.065 INFO:teuthology.orchestra.run.smithi073.stdout:60129542158 2024-03-23T06:10:34.065 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-23T06:10:34.066 INFO:teuthology.orchestra.run.smithi073.stdout:55834574861 2024-03-23T06:10:34.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-23T06:10:34.067 INFO:teuthology.orchestra.run.smithi073.stdout:55834574861 2024-03-23T06:10:34.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-23T06:10:34.068 INFO:teuthology.orchestra.run.smithi073.stdout:55834574860 2024-03-23T06:10:34.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-23T06:10:34.069 INFO:tasks.ceph.mds.f.smithi110.stderr:2024-03-23T06:10:34.067+0000 7fa39881c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-23T06:10:34.069 INFO:teuthology.orchestra.run.smithi073.stdout:60129542157 2024-03-23T06:10:34.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-23T06:10:34.070 INFO:teuthology.orchestra.run.smithi073.stdout:55834574860 2024-03-23T06:10:34.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-23T06:10:34.071 INFO:teuthology.orchestra.run.smithi073.stdout:60129542156 2024-03-23T06:10:34.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-23T06:10:34.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.398+0000 7fd137000640 1 Processor -- start 2024-03-23T06:10:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.398+0000 7fd137000640 1 -- start start 2024-03-23T06:10:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.400+0000 7fd137000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1300cb130 0x7fd1301592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.400+0000 7fd137000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13015a1f0 con 0x7fd1300b4780 2024-03-23T06:10:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.400+0000 7fd137000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300c5430 con 0x7fd1300c5050 2024-03-23T06:10:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.400+0000 7fd137000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd130159950 con 0x7fd1300cb130 2024-03-23T06:10:34.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.401+0000 7fd136600640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd1300b4780 0x7fd1300c9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55236/0 (socket says 172.21.15.73:55236) 2024-03-23T06:10:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.401+0000 7fed22c00640 1 Processor -- start 2024-03-23T06:10:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.401+0000 7fca15800640 1 Processor -- start 2024-03-23T06:10:34.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.401+0000 7fd135200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1300cb130 0x7fd1301592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.401+0000 7fd135200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1300cb130 0x7fd1301592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52504/0 (socket says 172.21.15.73:52504) 2024-03-23T06:10:34.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.401+0000 7fd135200640 1 -- 172.21.15.73:0/618529194 learned_addr learned my addr 172.21.15.73:0/618529194 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.402+0000 7fd12fe00640 1 -- 172.21.15.73:0/618529194 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539521123 0 0) 0x7fd13015a1f0 con 0x7fd1300b4780 2024-03-23T06:10:34.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.402+0000 7fd135200640 1 -- 172.21.15.73:0/618529194 >> v1:172.21.15.110:6789/0 conn(0x7fd1300c5050 legacy=0x7fd130069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fd135200640 1 -- 172.21.15.73:0/618529194 >> v1:172.21.15.73:6789/0 conn(0x7fd1300b4780 legacy=0x7fd1300c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.401+0000 7fed22c00640 1 -- start start 2024-03-23T06:10:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fd135200640 1 -- 172.21.15.73:0/618529194 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130159c30 con 0x7fd1300cb130 2024-03-23T06:10:34.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fed22c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fed1c0c9350 0x7fed1c0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.401+0000 7fca15800640 1 -- start start 2024-03-23T06:10:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fca15800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080dd390 0x7fca08046430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fca15800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca08045420 con 0x7fca080e3770 2024-03-23T06:10:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fca15800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca08045fa0 con 0x7fca0804ba30 2024-03-23T06:10:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fca15800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca080e3c00 con 0x7fca080dd390 2024-03-23T06:10:34.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fed22c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed1c0caea0 0x7fed1c15fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fed22c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c0ca090 con 0x7fed1c14f8b0 2024-03-23T06:10:34.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fed22c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c0717b0 con 0x7fed1c0caea0 2024-03-23T06:10:34.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.403+0000 7fed22c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c155e90 con 0x7fed1c0c9350 2024-03-23T06:10:34.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.404+0000 7fca14e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fca080e3770 0x7fca080ed9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55266/0 (socket says 172.21.15.73:55266) 2024-03-23T06:10:34.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.404+0000 7fca0f400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fca0804ba30 0x7fca080e3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38704/0 (socket says 172.21.15.73:38704) 2024-03-23T06:10:34.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.404+0000 7fca0f400640 1 -- 172.21.15.73:0/3303325778 learned_addr learned my addr 172.21.15.73:0/3303325778 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:34.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.404+0000 7fed1b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fed1c0c9350 0x7fed1c0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.404+0000 7fed1b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fed1c0c9350 0x7fed1c0ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52512/0 (socket says 172.21.15.73:52512) 2024-03-23T06:10:34.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.404+0000 7fed1b400640 1 -- 172.21.15.73:0/3298392987 learned_addr learned my addr 172.21.15.73:0/3298392987 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.404+0000 7fed20c00640 1 --2- 172.21.15.73:0/3298392987 >> v2:172.21.15.73:3300/0 conn(0x7fed1c0caea0 0x7fed1c15fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.405+0000 7fd135200640 1 --2- 172.21.15.73:0/618529194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1300cb130 0x7fd1301592a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd124009870 tx=0x7fd12402b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63cfa0cd994f5287 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.405+0000 7fed1b400640 1 -- 172.21.15.73:0/3298392987 >> v2:172.21.15.73:3300/0 conn(0x7fed1c0caea0 msgr2=0x7fed1c15fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.405+0000 7fed1b400640 1 --2- 172.21.15.73:0/3298392987 >> v2:172.21.15.73:3300/0 conn(0x7fed1c0caea0 0x7fed1c15fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.405+0000 7fed1b400640 1 -- 172.21.15.73:0/3298392987 >> v1:172.21.15.73:6789/0 conn(0x7fed1c14f8b0 legacy=0x7fed1c0710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.405+0000 7fed1b400640 1 -- 172.21.15.73:0/3298392987 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c0cb2a0 con 0x7fed1c0c9350 2024-03-23T06:10:34.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.405+0000 7fca0fe00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080dd390 0x7fca08046430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fd12fe00640 1 -- 172.21.15.73:0/618529194 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124031880 con 0x7fd1300cb130 2024-03-23T06:10:34.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.405+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743791571 0 0) 0x7fca08045fa0 con 0x7fca0804ba30 2024-03-23T06:10:34.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.405+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f8003520 con 0x7fca0804ba30 2024-03-23T06:10:34.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fd12fe00640 1 -- 172.21.15.73:0/618529194 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1240319e0 con 0x7fd1300cb130 2024-03-23T06:10:34.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fd12fe00640 1 -- 172.21.15.73:0/618529194 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124031880 con 0x7fd1300cb130 2024-03-23T06:10:34.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685539923 0 0) 0x7fca08045420 con 0x7fca080e3770 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca08045fa0 con 0x7fca080e3770 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 920566845 0 0) 0x7fc9f8003520 con 0x7fca0804ba30 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080dd390 msgr2=0x7fca08046430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080dd390 0x7fca08046430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 >> v1:172.21.15.73:6789/0 conn(0x7fca080e3770 legacy=0x7fca080ed9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080dd770 con 0x7fca0804ba30 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fca040015f0 con 0x7fca0804ba30 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 >> v1:172.21.15.110:6789/0 conn(0x7fca0804ba30 legacy=0x7fca080e3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9f8003b00 0x7fc9f8003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80047c0 0x7fc9f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9f8005180 0x7fc9f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080e3c00 con 0x7fc9f80047c0 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f800bef0 con 0x7fc9f8005180 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f800c0b0 con 0x7fc9f8003b00 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.406+0000 7fca14e00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9f8005180 0x7fc9f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fca14e00640 1 -- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9f8003b00 msgr2=0x7fc9f8003f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fca14e00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9f8003b00 0x7fc9f8003f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fca14e00640 1 -- 172.21.15.73:0/3303325778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80047c0 msgr2=0x7fc9f8004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:34.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fed1b400640 1 --2- 172.21.15.73:0/3298392987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c0c9350 0x7fed1c0ca960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed1c06f330 tx=0x7fed0802e050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7144fb4c0a8a4466 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fca0f400640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80047c0 0x7fc9f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fca14e00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80047c0 0x7fc9f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fca14e00640 1 -- 172.21.15.73:0/3303325778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8003520 con 0x7fc9f8005180 2024-03-23T06:10:34.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fd137000640 1 -- 172.21.15.73:0/618529194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1300cb130 msgr2=0x7fd1301592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.407+0000 7fd137000640 1 --2- 172.21.15.73:0/618529194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1300cb130 0x7fd1301592a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd124009870 tx=0x7fd12402b920 comp rx=0 tx=0).stop 2024-03-23T06:10:34.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fca0f400640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80047c0 0x7fc9f8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:34.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fd137000640 1 -- 172.21.15.73:0/618529194 shutdown_connections 2024-03-23T06:10:34.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fd137000640 1 --2- 172.21.15.73:0/618529194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1300cb130 0x7fd1301592a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fd137000640 1 -- 172.21.15.73:0/618529194 >> 172.21.15.73:0/618529194 conn(0x7fd1300ceb80 msgr2=0x7fd1300cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fd137000640 1 -- 172.21.15.73:0/618529194 shutdown_connections 2024-03-23T06:10:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fd137000640 1 -- 172.21.15.73:0/618529194 wait complete. 2024-03-23T06:10:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fed1aa00640 1 -- 172.21.15.73:0/3298392987 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0802ee00 con 0x7fed1c0c9350 2024-03-23T06:10:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fed1aa00640 1 -- 172.21.15.73:0/3298392987 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08032070 con 0x7fed1c0c9350 2024-03-23T06:10:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7fed1aa00640 1 -- 172.21.15.73:0/3298392987 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08038620 con 0x7fed1c0c9350 2024-03-23T06:10:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.408+0000 7ffa79200640 1 Processor -- start 2024-03-23T06:10:34.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.409+0000 7fed22c00640 1 -- 172.21.15.73:0/3298392987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c0c9350 msgr2=0x7fed1c0ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.409+0000 7fed22c00640 1 --2- 172.21.15.73:0/3298392987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c0c9350 0x7fed1c0ca960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed1c06f330 tx=0x7fed0802e050 comp rx=0 tx=0).stop 2024-03-23T06:10:34.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.409+0000 7fca14e00640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9f8005180 0x7fc9f800b980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca10063b00 tx=0x7fc9f80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a3fddd7a4fdc025 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.409+0000 7ffa79200640 1 -- start start 2024-03-23T06:10:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.409+0000 7fed22c00640 1 -- 172.21.15.73:0/3298392987 shutdown_connections 2024-03-23T06:10:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fed22c00640 1 --2- 172.21.15.73:0/3298392987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c0c9350 0x7fed1c0ca960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fed22c00640 1 --2- 172.21.15.73:0/3298392987 >> v2:172.21.15.73:3300/0 conn(0x7fed1c0caea0 0x7fed1c15fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fed22c00640 1 -- 172.21.15.73:0/3298392987 >> 172.21.15.73:0/3298392987 conn(0x7fed1c069cb0 msgr2=0x7fed1c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100ad600 con 0x7fc9f8005180 2024-03-23T06:10:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fed22c00640 1 -- 172.21.15.73:0/3298392987 shutdown_connections 2024-03-23T06:10:34.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca100a9050 con 0x7fc9f8005180 2024-03-23T06:10:34.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fca0ea00640 1 -- 172.21.15.73:0/3303325778 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100ad600 con 0x7fc9f8005180 2024-03-23T06:10:34.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fd137000640 1 Processor -- start 2024-03-23T06:10:34.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.410+0000 7fed22c00640 1 -- 172.21.15.73:0/3298392987 wait complete. 2024-03-23T06:10:34.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.411+0000 7fd137000640 1 -- start start 2024-03-23T06:10:34.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.411+0000 7fca15800640 1 -- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9f8005180 msgr2=0x7fc9f800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.411+0000 7fca15800640 1 --2- 172.21.15.73:0/3303325778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9f8005180 0x7fc9f800b980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fca10063b00 tx=0x7fc9f80057f0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.411+0000 7fca14e00640 1 -- 172.21.15.73:0/3303325778 reap_dead start 2024-03-23T06:10:34.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.412+0000 7fca15800640 1 -- 172.21.15.73:0/3303325778 shutdown_connections 2024-03-23T06:10:34.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.412+0000 7fca15800640 1 -- 172.21.15.73:0/3303325778 >> 172.21.15.73:0/3303325778 conn(0x7fca08050150 msgr2=0x7fca08050560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.412+0000 7fca15800640 1 -- 172.21.15.73:0/3303325778 shutdown_connections 2024-03-23T06:10:34.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.411+0000 7ffa79200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa6c050af0 0x7ffa6c006210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.411+0000 7ffa79200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c049f20 con 0x7ffa6c049af0 2024-03-23T06:10:34.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.411+0000 7ffa79200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c04f360 con 0x7ffa6c0d9170 2024-03-23T06:10:34.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.411+0000 7ffa79200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c04f640 con 0x7ffa6c050af0 2024-03-23T06:10:34.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.412+0000 7ffa72a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa6c050af0 0x7ffa6c006210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.412+0000 7ffa72a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa6c050af0 0x7ffa6c006210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52532/0 (socket says 172.21.15.73:52532) 2024-03-23T06:10:34.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.412+0000 7ffa72a00640 1 -- 172.21.15.73:0/1945604958 learned_addr learned my addr 172.21.15.73:0/1945604958 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.412+0000 7ffa72a00640 1 -- 172.21.15.73:0/1945604958 >> v1:172.21.15.110:6789/0 conn(0x7ffa6c0d9170 legacy=0x7ffa6c04ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7fed22c00640 1 Processor -- start 2024-03-23T06:10:34.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7fd137000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1300b4780 0x7fd130156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7fd137000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1300c5050 0x7fd130155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7fed22c00640 1 -- start start 2024-03-23T06:10:34.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7fd137000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1300cb130 0x7fd1301df420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7fd137000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301efa10 con 0x7fd1300cb130 2024-03-23T06:10:34.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7fd137000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130156130 con 0x7fd1300b4780 2024-03-23T06:10:34.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7fd137000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301eed90 con 0x7fd1300c5050 2024-03-23T06:10:34.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7ffa72a00640 1 -- 172.21.15.73:0/1945604958 >> v1:172.21.15.73:6789/0 conn(0x7ffa6c049af0 legacy=0x7ffa6c04ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.414+0000 7fd135200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1300c5050 0x7fd130155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.414+0000 7f71b3600640 1 Processor -- start 2024-03-23T06:10:34.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.414+0000 7fd136600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1300cb130 0x7fd1301df420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.414+0000 7fd135200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1300c5050 0x7fd130155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49392/0 (socket says 172.21.15.73:49392) 2024-03-23T06:10:34.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.414+0000 7fd135200640 1 -- 172.21.15.73:0/303606093 learned_addr learned my addr 172.21.15.73:0/303606093 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.412+0000 7fca15800640 1 -- 172.21.15.73:0/3303325778 wait complete. 2024-03-23T06:10:34.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.414+0000 7fca15800640 1 Processor -- start 2024-03-23T06:10:34.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fca15800640 1 -- start start 2024-03-23T06:10:34.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fd136600640 1 -- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1300c5050 msgr2=0x7fd130155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fd136600640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1300c5050 0x7fd130155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fd136600640 1 -- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1300b4780 msgr2=0x7fd130156610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:10:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fd136600640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1300b4780 0x7fd130156610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fd136600640 1 -- 172.21.15.73:0/303606093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240094d0 con 0x7fd1300cb130 2024-03-23T06:10:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.414+0000 7f71b3600640 1 -- start start 2024-03-23T06:10:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fd136600640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1300cb130 0x7fd1301df420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c750 tx=0x7fd12800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.413+0000 7ffa72a00640 1 -- 172.21.15.73:0/1945604958 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c04a150 con 0x7ffa6c050af0 2024-03-23T06:10:34.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7f95c8400640 1 Processor -- start 2024-03-23T06:10:34.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7f95c8400640 1 -- start start 2024-03-23T06:10:34.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed22c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed1c0c9350 0x7fed1c14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed22c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed1c0caea0 0x7fed1c149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed22c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c14f8b0 0x7fed1c150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed22c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c1479f0 con 0x7fed1c0caea0 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed22c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c147710 con 0x7fed1c14f8b0 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed22c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c152540 con 0x7fed1c0c9350 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed1be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed1c0c9350 0x7fed1c14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed1be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed1c0c9350 0x7fed1c14a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49404/0 (socket says 172.21.15.73:49404) 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.415+0000 7fed1be00640 1 -- 172.21.15.73:0/3437496783 learned_addr learned my addr 172.21.15.73:0/3437496783 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fed1be00640 1 -- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c14f8b0 msgr2=0x7fed1c150140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fed1be00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c14f8b0 0x7fed1c150140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fed1be00640 1 -- 172.21.15.73:0/3437496783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed1c0caea0 msgr2=0x7fed1c149ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fed1be00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed1c0caea0 0x7fed1c149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fed1be00640 1 -- 172.21.15.73:0/3437496783 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08008550 con 0x7fed1c0c9350 2024-03-23T06:10:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7ffa72a00640 1 --2- 172.21.15.73:0/1945604958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c006210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009870 tx=0x7ffa6002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba556af9928837b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fca15800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f8005180 0x7fca0804a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fca15800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca080e0d40 0x7fca080d5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fca15800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080cf8b0 0x7fca08048410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fd12d600640 1 -- 172.21.15.73:0/303606093 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128004d70 con 0x7fd1300cb130 2024-03-23T06:10:34.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fd12d600640 1 -- 172.21.15.73:0/303606093 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12800a640 con 0x7fd1300cb130 2024-03-23T06:10:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fd12d600640 1 -- 172.21.15.73:0/303606093 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12800a9f0 con 0x7fd1300cb130 2024-03-23T06:10:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1301ef070 con 0x7fd1300cb130 2024-03-23T06:10:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1301ef630 con 0x7fd1300cb130 2024-03-23T06:10:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7ffa72000640 1 -- 172.21.15.73:0/1945604958 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6002f850 con 0x7ffa6c050af0 2024-03-23T06:10:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7ffa72000640 1 -- 172.21.15.73:0/1945604958 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6002f9b0 con 0x7ffa6c050af0 2024-03-23T06:10:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7ffa72000640 1 -- 172.21.15.73:0/1945604958 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6002fd40 con 0x7ffa6c050af0 2024-03-23T06:10:34.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7f95c8400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c0157bc0 0x7f95c00c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7f71b3600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f71ac157b70 0x7f71ac0c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7f71b3600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac0c94d0 con 0x7f71ac15e340 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7f71b3600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac0c9850 con 0x7f71ac0caa20 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7f71b3600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac0c76f0 con 0x7f71ac157b70 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7f71b1600640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f71ac0caa20 0x7f71ac168240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38728/0 (socket says 172.21.15.73:38728) 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7f71b1600640 1 -- 172.21.15.73:0/1156972235 learned_addr learned my addr 172.21.15.73:0/1156972235 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64990269 0 0) 0x7f71ac0c9850 con 0x7f71ac0caa20 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7190003520 con 0x7f71ac0caa20 2024-03-23T06:10:34.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fead6800640 1 Processor -- start 2024-03-23T06:10:34.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fead6800640 1 -- start start 2024-03-23T06:10:34.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4010847569 0 0) 0x7f7190003520 con 0x7f71ac0caa20 2024-03-23T06:10:34.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 >> v2:172.21.15.73:3300/0 conn(0x7f71ac157b70 msgr2=0x7f71ac0c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 --2- 172.21.15.73:0/1156972235 >> v2:172.21.15.73:3300/0 conn(0x7f71ac157b70 0x7f71ac0c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 >> v1:172.21.15.73:6789/0 conn(0x7f71ac15e340 legacy=0x7f71ac0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0c9c30 con 0x7f71ac0caa20 2024-03-23T06:10:34.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f71a40019f0 con 0x7f71ac0caa20 2024-03-23T06:10:34.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 >> v1:172.21.15.110:6789/0 conn(0x7f71ac0caa20 legacy=0x7f71ac168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190003970 0x7f7190003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71900047c0 0x7f7190004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71900051f0 0x7f719000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0c76f0 con 0x7f71900051f0 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719000c140 con 0x7f7190003970 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719000c300 con 0x7f71900047c0 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.416+0000 7fed1be00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed1c0c9350 0x7fed1c14a990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c480 tx=0x7fed0c00c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fed13e00640 1 -- 172.21.15.73:0/3437496783 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0052d0 con 0x7fed1c0c9350 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c152820 con 0x7fed1c0c9350 2024-03-23T06:10:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c152de0 con 0x7fed1c0c9350 2024-03-23T06:10:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f95c5a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c0157bc0 0x7f95c00c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f95c5a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c0157bc0 0x7f95c00c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49406/0 (socket says 172.21.15.73:49406) 2024-03-23T06:10:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f95c5a00640 1 -- 172.21.15.73:0/250223855 learned_addr learned my addr 172.21.15.73:0/250223855 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7fed13e00640 1 -- 172.21.15.73:0/3437496783 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c005430 con 0x7fed1c0c9350 2024-03-23T06:10:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7f71b0c00640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190003970 0x7f7190003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7ffa79200640 1 -- 172.21.15.73:0/1945604958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 msgr2=0x7ffa6c006210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.417+0000 7ffa79200640 1 --2- 172.21.15.73:0/1945604958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c006210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009870 tx=0x7ffa6002ba30 comp rx=0 tx=0).stop 2024-03-23T06:10:34.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7fca0f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca080e0d40 0x7fca080d5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7fca0f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca080e0d40 0x7fca080d5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52540/0 (socket says 172.21.15.73:52540) 2024-03-23T06:10:34.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f95c8400640 1 -- 172.21.15.73:0/250223855 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00b1e70 con 0x7f95c00cb3a0 2024-03-23T06:10:34.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f95c8400640 1 -- 172.21.15.73:0/250223855 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c006a3f0 con 0x7f95c00ca880 2024-03-23T06:10:34.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f95c8400640 1 -- 172.21.15.73:0/250223855 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00ca050 con 0x7f95c0157bc0 2024-03-23T06:10:34.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f71b0c00640 1 -- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71900047c0 msgr2=0x7f7190004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:34.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f71b0c00640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71900047c0 0x7f7190004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f71b0c00640 1 -- 172.21.15.73:0/1156972235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71900051f0 msgr2=0x7f719000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f71b0c00640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71900051f0 0x7f719000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f71b0c00640 1 -- 172.21.15.73:0/1156972235 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac0c9c30 con 0x7f7190003970 2024-03-23T06:10:34.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.418+0000 7fed13e00640 1 -- 172.21.15.73:0/3437496783 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0052d0 con 0x7fed1c0c9350 2024-03-23T06:10:34.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7fca0f400640 1 -- 172.21.15.73:0/1002378744 learned_addr learned my addr 172.21.15.73:0/1002378744 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7fca14e00640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080cf8b0 0x7fca08048410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080d68c0 con 0x7fc9f8005180 2024-03-23T06:10:34.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca080d65e0 con 0x7fca080e0d40 2024-03-23T06:10:34.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca08047650 con 0x7fca080cf8b0 2024-03-23T06:10:34.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130069310 con 0x7fd1300cb130 2024-03-23T06:10:34.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7ffa79200640 1 -- 172.21.15.73:0/1945604958 shutdown_connections 2024-03-23T06:10:34.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7ffa79200640 1 --2- 172.21.15.73:0/1945604958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c006210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7ffa79200640 1 -- 172.21.15.73:0/1945604958 >> 172.21.15.73:0/1945604958 conn(0x7ffa6c050fc0 msgr2=0x7ffa6c0513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f95c5a00640 1 -- 172.21.15.73:0/250223855 >> v1:172.21.15.110:6789/0 conn(0x7f95c00ca880 legacy=0x7f95c006a880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:10:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f95c5a00640 1 -- 172.21.15.73:0/250223855 >> v1:172.21.15.73:6789/0 conn(0x7f95c00cb3a0 legacy=0x7f95c00cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f95c5a00640 1 -- 172.21.15.73:0/250223855 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c015e3d0 con 0x7f95c0157bc0 2024-03-23T06:10:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7f95c5a00640 1 --2- 172.21.15.73:0/250223855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c0157bc0 0x7f95c00c3c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009e80 tx=0x7f95b802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd2024315dd33e1e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.419+0000 7f71b1600640 1 -- 172.21.15.73:0/1156972235 reap_dead start 2024-03-23T06:10:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7f71b0c00640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190003970 0x7f7190003d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f719c009860 tx=0x7f71900057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=244344dde7afe905 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c032600 con 0x7f7190003970 2024-03-23T06:10:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c02e050 con 0x7f7190003970 2024-03-23T06:10:34.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7f71ab400640 1 -- 172.21.15.73:0/1156972235 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c032600 con 0x7f7190003970 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fead6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead00ca7d0 0x7fead00cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fead6800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fead00b1c40 0x7fead0163e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fead6800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead00b2460 con 0x7fead01537b0 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fead6800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00ca140 con 0x7fead00b1c40 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fead6800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead015a4b0 con 0x7fead00ca7d0 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7feacf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead00ca7d0 0x7fead00cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7feacea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fead01537b0 0x7fead006a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55288/0 (socket says 172.21.15.73:55288) 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7feacea00640 1 -- 172.21.15.73:0/217303258 learned_addr learned my addr 172.21.15.73:0/217303258 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7feacf400640 1 -- 172.21.15.73:0/217303258 >> v2:172.21.15.73:3300/0 conn(0x7fead00b1c40 msgr2=0x7fead0163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7feacf400640 1 --2- 172.21.15.73:0/217303258 >> v2:172.21.15.73:3300/0 conn(0x7fead00b1c40 0x7fead0163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7feacf400640 1 -- 172.21.15.73:0/217303258 >> v1:172.21.15.73:6789/0 conn(0x7fead01537b0 legacy=0x7fead006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7feacf400640 1 -- 172.21.15.73:0/217303258 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00c9e60 con 0x7fead00ca7d0 2024-03-23T06:10:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7f71b3600640 1 -- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190003970 msgr2=0x7f7190003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7f71b3600640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190003970 0x7f7190003d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f719c009860 tx=0x7f71900057f0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c14da70 con 0x7fed1c0c9350 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.420+0000 7fca0fe00640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f8005180 0x7fca0804a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7fca14e00640 1 -- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca080e0d40 msgr2=0x7fca080d5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7fca14e00640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca080e0d40 0x7fca080d5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7fca14e00640 1 -- 172.21.15.73:0/1002378744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f8005180 msgr2=0x7fca0804a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7fca14e00640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f8005180 0x7fca0804a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.421+0000 7fca14e00640 1 -- 172.21.15.73:0/1002378744 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08047930 con 0x7fca080cf8b0 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7fca14e00640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080cf8b0 0x7fca08048410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca10061880 tx=0x7fca10067f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7f71b3600640 1 -- 172.21.15.73:0/1156972235 shutdown_connections 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7f71b3600640 1 --2- 172.21.15.73:0/1156972235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190003970 0x7f7190003d70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7f71b3600640 1 -- 172.21.15.73:0/1156972235 >> 172.21.15.73:0/1156972235 conn(0x7f71ac069cb0 msgr2=0x7f71ac06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7fca03e00640 1 -- 172.21.15.73:0/1002378744 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100ad600 con 0x7fca080cf8b0 2024-03-23T06:10:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7fca03e00640 1 -- 172.21.15.73:0/1002378744 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca100ac860 con 0x7fca080cf8b0 2024-03-23T06:10:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7fca03e00640 1 -- 172.21.15.73:0/1002378744 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100acbd0 con 0x7fca080cf8b0 2024-03-23T06:10:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca08047c10 con 0x7fca080cf8b0 2024-03-23T06:10:34.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.422+0000 7f71b3600640 1 -- 172.21.15.73:0/1156972235 shutdown_connections 2024-03-23T06:10:34.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.423+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca080cfd30 con 0x7fca080cf8b0 2024-03-23T06:10:34.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.423+0000 7fed13e00640 1 -- 172.21.15.73:0/3437496783 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fed0c012630 con 0x7fed1c0c9350 2024-03-23T06:10:34.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.423+0000 7feacf400640 1 --2- 172.21.15.73:0/217303258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead00ca7d0 0x7fead00cabb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feac00097a0 tx=0x7feac002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88ab9bc1d251622a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.423+0000 7f71b3600640 1 -- 172.21.15.73:0/1156972235 wait complete. 2024-03-23T06:10:34.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.424+0000 7f95bfe00640 1 -- 172.21.15.73:0/250223855 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b802ca50 con 0x7f95c0157bc0 2024-03-23T06:10:34.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.424+0000 7fd12d600640 1 -- 172.21.15.73:0/303606093 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd12800ab50 con 0x7fd1300cb130 2024-03-23T06:10:34.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.424+0000 7fed13e00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fecfc06ac60 0x7fecfc06d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.424+0000 7ffa79200640 1 -- 172.21.15.73:0/1945604958 shutdown_connections 2024-03-23T06:10:34.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.424+0000 7fed13e00640 1 -- 172.21.15.73:0/3437496783 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fed0c088e60 con 0x7fed1c0c9350 2024-03-23T06:10:34.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.424+0000 7ffa79200640 1 -- 172.21.15.73:0/1945604958 wait complete. 2024-03-23T06:10:34.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.424+0000 7f95bfe00640 1 -- 172.21.15.73:0/250223855 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b802cbb0 con 0x7f95c0157bc0 2024-03-23T06:10:34.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.424+0000 7f95bfe00640 1 -- 172.21.15.73:0/250223855 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80343f0 con 0x7f95c0157bc0 2024-03-23T06:10:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.425+0000 7fed1b400640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fecfc06ac60 0x7fecfc06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.425+0000 7fd12d600640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd11006ad00 0x7fd11006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.425+0000 7f71b3600640 1 Processor -- start 2024-03-23T06:10:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.425+0000 7fd12d600640 1 -- 172.21.15.73:0/303606093 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd128089270 con 0x7fd1300cb130 2024-03-23T06:10:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.425+0000 7f95c8400640 1 -- 172.21.15.73:0/250223855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c0157bc0 msgr2=0x7f95c00c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.425+0000 7f95c8400640 1 --2- 172.21.15.73:0/250223855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c0157bc0 0x7f95c00c3c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009e80 tx=0x7f95b802beb0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.425+0000 7f71b3600640 1 -- start start 2024-03-23T06:10:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7fd135c00640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd11006ad00 0x7fd11006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7f95c8400640 1 -- 172.21.15.73:0/250223855 shutdown_connections 2024-03-23T06:10:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7f95c8400640 1 --2- 172.21.15.73:0/250223855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c0157bc0 0x7f95c00c3c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7f95c8400640 1 -- 172.21.15.73:0/250223855 >> 172.21.15.73:0/250223855 conn(0x7f95c0071800 msgr2=0x7f95c0071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7fed1b400640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fecfc06ac60 0x7fecfc06d120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed08039000 tx=0x7fed08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7f95c8400640 1 -- 172.21.15.73:0/250223855 shutdown_connections 2024-03-23T06:10:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec005250 con 0x7fca080cf8b0 2024-03-23T06:10:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7f95c8400640 1 -- 172.21.15.73:0/250223855 wait complete. 2024-03-23T06:10:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.426+0000 7fd135c00640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd11006ad00 0x7fd11006d1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000f60 tx=0x7fd11c0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.427+0000 7ffa79200640 1 Processor -- start 2024-03-23T06:10:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.427+0000 7ffa79200640 1 -- start start 2024-03-23T06:10:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.427+0000 7f71b3600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7190003970 0x7f71ac1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.427+0000 7f71b3600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71ac15ea80 0x7f71ac0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.427+0000 7f71b3600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71ac15a7b0 0x7f71ac0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.427+0000 7f71b3600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac161540 con 0x7f7190003970 2024-03-23T06:10:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.427+0000 7f71b3600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac1f3360 con 0x7f71ac15ea80 2024-03-23T06:10:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7f71b3600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac152ea0 con 0x7f71ac15a7b0 2024-03-23T06:10:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7fed13e00640 1 -- 172.21.15.73:0/3437496783 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fed0c053d40 con 0x7fed1c0c9350 2024-03-23T06:10:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.427+0000 7feace000640 1 -- 172.21.15.73:0/217303258 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac002f050 con 0x7fead00ca7d0 2024-03-23T06:10:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7feace000640 1 -- 172.21.15.73:0/217303258 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0031700 con 0x7fead00ca7d0 2024-03-23T06:10:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7feace000640 1 -- 172.21.15.73:0/217303258 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0031a90 con 0x7fead00ca7d0 2024-03-23T06:10:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7f71b0c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7190003970 0x7f71ac1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7f71b1600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71ac15a7b0 0x7f71ac0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7ffa79200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa6c049af0 0x7ffa6c0dffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7f71b1600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71ac15a7b0 0x7f71ac0c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49434/0 (socket says 172.21.15.73:49434) 2024-03-23T06:10:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.428+0000 7f71b1600640 1 -- 172.21.15.73:0/281463666 learned_addr learned my addr 172.21.15.73:0/281463666 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa79200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c0d41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa79200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa6c0d9170 0x7ffa6c0e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa79200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0cda30 con 0x7ffa6c049af0 2024-03-23T06:10:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa79200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0ce290 con 0x7ffa6c050af0 2024-03-23T06:10:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa79200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0ce5e0 con 0x7ffa6c0d9170 2024-03-23T06:10:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa72a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c0d41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa72a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c0d41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52572/0 (socket says 172.21.15.73:52572) 2024-03-23T06:10:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa72a00640 1 -- 172.21.15.73:0/1380044830 learned_addr learned my addr 172.21.15.73:0/1380044830 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7f95c8400640 1 Processor -- start 2024-03-23T06:10:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7fead6800640 1 -- 172.21.15.73:0/217303258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead00ca7d0 msgr2=0x7fead00cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7fead6800640 1 --2- 172.21.15.73:0/217303258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead00ca7d0 0x7fead00cabb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feac00097a0 tx=0x7feac002b7a0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa73e00640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa6c0d9170 0x7ffa6c0e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7ffa73400640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa6c049af0 0x7ffa6c0dffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f95c8400640 1 -- start start 2024-03-23T06:10:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7fca03e00640 1 -- 172.21.15.73:0/1002378744 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fca100b4050 con 0x7fca080cf8b0 2024-03-23T06:10:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7ffa72a00640 1 -- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa6c0d9170 msgr2=0x7ffa6c0e0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7ffa72a00640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa6c0d9170 0x7ffa6c0e0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7ffa72a00640 1 -- 172.21.15.73:0/1380044830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa6c049af0 msgr2=0x7ffa6c0dffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7ffa72a00640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa6c049af0 0x7ffa6c0dffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7ffa72a00640 1 -- 172.21.15.73:0/1380044830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa600094d0 con 0x7ffa6c050af0 2024-03-23T06:10:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.429+0000 7f71abe00640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71ac15ea80 0x7f71ac0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f71b0c00640 1 -- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71ac15a7b0 msgr2=0x7f71ac0c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f71b0c00640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71ac15a7b0 0x7f71ac0c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f71b0c00640 1 -- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71ac15ea80 msgr2=0x7f71ac0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f71b0c00640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71ac15ea80 0x7f71ac0c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f71b0c00640 1 -- 172.21.15.73:0/281463666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac153180 con 0x7f7190003970 2024-03-23T06:10:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f2fcf800640 1 Processor -- start 2024-03-23T06:10:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7ffa72a00640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c0d41e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009870 tx=0x7ffa600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7fead6800640 1 -- 172.21.15.73:0/217303258 shutdown_connections 2024-03-23T06:10:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7fead6800640 1 --2- 172.21.15.73:0/217303258 >> v2:172.21.15.73:3300/0 conn(0x7fead00b1c40 0x7fead0163e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7fead6800640 1 --2- 172.21.15.73:0/217303258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead00ca7d0 0x7fead00cabb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7fead6800640 1 -- 172.21.15.73:0/217303258 >> 172.21.15.73:0/217303258 conn(0x7fead0071800 msgr2=0x7fead0071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f71b0c00640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7190003970 0x7f71ac1581d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f719c032000 tx=0x7f719c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7fead6800640 1 -- 172.21.15.73:0/217303258 shutdown_connections 2024-03-23T06:10:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7ffa67400640 1 -- 172.21.15.73:0/1380044830 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6003b040 con 0x7ffa6c050af0 2024-03-23T06:10:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7ffa67400640 1 -- 172.21.15.73:0/1380044830 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa60037dd0 con 0x7ffa6c050af0 2024-03-23T06:10:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7ffa67400640 1 -- 172.21.15.73:0/1380044830 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa600426a0 con 0x7ffa6c050af0 2024-03-23T06:10:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0ce890 con 0x7ffa6c050af0 2024-03-23T06:10:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7fead6800640 1 -- 172.21.15.73:0/217303258 wait complete. 2024-03-23T06:10:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7fca03e00640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc9f006ad00 0x7fc9f006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c0cdf20 con 0x7ffa6c050af0 2024-03-23T06:10:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.430+0000 7f2fcf800640 1 -- start start 2024-03-23T06:10:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.431+0000 7fca03e00640 1 -- 172.21.15.73:0/1002378744 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca10124dc0 con 0x7fca080cf8b0 2024-03-23T06:10:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.432+0000 7fca0fe00640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc9f006ad00 0x7fc9f006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7fca0fe00640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc9f006ad00 0x7fc9f006d1c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca08007990 tx=0x7fc9fc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f71a8c00640 1 -- 172.21.15.73:0/281463666 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c03d620 con 0x7f7190003970 2024-03-23T06:10:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f71a8c00640 1 -- 172.21.15.73:0/281463666 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c03d7a0 con 0x7f7190003970 2024-03-23T06:10:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f71a8c00640 1 -- 172.21.15.73:0/281463666 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c03db50 con 0x7f7190003970 2024-03-23T06:10:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7fead6800640 1 Processor -- start 2024-03-23T06:10:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f2fcf800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fc8157bc0 0x7f2fc80c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7fca03e00640 1 -- 172.21.15.73:0/1002378744 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fca100efcb0 con 0x7fca080cf8b0 2024-03-23T06:10:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7fead6800640 1 -- start start 2024-03-23T06:10:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f2fcf800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2fc80cb3a0 0x7f2fc80cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f2fcf800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80ca880 0x7f2fc80cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcce00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fc8157bc0 0x7f2fc80c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcf800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80ca050 con 0x7f2fc80cb3a0 2024-03-23T06:10:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcf800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80b1e70 con 0x7f2fc8157bc0 2024-03-23T06:10:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcce00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fc8157bc0 0x7f2fc80c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52590/0 (socket says 172.21.15.73:52590) 2024-03-23T06:10:34.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcce00640 1 -- 172.21.15.73:0/1838716210 learned_addr learned my addr 172.21.15.73:0/1838716210 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcd800640 1 --2- 172.21.15.73:0/1838716210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80ca880 0x7f2fc80cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcf800640 1 -- 172.21.15.73:0/1838716210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc806a3f0 con 0x7f2fc80ca880 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcd800640 1 -- 172.21.15.73:0/1838716210 >> v2:172.21.15.110:3300/0 conn(0x7f2fc8157bc0 msgr2=0x7f2fc80c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcd800640 1 --2- 172.21.15.73:0/1838716210 >> v2:172.21.15.110:3300/0 conn(0x7f2fc8157bc0 0x7f2fc80c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fcd800640 1 -- 172.21.15.73:0/1838716210 >> v2:172.21.15.73:3300/0 conn(0x7f2fc80cb3a0 msgr2=0x7f2fc80cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f2fc7e00640 1 --2- 172.21.15.73:0/1838716210 >> v2:172.21.15.73:3300/0 conn(0x7f2fc80cb3a0 0x7f2fc80cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac1f3620 con 0x7f7190003970 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac1f3be0 con 0x7f7190003970 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7f2fcd800640 1 --2- 172.21.15.73:0/1838716210 >> v2:172.21.15.73:3300/0 conn(0x7f2fc80cb3a0 0x7f2fc80cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7f2fcd800640 1 -- 172.21.15.73:0/1838716210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc815e3d0 con 0x7f2fc80ca880 2024-03-23T06:10:34.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7f2fc7e00640 1 --2- 172.21.15.73:0/1838716210 >> v2:172.21.15.73:3300/0 conn(0x7f2fc80cb3a0 0x7f2fc80cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:34.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7fd12d600640 1 -- 172.21.15.73:0/303606093 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd128054280 con 0x7fd1300cb130 2024-03-23T06:10:34.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.432+0000 7f95c8400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c00ca880 0x7f95c00b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.432+0000 7f95c8400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95c00cb3a0 0x7f95c01f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.432+0000 7f95c8400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c0157bc0 0x7f95c00ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f95c6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c0157bc0 0x7f95c00ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f95c6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c0157bc0 0x7f95c00ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52580/0 (socket says 172.21.15.73:52580) 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f95c6400640 1 -- 172.21.15.73:0/95619598 learned_addr learned my addr 172.21.15.73:0/95619598 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f95c8400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00cfc30 con 0x7f95c00cb3a0 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00c6210 con 0x7f95c0157bc0 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.433+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01f3870 con 0x7f95c00ca880 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f95c5a00640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c00ca880 0x7f95c00b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f95c6400640 1 -- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c00ca880 msgr2=0x7f95c00b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f95c6400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c00ca880 0x7f95c00b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f95c6400640 1 -- 172.21.15.73:0/95619598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95c00cb3a0 msgr2=0x7f95c01f4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f95c6400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95c00cb3a0 0x7f95c01f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.434+0000 7f95c6400640 1 -- 172.21.15.73:0/95619598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009b30 con 0x7f95c0157bc0 2024-03-23T06:10:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa50005250 con 0x7ffa6c050af0 2024-03-23T06:10:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7ffa67400640 1 -- 172.21.15.73:0/1380044830 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ffa60042800 con 0x7ffa6c050af0 2024-03-23T06:10:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7fead6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead00b1c40 0x7fead01f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7fead6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead00ca7d0 0x7fead01e5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.435+0000 7fead6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead0143340 0x7fead01ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7fead6800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead01e5790 con 0x7fead00ca7d0 2024-03-23T06:10:34.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7feacf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead00b1c40 0x7fead01f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7fead6800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead01e3430 con 0x7fead00b1c40 2024-03-23T06:10:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7fead6800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead01efb10 con 0x7fead0143340 2024-03-23T06:10:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7feacfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead0143340 0x7fead01ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7feacfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead0143340 0x7fead01ef5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49478/0 (socket says 172.21.15.73:49478) 2024-03-23T06:10:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7feacfe00640 1 -- 172.21.15.73:0/3643519385 learned_addr learned my addr 172.21.15.73:0/3643519385 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7f95c6400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c0157bc0 0x7f95c00ccb60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00b420 tx=0x7f95ac00b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.436+0000 7feacea00640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead00ca7d0 0x7fead01e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f2fcd800640 1 --2- 172.21.15.73:0/1838716210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80ca880 0x7f2fc80cc210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80cfdb0 tx=0x7f2fb802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd564c81641c37ee server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7ffa67400640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffa5406ad00 0x7ffa5406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ac04e110 con 0x7f7190003970 2024-03-23T06:10:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7feacf400640 1 -- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead0143340 msgr2=0x7fead01ef5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7feacf400640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead0143340 0x7fead01ef5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7feacf400640 1 -- 172.21.15.73:0/3643519385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead00ca7d0 msgr2=0x7fead01e5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7feacf400640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead00ca7d0 0x7fead01e5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7feacf400640 1 -- 172.21.15.73:0/3643519385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac0009400 con 0x7fead00b1c40 2024-03-23T06:10:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7ffa67400640 1 -- 172.21.15.73:0/1380044830 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa600ac710 con 0x7ffa6c050af0 2024-03-23T06:10:34.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7ffa73400640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffa5406ad00 0x7ffa5406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f95bd600640 1 -- 172.21.15.73:0/95619598 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac011830 con 0x7f95c0157bc0 2024-03-23T06:10:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f95bd600640 1 -- 172.21.15.73:0/95619598 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac0119b0 con 0x7f95c0157bc0 2024-03-23T06:10:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f95bd600640 1 -- 172.21.15.73:0/95619598 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac011d40 con 0x7f95c0157bc0 2024-03-23T06:10:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c00c6490 con 0x7f95c0157bc0 2024-03-23T06:10:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f2fc7400640 1 -- 172.21.15.73:0/1838716210 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb802e070 con 0x7f2fc80ca880 2024-03-23T06:10:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f2fc7400640 1 -- 172.21.15.73:0/1838716210 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb80315a0 con 0x7f2fc80ca880 2024-03-23T06:10:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.437+0000 7f2fc7400640 1 -- 172.21.15.73:0/1838716210 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8031930 con 0x7f2fc80ca880 2024-03-23T06:10:34.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.438+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c00c6a50 con 0x7f95c0157bc0 2024-03-23T06:10:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.438+0000 7feacf400640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead00b1c40 0x7fead01f36c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fead00cc850 tx=0x7feac00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.439+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c004e110 con 0x7f95c0157bc0 2024-03-23T06:10:34.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.439+0000 7ffa73400640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffa5406ad00 0x7ffa5406d1c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa68000f60 tx=0x7ffa68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.439+0000 7f2fcf800640 1 -- 172.21.15.73:0/1838716210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80ca880 msgr2=0x7f2fc80cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.439+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1838716210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80ca880 0x7f2fc80cc210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80cfdb0 tx=0x7f2fb802b840 comp rx=0 tx=0).stop 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.440+0000 7f2fcf800640 1 -- 172.21.15.73:0/1838716210 shutdown_connections 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.440+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1838716210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80ca880 0x7f2fc80cc210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.440+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1838716210 >> v2:172.21.15.73:3300/0 conn(0x7f2fc80cb3a0 0x7f2fc80cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.440+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1838716210 >> v2:172.21.15.110:3300/0 conn(0x7f2fc8157bc0 0x7f2fc80c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.440+0000 7f2fcf800640 1 -- 172.21.15.73:0/1838716210 >> 172.21.15.73:0/1838716210 conn(0x7f2fc8071800 msgr2=0x7f2fc8071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.440+0000 7f2fcf800640 1 -- 172.21.15.73:0/1838716210 shutdown_connections 2024-03-23T06:10:34.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.440+0000 7f2fcf800640 1 -- 172.21.15.73:0/1838716210 wait complete. 2024-03-23T06:10:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.441+0000 7f71a8c00640 1 -- 172.21.15.73:0/281463666 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f719c03dcb0 con 0x7f7190003970 2024-03-23T06:10:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.442+0000 7f2fcf800640 1 Processor -- start 2024-03-23T06:10:34.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.442+0000 7f2fcf800640 1 -- start start 2024-03-23T06:10:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.442+0000 7f71a8c00640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f718c06ac00 0x7f718c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.442+0000 7f71a8c00640 1 -- 172.21.15.73:0/281463666 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f719c0ab8b0 con 0x7f7190003970 2024-03-23T06:10:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7feac7400640 1 -- 172.21.15.73:0/3643519385 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0033bf0 con 0x7fead00b1c40 2024-03-23T06:10:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead01f3230 con 0x7fead00b1c40 2024-03-23T06:10:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead0143d80 con 0x7fead00b1c40 2024-03-23T06:10:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7feac7400640 1 -- 172.21.15.73:0/3643519385 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0033d50 con 0x7fead00b1c40 2024-03-23T06:10:34.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7feac7400640 1 -- 172.21.15.73:0/3643519385 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0033bf0 con 0x7fead00b1c40 2024-03-23T06:10:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7f2fcf800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc80ca880 0x7f2fc81592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7f2fcf800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80cb3a0 0x7f2fc80c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7ffa67400640 1 -- 172.21.15.73:0/1380044830 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ffa6007b100 con 0x7ffa6c050af0 2024-03-23T06:10:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7f2fcf800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fc8157bc0 0x7f2fc8158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7f2fcf800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc815a0d0 con 0x7f2fc8157bc0 2024-03-23T06:10:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7f2fcf800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc815a970 con 0x7f2fc80ca880 2024-03-23T06:10:34.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.443+0000 7f2fcf800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80c6e40 con 0x7f2fc80cb3a0 2024-03-23T06:10:34.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.444+0000 7f71abe00640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f718c06ac00 0x7f718c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.444+0000 7f2fcce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc80ca880 0x7f2fc81592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.444+0000 7f2fcce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc80ca880 0x7f2fc81592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52612/0 (socket says 172.21.15.73:52612) 2024-03-23T06:10:34.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.444+0000 7f2fcce00640 1 -- 172.21.15.73:0/1559560940 learned_addr learned my addr 172.21.15.73:0/1559560940 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:34.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.445+0000 7f2fcce00640 1 -- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80cb3a0 msgr2=0x7f2fc80c8380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T06:10:34.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.445+0000 7f2fcce00640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80cb3a0 0x7f2fc80c8380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.445+0000 7f2fcce00640 1 -- 172.21.15.73:0/1559560940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fc8157bc0 msgr2=0x7f2fc8158a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:10:34.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.445+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa8005250 con 0x7fead00b1c40 2024-03-23T06:10:34.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.445+0000 7f2fcce00640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fc8157bc0 0x7f2fc8158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.445+0000 7f2fcce00640 1 -- 172.21.15.73:0/1559560940 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb8009400 con 0x7f2fc80ca880 2024-03-23T06:10:34.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.446+0000 7f71abe00640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f718c06ac00 0x7f718c06d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7198007fd0 tx=0x7f7198009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.446+0000 7f95bd600640 1 -- 172.21.15.73:0/95619598 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f95ac01b460 con 0x7f95c0157bc0 2024-03-23T06:10:34.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.446+0000 7f2fcce00640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc80ca880 0x7f2fc81592a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00070b0 tx=0x7f2fc000d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.448+0000 7f71a8c00640 1 -- 172.21.15.73:0/281463666 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f719c07a230 con 0x7f7190003970 2024-03-23T06:10:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.448+0000 7f2fc4c00640 1 -- 172.21.15.73:0/1559560940 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000dd80 con 0x7f2fc80ca880 2024-03-23T06:10:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.448+0000 7f2fc4c00640 1 -- 172.21.15.73:0/1559560940 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000f040 con 0x7f2fc80ca880 2024-03-23T06:10:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.448+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc80c88c0 con 0x7f2fc80ca880 2024-03-23T06:10:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.448+0000 7f2fc4c00640 1 -- 172.21.15.73:0/1559560940 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0015620 con 0x7f2fc80ca880 2024-03-23T06:10:34.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.448+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc81f42c0 con 0x7f2fc80ca880 2024-03-23T06:10:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.448+0000 7f95bd600640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95a006acd0 0x7f95a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.449+0000 7f95c5a00640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95a006acd0 0x7f95a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.449+0000 7f95bd600640 1 -- 172.21.15.73:0/95619598 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f95ac089ee0 con 0x7f95c0157bc0 2024-03-23T06:10:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.450+0000 7f95bd600640 1 -- 172.21.15.73:0/95619598 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f95ac054680 con 0x7f95c0157bc0 2024-03-23T06:10:34.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.450+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc81553e0 con 0x7f2fc80ca880 2024-03-23T06:10:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.451+0000 7f95c5a00640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95a006acd0 0x7f95a006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f95b8035000 tx=0x7f95b8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.451+0000 7feac7400640 1 -- 172.21.15.73:0/3643519385 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feac003a070 con 0x7fead00b1c40 2024-03-23T06:10:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.452+0000 7feac7400640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feab006ac90 0x7feab006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.452+0000 7feac7400640 1 -- 172.21.15.73:0/3643519385 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feac00ab040 con 0x7fead00b1c40 2024-03-23T06:10:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.453+0000 7feac7400640 1 -- 172.21.15.73:0/3643519385 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7feac0075f10 con 0x7fead00b1c40 2024-03-23T06:10:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.454+0000 7feacea00640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feab006ac90 0x7feab006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.457+0000 7feacea00640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feab006ac90 0x7feab006d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fead0146970 tx=0x7feabc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.456+0000 7f2fc4c00640 1 -- 172.21.15.73:0/1559560940 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2fc0015780 con 0x7f2fc80ca880 2024-03-23T06:10:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.457+0000 7f2fc4c00640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fa806ad00 0x7f2fa806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.457+0000 7f2fc4c00640 1 -- 172.21.15.73:0/1559560940 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2fc0089d60 con 0x7f2fc80ca880 2024-03-23T06:10:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.458+0000 7f2fc7e00640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fa806ad00 0x7f2fa806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.458+0000 7f2fc4c00640 1 -- 172.21.15.73:0/1559560940 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2fc0054c50 con 0x7f2fc80ca880 2024-03-23T06:10:34.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.462+0000 7f2fc7e00640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fa806ad00 0x7f2fa806d1c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80cfc60 tx=0x7f2fb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:34.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.850+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc9ec0057d0 con 0x7fca080cf8b0 2024-03-23T06:10:34.852 INFO:teuthology.orchestra.run.smithi073.stdout:60129542157 2024-03-23T06:10:34.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.851+0000 7fca03e00640 1 -- 172.21.15.73:0/1002378744 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca100c1030 con 0x7fca080cf8b0 2024-03-23T06:10:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.854+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc9f006ad00 msgr2=0x7fc9f006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc9f006ad00 0x7fc9f006d1c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca08007990 tx=0x7fc9fc009190 comp rx=0 tx=0).stop 2024-03-23T06:10:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080cf8b0 msgr2=0x7fca08048410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080cf8b0 0x7fca08048410 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca10061880 tx=0x7fca10067f80 comp rx=0 tx=0).stop 2024-03-23T06:10:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 shutdown_connections 2024-03-23T06:10:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc9f006ad00 0x7fc9f006d1c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca080cf8b0 0x7fca08048410 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca080e0d40 0x7fca080d5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.856+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffa50005500 con 0x7ffa6c050af0 2024-03-23T06:10:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 --2- 172.21.15.73:0/1002378744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f8005180 0x7fca0804a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.855+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 >> 172.21.15.73:0/1002378744 conn(0x7fca08050150 msgr2=0x7fca08006da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.856+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 shutdown_connections 2024-03-23T06:10:34.857 INFO:teuthology.orchestra.run.smithi073.stdout:55834574860 2024-03-23T06:10:34.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.857+0000 7fca15800640 1 -- 172.21.15.73:0/1002378744 wait complete. 2024-03-23T06:10:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.857+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fed1c0b0b50 con 0x7fed1c0c9350 2024-03-23T06:10:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.857+0000 7ffa67400640 1 -- 172.21.15.73:0/1380044830 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa60090070 con 0x7ffa6c050af0 2024-03-23T06:10:34.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.858+0000 7fed13e00640 1 -- 172.21.15.73:0/3437496783 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed0c057360 con 0x7fed1c0c9350 2024-03-23T06:10:34.858 INFO:teuthology.orchestra.run.smithi073.stdout:55834574860 2024-03-23T06:10:34.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.860+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffa5406ad00 msgr2=0x7ffa5406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.860+0000 7ffa79200640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffa5406ad00 0x7ffa5406d1c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa68000f60 tx=0x7ffa68009040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.860+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 msgr2=0x7ffa6c0d41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.860+0000 7ffa79200640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c0d41e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009870 tx=0x7ffa600046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 shutdown_connections 2024-03-23T06:10:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7ffa79200640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffa5406ad00 0x7ffa5406d1c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7ffa79200640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa6c0d9170 0x7ffa6c0e0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7ffa79200640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa6c050af0 0x7ffa6c0d41e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7ffa79200640 1 --2- 172.21.15.73:0/1380044830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa6c049af0 0x7ffa6c0dffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 >> 172.21.15.73:0/1380044830 conn(0x7ffa6c050fc0 msgr2=0x7ffa6c0d6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fecfc06ac60 msgr2=0x7fecfc06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 shutdown_connections 2024-03-23T06:10:34.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.861+0000 7ffa79200640 1 -- 172.21.15.73:0/1380044830 wait complete. 2024-03-23T06:10:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fecfc06ac60 0x7fecfc06d120 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed08039000 tx=0x7fed08008040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed1c0c9350 msgr2=0x7fed1c14a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed1c0c9350 0x7fed1c14a990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00c480 tx=0x7fed0c00c940 comp rx=0 tx=0).stop 2024-03-23T06:10:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 shutdown_connections 2024-03-23T06:10:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed1c14f8b0 0x7fed1c150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed1c0caea0 0x7fed1c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fecfc06ac60 0x7fecfc06d120 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 --2- 172.21.15.73:0/3437496783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed1c0c9350 0x7fed1c14a990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.862+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 >> 172.21.15.73:0/3437496783 conn(0x7fed1c069cb0 msgr2=0x7fed1c06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.863+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 shutdown_connections 2024-03-23T06:10:34.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.863+0000 7fed22c00640 1 -- 172.21.15.73:0/3437496783 wait complete. 2024-03-23T06:10:34.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.869+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f95c00ca5d0 con 0x7f95c0157bc0 2024-03-23T06:10:34.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.869+0000 7f95bd600640 1 -- 172.21.15.73:0/95619598 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95ac0583d0 con 0x7f95c0157bc0 2024-03-23T06:10:34.872 INFO:teuthology.orchestra.run.smithi073.stdout:55834574859 2024-03-23T06:10:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.873+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95a006acd0 msgr2=0x7f95a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.873+0000 7f95c8400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95a006acd0 0x7f95a006d190 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f95b8035000 tx=0x7f95b8030000 comp rx=0 tx=0).stop 2024-03-23T06:10:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.873+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c0157bc0 msgr2=0x7f95c00ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.873+0000 7f95c8400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c0157bc0 0x7f95c00ccb60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00b420 tx=0x7f95ac00b8e0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd13004e030 con 0x7fd1300cb130 2024-03-23T06:10:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 shutdown_connections 2024-03-23T06:10:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7f95c8400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95c0157bc0 0x7f95c00ccb60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7f95c8400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95c00cb3a0 0x7f95c01f4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7f95c8400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95a006acd0 0x7f95a006d190 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7f95c8400640 1 --2- 172.21.15.73:0/95619598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95c00ca880 0x7f95c00b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 >> 172.21.15.73:0/95619598 conn(0x7f95c0071800 msgr2=0x7f95c0151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 shutdown_connections 2024-03-23T06:10:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.874+0000 7f95c8400640 1 -- 172.21.15.73:0/95619598 wait complete. 2024-03-23T06:10:34.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.875+0000 7fd12d600640 1 -- 172.21.15.73:0/303606093 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1280578a0 con 0x7fd1300cb130 2024-03-23T06:10:34.875 INFO:teuthology.orchestra.run.smithi073.stdout:60129542155 2024-03-23T06:10:34.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.877+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71ac0c9a10 con 0x7f7190003970 2024-03-23T06:10:34.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.877+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7feaa80057d0 con 0x7fead00b1c40 2024-03-23T06:10:34.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.878+0000 7f71a8c00640 1 -- 172.21.15.73:0/281463666 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f719c037020 con 0x7f7190003970 2024-03-23T06:10:34.877 INFO:teuthology.orchestra.run.smithi073.stdout:60129542156 2024-03-23T06:10:34.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd11006ad00 msgr2=0x7fd11006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd11006ad00 0x7fd11006d1c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd11c000f60 tx=0x7fd11c0079b0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1300cb130 msgr2=0x7fd1301df420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1300cb130 0x7fd1301df420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c750 tx=0x7fd12800cc10 comp rx=0 tx=0).stop 2024-03-23T06:10:34.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 shutdown_connections 2024-03-23T06:10:34.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1300cb130 0x7fd1301df420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd11006ad00 0x7fd11006d1c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1300c5050 0x7fd130155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 --2- 172.21.15.73:0/303606093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1300b4780 0x7fd130156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.879+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 >> 172.21.15.73:0/303606093 conn(0x7fd1300ceb80 msgr2=0x7fd1300cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.880 INFO:teuthology.orchestra.run.smithi073.stdout:55834574859 2024-03-23T06:10:34.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.880+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 shutdown_connections 2024-03-23T06:10:34.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.878+0000 7feac7400640 1 -- 172.21.15.73:0/3643519385 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feac0038020 con 0x7fead00b1c40 2024-03-23T06:10:34.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.881+0000 7fd137000640 1 -- 172.21.15.73:0/303606093 wait complete. 2024-03-23T06:10:34.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.881+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f718c06ac00 msgr2=0x7f718c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.881+0000 7f71b3600640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f718c06ac00 0x7f718c06d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7198007fd0 tx=0x7f7198009040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.881+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7190003970 msgr2=0x7f71ac1581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.881+0000 7f71b3600640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7190003970 0x7f71ac1581d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f719c032000 tx=0x7f719c0047d0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.882+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 shutdown_connections 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.882+0000 7f71b3600640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f718c06ac00 0x7f718c06d0c0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7198007fd0 tx=0x7f7198009040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.882+0000 7f71b3600640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71ac15a7b0 0x7f71ac0c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.882+0000 7f71b3600640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71ac15ea80 0x7f71ac0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.882+0000 7f71b3600640 1 --2- 172.21.15.73:0/281463666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7190003970 0x7f71ac1581d0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f719c032000 tx=0x7f719c0047d0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.882+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 >> 172.21.15.73:0/281463666 conn(0x7f71ac069cb0 msgr2=0x7f71ac0c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 shutdown_connections 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feab006ac90 msgr2=0x7feab006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feab006ac90 0x7feab006d150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fead0146970 tx=0x7feabc008040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead00b1c40 msgr2=0x7fead01f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead00b1c40 0x7fead01f36c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fead00cc850 tx=0x7feac00046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 shutdown_connections 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feab006ac90 0x7feab006d150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fead0143340 0x7fead01ef5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fead00ca7d0 0x7fead01e5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 --2- 172.21.15.73:0/3643519385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fead00b1c40 0x7fead01f36c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.883+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 >> 172.21.15.73:0/3643519385 conn(0x7fead0071800 msgr2=0x7fead01425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.884+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 shutdown_connections 2024-03-23T06:10:34.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.884+0000 7f71b3600640 1 -- 172.21.15.73:0/281463666 wait complete. 2024-03-23T06:10:34.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.884+0000 7fead6800640 1 -- 172.21.15.73:0/3643519385 wait complete. 2024-03-23T06:10:34.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.885+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2fc804e110 con 0x7f2fc80ca880 2024-03-23T06:10:34.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.886+0000 7f2fc4c00640 1 -- 172.21.15.73:0/1559560940 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2fc0024020 con 0x7f2fc80ca880 2024-03-23T06:10:34.888 INFO:teuthology.orchestra.run.smithi073.stdout:60129542155 2024-03-23T06:10:34.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.0 2024-03-23T06:10:34.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.6 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fa806ad00 msgr2=0x7f2fa806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fa806ad00 0x7f2fa806d1c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80cfc60 tx=0x7f2fb4008040 comp rx=0 tx=0).stop 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc80ca880 msgr2=0x7f2fc81592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc80ca880 0x7f2fc81592a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00070b0 tx=0x7f2fc000d4a0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 shutdown_connections 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fc8157bc0 0x7f2fc8158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fa806ad00 0x7f2fa806d1c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fc80cb3a0 0x7f2fc80c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 --2- 172.21.15.73:0/1559560940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fc80ca880 0x7f2fc81592a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:34.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 >> 172.21.15.73:0/1559560940 conn(0x7f2fc8071800 msgr2=0x7f2fc80cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.890+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 shutdown_connections 2024-03-23T06:10:34.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:34.891+0000 7f2fcf800640 1 -- 172.21.15.73:0/1559560940 wait complete. 2024-03-23T06:10:34.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.5 2024-03-23T06:10:34.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.3 2024-03-23T06:10:34.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2024-03-23T06:10:34.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2024-03-23T06:10:34.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.1 2024-03-23T06:10:34.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.2 2024-03-23T06:10:35.889 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-23T06:10:35.890 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-23T06:10:35.893 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-23T06:10:35.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-23T06:10:35.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-23T06:10:35.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-23T06:10:35.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-23T06:10:35.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-23T06:10:36.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.153+0000 7f26c4400640 1 Processor -- start 2024-03-23T06:10:36.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.154+0000 7f26c4400640 1 -- start start 2024-03-23T06:10:36.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.156+0000 7f26c4400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26bc0c1b40 0x7f26bc155e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.157+0000 7f26c4400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc0c7080 con 0x7f26bc0c5c80 2024-03-23T06:10:36.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.157+0000 7f26c4400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26bc0c72f0 con 0x7f26bc14f550 2024-03-23T06:10:36.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.157+0000 7f26c1000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26bc0c1b40 0x7f26bc155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.158+0000 7f26c1000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26bc0c1b40 0x7f26bc155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52620/0 (socket says 172.21.15.73:52620) 2024-03-23T06:10:36.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.158+0000 7f26c1a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f26bc14f550 0x7f26bc0c2290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38750/0 (socket says 172.21.15.73:38750) 2024-03-23T06:10:36.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.158+0000 7f26c1000640 1 -- 172.21.15.73:0/1010978158 learned_addr learned my addr 172.21.15.73:0/1010978158 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.158+0000 7f26c4400640 1 -- 172.21.15.73:0/1010978158 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26bc0c6640 con 0x7f26bc0c1b40 2024-03-23T06:10:36.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.158+0000 7f26c1000640 1 -- 172.21.15.73:0/1010978158 >> v1:172.21.15.110:6789/0 conn(0x7f26bc14f550 legacy=0x7f26bc0c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.158+0000 7f26c1000640 1 -- 172.21.15.73:0/1010978158 >> v1:172.21.15.73:6789/0 conn(0x7f26bc0c5c80 legacy=0x7f26bc0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.158+0000 7f26c1000640 1 -- 172.21.15.73:0/1010978158 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26bc0c75d0 con 0x7f26bc0c1b40 2024-03-23T06:10:36.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.160+0000 7f26c1000640 1 --2- 172.21.15.73:0/1010978158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc155e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f26a800dc90 tx=0x7f26a802fdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd3274a7a24ad1e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.161+0000 7f26bbe00640 1 -- 172.21.15.73:0/1010978158 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8030950 con 0x7f26bc0c1b40 2024-03-23T06:10:36.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.161+0000 7f26bbe00640 1 -- 172.21.15.73:0/1010978158 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a8030ab0 con 0x7f26bc0c1b40 2024-03-23T06:10:36.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.161+0000 7f26bbe00640 1 -- 172.21.15.73:0/1010978158 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8030e40 con 0x7f26bc0c1b40 2024-03-23T06:10:36.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.162+0000 7f26c4400640 1 -- 172.21.15.73:0/1010978158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 msgr2=0x7f26bc155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.162+0000 7f26c4400640 1 --2- 172.21.15.73:0/1010978158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc155e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f26a800dc90 tx=0x7f26a802fdb0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.163+0000 7f26c4400640 1 -- 172.21.15.73:0/1010978158 shutdown_connections 2024-03-23T06:10:36.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.163+0000 7f26c4400640 1 --2- 172.21.15.73:0/1010978158 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc155e00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.163+0000 7f26c4400640 1 -- 172.21.15.73:0/1010978158 >> 172.21.15.73:0/1010978158 conn(0x7f26bc066080 msgr2=0x7f26bc06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.164+0000 7f26c4400640 1 -- 172.21.15.73:0/1010978158 shutdown_connections 2024-03-23T06:10:36.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.164+0000 7f26c4400640 1 -- 172.21.15.73:0/1010978158 wait complete. 2024-03-23T06:10:36.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.165+0000 7f089c400640 1 Processor -- start 2024-03-23T06:10:36.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.165+0000 7f089c400640 1 -- start start 2024-03-23T06:10:36.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.167+0000 7f089c400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0894153a30 0x7f08940c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.167+0000 7f089c400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08940b1900 0x7f089406a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.167+0000 7f089c400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089415d740 con 0x7f08940ca4a0 2024-03-23T06:10:36.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.167+0000 7f089c400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089415dc90 con 0x7f08940b1900 2024-03-23T06:10:36.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.167+0000 7f089c400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08941596a0 con 0x7f0894153a30 2024-03-23T06:10:36.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.168+0000 7f26c4400640 1 Processor -- start 2024-03-23T06:10:36.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.168+0000 7f0899a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0894153a30 0x7f08940c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f0899000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f08940ca4a0 0x7f0894159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38760/0 (socket says 172.21.15.73:38760) 2024-03-23T06:10:36.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f0899000640 1 -- 172.21.15.73:0/1512240899 learned_addr learned my addr 172.21.15.73:0/1512240899 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:36.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f089a400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08940b1900 0x7f089406a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.168+0000 7f26c4400640 1 -- start start 2024-03-23T06:10:36.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f26c4400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc1eada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f26c4400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26bc0c5c80 0x7f26bc14a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f26c4400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26bc14f550 0x7f26bc154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f26c4400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc14a260 con 0x7f26bc0c5c80 2024-03-23T06:10:36.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f26c4400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc149890 con 0x7f26bc0c1b40 2024-03-23T06:10:36.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.169+0000 7f26c4400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26bc0c1500 con 0x7f26bc14f550 2024-03-23T06:10:36.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121763368 0 0) 0x7f089415d740 con 0x7f08940ca4a0 2024-03-23T06:10:36.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f087c003520 con 0x7f08940ca4a0 2024-03-23T06:10:36.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f26c2400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26bc14f550 0x7f26bc154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f26c1a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc1eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f26c1a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc1eada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52648/0 (socket says 172.21.15.73:52648) 2024-03-23T06:10:36.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701554376 0 0) 0x7f087c003520 con 0x7f08940ca4a0 2024-03-23T06:10:36.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0894153a30 msgr2=0x7f08940c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f26c1a00640 1 -- 172.21.15.73:0/1017158594 learned_addr learned my addr 172.21.15.73:0/1017158594 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.170+0000 7f0893e00640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0894153a30 0x7f08940c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 >> v2:172.21.15.110:3300/0 conn(0x7f08940b1900 msgr2=0x7f089406a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 --2- 172.21.15.73:0/1512240899 >> v2:172.21.15.110:3300/0 conn(0x7f08940b1900 0x7f089406a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089406ac00 con 0x7f08940ca4a0 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f0880001650 con 0x7f08940ca4a0 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 >> v1:172.21.15.110:6789/0 conn(0x7f08940ca4a0 legacy=0x7f0894159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c003990 0x7f087c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f087c0047c0 0x7f087c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f087c005260 0x7f087c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08941596a0 con 0x7f087c003990 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0148f0 con 0x7f087c0047c0 2024-03-23T06:10:36.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c014ab0 con 0x7f087c005260 2024-03-23T06:10:36.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f26c1a00640 1 -- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26bc14f550 msgr2=0x7f26bc154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f26c1a00640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26bc14f550 0x7f26bc154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f26c1a00640 1 -- 172.21.15.73:0/1017158594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26bc0c5c80 msgr2=0x7f26bc14a680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:10:36.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f26c1a00640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26bc0c5c80 0x7f26bc14a680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.172+0000 7f26c1a00640 1 -- 172.21.15.73:0/1017158594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a800d970 con 0x7f26bc0c1b40 2024-03-23T06:10:36.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.172+0000 7f26c2400640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26bc14f550 0x7f26bc154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.171+0000 7f089a400640 1 --2- 172.21.15.73:0/1512240899 >> v2:172.21.15.110:3300/0 conn(0x7f08940b1900 0x7f089406a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.172+0000 7f0899000640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f087c0047c0 0x7f087c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.172+0000 7f089a400640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f087c005260 0x7f087c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.172+0000 7f0899a00640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0894153a30 0x7f08940c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:36.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f26c1a00640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc1eada0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26b000c840 tx=0x7f26b000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f089a400640 1 -- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f087c0047c0 msgr2=0x7f087c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f089a400640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f087c0047c0 0x7f087c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f089a400640 1 -- 172.21.15.73:0/1512240899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c003990 msgr2=0x7f087c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f089a400640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c003990 0x7f087c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f089a400640 1 -- 172.21.15.73:0/1512240899 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c003520 con 0x7f087c005260 2024-03-23T06:10:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f26b9600640 1 -- 172.21.15.73:0/1017158594 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0007870 con 0x7f26bc0c1b40 2024-03-23T06:10:36.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f26b9600640 1 -- 172.21.15.73:0/1017158594 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b00079d0 con 0x7f26bc0c1b40 2024-03-23T06:10:36.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.173+0000 7f26b9600640 1 -- 172.21.15.73:0/1017158594 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0007870 con 0x7f26bc0c1b40 2024-03-23T06:10:36.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.175+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26bc1492d0 con 0x7f26bc0c1b40 2024-03-23T06:10:36.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.175+0000 7f089a400640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f087c005260 0x7f087c00b980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f088c0073e0 tx=0x7f087c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=830c27eb99f35e8a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.175+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc149ba0 con 0x7f26bc0c1b40 2024-03-23T06:10:36.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.176+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c02cdc0 con 0x7f087c005260 2024-03-23T06:10:36.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.176+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c034440 con 0x7f087c005260 2024-03-23T06:10:36.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.177+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26bc04e030 con 0x7f26bc0c1b40 2024-03-23T06:10:36.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.177+0000 7f089c400640 1 -- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f087c005260 msgr2=0x7f087c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.177+0000 7f0893e00640 1 -- 172.21.15.73:0/1512240899 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c02cdc0 con 0x7f087c005260 2024-03-23T06:10:36.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.177+0000 7f089c400640 1 --2- 172.21.15.73:0/1512240899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f087c005260 0x7f087c00b980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f088c0073e0 tx=0x7f087c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.177+0000 7f089a400640 1 -- 172.21.15.73:0/1512240899 reap_dead start 2024-03-23T06:10:36.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.178+0000 7f089c400640 1 -- 172.21.15.73:0/1512240899 shutdown_connections 2024-03-23T06:10:36.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.178+0000 7f089c400640 1 -- 172.21.15.73:0/1512240899 >> 172.21.15.73:0/1512240899 conn(0x7f0894071d20 msgr2=0x7f089406bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.178+0000 7f26b9600640 1 -- 172.21.15.73:0/1017158594 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f26b000f070 con 0x7f26bc0c1b40 2024-03-23T06:10:36.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.178+0000 7f089c400640 1 -- 172.21.15.73:0/1512240899 shutdown_connections 2024-03-23T06:10:36.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.179+0000 7f089c400640 1 -- 172.21.15.73:0/1512240899 wait complete. 2024-03-23T06:10:36.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.180+0000 7f26b9600640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f269c06ac60 0x7f269c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.180+0000 7f26b9600640 1 -- 172.21.15.73:0/1017158594 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26b00895f0 con 0x7f26bc0c1b40 2024-03-23T06:10:36.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.180+0000 7f26c1000640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f269c06ac60 0x7f269c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.181+0000 7f26c1000640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f269c06ac60 0x7f269c06d120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26a8039000 tx=0x7f26a8034000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.183+0000 7f089c400640 1 Processor -- start 2024-03-23T06:10:36.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.183+0000 7f089c400640 1 -- start start 2024-03-23T06:10:36.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.184+0000 7f26b9600640 1 -- 172.21.15.73:0/1017158594 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f26b00544e0 con 0x7f26bc0c1b40 2024-03-23T06:10:36.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.185+0000 7f089c400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c005260 0x7f08941ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.186+0000 7f089c400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08941574e0 0x7f089415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.187+0000 7f089c400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f089414d940 0x7f089414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.187+0000 7f089c400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089415d220 con 0x7f087c005260 2024-03-23T06:10:36.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.187+0000 7f089c400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08940c4320 con 0x7f08941574e0 2024-03-23T06:10:36.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.187+0000 7f089c400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08941ee440 con 0x7f089414d940 2024-03-23T06:10:36.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.187+0000 7f0899a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c005260 0x7f08941ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.188+0000 7f089a400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f089414d940 0x7f089414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.188+0000 7f089a400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f089414d940 0x7f089414ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49520/0 (socket says 172.21.15.73:49520) 2024-03-23T06:10:36.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.188+0000 7f089a400640 1 -- 172.21.15.73:0/936656023 learned_addr learned my addr 172.21.15.73:0/936656023 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.188+0000 7f0899000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08941574e0 0x7f089415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.190+0000 7f089a400640 1 -- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08941574e0 msgr2=0x7f089415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.190+0000 7f089a400640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08941574e0 0x7f089415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.190+0000 7f089a400640 1 -- 172.21.15.73:0/936656023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c005260 msgr2=0x7f08941ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.190+0000 7f089a400640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c005260 0x7f08941ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.190+0000 7f089a400640 1 -- 172.21.15.73:0/936656023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08941ee720 con 0x7f089414d940 2024-03-23T06:10:36.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.190+0000 7f0899000640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08941574e0 0x7f089415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:36.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.190+0000 7f0899a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c005260 0x7f08941ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:36.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.191+0000 7f089a400640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f089414d940 0x7f089414ddc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f088c007500 tx=0x7f088c004ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.192+0000 7f0891600640 1 -- 172.21.15.73:0/936656023 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c03e810 con 0x7f089414d940 2024-03-23T06:10:36.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.192+0000 7f0891600640 1 -- 172.21.15.73:0/936656023 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c03e9b0 con 0x7f089414d940 2024-03-23T06:10:36.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.192+0000 7f0891600640 1 -- 172.21.15.73:0/936656023 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c03ed60 con 0x7f089414d940 2024-03-23T06:10:36.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.193+0000 7f089c400640 1 -- 172.21.15.73:0/936656023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08941ea700 con 0x7f089414d940 2024-03-23T06:10:36.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.193+0000 7f089c400640 1 -- 172.21.15.73:0/936656023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08941eacc0 con 0x7f089414d940 2024-03-23T06:10:36.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.197+0000 7f0886a00640 1 -- 172.21.15.73:0/936656023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0868005250 con 0x7f089414d940 2024-03-23T06:10:36.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.198+0000 7f0891600640 1 -- 172.21.15.73:0/936656023 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f088c049410 con 0x7f089414d940 2024-03-23T06:10:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.199+0000 7f0891600640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f087406ad00 0x7f087406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.199+0000 7f0891600640 1 -- 172.21.15.73:0/936656023 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f088c0abaf0 con 0x7f089414d940 2024-03-23T06:10:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.200+0000 7f0899a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f087406ad00 0x7f087406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.201+0000 7f0899a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f087406ad00 0x7f087406d1c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0888006fd0 tx=0x7f0888008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.203+0000 7f0891600640 1 -- 172.21.15.73:0/936656023 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f088c0769e0 con 0x7f089414d940 2024-03-23T06:10:36.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.226+0000 7f2d81200640 1 Processor -- start 2024-03-23T06:10:36.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.227+0000 7f2d81200640 1 -- start start 2024-03-23T06:10:36.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.229+0000 7f2d81200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d7c14f510 0x7f2d7c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.230+0000 7f2d81200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c158980 con 0x7f2d7c0c5980 2024-03-23T06:10:36.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.230+0000 7f2d81200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c159500 con 0x7f2d7c0c7710 2024-03-23T06:10:36.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.230+0000 7f2d81200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c159990 con 0x7f2d7c14f510 2024-03-23T06:10:36.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.230+0000 7f2d7aa00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2d7c0c7710 0x7f2d7c0be9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38768/0 (socket says 172.21.15.73:38768) 2024-03-23T06:10:36.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.230+0000 7f2d7aa00640 1 -- 172.21.15.73:0/2720644001 learned_addr learned my addr 172.21.15.73:0/2720644001 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:36.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.231+0000 7f2d7b400640 1 --2- 172.21.15.73:0/2720644001 >> v2:172.21.15.110:3300/0 conn(0x7f2d7c14f510 0x7f2d7c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.232+0000 7f2d7b400640 1 -- 172.21.15.73:0/2720644001 >> v1:172.21.15.110:6789/0 conn(0x7f2d7c0c7710 legacy=0x7f2d7c0be9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.232+0000 7f2d7a000640 1 -- 172.21.15.73:0/2720644001 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801873409 0 0) 0x7f2d7c159500 con 0x7f2d7c0c7710 2024-03-23T06:10:36.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.232+0000 7f2d7b400640 1 -- 172.21.15.73:0/2720644001 >> v1:172.21.15.73:6789/0 conn(0x7f2d7c0c5980 legacy=0x7f2d7c15fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.232+0000 7f2d7b400640 1 -- 172.21.15.73:0/2720644001 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c156350 con 0x7f2d7c14f510 2024-03-23T06:10:36.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.234+0000 7f2d7b400640 1 --2- 172.21.15.73:0/2720644001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d7c14f510 0x7f2d7c155e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400d1e0 tx=0x7f2d7402c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a41dbf4aaaf12c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.235+0000 7f2d7a000640 1 -- 172.21.15.73:0/2720644001 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7402cdb0 con 0x7f2d7c14f510 2024-03-23T06:10:36.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.235+0000 7f2d7a000640 1 -- 172.21.15.73:0/2720644001 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74030070 con 0x7f2d7c14f510 2024-03-23T06:10:36.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.235+0000 7f2d7a000640 1 -- 172.21.15.73:0/2720644001 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74036640 con 0x7f2d7c14f510 2024-03-23T06:10:36.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.236+0000 7f2d81200640 1 -- 172.21.15.73:0/2720644001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d7c14f510 msgr2=0x7f2d7c155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.236+0000 7f2d81200640 1 --2- 172.21.15.73:0/2720644001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d7c14f510 0x7f2d7c155e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400d1e0 tx=0x7f2d7402c000 comp rx=0 tx=0).stop 2024-03-23T06:10:36.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.237+0000 7f2d81200640 1 -- 172.21.15.73:0/2720644001 shutdown_connections 2024-03-23T06:10:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.237+0000 7f2d81200640 1 --2- 172.21.15.73:0/2720644001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d7c14f510 0x7f2d7c155e10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.237+0000 7f2d81200640 1 -- 172.21.15.73:0/2720644001 >> 172.21.15.73:0/2720644001 conn(0x7f2d7c069cb0 msgr2=0x7f2d7c06a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.237+0000 7f2d81200640 1 -- 172.21.15.73:0/2720644001 shutdown_connections 2024-03-23T06:10:36.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.237+0000 7f2d81200640 1 -- 172.21.15.73:0/2720644001 wait complete. 2024-03-23T06:10:36.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.239+0000 7f2d81200640 1 Processor -- start 2024-03-23T06:10:36.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.240+0000 7f2d81200640 1 -- start start 2024-03-23T06:10:36.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.242+0000 7fc9a0e00640 1 Processor -- start 2024-03-23T06:10:36.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.242+0000 7f9473200640 1 Processor -- start 2024-03-23T06:10:36.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.242+0000 7fc9a0e00640 1 -- start start 2024-03-23T06:10:36.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.243+0000 7f2d81200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d7c0c5980 0x7f2d7c157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.243+0000 7f2d81200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d7c0c7710 0x7f2d7c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.243+0000 7f2d81200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d7c14f510 0x7f2d7c152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f2d81200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c1ea4b0 con 0x7f2d7c14f510 2024-03-23T06:10:36.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f2d81200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c1ea790 con 0x7f2d7c0c7710 2024-03-23T06:10:36.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f2d81200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c1eaa70 con 0x7f2d7c0c5980 2024-03-23T06:10:36.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.242+0000 7f9473200640 1 -- start start 2024-03-23T06:10:36.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f9473200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94680e0460 0x7f9468039e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f9473200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f946804ffa0 0x7f94680dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f9473200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680dffb0 con 0x7f94680d9220 2024-03-23T06:10:36.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f9473200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946803a480 con 0x7f94680e0460 2024-03-23T06:10:36.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f9473200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9468050430 con 0x7f946804ffa0 2024-03-23T06:10:36.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f2d7be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d7c14f510 0x7f2d7c152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f2d7b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d7c0c5980 0x7f2d7c157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f2d7b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d7c0c5980 0x7f2d7c157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49526/0 (socket says 172.21.15.73:49526) 2024-03-23T06:10:36.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.244+0000 7f2d7b400640 1 -- 172.21.15.73:0/2953036536 learned_addr learned my addr 172.21.15.73:0/2953036536 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f9471400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94680e0460 0x7f9468039e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7fc9a0e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc99c0ca7d0 0x7fc99c0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7fc9a0e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1537b0 0x7fc99c06a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7fc9a0e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0b2460 con 0x7fc99c0b1c40 2024-03-23T06:10:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7fc9a0e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c0ca140 con 0x7fc99c0ca7d0 2024-03-23T06:10:36.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7fc9a0e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c15a4b0 con 0x7fc99c1537b0 2024-03-23T06:10:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f9bdfe00640 1 Processor -- start 2024-03-23T06:10:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f9471400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94680e0460 0x7f9468039e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34736/0 (socket says 172.21.15.73:34736) 2024-03-23T06:10:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f9471400640 1 -- 172.21.15.73:0/3559903676 learned_addr learned my addr 172.21.15.73:0/3559903676 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f9472800640 1 --2- 172.21.15.73:0/3559903676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f946804ffa0 0x7f94680dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f2d7b400640 1 -- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d7c0c7710 msgr2=0x7f2d7c151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f2d7b400640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d7c0c7710 0x7f2d7c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f2d7b400640 1 -- 172.21.15.73:0/2953036536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d7c14f510 msgr2=0x7f2d7c152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f2d7b400640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d7c14f510 0x7f2d7c152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f9471400640 1 -- 172.21.15.73:0/3559903676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f946804ffa0 msgr2=0x7f94680dfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.245+0000 7f2d7b400640 1 -- 172.21.15.73:0/2953036536 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d74007910 con 0x7f2d7c0c5980 2024-03-23T06:10:36.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7f9471400640 1 --2- 172.21.15.73:0/3559903676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f946804ffa0 0x7f94680dfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7f9471400640 1 -- 172.21.15.73:0/3559903676 >> v1:172.21.15.73:6789/0 conn(0x7f94680d9220 legacy=0x7f9468007180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc99a800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc99c0b1c40 0x7fc99c15cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38772/0 (socket says 172.21.15.73:38772) 2024-03-23T06:10:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc99a800640 1 -- 172.21.15.73:0/2194302487 learned_addr learned my addr 172.21.15.73:0/2194302487 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc999e00640 1 --2- 172.21.15.73:0/2194302487 >> v2:172.21.15.110:3300/0 conn(0x7fc99c0ca7d0 0x7fc99c0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7f9bdfe00640 1 -- start start 2024-03-23T06:10:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc999400640 1 --2- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1537b0 0x7fc99c06a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc999e00640 1 -- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1537b0 msgr2=0x7fc99c06a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc999e00640 1 --2- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1537b0 0x7fc99c06a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc999e00640 1 -- 172.21.15.73:0/2194302487 >> v1:172.21.15.110:6789/0 conn(0x7fc99c0b1c40 legacy=0x7fc99c15cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc999e00640 1 -- 172.21.15.73:0/2194302487 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0c9e60 con 0x7fc99c0ca7d0 2024-03-23T06:10:36.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7f2d7b400640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d7c0c5980 0x7f2d7c157b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000f80 tx=0x7f2d74004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7fc999400640 1 --2- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1537b0 0x7fc99c06a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.246+0000 7f9471400640 1 -- 172.21.15.73:0/3559903676 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946804ef00 con 0x7f94680e0460 2024-03-23T06:10:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.247+0000 7f2d73400640 1 -- 172.21.15.73:0/2953036536 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74004880 con 0x7f2d7c0c5980 2024-03-23T06:10:36.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.247+0000 7f2d73400640 1 -- 172.21.15.73:0/2953036536 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d74041470 con 0x7f2d7c0c5980 2024-03-23T06:10:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.247+0000 7f2d73400640 1 -- 172.21.15.73:0/2953036536 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74041800 con 0x7f2d7c0c5980 2024-03-23T06:10:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.247+0000 7f9472800640 1 --2- 172.21.15.73:0/3559903676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f946804ffa0 0x7f94680dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7f9471400640 1 --2- 172.21.15.73:0/3559903676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680e0460 0x7f9468039e40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f945c009870 tx=0x7f945c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12196db93e7ff857 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7fc999e00640 1 --2- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 0x7fc99c0cabb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0097a0 tx=0x7fc98c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4da2663e8bd333 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7f9bdfe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bd8047b70 0x7f9bd804f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7f9bdfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80e0040 0x7f9bd804d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7f9bdfe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd80e04d0 con 0x7f9bd80d6d00 2024-03-23T06:10:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7f9bdfe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd80dca50 con 0x7f9bd8047b70 2024-03-23T06:10:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7f9bdfe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80e07a0 con 0x7f9bd80e0040 2024-03-23T06:10:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.247+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c1ead50 con 0x7f2d7c0c5980 2024-03-23T06:10:36.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.247+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c158090 con 0x7f2d7c0c5980 2024-03-23T06:10:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7fc998a00640 1 -- 172.21.15.73:0/2194302487 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c031780 con 0x7fc99c0ca7d0 2024-03-23T06:10:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7f9bdea00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9bd80d6d00 0x7f9bd80dd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38782/0 (socket says 172.21.15.73:38782) 2024-03-23T06:10:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.248+0000 7f9bdea00640 1 -- 172.21.15.73:0/871640820 learned_addr learned my addr 172.21.15.73:0/871640820 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9bde000640 1 --2- 172.21.15.73:0/871640820 >> v2:172.21.15.73:3300/0 conn(0x7f9bd8047b70 0x7f9bd804f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7fc998a00640 1 -- 172.21.15.73:0/2194302487 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c0318e0 con 0x7fc99c0ca7d0 2024-03-23T06:10:36.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7fc998a00640 1 -- 172.21.15.73:0/2194302487 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c031c70 con 0x7fc99c0ca7d0 2024-03-23T06:10:36.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9bdf400640 1 --2- 172.21.15.73:0/871640820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80e0040 0x7f9bd804d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9bdd600640 1 -- 172.21.15.73:0/871640820 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210107875 0 0) 0x7f9bd80e04d0 con 0x7f9bd80d6d00 2024-03-23T06:10:36.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9bdd600640 1 -- 172.21.15.73:0/871640820 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bc4003520 con 0x7f9bd80d6d00 2024-03-23T06:10:36.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9bde000640 1 -- 172.21.15.73:0/871640820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80e0040 msgr2=0x7f9bd804d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9bde000640 1 --2- 172.21.15.73:0/871640820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80e0040 0x7f9bd804d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9bde000640 1 -- 172.21.15.73:0/871640820 >> v1:172.21.15.110:6789/0 conn(0x7f9bd80d6d00 legacy=0x7f9bd80dd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9bde000640 1 -- 172.21.15.73:0/871640820 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80e0a80 con 0x7f9bd8047b70 2024-03-23T06:10:36.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9470a00640 1 -- 172.21.15.73:0/3559903676 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c030860 con 0x7f94680e0460 2024-03-23T06:10:36.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7fcd8ae00640 1 Processor -- start 2024-03-23T06:10:36.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9470a00640 1 -- 172.21.15.73:0/3559903676 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945c0309c0 con 0x7f94680e0460 2024-03-23T06:10:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.249+0000 7f9470a00640 1 -- 172.21.15.73:0/3559903676 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c030d90 con 0x7f94680e0460 2024-03-23T06:10:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fb49a000640 1 Processor -- start 2024-03-23T06:10:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fc9a0e00640 1 -- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 msgr2=0x7fc99c0cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 0x7fc99c0cabb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0097a0 tx=0x7fc98c02b820 comp rx=0 tx=0).stop 2024-03-23T06:10:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fc9a0e00640 1 -- 172.21.15.73:0/2194302487 shutdown_connections 2024-03-23T06:10:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1537b0 0x7fc99c06a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/2194302487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 0x7fc99c0cabb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fc9a0e00640 1 -- 172.21.15.73:0/2194302487 >> 172.21.15.73:0/2194302487 conn(0x7fc99c071800 msgr2=0x7fc99c071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fc9a0e00640 1 -- 172.21.15.73:0/2194302487 shutdown_connections 2024-03-23T06:10:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fc9a0e00640 1 -- 172.21.15.73:0/2194302487 wait complete. 2024-03-23T06:10:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9473200640 1 -- 172.21.15.73:0/3559903676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680e0460 msgr2=0x7f9468039e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9473200640 1 --2- 172.21.15.73:0/3559903676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680e0460 0x7f9468039e40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f945c009870 tx=0x7f945c02b9a0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9473200640 1 -- 172.21.15.73:0/3559903676 shutdown_connections 2024-03-23T06:10:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9473200640 1 --2- 172.21.15.73:0/3559903676 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f946804ffa0 0x7f94680dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9473200640 1 --2- 172.21.15.73:0/3559903676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94680e0460 0x7f9468039e40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9473200640 1 -- 172.21.15.73:0/3559903676 >> 172.21.15.73:0/3559903676 conn(0x7f946800e130 msgr2=0x7f946800e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fb49a000640 1 -- start start 2024-03-23T06:10:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.252+0000 7fb49a000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4941536c0 0x7fb494159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.252+0000 7fb49a000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4940c8eb0 0x7fb494070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.250+0000 7fcd8ae00640 1 -- start start 2024-03-23T06:10:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.252+0000 7fb49a000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49415d920 con 0x7fb4940ca4d0 2024-03-23T06:10:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.252+0000 7fb49a000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4940703e0 con 0x7fb4940c8eb0 2024-03-23T06:10:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.252+0000 7fb49a000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49415cac0 con 0x7fb4941536c0 2024-03-23T06:10:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9bde000640 1 --2- 172.21.15.73:0/871640820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd804f240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0097a0 tx=0x7f9bcc02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13a1dad7800263a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9bdd600640 1 -- 172.21.15.73:0/871640820 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc030800 con 0x7f9bd8047b70 2024-03-23T06:10:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9bdd600640 1 -- 172.21.15.73:0/871640820 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc030960 con 0x7f9bd8047b70 2024-03-23T06:10:36.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.251+0000 7f9bdd600640 1 -- 172.21.15.73:0/871640820 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc030cf0 con 0x7f9bd8047b70 2024-03-23T06:10:36.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.252+0000 7fb492a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb4940ca4d0 0x7fb4940caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55334/0 (socket says 172.21.15.73:55334) 2024-03-23T06:10:36.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.252+0000 7fb492a00640 1 -- 172.21.15.73:0/3756319492 learned_addr learned my addr 172.21.15.73:0/3756319492 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:36.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.252+0000 7fb493e00640 1 --2- 172.21.15.73:0/3756319492 >> v2:172.21.15.110:3300/0 conn(0x7fb4940c8eb0 0x7fb494070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fb492000640 1 -- 172.21.15.73:0/3756319492 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262926155 0 0) 0x7fb49415d920 con 0x7fb4940ca4d0 2024-03-23T06:10:36.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fb492000640 1 -- 172.21.15.73:0/3756319492 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb478003520 con 0x7fb4940ca4d0 2024-03-23T06:10:36.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7f9473200640 1 -- 172.21.15.73:0/3559903676 shutdown_connections 2024-03-23T06:10:36.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f9bdfe00640 1 -- 172.21.15.73:0/871640820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 msgr2=0x7f9bd804f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/871640820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd804f240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0097a0 tx=0x7f9bcc02b940 comp rx=0 tx=0).stop 2024-03-23T06:10:36.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f9bdfe00640 1 -- 172.21.15.73:0/871640820 shutdown_connections 2024-03-23T06:10:36.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/871640820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80e0040 0x7f9bd804d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/871640820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd804f240 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f9bdfe00640 1 -- 172.21.15.73:0/871640820 >> 172.21.15.73:0/871640820 conn(0x7f9bd800e050 msgr2=0x7f9bd800e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7f9473200640 1 -- 172.21.15.73:0/3559903676 wait complete. 2024-03-23T06:10:36.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fcd8ae00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd840ca7d0 0x7fcd840cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7f2d73400640 1 -- 172.21.15.73:0/2953036536 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2d74041960 con 0x7f2d7c0c5980 2024-03-23T06:10:36.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f2d73400640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5c06ac50 0x7f2d5c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f2d73400640 1 -- 172.21.15.73:0/2953036536 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2d740ac6b0 con 0x7f2d7c0c5980 2024-03-23T06:10:36.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7f2d7aa00640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5c06ac50 0x7f2d5c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fcd8ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd841537b0 0x7fcd8406a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fcd8ae00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd840b2460 con 0x7fcd840b1c40 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fcd8ae00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd840ca140 con 0x7fcd840ca7d0 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fcd8ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8415a4b0 con 0x7fcd841537b0 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fcd88e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcd840b1c40 0x7fcd8415cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55338/0 (socket says 172.21.15.73:55338) 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fcd88e00640 1 -- 172.21.15.73:0/2156274878 learned_addr learned my addr 172.21.15.73:0/2156274878 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7fcd83e00640 1 --2- 172.21.15.73:0/2156274878 >> v2:172.21.15.110:3300/0 conn(0x7fcd840ca7d0 0x7fcd840cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651095222 0 0) 0x7fcd7c001490 con 0x7fcd840b1c40 2024-03-23T06:10:36.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.254+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd68003520 con 0x7fcd840b1c40 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fb493e00640 1 -- 172.21.15.73:0/3756319492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4941536c0 msgr2=0x7fb494159f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fb493e00640 1 --2- 172.21.15.73:0/3756319492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4941536c0 0x7fb494159f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fb493e00640 1 -- 172.21.15.73:0/3756319492 >> v1:172.21.15.73:6789/0 conn(0x7fb4940ca4d0 legacy=0x7fb4940caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 65550450 0 0) 0x7fcd68003520 con 0x7fcd840b1c40 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd841537b0 msgr2=0x7fcd8406a1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd841537b0 0x7fcd8406a1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 >> v2:172.21.15.110:3300/0 conn(0x7fcd840ca7d0 msgr2=0x7fcd840cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 --2- 172.21.15.73:0/2156274878 >> v2:172.21.15.110:3300/0 conn(0x7fcd840ca7d0 0x7fcd840cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840c9e60 con 0x7fcd840b1c40 2024-03-23T06:10:36.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fcd7c001b80 con 0x7fcd840b1c40 2024-03-23T06:10:36.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 >> v1:172.21.15.73:6789/0 conn(0x7fcd840b1c40 legacy=0x7fcd8415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd68003970 0x7fcd68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd680047c0 0x7fcd68004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd680052d0 0x7fcd6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8415a4b0 con 0x7fcd680047c0 2024-03-23T06:10:36.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6800c120 con 0x7fcd68003970 2024-03-23T06:10:36.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6800c2e0 con 0x7fcd680052d0 2024-03-23T06:10:36.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7f2d7aa00640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5c06ac50 0x7f2d5c06d110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c007fd0 tx=0x7f2d6c007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c04e030 con 0x7f2d7c0c5980 2024-03-23T06:10:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7f9bdfe00640 1 -- 172.21.15.73:0/871640820 shutdown_connections 2024-03-23T06:10:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.255+0000 7f9bdfe00640 1 -- 172.21.15.73:0/871640820 wait complete. 2024-03-23T06:10:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fb493e00640 1 -- 172.21.15.73:0/3756319492 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49415cd10 con 0x7fb4940c8eb0 2024-03-23T06:10:36.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.256+0000 7fb493e00640 1 --2- 172.21.15.73:0/3756319492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4940c8eb0 0x7fb494070e70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb4840097a0 tx=0x7fb48402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ae933149c8eed84 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.256+0000 7fcd83e00640 1 --2- 172.21.15.73:0/2156274878 >> v2:172.21.15.110:3300/0 conn(0x7fcd840ca7d0 0x7fcd840cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.253+0000 7fc9a0e00640 1 Processor -- start 2024-03-23T06:10:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.256+0000 7fcd88e00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd680052d0 0x7fcd6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.256+0000 7fb492000640 1 -- 172.21.15.73:0/3756319492 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484031830 con 0x7fb4940c8eb0 2024-03-23T06:10:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.256+0000 7fb492000640 1 -- 172.21.15.73:0/3756319492 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb484031990 con 0x7fb4940c8eb0 2024-03-23T06:10:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb492000640 1 -- 172.21.15.73:0/3756319492 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484031830 con 0x7fb4940c8eb0 2024-03-23T06:10:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.256+0000 7fcd83400640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd680047c0 0x7fcd68004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.256+0000 7fcd83e00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd68003970 0x7fcd68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb49a000640 1 -- 172.21.15.73:0/3756319492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4940c8eb0 msgr2=0x7fb494070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb49a000640 1 --2- 172.21.15.73:0/3756319492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4940c8eb0 0x7fb494070e70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb4840097a0 tx=0x7fb48402b8d0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fcd83400640 1 -- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd680052d0 msgr2=0x7fcd6800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7f9473200640 1 Processor -- start 2024-03-23T06:10:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fcd83400640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd680052d0 0x7fcd6800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fcd83400640 1 -- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd68003970 msgr2=0x7fcd68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7f9473200640 1 -- start start 2024-03-23T06:10:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fcd83400640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd68003970 0x7fcd68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fcd83400640 1 -- 172.21.15.73:0/2156274878 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68003520 con 0x7fcd680047c0 2024-03-23T06:10:36.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fcd88e00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd680052d0 0x7fcd6800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb49a000640 1 -- 172.21.15.73:0/3756319492 shutdown_connections 2024-03-23T06:10:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb49a000640 1 --2- 172.21.15.73:0/3756319492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4940c8eb0 0x7fb494070e70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb49a000640 1 --2- 172.21.15.73:0/3756319492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4941536c0 0x7fb494159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb49a000640 1 -- 172.21.15.73:0/3756319492 >> 172.21.15.73:0/3756319492 conn(0x7fb494069cb0 msgr2=0x7fb49406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb49a000640 1 -- 172.21.15.73:0/3756319492 shutdown_connections 2024-03-23T06:10:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.257+0000 7fb49a000640 1 -- 172.21.15.73:0/3756319492 wait complete. 2024-03-23T06:10:36.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.258+0000 7fcd83e00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd68003970 0x7fcd68003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7f9bdfe00640 1 Processor -- start 2024-03-23T06:10:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7f9bdfe00640 1 -- start start 2024-03-23T06:10:36.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7fb49a000640 1 Processor -- start 2024-03-23T06:10:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7fcd83400640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd680047c0 0x7fcd68004c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd8408cc20 tx=0x7fcd680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23573dc15bd24456 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7fb49a000640 1 -- start start 2024-03-23T06:10:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7f9473200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f946804ffa0 0x7f9468048640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70032600 con 0x7fcd680047c0 2024-03-23T06:10:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7f9473200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94680d9220 0x7f94680db530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7002e050 con 0x7fcd680047c0 2024-03-23T06:10:36.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.259+0000 7fcd82a00640 1 -- 172.21.15.73:0/2156274878 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700329a0 con 0x7fcd680047c0 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9473200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94680e0460 0x7f94681752b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9473200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946804b360 con 0x7f946804ffa0 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9473200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680dbff0 con 0x7f94680e0460 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9473200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94681757f0 con 0x7f94680d9220 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9472800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94680e0460 0x7f94681752b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9471400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94680d9220 0x7f94680db530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9471e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f946804ffa0 0x7f9468048640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9472800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94680e0460 0x7f94681752b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52730/0 (socket says 172.21.15.73:52730) 2024-03-23T06:10:36.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7f9472800640 1 -- 172.21.15.73:0/3692259938 learned_addr learned my addr 172.21.15.73:0/3692259938 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fb49a000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4940c8eb0 0x7fb494153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fb49a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4940ca4d0 0x7fb4940ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fb49a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4941536c0 0x7fb494156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fb49a000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940c1e90 con 0x7fb4940ca4d0 2024-03-23T06:10:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fb49a000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494154300 con 0x7fb4941536c0 2024-03-23T06:10:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fb49a000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940c20c0 con 0x7fb4940c8eb0 2024-03-23T06:10:36.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fcd8ae00640 1 -- 172.21.15.73:0/2156274878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd680047c0 msgr2=0x7fcd68004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9bdfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd816a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9471e00640 1 -- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94680d9220 msgr2=0x7f94680db530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9471e00640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94680d9220 0x7f94680db530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9471e00640 1 -- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94680e0460 msgr2=0x7f94681752b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9471e00640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94680e0460 0x7f94681752b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4940c8eb0 0x7fb494153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4941536c0 0x7fb494156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9471e00640 1 -- 172.21.15.73:0/3692259938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0094d0 con 0x7f946804ffa0 2024-03-23T06:10:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9bdfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80d6d00 0x7f9bd816ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4940c8eb0 0x7fb494153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49580/0 (socket says 172.21.15.73:49580) 2024-03-23T06:10:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493400640 1 -- 172.21.15.73:0/4290075862 learned_addr learned my addr 172.21.15.73:0/4290075862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f2d73400640 1 -- 172.21.15.73:0/2953036536 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2d740775f0 con 0x7f2d7c0c5980 2024-03-23T06:10:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fcd8ae00640 1 --2- 172.21.15.73:0/2156274878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd680047c0 0x7fcd68004c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd8408cc20 tx=0x7fcd680057f0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.260+0000 7fcd88e00640 1 -- 172.21.15.73:0/2156274878 reap_dead start 2024-03-23T06:10:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9bdea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd816a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fcd8ae00640 1 -- 172.21.15.73:0/2156274878 shutdown_connections 2024-03-23T06:10:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fcd8ae00640 1 -- 172.21.15.73:0/2156274878 >> 172.21.15.73:0/2156274878 conn(0x7fcd84071800 msgr2=0x7fcd84071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7f9bdfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd80e0040 0x7f9bd80c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493400640 1 -- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4941536c0 msgr2=0x7fb494156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493400640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4941536c0 0x7fb494156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493400640 1 -- 172.21.15.73:0/4290075862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4940ca4d0 msgr2=0x7fb4940ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493400640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4940ca4d0 0x7fb4940ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fb493400640 1 -- 172.21.15.73:0/4290075862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484009400 con 0x7fb4940c8eb0 2024-03-23T06:10:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bde000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80d6d00 0x7f9bd816ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fb493400640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4940c8eb0 0x7fb494153dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00ba50 tx=0x7fb48c00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bdfe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd80de4b0 con 0x7f9bd8047b70 2024-03-23T06:10:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bdfe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd817d0a0 con 0x7f9bd80e0040 2024-03-23T06:10:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bdfe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd817c210 con 0x7f9bd80d6d00 2024-03-23T06:10:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fcd8ae00640 1 -- 172.21.15.73:0/2156274878 shutdown_connections 2024-03-23T06:10:36.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fcd8ae00640 1 -- 172.21.15.73:0/2156274878 wait complete. 2024-03-23T06:10:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bde000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80d6d00 0x7f9bd816ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49596/0 (socket says 172.21.15.73:49596) 2024-03-23T06:10:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bde000640 1 -- 172.21.15.73:0/1839140112 learned_addr learned my addr 172.21.15.73:0/1839140112 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bdea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd816a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34790/0 (socket says 172.21.15.73:34790) 2024-03-23T06:10:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bdf400640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd80e0040 0x7f9bd80c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fb48b400640 1 -- 172.21.15.73:0/4290075862 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00cc10 con 0x7fb4940c8eb0 2024-03-23T06:10:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fb48b400640 1 -- 172.21.15.73:0/4290075862 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c00cd70 con 0x7fb4940c8eb0 2024-03-23T06:10:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fb48b400640 1 -- 172.21.15.73:0/4290075862 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c014680 con 0x7fb4940c8eb0 2024-03-23T06:10:36.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.261+0000 7fc9a0e00640 1 -- start start 2024-03-23T06:10:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9471e00640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f946804ffa0 0x7f9468048640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94600045b0 tx=0x7f946000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fc9a0e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc99c0b1c40 0x7fc99c0ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fc9a0e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 0x7fc99c1fc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fc9a0e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1fc680 0x7fc99c1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fc9a0e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c148130 con 0x7fc99c0b1c40 2024-03-23T06:10:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fc9a0e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c149700 con 0x7fc99c0ca7d0 2024-03-23T06:10:36.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7fc9a0e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c1e5060 con 0x7fc99c1fc680 2024-03-23T06:10:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9466000640 1 -- 172.21.15.73:0/3692259938 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460015e90 con 0x7f946804ffa0 2024-03-23T06:10:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb494156d60 con 0x7fb4940c8eb0 2024-03-23T06:10:36.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4940c3b90 con 0x7fb4940c8eb0 2024-03-23T06:10:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9466000640 1 -- 172.21.15.73:0/3692259938 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946001d3f0 con 0x7f946804ffa0 2024-03-23T06:10:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9466000640 1 -- 172.21.15.73:0/3692259938 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946001d7a0 con 0x7f946804ffa0 2024-03-23T06:10:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94680dc240 con 0x7f946804ffa0 2024-03-23T06:10:36.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94680dc800 con 0x7f946804ffa0 2024-03-23T06:10:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.264+0000 7fcd8ae00640 1 Processor -- start 2024-03-23T06:10:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.264+0000 7fcd8ae00640 1 -- start start 2024-03-23T06:10:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.265+0000 7fcd8ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840b2c50 0x7fcd840b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.265+0000 7fcd8ae00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd84151fe0 0x7fcd84144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.265+0000 7fcd8ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84144e50 0x7fcd841452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.265+0000 7fcd8ae00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84157890 con 0x7fcd84151fe0 2024-03-23T06:10:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.265+0000 7fcd8ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd841e4730 con 0x7fcd840b2c50 2024-03-23T06:10:36.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.262+0000 7f9bde000640 1 -- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd80e0040 msgr2=0x7f9bd80c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9bde000640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd80e0040 0x7f9bd80c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9bde000640 1 -- 172.21.15.73:0/1839140112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 msgr2=0x7f9bd816a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9bde000640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd816a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.263+0000 7f9bde000640 1 -- 172.21.15.73:0/1839140112 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc009400 con 0x7f9bd80d6d00 2024-03-23T06:10:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7f9bdea00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd816a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:10:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.265+0000 7fcd8ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd84157ac0 con 0x7fcd84144e50 2024-03-23T06:10:36.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fcd88e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84144e50 0x7fcd841452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fc999e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc99c0b1c40 0x7fc99c0ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fc99a800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1fc680 0x7fc99c1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fc999e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc99c0b1c40 0x7fc99c0ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34800/0 (socket says 172.21.15.73:34800) 2024-03-23T06:10:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fcd88e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84144e50 0x7fcd841452d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49600/0 (socket says 172.21.15.73:49600) 2024-03-23T06:10:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fc999e00640 1 -- 172.21.15.73:0/3970780891 learned_addr learned my addr 172.21.15.73:0/3970780891 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fc999400640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 0x7fc99c1fc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fc99a800640 1 -- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 msgr2=0x7fc99c1fc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fc99a800640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 0x7fc99c1fc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fc99a800640 1 -- 172.21.15.73:0/3970780891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc99c0b1c40 msgr2=0x7fc99c0ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fc99a800640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc99c0b1c40 0x7fc99c0ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fc99a800640 1 -- 172.21.15.73:0/3970780891 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c009400 con 0x7fc99c1fc680 2024-03-23T06:10:36.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7f9bde000640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80d6d00 0x7f9bd816ea10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc02bf50 tx=0x7f9bcc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fcd88e00640 1 -- 172.21.15.73:0/3432035642 learned_addr learned my addr 172.21.15.73:0/3432035642 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fcd88e00640 1 -- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840b2c50 msgr2=0x7fcd840b3030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T06:10:36.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fcd88e00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840b2c50 0x7fcd840b3030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fc99a800640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1fc680 0x7fc99c1469e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc99400ca70 tx=0x7fc99400cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9468006930 con 0x7f946804ffa0 2024-03-23T06:10:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.268+0000 7f9466000640 1 -- 172.21.15.73:0/3692259938 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f946001d900 con 0x7f946804ffa0 2024-03-23T06:10:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.266+0000 7fcd88e00640 1 -- 172.21.15.73:0/3432035642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd84151fe0 msgr2=0x7fcd84144910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:10:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fcd88e00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd84151fe0 0x7fcd84144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fcd88e00640 1 -- 172.21.15.73:0/3432035642 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd841e5020 con 0x7fcd84144e50 2024-03-23T06:10:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.268+0000 7f9bd6a00640 1 -- 172.21.15.73:0/1839140112 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc03e070 con 0x7f9bd80d6d00 2024-03-23T06:10:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.268+0000 7f9bd6a00640 1 -- 172.21.15.73:0/1839140112 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc006e10 con 0x7f9bd80d6d00 2024-03-23T06:10:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.268+0000 7f9bd6a00640 1 -- 172.21.15.73:0/1839140112 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc039c30 con 0x7f9bd80d6d00 2024-03-23T06:10:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.268+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd816ae20 con 0x7f9bd80d6d00 2024-03-23T06:10:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.268+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd817c700 con 0x7f9bd80d6d00 2024-03-23T06:10:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.269+0000 7f9466000640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f945006ac00 0x7f945006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.269+0000 7f9466000640 1 -- 172.21.15.73:0/3692259938 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9460091400 con 0x7f946804ffa0 2024-03-23T06:10:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.267+0000 7fb48b400640 1 -- 172.21.15.73:0/4290075862 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb48c01d3b0 con 0x7fb4940c8eb0 2024-03-23T06:10:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.268+0000 7fb48b400640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb47406ac50 0x7fb47406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.269+0000 7fb492a00640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb47406ac50 0x7fb47406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.269+0000 7fb48b400640 1 -- 172.21.15.73:0/4290075862 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb48c058980 con 0x7fb4940c8eb0 2024-03-23T06:10:36.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.269+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4940c2200 con 0x7fb4940c8eb0 2024-03-23T06:10:36.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.269+0000 7fb492a00640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb47406ac50 0x7fb47406d110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb480000f60 tx=0x7fb4800078f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.268+0000 7fc992000640 1 -- 172.21.15.73:0/3970780891 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400abd0 con 0x7fc99c1fc680 2024-03-23T06:10:36.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.270+0000 7fc992000640 1 -- 172.21.15.73:0/3970780891 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400ad30 con 0x7fc99c1fc680 2024-03-23T06:10:36.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.270+0000 7fc992000640 1 -- 172.21.15.73:0/3970780891 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400aea0 con 0x7fc99c1fc680 2024-03-23T06:10:36.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.270+0000 7f9471400640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f945006ac00 0x7f945006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.270+0000 7fcd88e00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84144e50 0x7fcd841452d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c000f80 tx=0x7fcd7c007430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.271+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c1fbcb0 con 0x7fc99c1fc680 2024-03-23T06:10:36.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.271+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd80057b0 con 0x7f9bd80d6d00 2024-03-23T06:10:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.271+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c149930 con 0x7fc99c1fc680 2024-03-23T06:10:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.272+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c1fbe40 con 0x7fc99c1fc680 2024-03-23T06:10:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.273+0000 7f9bd6a00640 1 -- 172.21.15.73:0/1839140112 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9bcc0423f0 con 0x7f9bd80d6d00 2024-03-23T06:10:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.273+0000 7f9471400640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f945006ac00 0x7f945006d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f945c036000 tx=0x7f945c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.273+0000 7f9bd6a00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bc006ac00 0x7f9bc006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.274+0000 7fcd7be00640 1 -- 172.21.15.73:0/3432035642 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c013600 con 0x7fcd84144e50 2024-03-23T06:10:36.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.274+0000 7f9bd6a00640 1 -- 172.21.15.73:0/1839140112 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9bcc0ab1a0 con 0x7f9bd80d6d00 2024-03-23T06:10:36.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.274+0000 7f9bdea00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bc006ac00 0x7f9bc006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.274+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd841e5300 con 0x7fcd84144e50 2024-03-23T06:10:36.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.274+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd840b39c0 con 0x7fcd84144e50 2024-03-23T06:10:36.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.274+0000 7fb48b400640 1 -- 172.21.15.73:0/4290075862 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb48c054d50 con 0x7fb4940c8eb0 2024-03-23T06:10:36.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.275+0000 7f9bdea00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bc006ac00 0x7f9bc006d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0001230 tx=0x7f9bd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.276+0000 7fc992000640 1 -- 172.21.15.73:0/3970780891 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc994007070 con 0x7fc99c1fc680 2024-03-23T06:10:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.276+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd84157670 con 0x7fcd84144e50 2024-03-23T06:10:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.277+0000 7fc992000640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc97c06ac50 0x7fc97c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.278+0000 7fc999e00640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc97c06ac50 0x7fc97c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.279+0000 7fc992000640 1 -- 172.21.15.73:0/3970780891 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc994058470 con 0x7fc99c1fc680 2024-03-23T06:10:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.278+0000 7fcd7be00640 1 -- 172.21.15.73:0/3432035642 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c013760 con 0x7fcd84144e50 2024-03-23T06:10:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.280+0000 7fc999e00640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc97c06ac50 0x7fc97c06d110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc98c02b860 tx=0x7fc98c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.278+0000 7fcd7be00640 1 -- 172.21.15.73:0/3432035642 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c013af0 con 0x7fcd84144e50 2024-03-23T06:10:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.280+0000 7f9466000640 1 -- 172.21.15.73:0/3692259938 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f946005c2e0 con 0x7f946804ffa0 2024-03-23T06:10:36.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.280+0000 7f9bd6a00640 1 -- 172.21.15.73:0/1839140112 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9bcc075f60 con 0x7f9bd80d6d00 2024-03-23T06:10:36.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.281+0000 7fcd7be00640 1 -- 172.21.15.73:0/3432035642 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcd7c013c50 con 0x7fcd84144e50 2024-03-23T06:10:36.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.283+0000 7fcd7be00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.283+0000 7fcd83e00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.283+0000 7fcd7be00640 1 -- 172.21.15.73:0/3432035642 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd7c058760 con 0x7fcd84144e50 2024-03-23T06:10:36.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.284+0000 7fc992000640 1 -- 172.21.15.73:0/3970780891 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc9940547b0 con 0x7fc99c1fc680 2024-03-23T06:10:36.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.285+0000 7fcd83e00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd6406ac00 0x7fcd6406d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd74006fd0 tx=0x7fcd74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.288+0000 7fcd7be00640 1 -- 172.21.15.73:0/3432035642 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fcd7c054aa0 con 0x7fcd84144e50 2024-03-23T06:10:36.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.594+0000 7f0886a00640 1 -- 172.21.15.73:0/936656023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0868005500 con 0x7f089414d940 2024-03-23T06:10:36.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.595+0000 7f0891600640 1 -- 172.21.15.73:0/936656023 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f088c039070 con 0x7f089414d940 2024-03-23T06:10:36.598 INFO:teuthology.orchestra.run.smithi073.stdout:55834574861 2024-03-23T06:10:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.599+0000 7f0886a00640 1 -- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f087406ad00 msgr2=0x7f087406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.599+0000 7f0886a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f087406ad00 0x7f087406d1c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0888006fd0 tx=0x7f0888008040 comp rx=0 tx=0).stop 2024-03-23T06:10:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.599+0000 7f0886a00640 1 -- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f089414d940 msgr2=0x7f089414ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.599+0000 7f0886a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f089414d940 0x7f089414ddc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f088c007500 tx=0x7f088c004ae0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.600+0000 7f0886a00640 1 -- 172.21.15.73:0/936656023 shutdown_connections 2024-03-23T06:10:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.600+0000 7f0886a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f087406ad00 0x7f087406d1c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.600+0000 7f0886a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f089414d940 0x7f089414ddc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.600+0000 7f0886a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08941574e0 0x7f089415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.600+0000 7f0886a00640 1 --2- 172.21.15.73:0/936656023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f087c005260 0x7f08941ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.600+0000 7f0886a00640 1 -- 172.21.15.73:0/936656023 >> 172.21.15.73:0/936656023 conn(0x7f0894071d20 msgr2=0x7f08940c4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.601+0000 7f0886a00640 1 -- 172.21.15.73:0/936656023 shutdown_connections 2024-03-23T06:10:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.601+0000 7f0886a00640 1 -- 172.21.15.73:0/936656023 wait complete. 2024-03-23T06:10:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.611+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f26bc0c67e0 con 0x7f26bc0c1b40 2024-03-23T06:10:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.612+0000 7f26b9600640 1 -- 172.21.15.73:0/1017158594 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26b0057b00 con 0x7f26bc0c1b40 2024-03-23T06:10:36.614 INFO:teuthology.orchestra.run.smithi073.stdout:60129542158 2024-03-23T06:10:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.615+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f269c06ac60 msgr2=0x7f269c06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.615+0000 7f26c4400640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f269c06ac60 0x7f269c06d120 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26a8039000 tx=0x7f26a8034000 comp rx=0 tx=0).stop 2024-03-23T06:10:36.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.616+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 msgr2=0x7f26bc1eada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.616+0000 7f26c4400640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc1eada0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26b000c840 tx=0x7f26b000cc40 comp rx=0 tx=0).stop 2024-03-23T06:10:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.620+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 shutdown_connections 2024-03-23T06:10:36.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.620+0000 7f26c4400640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f269c06ac60 0x7f269c06d120 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.620+0000 7f26c4400640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26bc14f550 0x7f26bc154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.620+0000 7f26c4400640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26bc0c5c80 0x7f26bc14a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.620+0000 7f26c4400640 1 --2- 172.21.15.73:0/1017158594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26bc0c1b40 0x7f26bc1eada0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.620+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 >> 172.21.15.73:0/1017158594 conn(0x7f26bc066080 msgr2=0x7f26bc0ca830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.620+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 shutdown_connections 2024-03-23T06:10:36.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.621+0000 7f26c4400640 1 -- 172.21.15.73:0/1017158594 wait complete. 2024-03-23T06:10:36.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.6 2024-03-23T06:10:36.626 DEBUG:teuthology.parallel:result is None 2024-03-23T06:10:36.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.0 2024-03-23T06:10:36.651 DEBUG:teuthology.parallel:result is None 2024-03-23T06:10:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.668+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc99c0b2460 con 0x7fc99c1fc680 2024-03-23T06:10:36.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.669+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd840b2460 con 0x7fcd84144e50 2024-03-23T06:10:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.669+0000 7fc992000640 1 -- 172.21.15.73:0/3970780891 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc99c0b2460 con 0x7fc99c1fc680 2024-03-23T06:10:36.669 INFO:teuthology.orchestra.run.smithi073.stdout:60129542156 2024-03-23T06:10:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.669+0000 7fcd7be00640 1 -- 172.21.15.73:0/3432035642 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd840b2460 con 0x7fcd84144e50 2024-03-23T06:10:36.670 INFO:teuthology.orchestra.run.smithi073.stdout:60129542156 2024-03-23T06:10:36.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc97c06ac50 msgr2=0x7fc97c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd6406ac00 msgr2=0x7fcd6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd6406ac00 0x7fcd6406d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd74006fd0 tx=0x7fcd74008040 comp rx=0 tx=0).stop 2024-03-23T06:10:36.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84144e50 msgr2=0x7fcd841452d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84144e50 0x7fcd841452d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c000f80 tx=0x7fcd7c007430 comp rx=0 tx=0).stop 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 shutdown_connections 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd6406ac00 0x7fcd6406d0c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd84144e50 0x7fcd841452d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd84151fe0 0x7fcd84144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 --2- 172.21.15.73:0/3432035642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd840b2c50 0x7fcd840b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 >> 172.21.15.73:0/3432035642 conn(0x7fcd84071800 msgr2=0x7fcd840732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc97c06ac50 0x7fc97c06d110 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc98c02b860 tx=0x7fc98c03d040 comp rx=0 tx=0).stop 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1fc680 msgr2=0x7fc99c1469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1fc680 0x7fc99c1469e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc99400ca70 tx=0x7fc99400cf30 comp rx=0 tx=0).stop 2024-03-23T06:10:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 shutdown_connections 2024-03-23T06:10:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc97c06ac50 0x7fc97c06d110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc99c1fc680 0x7fc99c1469e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc99c0ca7d0 0x7fc99c1fc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 --2- 172.21.15.73:0/3970780891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc99c0b1c40 0x7fc99c0ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 >> 172.21.15.73:0/3970780891 conn(0x7fc99c071800 msgr2=0x7fc99c157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 shutdown_connections 2024-03-23T06:10:36.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fcd8ae00640 1 -- 172.21.15.73:0/3432035642 wait complete. 2024-03-23T06:10:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.672+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 shutdown_connections 2024-03-23T06:10:36.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.673+0000 7fc9a0e00640 1 -- 172.21.15.73:0/3970780891 wait complete. 2024-03-23T06:10:36.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.3 2024-03-23T06:10:36.689 DEBUG:teuthology.parallel:result is None 2024-03-23T06:10:36.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.694+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2d7c1eaee0 con 0x7f2d7c0c5980 2024-03-23T06:10:36.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.694+0000 7f2d73400640 1 -- 172.21.15.73:0/2953036536 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d7407ac10 con 0x7f2d7c0c5980 2024-03-23T06:10:36.694 INFO:teuthology.orchestra.run.smithi073.stdout:55834574862 2024-03-23T06:10:36.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.695+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb49404e110 con 0x7fb4940c8eb0 2024-03-23T06:10:36.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.696+0000 7fb48b400640 1 -- 172.21.15.73:0/4290075862 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb48c019020 con 0x7fb4940c8eb0 2024-03-23T06:10:36.695 INFO:teuthology.orchestra.run.smithi073.stdout:60129542157 2024-03-23T06:10:36.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.2 2024-03-23T06:10:36.696 DEBUG:teuthology.parallel:result is None 2024-03-23T06:10:36.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5c06ac50 msgr2=0x7f2d5c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5c06ac50 0x7f2d5c06d110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c007fd0 tx=0x7f2d6c007920 comp rx=0 tx=0).stop 2024-03-23T06:10:36.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d7c0c5980 msgr2=0x7f2d7c157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d7c0c5980 0x7f2d7c157b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000f80 tx=0x7f2d74004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:36.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 shutdown_connections 2024-03-23T06:10:36.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d7c14f510 0x7f2d7c152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d7c0c7710 0x7f2d7c151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5c06ac50 0x7f2d5c06d110 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c007fd0 tx=0x7f2d6c007920 comp rx=0 tx=0).stop 2024-03-23T06:10:36.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 --2- 172.21.15.73:0/2953036536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d7c0c5980 0x7f2d7c157b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 >> 172.21.15.73:0/2953036536 conn(0x7f2d7c069cb0 msgr2=0x7f2d7c14d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.697+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 shutdown_connections 2024-03-23T06:10:36.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.698+0000 7f2d81200640 1 -- 172.21.15.73:0/2953036536 wait complete. 2024-03-23T06:10:36.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.698+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9bd804e400 con 0x7f9bd80d6d00 2024-03-23T06:10:36.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7f9bd6a00640 1 -- 172.21.15.73:0/1839140112 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9bcc034090 con 0x7f9bd80d6d00 2024-03-23T06:10:36.699 INFO:teuthology.orchestra.run.smithi073.stdout:55834574861 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb47406ac50 msgr2=0x7fb47406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb47406ac50 0x7fb47406d110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb480000f60 tx=0x7fb4800078f0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4940c8eb0 msgr2=0x7fb494153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4940c8eb0 0x7fb494153dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00ba50 tx=0x7fb48c00bf10 comp rx=0 tx=0).stop 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 shutdown_connections 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4941536c0 0x7fb494156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4940ca4d0 0x7fb4940ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb47406ac50 0x7fb47406d110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 --2- 172.21.15.73:0/4290075862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4940c8eb0 0x7fb494153dc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.699+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 >> 172.21.15.73:0/4290075862 conn(0x7fb494069cb0 msgr2=0x7fb4940c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.700+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 shutdown_connections 2024-03-23T06:10:36.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.700+0000 7fb49a000640 1 -- 172.21.15.73:0/4290075862 wait complete. 2024-03-23T06:10:36.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bc006ac00 msgr2=0x7f9bc006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bc006ac00 0x7f9bc006d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0001230 tx=0x7f9bd0009040 comp rx=0 tx=0).stop 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80d6d00 msgr2=0x7f9bd816ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80d6d00 0x7f9bd816ea10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc02bf50 tx=0x7f9bcc0046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 shutdown_connections 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bd80e0040 0x7f9bd80c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bc006ac00 0x7f9bc006d0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bd80d6d00 0x7f9bd816ea10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 --2- 172.21.15.73:0/1839140112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bd8047b70 0x7f9bd816a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 >> 172.21.15.73:0/1839140112 conn(0x7f9bd800e050 msgr2=0x7f9bd804e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 shutdown_connections 2024-03-23T06:10:36.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.701+0000 7f9bdfe00640 1 -- 172.21.15.73:0/1839140112 wait complete. 2024-03-23T06:10:36.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.703+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f946800efd0 con 0x7f946804ffa0 2024-03-23T06:10:36.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.704+0000 7f9466000640 1 -- 172.21.15.73:0/3692259938 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f946005f900 con 0x7f946804ffa0 2024-03-23T06:10:36.704 INFO:teuthology.orchestra.run.smithi073.stdout:55834574861 2024-03-23T06:10:36.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f945006ac00 msgr2=0x7f945006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f945006ac00 0x7f945006d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f945c036000 tx=0x7f945c03b040 comp rx=0 tx=0).stop 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f946804ffa0 msgr2=0x7f9468048640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f946804ffa0 0x7f9468048640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94600045b0 tx=0x7f946000c8a0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 shutdown_connections 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94680e0460 0x7f94681752b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f945006ac00 0x7f945006d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94680d9220 0x7f94680db530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 --2- 172.21.15.73:0/3692259938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f946804ffa0 0x7f9468048640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 >> 172.21.15.73:0/3692259938 conn(0x7f946800e130 msgr2=0x7f94680d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 shutdown_connections 2024-03-23T06:10:36.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.706+0000 7f9473200640 1 -- 172.21.15.73:0/3692259938 wait complete. 2024-03-23T06:10:36.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574861 for osd.7 2024-03-23T06:10:36.720 DEBUG:teuthology.parallel:result is None 2024-03-23T06:10:36.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574862 for osd.5 2024-03-23T06:10:36.723 DEBUG:teuthology.parallel:result is None 2024-03-23T06:10:36.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574861 for osd.4 2024-03-23T06:10:36.724 DEBUG:teuthology.parallel:result is None 2024-03-23T06:10:36.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.1 2024-03-23T06:10:36.725 DEBUG:teuthology.parallel:result is None 2024-03-23T06:10:36.725 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-23T06:10:36.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:10:36.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.964+0000 7f434c800640 1 Processor -- start 2024-03-23T06:10:36.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.964+0000 7f434c800640 1 -- start start 2024-03-23T06:10:36.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.966+0000 7f434c800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43440c5a10 0x7f43440bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.966+0000 7f434c800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4344157b60 con 0x7f43441513f0 2024-03-23T06:10:36.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.966+0000 7f434c800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43440c0830 con 0x7f43440c03a0 2024-03-23T06:10:36.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.966+0000 7f434c800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4344158dc0 con 0x7f43440c5a10 2024-03-23T06:10:36.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.966+0000 7f4349e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f43441513f0 0x7f43441586b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55340/0 (socket says 172.21.15.73:55340) 2024-03-23T06:10:36.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.966+0000 7f4349e00640 1 -- 172.21.15.73:0/2483414866 learned_addr learned my addr 172.21.15.73:0/2483414866 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:36.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.966+0000 7f4349400640 1 --2- 172.21.15.73:0/2483414866 >> v2:172.21.15.110:3300/0 conn(0x7f43440c5a10 0x7f43440bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.966+0000 7f4348a00640 1 -- 172.21.15.73:0/2483414866 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290768680 0 0) 0x7f4344157b60 con 0x7f43441513f0 2024-03-23T06:10:36.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.967+0000 7f4349400640 1 -- 172.21.15.73:0/2483414866 >> v1:172.21.15.110:6789/0 conn(0x7f43440c03a0 legacy=0x7f4344071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.967+0000 7f4349400640 1 -- 172.21.15.73:0/2483414866 >> v1:172.21.15.73:6789/0 conn(0x7f43441513f0 legacy=0x7f43441586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.967+0000 7f4349400640 1 -- 172.21.15.73:0/2483414866 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440c0b10 con 0x7f43440c5a10 2024-03-23T06:10:36.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.968+0000 7f4349400640 1 --2- 172.21.15.73:0/2483414866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43440c5a10 0x7f43440bfe60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4334009720 tx=0x7f433402b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51337e0fd265fa84 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.968+0000 7f4348a00640 1 -- 172.21.15.73:0/2483414866 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334031520 con 0x7f43440c5a10 2024-03-23T06:10:36.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.968+0000 7f4348a00640 1 -- 172.21.15.73:0/2483414866 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334031680 con 0x7f43440c5a10 2024-03-23T06:10:36.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.968+0000 7f4348a00640 1 -- 172.21.15.73:0/2483414866 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334031a10 con 0x7f43440c5a10 2024-03-23T06:10:36.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.969+0000 7f434c800640 1 -- 172.21.15.73:0/2483414866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43440c5a10 msgr2=0x7f43440bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.969+0000 7f434c800640 1 --2- 172.21.15.73:0/2483414866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43440c5a10 0x7f43440bfe60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4334009720 tx=0x7f433402b7c0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.969+0000 7f434c800640 1 -- 172.21.15.73:0/2483414866 shutdown_connections 2024-03-23T06:10:36.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.969+0000 7f434c800640 1 --2- 172.21.15.73:0/2483414866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43440c5a10 0x7f43440bfe60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.969+0000 7f434c800640 1 -- 172.21.15.73:0/2483414866 >> 172.21.15.73:0/2483414866 conn(0x7f434406bb40 msgr2=0x7f434406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:36.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.969+0000 7f434c800640 1 -- 172.21.15.73:0/2483414866 shutdown_connections 2024-03-23T06:10:36.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.969+0000 7f434c800640 1 -- 172.21.15.73:0/2483414866 wait complete. 2024-03-23T06:10:36.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.970+0000 7f434c800640 1 Processor -- start 2024-03-23T06:10:36.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.970+0000 7f434c800640 1 -- start start 2024-03-23T06:10:36.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.971+0000 7f434c800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43440c5a10 0x7f43440c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.971+0000 7f434c800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43441513f0 0x7f43441f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.971+0000 7f434c800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43441483a0 0x7f43441f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.971+0000 7f434c800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440c7a20 con 0x7f43440c5a10 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.971+0000 7f434c800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434414b3b0 con 0x7f43441513f0 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.971+0000 7f434c800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43441557d0 con 0x7f43441483a0 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43441513f0 0x7f43441f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43441513f0 0x7f43441f21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52804/0 (socket says 172.21.15.73:52804) 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349400640 1 -- 172.21.15.73:0/1361043867 learned_addr learned my addr 172.21.15.73:0/1361043867 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f434a800640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43441483a0 0x7f43441f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349e00640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43440c5a10 0x7f43440c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349400640 1 -- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43441483a0 msgr2=0x7f43441f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349400640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43441483a0 0x7f43441f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349400640 1 -- 172.21.15.73:0/1361043867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43440c5a10 msgr2=0x7f43440c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349400640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43440c5a10 0x7f43440c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.972+0000 7f4349400640 1 -- 172.21.15.73:0/1361043867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334009400 con 0x7f43441513f0 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.973+0000 7f4349400640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43441513f0 0x7f43441f21f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4334009720 tx=0x7f43340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.973+0000 7f433e000640 1 -- 172.21.15.73:0/1361043867 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334033bd0 con 0x7f43441513f0 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.973+0000 7f433e000640 1 -- 172.21.15.73:0/1361043867 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334033d30 con 0x7f43441513f0 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.973+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4344071370 con 0x7f43441513f0 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.973+0000 7f433e000640 1 -- 172.21.15.73:0/1361043867 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334033ea0 con 0x7f43441513f0 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.974+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4344155a20 con 0x7f43441513f0 2024-03-23T06:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.975+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434404e110 con 0x7f43441513f0 2024-03-23T06:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.976+0000 7f433e000640 1 -- 172.21.15.73:0/1361043867 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f433403a070 con 0x7f43441513f0 2024-03-23T06:10:36.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.976+0000 7f433e000640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f432806ac30 0x7f432806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:36.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.977+0000 7f433e000640 1 -- 172.21.15.73:0/1361043867 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f43340ab490 con 0x7f43441513f0 2024-03-23T06:10:36.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.977+0000 7f4349e00640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f432806ac30 0x7f432806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:36.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.977+0000 7f4349e00640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f432806ac30 0x7f432806d0f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4338007f70 tx=0x7f4338007f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:36.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:36.981+0000 7f433e000640 1 -- 172.21.15.73:0/1361043867 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4334076390 con 0x7f43441513f0 2024-03-23T06:10:37.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.156+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4344155dc0 con 0x7f432806ac30 2024-03-23T06:10:37.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.167+0000 7f433e000640 1 -- 172.21.15.73:0/1361043867 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345226 (secure 0 0 0) 0x7f4338004c70 con 0x7f432806ac30 2024-03-23T06:10:37.171 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:37.173 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:10:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.172+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f432806ac30 msgr2=0x7f432806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.172+0000 7f434c800640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f432806ac30 0x7f432806d0f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4338007f70 tx=0x7f4338007f00 comp rx=0 tx=0).stop 2024-03-23T06:10:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.172+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43441513f0 msgr2=0x7f43441f21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.172+0000 7f434c800640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43441513f0 0x7f43441f21f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4334009720 tx=0x7f43340046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.173+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 shutdown_connections 2024-03-23T06:10:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.173+0000 7f434c800640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f432806ac30 0x7f432806d0f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.173+0000 7f434c800640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43441483a0 0x7f43441f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.173+0000 7f434c800640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43441513f0 0x7f43441f21f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.173+0000 7f434c800640 1 --2- 172.21.15.73:0/1361043867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f43440c5a10 0x7f43440c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.173+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 >> 172.21.15.73:0/1361043867 conn(0x7f434406bb40 msgr2=0x7f43441565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.173+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 shutdown_connections 2024-03-23T06:10:37.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.173+0000 7f434c800640 1 -- 172.21.15.73:0/1361043867 wait complete. 2024-03-23T06:10:37.190 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-23T06:10:36.619491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596319,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":247,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":3316,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":3395584,"data_stored":2019260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003860"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.938317+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:10:02.938317+0000","last_peered":"2024-03-23T06:10:02.938317+0000","last_clean":"2024-03-23T06:10:02.938317+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:10:02.938317+0000","last_undegraded":"2024-03-23T06:10:02.938317+0000","last_fullsized":"2024-03-23T06:10:02.938317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948197+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:10:01.948197+0000","last_peered":"2024-03-23T06:10:01.948197+0000","last_clean":"2024-03-23T06:10:01.948197+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:10:01.948197+0000","last_undegraded":"2024-03-23T06:10:01.948197+0000","last_fullsized":"2024-03-23T06:10:01.948197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929155+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:10:02.929155+0000","last_peered":"2024-03-23T06:10:02.929155+0000","last_clean":"2024-03-23T06:10:02.929155+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:10:02.929155+0000","last_undegraded":"2024-03-23T06:10:02.929155+0000","last_fullsized":"2024-03-23T06:10:02.929155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932040+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:10:02.932040+0000","last_peered":"2024-03-23T06:10:02.932040+0000","last_clean":"2024-03-23T06:10:02.932040+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:10:02.932040+0000","last_undegraded":"2024-03-23T06:10:02.932040+0000","last_fullsized":"2024-03-23T06:10:02.932040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948557+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:10:01.948557+0000","last_peered":"2024-03-23T06:10:01.948557+0000","last_clean":"2024-03-23T06:10:01.948557+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:10:01.948557+0000","last_undegraded":"2024-03-23T06:10:01.948557+0000","last_fullsized":"2024-03-23T06:10:01.948557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.979095+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:10:01.979095+0000","last_peered":"2024-03-23T06:10:01.979095+0000","last_clean":"2024-03-23T06:10:01.979095+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:10:01.979095+0000","last_undegraded":"2024-03-23T06:10:01.979095+0000","last_fullsized":"2024-03-23T06:10:01.979095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932874+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:10:02.932874+0000","last_peered":"2024-03-23T06:10:02.932874+0000","last_clean":"2024-03-23T06:10:02.932874+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:10:02.932874+0000","last_undegraded":"2024-03-23T06:10:02.932874+0000","last_fullsized":"2024-03-23T06:10:02.932874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960659+0000","last_change":"2024-03-23T06:09:57.945661+0000","last_active":"2024-03-23T06:10:01.960659+0000","last_peered":"2024-03-23T06:10:01.960659+0000","last_clean":"2024-03-23T06:10:01.960659+0000","last_became_active":"2024-03-23T06:09:57.945374+0000","last_became_peered":"2024-03-23T06:09:57.945374+0000","last_unstale":"2024-03-23T06:10:01.960659+0000","last_undegraded":"2024-03-23T06:10:01.960659+0000","last_fullsized":"2024-03-23T06:10:01.960659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:20:55.180098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.981444+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:10:01.981444+0000","last_peered":"2024-03-23T06:10:01.981444+0000","last_clean":"2024-03-23T06:10:01.981444+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:10:01.981444+0000","last_undegraded":"2024-03-23T06:10:01.981444+0000","last_fullsized":"2024-03-23T06:10:01.981444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.936447+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:10:02.936447+0000","last_peered":"2024-03-23T06:10:02.936447+0000","last_clean":"2024-03-23T06:10:02.936447+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:10:02.936447+0000","last_undegraded":"2024-03-23T06:10:02.936447+0000","last_fullsized":"2024-03-23T06:10:02.936447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956142+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:10:01.956142+0000","last_peered":"2024-03-23T06:10:01.956142+0000","last_clean":"2024-03-23T06:10:01.956142+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:10:01.956142+0000","last_undegraded":"2024-03-23T06:10:01.956142+0000","last_fullsized":"2024-03-23T06:10:01.956142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.986981+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:10:01.986981+0000","last_peered":"2024-03-23T06:10:01.986981+0000","last_clean":"2024-03-23T06:10:01.986981+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:10:01.986981+0000","last_undegraded":"2024-03-23T06:10:01.986981+0000","last_fullsized":"2024-03-23T06:10:01.986981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947842+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:10:01.947842+0000","last_peered":"2024-03-23T06:10:01.947842+0000","last_clean":"2024-03-23T06:10:01.947842+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:10:01.947842+0000","last_undegraded":"2024-03-23T06:10:01.947842+0000","last_fullsized":"2024-03-23T06:10:01.947842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.458019+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:10:33.458019+0000","last_peered":"2024-03-23T06:10:33.458019+0000","last_clean":"2024-03-23T06:10:33.458019+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:10:33.458019+0000","last_undegraded":"2024-03-23T06:10:33.458019+0000","last_fullsized":"2024-03-23T06:10:33.458019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.977132+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:10:01.977132+0000","last_peered":"2024-03-23T06:10:01.977132+0000","last_clean":"2024-03-23T06:10:01.977132+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:10:01.977132+0000","last_undegraded":"2024-03-23T06:10:01.977132+0000","last_fullsized":"2024-03-23T06:10:01.977132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944424+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:10:01.944424+0000","last_peered":"2024-03-23T06:10:01.944424+0000","last_clean":"2024-03-23T06:10:01.944424+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:10:01.944424+0000","last_undegraded":"2024-03-23T06:10:01.944424+0000","last_fullsized":"2024-03-23T06:10:01.944424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938236+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:10:01.938236+0000","last_peered":"2024-03-23T06:10:01.938236+0000","last_clean":"2024-03-23T06:10:01.938236+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:10:01.938236+0000","last_undegraded":"2024-03-23T06:10:01.938236+0000","last_fullsized":"2024-03-23T06:10:01.938236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.974726+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:10:01.974726+0000","last_peered":"2024-03-23T06:10:01.974726+0000","last_clean":"2024-03-23T06:10:01.974726+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:10:01.974726+0000","last_undegraded":"2024-03-23T06:10:01.974726+0000","last_fullsized":"2024-03-23T06:10:01.974726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938551+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:10:01.938551+0000","last_peered":"2024-03-23T06:10:01.938551+0000","last_clean":"2024-03-23T06:10:01.938551+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:10:01.938551+0000","last_undegraded":"2024-03-23T06:10:01.938551+0000","last_fullsized":"2024-03-23T06:10:01.938551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.456738+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:10:33.456738+0000","last_peered":"2024-03-23T06:10:33.456738+0000","last_clean":"2024-03-23T06:10:33.456738+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:10:33.456738+0000","last_undegraded":"2024-03-23T06:10:33.456738+0000","last_fullsized":"2024-03-23T06:10:33.456738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930440+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:10:02.930440+0000","last_peered":"2024-03-23T06:10:02.930440+0000","last_clean":"2024-03-23T06:10:02.930440+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:10:02.930440+0000","last_undegraded":"2024-03-23T06:10:02.930440+0000","last_fullsized":"2024-03-23T06:10:02.930440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946405+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:10:01.946405+0000","last_peered":"2024-03-23T06:10:01.946405+0000","last_clean":"2024-03-23T06:10:01.946405+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:10:01.946405+0000","last_undegraded":"2024-03-23T06:10:01.946405+0000","last_fullsized":"2024-03-23T06:10:01.946405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.460728+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:10:33.460728+0000","last_peered":"2024-03-23T06:10:33.460728+0000","last_clean":"2024-03-23T06:10:33.460728+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:10:33.460728+0000","last_undegraded":"2024-03-23T06:10:33.460728+0000","last_fullsized":"2024-03-23T06:10:33.460728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982640+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:10:01.982640+0000","last_peered":"2024-03-23T06:10:01.982640+0000","last_clean":"2024-03-23T06:10:01.982640+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:10:01.982640+0000","last_undegraded":"2024-03-23T06:10:01.982640+0000","last_fullsized":"2024-03-23T06:10:01.982640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938356+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:10:01.938356+0000","last_peered":"2024-03-23T06:10:01.938356+0000","last_clean":"2024-03-23T06:10:01.938356+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:10:01.938356+0000","last_undegraded":"2024-03-23T06:10:01.938356+0000","last_fullsized":"2024-03-23T06:10:01.938356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.458019+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:10:33.458019+0000","last_peered":"2024-03-23T06:10:33.458019+0000","last_clean":"2024-03-23T06:10:33.458019+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:10:33.458019+0000","last_undegraded":"2024-03-23T06:10:33.458019+0000","last_fullsized":"2024-03-23T06:10:33.458019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982776+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:10:01.982776+0000","last_peered":"2024-03-23T06:10:01.982776+0000","last_clean":"2024-03-23T06:10:01.982776+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:10:01.982776+0000","last_undegraded":"2024-03-23T06:10:01.982776+0000","last_fullsized":"2024-03-23T06:10:01.982776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936925+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:10:01.936925+0000","last_peered":"2024-03-23T06:10:01.936925+0000","last_clean":"2024-03-23T06:10:01.936925+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:10:01.936925+0000","last_undegraded":"2024-03-23T06:10:01.936925+0000","last_fullsized":"2024-03-23T06:10:01.936925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427809+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:10:02.427809+0000","last_peered":"2024-03-23T06:10:02.427809+0000","last_clean":"2024-03-23T06:10:02.427809+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:10:02.427809+0000","last_undegraded":"2024-03-23T06:10:02.427809+0000","last_fullsized":"2024-03-23T06:10:02.427809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427188+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:10:02.427188+0000","last_peered":"2024-03-23T06:10:02.427188+0000","last_clean":"2024-03-23T06:10:02.427188+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:10:02.427188+0000","last_undegraded":"2024-03-23T06:10:02.427188+0000","last_fullsized":"2024-03-23T06:10:02.427188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938375+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:10:01.938375+0000","last_peered":"2024-03-23T06:10:01.938375+0000","last_clean":"2024-03-23T06:10:01.938375+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:10:01.938375+0000","last_undegraded":"2024-03-23T06:10:01.938375+0000","last_fullsized":"2024-03-23T06:10:01.938375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.429012+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:10:02.429012+0000","last_peered":"2024-03-23T06:10:02.429012+0000","last_clean":"2024-03-23T06:10:02.429012+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:10:02.429012+0000","last_undegraded":"2024-03-23T06:10:02.429012+0000","last_fullsized":"2024-03-23T06:10:02.429012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426879+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:10:02.426879+0000","last_peered":"2024-03-23T06:10:02.426879+0000","last_clean":"2024-03-23T06:10:02.426879+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:10:02.426879+0000","last_undegraded":"2024-03-23T06:10:02.426879+0000","last_fullsized":"2024-03-23T06:10:02.426879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.962945+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:10:01.962945+0000","last_peered":"2024-03-23T06:10:01.962945+0000","last_clean":"2024-03-23T06:10:01.962945+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:10:01.962945+0000","last_undegraded":"2024-03-23T06:10:01.962945+0000","last_fullsized":"2024-03-23T06:10:01.962945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947204+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:10:01.947204+0000","last_peered":"2024-03-23T06:10:01.947204+0000","last_clean":"2024-03-23T06:10:01.947204+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:10:01.947204+0000","last_undegraded":"2024-03-23T06:10:01.947204+0000","last_fullsized":"2024-03-23T06:10:01.947204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426681+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:10:02.426681+0000","last_peered":"2024-03-23T06:10:02.426681+0000","last_clean":"2024-03-23T06:10:02.426681+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:10:02.426681+0000","last_undegraded":"2024-03-23T06:10:02.426681+0000","last_fullsized":"2024-03-23T06:10:02.426681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956957+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:10:01.956957+0000","last_peered":"2024-03-23T06:10:01.956957+0000","last_clean":"2024-03-23T06:10:01.956957+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:10:01.956957+0000","last_undegraded":"2024-03-23T06:10:01.956957+0000","last_fullsized":"2024-03-23T06:10:01.956957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951233+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:10:01.951233+0000","last_peered":"2024-03-23T06:10:01.951233+0000","last_clean":"2024-03-23T06:10:01.951233+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:10:01.951233+0000","last_undegraded":"2024-03-23T06:10:01.951233+0000","last_fullsized":"2024-03-23T06:10:01.951233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427177+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:10:02.427177+0000","last_peered":"2024-03-23T06:10:02.427177+0000","last_clean":"2024-03-23T06:10:02.427177+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:10:02.427177+0000","last_undegraded":"2024-03-23T06:10:02.427177+0000","last_fullsized":"2024-03-23T06:10:02.427177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947571+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:10:01.947571+0000","last_peered":"2024-03-23T06:10:01.947571+0000","last_clean":"2024-03-23T06:10:01.947571+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:10:01.947571+0000","last_undegraded":"2024-03-23T06:10:01.947571+0000","last_fullsized":"2024-03-23T06:10:01.947571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929323+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:10:02.929323+0000","last_peered":"2024-03-23T06:10:02.929323+0000","last_clean":"2024-03-23T06:10:02.929323+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:10:02.929323+0000","last_undegraded":"2024-03-23T06:10:02.929323+0000","last_fullsized":"2024-03-23T06:10:02.929323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427599+0000","last_change":"2024-03-23T06:10:01.967435+0000","last_active":"2024-03-23T06:10:02.427599+0000","last_peered":"2024-03-23T06:10:02.427599+0000","last_clean":"2024-03-23T06:10:02.427599+0000","last_became_active":"2024-03-23T06:10:01.967059+0000","last_became_peered":"2024-03-23T06:10:01.967059+0000","last_unstale":"2024-03-23T06:10:02.427599+0000","last_undegraded":"2024-03-23T06:10:02.427599+0000","last_fullsized":"2024-03-23T06:10:02.427599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:51:56.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936633+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:10:01.936633+0000","last_peered":"2024-03-23T06:10:01.936633+0000","last_clean":"2024-03-23T06:10:01.936633+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:01.936633+0000","last_undegraded":"2024-03-23T06:10:01.936633+0000","last_fullsized":"2024-03-23T06:10:01.936633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427939+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:10:02.427939+0000","last_peered":"2024-03-23T06:10:02.427939+0000","last_clean":"2024-03-23T06:10:02.427939+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:10:02.427939+0000","last_undegraded":"2024-03-23T06:10:02.427939+0000","last_fullsized":"2024-03-23T06:10:02.427939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931695+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:10:02.931695+0000","last_peered":"2024-03-23T06:10:02.931695+0000","last_clean":"2024-03-23T06:10:02.931695+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:10:02.931695+0000","last_undegraded":"2024-03-23T06:10:02.931695+0000","last_fullsized":"2024-03-23T06:10:02.931695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938499+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:10:01.938499+0000","last_peered":"2024-03-23T06:10:01.938499+0000","last_clean":"2024-03-23T06:10:01.938499+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:10:01.938499+0000","last_undegraded":"2024-03-23T06:10:01.938499+0000","last_fullsized":"2024-03-23T06:10:01.938499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.463587+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:10:33.463587+0000","last_peered":"2024-03-23T06:10:33.463587+0000","last_clean":"2024-03-23T06:10:33.463587+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:10:33.463587+0000","last_undegraded":"2024-03-23T06:10:33.463587+0000","last_fullsized":"2024-03-23T06:10:33.463587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955598+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:10:01.955598+0000","last_peered":"2024-03-23T06:10:01.955598+0000","last_clean":"2024-03-23T06:10:01.955598+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:10:01.955598+0000","last_undegraded":"2024-03-23T06:10:01.955598+0000","last_fullsized":"2024-03-23T06:10:01.955598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982185+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:10:01.982185+0000","last_peered":"2024-03-23T06:10:01.982185+0000","last_clean":"2024-03-23T06:10:01.982185+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:10:01.982185+0000","last_undegraded":"2024-03-23T06:10:01.982185+0000","last_fullsized":"2024-03-23T06:10:01.982185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955865+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:10:01.955865+0000","last_peered":"2024-03-23T06:10:01.955865+0000","last_clean":"2024-03-23T06:10:01.955865+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:10:01.955865+0000","last_undegraded":"2024-03-23T06:10:01.955865+0000","last_fullsized":"2024-03-23T06:10:01.955865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938453+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:10:01.938453+0000","last_peered":"2024-03-23T06:10:01.938453+0000","last_clean":"2024-03-23T06:10:01.938453+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:10:01.938453+0000","last_undegraded":"2024-03-23T06:10:01.938453+0000","last_fullsized":"2024-03-23T06:10:01.938453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.980947+0000","last_change":"2024-03-23T06:10:01.975352+0000","last_active":"2024-03-23T06:10:01.980947+0000","last_peered":"2024-03-23T06:10:01.980947+0000","last_clean":"2024-03-23T06:10:01.980947+0000","last_became_active":"2024-03-23T06:10:01.974177+0000","last_became_peered":"2024-03-23T06:10:01.974177+0000","last_unstale":"2024-03-23T06:10:01.980947+0000","last_undegraded":"2024-03-23T06:10:01.980947+0000","last_fullsized":"2024-03-23T06:10:01.980947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:33.405804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958813+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:10:01.958813+0000","last_peered":"2024-03-23T06:10:01.958813+0000","last_clean":"2024-03-23T06:10:01.958813+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:10:01.958813+0000","last_undegraded":"2024-03-23T06:10:01.958813+0000","last_fullsized":"2024-03-23T06:10:01.958813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931676+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:10:02.931676+0000","last_peered":"2024-03-23T06:10:02.931676+0000","last_clean":"2024-03-23T06:10:02.931676+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:10:02.931676+0000","last_undegraded":"2024-03-23T06:10:02.931676+0000","last_fullsized":"2024-03-23T06:10:02.931676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930842+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:10:02.930842+0000","last_peered":"2024-03-23T06:10:02.930842+0000","last_clean":"2024-03-23T06:10:02.930842+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:10:02.930842+0000","last_undegraded":"2024-03-23T06:10:02.930842+0000","last_fullsized":"2024-03-23T06:10:02.930842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955953+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:10:01.955953+0000","last_peered":"2024-03-23T06:10:01.955953+0000","last_clean":"2024-03-23T06:10:01.955953+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:10:01.955953+0000","last_undegraded":"2024-03-23T06:10:01.955953+0000","last_fullsized":"2024-03-23T06:10:01.955953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930322+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:10:02.930322+0000","last_peered":"2024-03-23T06:10:02.930322+0000","last_clean":"2024-03-23T06:10:02.930322+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:10:02.930322+0000","last_undegraded":"2024-03-23T06:10:02.930322+0000","last_fullsized":"2024-03-23T06:10:02.930322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.978341+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:10:01.978341+0000","last_peered":"2024-03-23T06:10:01.978341+0000","last_clean":"2024-03-23T06:10:01.978341+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:10:01.978341+0000","last_undegraded":"2024-03-23T06:10:01.978341+0000","last_fullsized":"2024-03-23T06:10:01.978341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961138+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:10:01.961138+0000","last_peered":"2024-03-23T06:10:01.961138+0000","last_clean":"2024-03-23T06:10:01.961138+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:10:01.961138+0000","last_undegraded":"2024-03-23T06:10:01.961138+0000","last_fullsized":"2024-03-23T06:10:01.961138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932726+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:10:02.932726+0000","last_peered":"2024-03-23T06:10:02.932726+0000","last_clean":"2024-03-23T06:10:02.932726+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:10:02.932726+0000","last_undegraded":"2024-03-23T06:10:02.932726+0000","last_fullsized":"2024-03-23T06:10:02.932726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.987273+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:10:01.987273+0000","last_peered":"2024-03-23T06:10:01.987273+0000","last_clean":"2024-03-23T06:10:01.987273+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:10:01.987273+0000","last_undegraded":"2024-03-23T06:10:01.987273+0000","last_fullsized":"2024-03-23T06:10:01.987273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946483+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:10:01.946483+0000","last_peered":"2024-03-23T06:10:01.946483+0000","last_clean":"2024-03-23T06:10:01.946483+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:10:01.946483+0000","last_undegraded":"2024-03-23T06:10:01.946483+0000","last_fullsized":"2024-03-23T06:10:01.946483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.453012+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:10:33.453012+0000","last_peered":"2024-03-23T06:10:33.453012+0000","last_clean":"2024-03-23T06:10:33.453012+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:10:33.453012+0000","last_undegraded":"2024-03-23T06:10:33.453012+0000","last_fullsized":"2024-03-23T06:10:33.453012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931833+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:10:02.931833+0000","last_peered":"2024-03-23T06:10:02.931833+0000","last_clean":"2024-03-23T06:10:02.931833+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:10:02.931833+0000","last_undegraded":"2024-03-23T06:10:02.931833+0000","last_fullsized":"2024-03-23T06:10:02.931833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955456+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:10:01.955456+0000","last_peered":"2024-03-23T06:10:01.955456+0000","last_clean":"2024-03-23T06:10:01.955456+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:10:01.955456+0000","last_undegraded":"2024-03-23T06:10:01.955456+0000","last_fullsized":"2024-03-23T06:10:01.955456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958080+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:10:01.958080+0000","last_peered":"2024-03-23T06:10:01.958080+0000","last_clean":"2024-03-23T06:10:01.958080+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:10:01.958080+0000","last_undegraded":"2024-03-23T06:10:01.958080+0000","last_fullsized":"2024-03-23T06:10:01.958080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931864+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:10:02.931864+0000","last_peered":"2024-03-23T06:10:02.931864+0000","last_clean":"2024-03-23T06:10:02.931864+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:10:02.931864+0000","last_undegraded":"2024-03-23T06:10:02.931864+0000","last_fullsized":"2024-03-23T06:10:02.931864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954582+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:10:01.954582+0000","last_peered":"2024-03-23T06:10:01.954582+0000","last_clean":"2024-03-23T06:10:01.954582+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:10:01.954582+0000","last_undegraded":"2024-03-23T06:10:01.954582+0000","last_fullsized":"2024-03-23T06:10:01.954582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.461196+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:10:33.461196+0000","last_peered":"2024-03-23T06:10:33.461196+0000","last_clean":"2024-03-23T06:10:33.461196+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:10:33.461196+0000","last_undegraded":"2024-03-23T06:10:33.461196+0000","last_fullsized":"2024-03-23T06:10:33.461196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427019+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:10:02.427019+0000","last_peered":"2024-03-23T06:10:02.427019+0000","last_clean":"2024-03-23T06:10:02.427019+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:10:02.427019+0000","last_undegraded":"2024-03-23T06:10:02.427019+0000","last_fullsized":"2024-03-23T06:10:02.427019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.937969+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:10:01.937969+0000","last_peered":"2024-03-23T06:10:01.937969+0000","last_clean":"2024-03-23T06:10:01.937969+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:10:01.937969+0000","last_undegraded":"2024-03-23T06:10:01.937969+0000","last_fullsized":"2024-03-23T06:10:01.937969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.456440+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:10:33.456440+0000","last_peered":"2024-03-23T06:10:33.456440+0000","last_clean":"2024-03-23T06:10:33.456440+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:10:33.456440+0000","last_undegraded":"2024-03-23T06:10:33.456440+0000","last_fullsized":"2024-03-23T06:10:33.456440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.977106+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:10:01.977106+0000","last_peered":"2024-03-23T06:10:01.977106+0000","last_clean":"2024-03-23T06:10:01.977106+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:10:01.977106+0000","last_undegraded":"2024-03-23T06:10:01.977106+0000","last_fullsized":"2024-03-23T06:10:01.977106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960157+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:10:01.960157+0000","last_peered":"2024-03-23T06:10:01.960157+0000","last_clean":"2024-03-23T06:10:01.960157+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:10:01.960157+0000","last_undegraded":"2024-03-23T06:10:01.960157+0000","last_fullsized":"2024-03-23T06:10:01.960157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'12","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.457957+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:10:33.457957+0000","last_peered":"2024-03-23T06:10:33.457957+0000","last_clean":"2024-03-23T06:10:33.457957+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:10:33.457957+0000","last_undegraded":"2024-03-23T06:10:33.457957+0000","last_fullsized":"2024-03-23T06:10:33.457957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426645+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:10:02.426645+0000","last_peered":"2024-03-23T06:10:02.426645+0000","last_clean":"2024-03-23T06:10:02.426645+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:10:02.426645+0000","last_undegraded":"2024-03-23T06:10:02.426645+0000","last_fullsized":"2024-03-23T06:10:02.426645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951611+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:10:01.951611+0000","last_peered":"2024-03-23T06:10:01.951611+0000","last_clean":"2024-03-23T06:10:01.951611+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:10:01.951611+0000","last_undegraded":"2024-03-23T06:10:01.951611+0000","last_fullsized":"2024-03-23T06:10:01.951611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.933858+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:10:02.933858+0000","last_peered":"2024-03-23T06:10:02.933858+0000","last_clean":"2024-03-23T06:10:02.933858+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:10:02.933858+0000","last_undegraded":"2024-03-23T06:10:02.933858+0000","last_fullsized":"2024-03-23T06:10:02.933858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.981424+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:10:01.981424+0000","last_peered":"2024-03-23T06:10:01.981424+0000","last_clean":"2024-03-23T06:10:01.981424+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:10:01.981424+0000","last_undegraded":"2024-03-23T06:10:01.981424+0000","last_fullsized":"2024-03-23T06:10:01.981424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948637+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:10:01.948637+0000","last_peered":"2024-03-23T06:10:01.948637+0000","last_clean":"2024-03-23T06:10:01.948637+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:10:01.948637+0000","last_undegraded":"2024-03-23T06:10:01.948637+0000","last_fullsized":"2024-03-23T06:10:01.948637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.460726+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:10:33.460726+0000","last_peered":"2024-03-23T06:10:33.460726+0000","last_clean":"2024-03-23T06:10:33.460726+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:10:33.460726+0000","last_undegraded":"2024-03-23T06:10:33.460726+0000","last_fullsized":"2024-03-23T06:10:33.460726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929041+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:10:02.929041+0000","last_peered":"2024-03-23T06:10:02.929041+0000","last_clean":"2024-03-23T06:10:02.929041+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:10:02.929041+0000","last_undegraded":"2024-03-23T06:10:02.929041+0000","last_fullsized":"2024-03-23T06:10:02.929041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961066+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:10:01.961066+0000","last_peered":"2024-03-23T06:10:01.961066+0000","last_clean":"2024-03-23T06:10:01.961066+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:10:01.961066+0000","last_undegraded":"2024-03-23T06:10:01.961066+0000","last_fullsized":"2024-03-23T06:10:01.961066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.460568+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:10:33.460568+0000","last_peered":"2024-03-23T06:10:33.460568+0000","last_clean":"2024-03-23T06:10:33.460568+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:10:33.460568+0000","last_undegraded":"2024-03-23T06:10:33.460568+0000","last_fullsized":"2024-03-23T06:10:33.460568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427056+0000","last_change":"2024-03-23T06:10:01.963116+0000","last_active":"2024-03-23T06:10:02.427056+0000","last_peered":"2024-03-23T06:10:02.427056+0000","last_clean":"2024-03-23T06:10:02.427056+0000","last_became_active":"2024-03-23T06:10:01.962746+0000","last_became_peered":"2024-03-23T06:10:01.962746+0000","last_unstale":"2024-03-23T06:10:02.427056+0000","last_undegraded":"2024-03-23T06:10:02.427056+0000","last_fullsized":"2024-03-23T06:10:02.427056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:51:03.948467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427647+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:10:02.427647+0000","last_peered":"2024-03-23T06:10:02.427647+0000","last_clean":"2024-03-23T06:10:02.427647+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:10:02.427647+0000","last_undegraded":"2024-03-23T06:10:02.427647+0000","last_fullsized":"2024-03-23T06:10:02.427647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938885+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:10:01.938885+0000","last_peered":"2024-03-23T06:10:01.938885+0000","last_clean":"2024-03-23T06:10:01.938885+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:10:01.938885+0000","last_undegraded":"2024-03-23T06:10:01.938885+0000","last_fullsized":"2024-03-23T06:10:01.938885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427860+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:10:02.427860+0000","last_peered":"2024-03-23T06:10:02.427860+0000","last_clean":"2024-03-23T06:10:02.427860+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:10:02.427860+0000","last_undegraded":"2024-03-23T06:10:02.427860+0000","last_fullsized":"2024-03-23T06:10:02.427860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982125+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:10:01.982125+0000","last_peered":"2024-03-23T06:10:01.982125+0000","last_clean":"2024-03-23T06:10:01.982125+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:10:01.982125+0000","last_undegraded":"2024-03-23T06:10:01.982125+0000","last_fullsized":"2024-03-23T06:10:01.982125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947907+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:10:01.947907+0000","last_peered":"2024-03-23T06:10:01.947907+0000","last_clean":"2024-03-23T06:10:01.947907+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:10:01.947907+0000","last_undegraded":"2024-03-23T06:10:01.947907+0000","last_fullsized":"2024-03-23T06:10:01.947907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936901+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:10:01.936901+0000","last_peered":"2024-03-23T06:10:01.936901+0000","last_clean":"2024-03-23T06:10:01.936901+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:10:01.936901+0000","last_undegraded":"2024-03-23T06:10:01.936901+0000","last_fullsized":"2024-03-23T06:10:01.936901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.428499+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:10:02.428499+0000","last_peered":"2024-03-23T06:10:02.428499+0000","last_clean":"2024-03-23T06:10:02.428499+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:10:02.428499+0000","last_undegraded":"2024-03-23T06:10:02.428499+0000","last_fullsized":"2024-03-23T06:10:02.428499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936867+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:10:01.936867+0000","last_peered":"2024-03-23T06:10:01.936867+0000","last_clean":"2024-03-23T06:10:01.936867+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:10:01.936867+0000","last_undegraded":"2024-03-23T06:10:01.936867+0000","last_fullsized":"2024-03-23T06:10:01.936867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427526+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:10:02.427526+0000","last_peered":"2024-03-23T06:10:02.427526+0000","last_clean":"2024-03-23T06:10:02.427526+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:10:02.427526+0000","last_undegraded":"2024-03-23T06:10:02.427526+0000","last_fullsized":"2024-03-23T06:10:02.427526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.457074+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:10:33.457074+0000","last_peered":"2024-03-23T06:10:33.457074+0000","last_clean":"2024-03-23T06:10:33.457074+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:10:33.457074+0000","last_undegraded":"2024-03-23T06:10:33.457074+0000","last_fullsized":"2024-03-23T06:10:33.457074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959100+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:10:01.959100+0000","last_peered":"2024-03-23T06:10:01.959100+0000","last_clean":"2024-03-23T06:10:01.959100+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:10:01.959100+0000","last_undegraded":"2024-03-23T06:10:01.959100+0000","last_fullsized":"2024-03-23T06:10:01.959100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929722+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:10:02.929722+0000","last_peered":"2024-03-23T06:10:02.929722+0000","last_clean":"2024-03-23T06:10:02.929722+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:10:02.929722+0000","last_undegraded":"2024-03-23T06:10:02.929722+0000","last_fullsized":"2024-03-23T06:10:02.929722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960026+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:10:01.960026+0000","last_peered":"2024-03-23T06:10:01.960026+0000","last_clean":"2024-03-23T06:10:01.960026+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:10:01.960026+0000","last_undegraded":"2024-03-23T06:10:01.960026+0000","last_fullsized":"2024-03-23T06:10:01.960026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944307+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:10:01.944307+0000","last_peered":"2024-03-23T06:10:01.944307+0000","last_clean":"2024-03-23T06:10:01.944307+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:10:01.944307+0000","last_undegraded":"2024-03-23T06:10:01.944307+0000","last_fullsized":"2024-03-23T06:10:01.944307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951291+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:10:01.951291+0000","last_peered":"2024-03-23T06:10:01.951291+0000","last_clean":"2024-03-23T06:10:01.951291+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:10:01.951291+0000","last_undegraded":"2024-03-23T06:10:01.951291+0000","last_fullsized":"2024-03-23T06:10:01.951291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947547+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:10:01.947547+0000","last_peered":"2024-03-23T06:10:01.947547+0000","last_clean":"2024-03-23T06:10:01.947547+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:10:01.947547+0000","last_undegraded":"2024-03-23T06:10:01.947547+0000","last_fullsized":"2024-03-23T06:10:01.947547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938289+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:10:01.938289+0000","last_peered":"2024-03-23T06:10:01.938289+0000","last_clean":"2024-03-23T06:10:01.938289+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:10:01.938289+0000","last_undegraded":"2024-03-23T06:10:01.938289+0000","last_fullsized":"2024-03-23T06:10:01.938289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938341+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:10:01.938341+0000","last_peered":"2024-03-23T06:10:01.938341+0000","last_clean":"2024-03-23T06:10:01.938341+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:10:01.938341+0000","last_undegraded":"2024-03-23T06:10:01.938341+0000","last_fullsized":"2024-03-23T06:10:01.938341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960989+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:10:01.960989+0000","last_peered":"2024-03-23T06:10:01.960989+0000","last_clean":"2024-03-23T06:10:01.960989+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:10:01.960989+0000","last_undegraded":"2024-03-23T06:10:01.960989+0000","last_fullsized":"2024-03-23T06:10:01.960989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948453+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:01.948453+0000","last_peered":"2024-03-23T06:10:01.948453+0000","last_clean":"2024-03-23T06:10:01.948453+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:10:01.948453+0000","last_undegraded":"2024-03-23T06:10:01.948453+0000","last_fullsized":"2024-03-23T06:10:01.948453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951149+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:10:01.951149+0000","last_peered":"2024-03-23T06:10:01.951149+0000","last_clean":"2024-03-23T06:10:01.951149+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:10:01.951149+0000","last_undegraded":"2024-03-23T06:10:01.951149+0000","last_fullsized":"2024-03-23T06:10:01.951149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947028+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:10:01.947028+0000","last_peered":"2024-03-23T06:10:01.947028+0000","last_clean":"2024-03-23T06:10:01.947028+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:01.947028+0000","last_undegraded":"2024-03-23T06:10:01.947028+0000","last_fullsized":"2024-03-23T06:10:01.947028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959084+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:10:01.959084+0000","last_peered":"2024-03-23T06:10:01.959084+0000","last_clean":"2024-03-23T06:10:01.959084+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:10:01.959084+0000","last_undegraded":"2024-03-23T06:10:01.959084+0000","last_fullsized":"2024-03-23T06:10:01.959084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936782+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:10:01.936782+0000","last_peered":"2024-03-23T06:10:01.936782+0000","last_clean":"2024-03-23T06:10:01.936782+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:10:01.936782+0000","last_undegraded":"2024-03-23T06:10:01.936782+0000","last_fullsized":"2024-03-23T06:10:01.936782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958727+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:10:01.958727+0000","last_peered":"2024-03-23T06:10:01.958727+0000","last_clean":"2024-03-23T06:10:01.958727+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:10:01.958727+0000","last_undegraded":"2024-03-23T06:10:01.958727+0000","last_fullsized":"2024-03-23T06:10:01.958727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955979+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:10:01.955979+0000","last_peered":"2024-03-23T06:10:01.955979+0000","last_clean":"2024-03-23T06:10:01.955979+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:10:01.955979+0000","last_undegraded":"2024-03-23T06:10:01.955979+0000","last_fullsized":"2024-03-23T06:10:01.955979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.942778+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:10:01.942778+0000","last_peered":"2024-03-23T06:10:01.942778+0000","last_clean":"2024-03-23T06:10:01.942778+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:10:01.942778+0000","last_undegraded":"2024-03-23T06:10:01.942778+0000","last_fullsized":"2024-03-23T06:10:01.942778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954107+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:10:01.954107+0000","last_peered":"2024-03-23T06:10:01.954107+0000","last_clean":"2024-03-23T06:10:01.954107+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:10:01.954107+0000","last_undegraded":"2024-03-23T06:10:01.954107+0000","last_fullsized":"2024-03-23T06:10:01.954107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947698+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:01.947698+0000","last_peered":"2024-03-23T06:10:01.947698+0000","last_clean":"2024-03-23T06:10:01.947698+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:10:01.947698+0000","last_undegraded":"2024-03-23T06:10:01.947698+0000","last_fullsized":"2024-03-23T06:10:01.947698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946933+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:10:01.946933+0000","last_peered":"2024-03-23T06:10:01.946933+0000","last_clean":"2024-03-23T06:10:01.946933+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:10:01.946933+0000","last_undegraded":"2024-03-23T06:10:01.946933+0000","last_fullsized":"2024-03-23T06:10:01.946933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.937864+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:10:01.937864+0000","last_peered":"2024-03-23T06:10:01.937864+0000","last_clean":"2024-03-23T06:10:01.937864+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:10:01.937864+0000","last_undegraded":"2024-03-23T06:10:01.937864+0000","last_fullsized":"2024-03-23T06:10:01.937864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938183+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:10:01.938183+0000","last_peered":"2024-03-23T06:10:01.938183+0000","last_clean":"2024-03-23T06:10:01.938183+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:10:01.938183+0000","last_undegraded":"2024-03-23T06:10:01.938183+0000","last_fullsized":"2024-03-23T06:10:01.938183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959302+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:10:01.959302+0000","last_peered":"2024-03-23T06:10:01.959302+0000","last_clean":"2024-03-23T06:10:01.959302+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:10:01.959302+0000","last_undegraded":"2024-03-23T06:10:01.959302+0000","last_fullsized":"2024-03-23T06:10:01.959302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960084+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:10:01.960084+0000","last_peered":"2024-03-23T06:10:01.960084+0000","last_clean":"2024-03-23T06:10:01.960084+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:10:01.960084+0000","last_undegraded":"2024-03-23T06:10:01.960084+0000","last_fullsized":"2024-03-23T06:10:01.960084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955366+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:10:01.955366+0000","last_peered":"2024-03-23T06:10:01.955366+0000","last_clean":"2024-03-23T06:10:01.955366+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:10:01.955366+0000","last_undegraded":"2024-03-23T06:10:01.955366+0000","last_fullsized":"2024-03-23T06:10:01.955366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961295+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:10:01.961295+0000","last_peered":"2024-03-23T06:10:01.961295+0000","last_clean":"2024-03-23T06:10:01.961295+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:10:01.961295+0000","last_undegraded":"2024-03-23T06:10:01.961295+0000","last_fullsized":"2024-03-23T06:10:01.961295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947495+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:10:01.947495+0000","last_peered":"2024-03-23T06:10:01.947495+0000","last_clean":"2024-03-23T06:10:01.947495+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:10:01.947495+0000","last_undegraded":"2024-03-23T06:10:01.947495+0000","last_fullsized":"2024-03-23T06:10:01.947495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.957968+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:10:01.957968+0000","last_peered":"2024-03-23T06:10:01.957968+0000","last_clean":"2024-03-23T06:10:01.957968+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:10:01.957968+0000","last_undegraded":"2024-03-23T06:10:01.957968+0000","last_fullsized":"2024-03-23T06:10:01.957968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.970135+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:10:01.970135+0000","last_peered":"2024-03-23T06:10:01.970135+0000","last_clean":"2024-03-23T06:10:01.970135+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:10:01.970135+0000","last_undegraded":"2024-03-23T06:10:01.970135+0000","last_fullsized":"2024-03-23T06:10:01.970135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.957139+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:10:01.957139+0000","last_peered":"2024-03-23T06:10:01.957139+0000","last_clean":"2024-03-23T06:10:01.957139+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:10:01.957139+0000","last_undegraded":"2024-03-23T06:10:01.957139+0000","last_fullsized":"2024-03-23T06:10:01.957139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956477+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:10:01.956477+0000","last_peered":"2024-03-23T06:10:01.956477+0000","last_clean":"2024-03-23T06:10:01.956477+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:10:01.956477+0000","last_undegraded":"2024-03-23T06:10:01.956477+0000","last_fullsized":"2024-03-23T06:10:01.956477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947435+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:10:01.947435+0000","last_peered":"2024-03-23T06:10:01.947435+0000","last_clean":"2024-03-23T06:10:01.947435+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:10:01.947435+0000","last_undegraded":"2024-03-23T06:10:01.947435+0000","last_fullsized":"2024-03-23T06:10:01.947435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948381+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:10:01.948381+0000","last_peered":"2024-03-23T06:10:01.948381+0000","last_clean":"2024-03-23T06:10:01.948381+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:10:01.948381+0000","last_undegraded":"2024-03-23T06:10:01.948381+0000","last_fullsized":"2024-03-23T06:10:01.948381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955839+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:10:01.955839+0000","last_peered":"2024-03-23T06:10:01.955839+0000","last_clean":"2024-03-23T06:10:01.955839+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:10:01.955839+0000","last_undegraded":"2024-03-23T06:10:01.955839+0000","last_fullsized":"2024-03-23T06:10:01.955839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5951,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":11902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":103943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.861}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.544}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":693777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0270000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2130000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":103485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":274432,"data_stored":104045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":270336,"data_stored":103913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":872448,"data_stored":694373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":299008,"data_stored":108590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:10:37.195 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:10:37.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.438+0000 7f7f75600640 1 Processor -- start 2024-03-23T06:10:37.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.438+0000 7f7f75600640 1 -- start start 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.439+0000 7f7f75600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f70150100 0x7f7f700c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.439+0000 7f7f75600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f700c6fe0 0x7f7f70156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.439+0000 7f7f75600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f700c7e10 0x7f7f70071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.439+0000 7f7f75600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7006f9b0 con 0x7f7f700c7e10 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.439+0000 7f7f75600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f70070250 con 0x7f7f700c6fe0 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.439+0000 7f7f75600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700c0150 con 0x7f7f70150100 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f700c7e10 0x7f7f70071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f700c7e10 0x7f7f70071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34810/0 (socket says 172.21.15.73:34810) 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6f400640 1 -- 172.21.15.73:0/1205994619 learned_addr learned my addr 172.21.15.73:0/1205994619 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6ea00640 1 --2- 172.21.15.73:0/1205994619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f70150100 0x7f7f700c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f66000640 1 --2- 172.21.15.73:0/1205994619 >> v2:172.21.15.110:3300/0 conn(0x7f7f700c6fe0 0x7f7f70156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6f400640 1 -- 172.21.15.73:0/1205994619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f70150100 msgr2=0x7f7f700c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:37.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6f400640 1 --2- 172.21.15.73:0/1205994619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f70150100 0x7f7f700c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6f400640 1 -- 172.21.15.73:0/1205994619 >> v2:172.21.15.110:3300/0 conn(0x7f7f700c6fe0 msgr2=0x7f7f70156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:37.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6f400640 1 --2- 172.21.15.73:0/1205994619 >> v2:172.21.15.110:3300/0 conn(0x7f7f700c6fe0 0x7f7f70156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f6f400640 1 -- 172.21.15.73:0/1205994619 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700c03f0 con 0x7f7f700c7e10 2024-03-23T06:10:37.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.440+0000 7f7f66000640 1 --2- 172.21.15.73:0/1205994619 >> v2:172.21.15.110:3300/0 conn(0x7f7f700c6fe0 0x7f7f70156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.441+0000 7f7f6f400640 1 --2- 172.21.15.73:0/1205994619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f700c7e10 0x7f7f70071d20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7f7006e3b0 tx=0x7f7f6802e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df55c032f0271d51 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.441+0000 7f7f6e000640 1 -- 172.21.15.73:0/1205994619 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6802e9f0 con 0x7f7f700c7e10 2024-03-23T06:10:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.441+0000 7f7f6e000640 1 -- 172.21.15.73:0/1205994619 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6802eb50 con 0x7f7f700c7e10 2024-03-23T06:10:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.441+0000 7f7f6e000640 1 -- 172.21.15.73:0/1205994619 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68009600 con 0x7f7f700c7e10 2024-03-23T06:10:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 -- 172.21.15.73:0/1205994619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f700c7e10 msgr2=0x7f7f70071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 --2- 172.21.15.73:0/1205994619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f700c7e10 0x7f7f70071d20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7f7006e3b0 tx=0x7f7f6802e050 comp rx=0 tx=0).stop 2024-03-23T06:10:37.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 -- 172.21.15.73:0/1205994619 shutdown_connections 2024-03-23T06:10:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 --2- 172.21.15.73:0/1205994619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f700c7e10 0x7f7f70071d20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 --2- 172.21.15.73:0/1205994619 >> v2:172.21.15.110:3300/0 conn(0x7f7f700c6fe0 0x7f7f70156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 --2- 172.21.15.73:0/1205994619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f70150100 0x7f7f700c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 -- 172.21.15.73:0/1205994619 >> 172.21.15.73:0/1205994619 conn(0x7f7f7006bb40 msgr2=0x7f7f7006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 -- 172.21.15.73:0/1205994619 shutdown_connections 2024-03-23T06:10:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.442+0000 7f7f75600640 1 -- 172.21.15.73:0/1205994619 wait complete. 2024-03-23T06:10:37.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.444+0000 7f7f75600640 1 Processor -- start 2024-03-23T06:10:37.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.444+0000 7f7f75600640 1 -- start start 2024-03-23T06:10:37.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f75600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f700c7e10 0x7f7f70071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f75600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f70150100 0x7f7f701eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f75600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f7014d090 0x7f7f701ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f75600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7014a5f0 con 0x7f7f70150100 2024-03-23T06:10:37.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f75600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f701f2d30 con 0x7f7f700c7e10 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f75600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f701f21b0 con 0x7f7f7014d090 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f66000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f70150100 0x7f7f701eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f66000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f70150100 0x7f7f701eefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34826/0 (socket says 172.21.15.73:34826) 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f66000640 1 -- 172.21.15.73:0/212425047 learned_addr learned my addr 172.21.15.73:0/212425047 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f6f400640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f7014d090 0x7f7f701ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.445+0000 7f7f6ea00640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f700c7e10 0x7f7f70071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f66000640 1 -- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f7014d090 msgr2=0x7f7f701ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f66000640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f7014d090 0x7f7f701ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f66000640 1 -- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f700c7e10 msgr2=0x7f7f70071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f66000640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f700c7e10 0x7f7f70071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f66000640 1 -- 172.21.15.73:0/212425047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6800bd40 con 0x7f7f70150100 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f66000640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f70150100 0x7f7f701eefa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800d800 tx=0x7f7f5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f67400640 1 -- 172.21.15.73:0/212425047 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f58004030 con 0x7f7f70150100 2024-03-23T06:10:37.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f67400640 1 -- 172.21.15.73:0/212425047 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f58004190 con 0x7f7f70150100 2024-03-23T06:10:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f67400640 1 -- 172.21.15.73:0/212425047 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f58004520 con 0x7f7f70150100 2024-03-23T06:10:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f701f2490 con 0x7f7f70150100 2024-03-23T06:10:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.446+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f701f2a50 con 0x7f7f70150100 2024-03-23T06:10:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.447+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7004e110 con 0x7f7f70150100 2024-03-23T06:10:37.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.448+0000 7f7f67400640 1 -- 172.21.15.73:0/212425047 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7f580096a0 con 0x7f7f70150100 2024-03-23T06:10:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.449+0000 7f7f67400640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f4c06ac00 0x7f7f4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.449+0000 7f7f67400640 1 -- 172.21.15.73:0/212425047 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f58089830 con 0x7f7f70150100 2024-03-23T06:10:37.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.450+0000 7f7f6ea00640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f4c06ac00 0x7f7f4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.450+0000 7f7f6ea00640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f4c06ac00 0x7f7f4c06d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009b40 tx=0x7f7f60009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:37.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.454+0000 7f7f67400640 1 -- 172.21.15.73:0/212425047 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7f58054760 con 0x7f7f70150100 2024-03-23T06:10:37.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.631+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f7006fee0 con 0x7f7f4c06ac00 2024-03-23T06:10:37.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.642+0000 7f7f67400640 1 -- 172.21.15.73:0/212425047 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345226 (secure 0 0 0) 0x7f7f60011a60 con 0x7f7f4c06ac00 2024-03-23T06:10:37.646 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:37.648 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:10:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.646+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f4c06ac00 msgr2=0x7f7f4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.646+0000 7f7f75600640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f4c06ac00 0x7f7f4c06d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009b40 tx=0x7f7f60009190 comp rx=0 tx=0).stop 2024-03-23T06:10:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.646+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f70150100 msgr2=0x7f7f701eefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.646+0000 7f7f75600640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f70150100 0x7f7f701eefa0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800d800 tx=0x7f7f5800dcc0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.647+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 shutdown_connections 2024-03-23T06:10:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.647+0000 7f7f75600640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f4c06ac00 0x7f7f4c06d0c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.647+0000 7f7f75600640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f7014d090 0x7f7f701ef4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.647+0000 7f7f75600640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f70150100 0x7f7f701eefa0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.647+0000 7f7f75600640 1 --2- 172.21.15.73:0/212425047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f700c7e10 0x7f7f70071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.647+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 >> 172.21.15.73:0/212425047 conn(0x7f7f7006bb40 msgr2=0x7f7f7014ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.647+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 shutdown_connections 2024-03-23T06:10:37.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.647+0000 7f7f75600640 1 -- 172.21.15.73:0/212425047 wait complete. 2024-03-23T06:10:37.663 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-03-23T06:10:36.619491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596319,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":247,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235840,"kb_used_data":3316,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738880,"statfs":{"total":773094113280,"available":772852613120,"internally_reserved":0,"allocated":3395584,"data_stored":2019260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003860"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.938317+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:10:02.938317+0000","last_peered":"2024-03-23T06:10:02.938317+0000","last_clean":"2024-03-23T06:10:02.938317+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:10:02.938317+0000","last_undegraded":"2024-03-23T06:10:02.938317+0000","last_fullsized":"2024-03-23T06:10:02.938317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948197+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:10:01.948197+0000","last_peered":"2024-03-23T06:10:01.948197+0000","last_clean":"2024-03-23T06:10:01.948197+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:10:01.948197+0000","last_undegraded":"2024-03-23T06:10:01.948197+0000","last_fullsized":"2024-03-23T06:10:01.948197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929155+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:10:02.929155+0000","last_peered":"2024-03-23T06:10:02.929155+0000","last_clean":"2024-03-23T06:10:02.929155+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:10:02.929155+0000","last_undegraded":"2024-03-23T06:10:02.929155+0000","last_fullsized":"2024-03-23T06:10:02.929155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932040+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:10:02.932040+0000","last_peered":"2024-03-23T06:10:02.932040+0000","last_clean":"2024-03-23T06:10:02.932040+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:10:02.932040+0000","last_undegraded":"2024-03-23T06:10:02.932040+0000","last_fullsized":"2024-03-23T06:10:02.932040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948557+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:10:01.948557+0000","last_peered":"2024-03-23T06:10:01.948557+0000","last_clean":"2024-03-23T06:10:01.948557+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:10:01.948557+0000","last_undegraded":"2024-03-23T06:10:01.948557+0000","last_fullsized":"2024-03-23T06:10:01.948557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.979095+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:10:01.979095+0000","last_peered":"2024-03-23T06:10:01.979095+0000","last_clean":"2024-03-23T06:10:01.979095+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:10:01.979095+0000","last_undegraded":"2024-03-23T06:10:01.979095+0000","last_fullsized":"2024-03-23T06:10:01.979095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932874+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:10:02.932874+0000","last_peered":"2024-03-23T06:10:02.932874+0000","last_clean":"2024-03-23T06:10:02.932874+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:10:02.932874+0000","last_undegraded":"2024-03-23T06:10:02.932874+0000","last_fullsized":"2024-03-23T06:10:02.932874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960659+0000","last_change":"2024-03-23T06:09:57.945661+0000","last_active":"2024-03-23T06:10:01.960659+0000","last_peered":"2024-03-23T06:10:01.960659+0000","last_clean":"2024-03-23T06:10:01.960659+0000","last_became_active":"2024-03-23T06:09:57.945374+0000","last_became_peered":"2024-03-23T06:09:57.945374+0000","last_unstale":"2024-03-23T06:10:01.960659+0000","last_undegraded":"2024-03-23T06:10:01.960659+0000","last_fullsized":"2024-03-23T06:10:01.960659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:20:55.180098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.981444+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:10:01.981444+0000","last_peered":"2024-03-23T06:10:01.981444+0000","last_clean":"2024-03-23T06:10:01.981444+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:10:01.981444+0000","last_undegraded":"2024-03-23T06:10:01.981444+0000","last_fullsized":"2024-03-23T06:10:01.981444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.936447+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:10:02.936447+0000","last_peered":"2024-03-23T06:10:02.936447+0000","last_clean":"2024-03-23T06:10:02.936447+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:10:02.936447+0000","last_undegraded":"2024-03-23T06:10:02.936447+0000","last_fullsized":"2024-03-23T06:10:02.936447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956142+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:10:01.956142+0000","last_peered":"2024-03-23T06:10:01.956142+0000","last_clean":"2024-03-23T06:10:01.956142+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:10:01.956142+0000","last_undegraded":"2024-03-23T06:10:01.956142+0000","last_fullsized":"2024-03-23T06:10:01.956142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.986981+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:10:01.986981+0000","last_peered":"2024-03-23T06:10:01.986981+0000","last_clean":"2024-03-23T06:10:01.986981+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:10:01.986981+0000","last_undegraded":"2024-03-23T06:10:01.986981+0000","last_fullsized":"2024-03-23T06:10:01.986981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947842+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:10:01.947842+0000","last_peered":"2024-03-23T06:10:01.947842+0000","last_clean":"2024-03-23T06:10:01.947842+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:10:01.947842+0000","last_undegraded":"2024-03-23T06:10:01.947842+0000","last_fullsized":"2024-03-23T06:10:01.947842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.458019+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:10:33.458019+0000","last_peered":"2024-03-23T06:10:33.458019+0000","last_clean":"2024-03-23T06:10:33.458019+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:10:33.458019+0000","last_undegraded":"2024-03-23T06:10:33.458019+0000","last_fullsized":"2024-03-23T06:10:33.458019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.977132+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:10:01.977132+0000","last_peered":"2024-03-23T06:10:01.977132+0000","last_clean":"2024-03-23T06:10:01.977132+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:10:01.977132+0000","last_undegraded":"2024-03-23T06:10:01.977132+0000","last_fullsized":"2024-03-23T06:10:01.977132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944424+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:10:01.944424+0000","last_peered":"2024-03-23T06:10:01.944424+0000","last_clean":"2024-03-23T06:10:01.944424+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:10:01.944424+0000","last_undegraded":"2024-03-23T06:10:01.944424+0000","last_fullsized":"2024-03-23T06:10:01.944424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938236+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:10:01.938236+0000","last_peered":"2024-03-23T06:10:01.938236+0000","last_clean":"2024-03-23T06:10:01.938236+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:10:01.938236+0000","last_undegraded":"2024-03-23T06:10:01.938236+0000","last_fullsized":"2024-03-23T06:10:01.938236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.974726+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:10:01.974726+0000","last_peered":"2024-03-23T06:10:01.974726+0000","last_clean":"2024-03-23T06:10:01.974726+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:10:01.974726+0000","last_undegraded":"2024-03-23T06:10:01.974726+0000","last_fullsized":"2024-03-23T06:10:01.974726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938551+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:10:01.938551+0000","last_peered":"2024-03-23T06:10:01.938551+0000","last_clean":"2024-03-23T06:10:01.938551+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:10:01.938551+0000","last_undegraded":"2024-03-23T06:10:01.938551+0000","last_fullsized":"2024-03-23T06:10:01.938551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.456738+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:10:33.456738+0000","last_peered":"2024-03-23T06:10:33.456738+0000","last_clean":"2024-03-23T06:10:33.456738+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:10:33.456738+0000","last_undegraded":"2024-03-23T06:10:33.456738+0000","last_fullsized":"2024-03-23T06:10:33.456738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930440+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:10:02.930440+0000","last_peered":"2024-03-23T06:10:02.930440+0000","last_clean":"2024-03-23T06:10:02.930440+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:10:02.930440+0000","last_undegraded":"2024-03-23T06:10:02.930440+0000","last_fullsized":"2024-03-23T06:10:02.930440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946405+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:10:01.946405+0000","last_peered":"2024-03-23T06:10:01.946405+0000","last_clean":"2024-03-23T06:10:01.946405+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:10:01.946405+0000","last_undegraded":"2024-03-23T06:10:01.946405+0000","last_fullsized":"2024-03-23T06:10:01.946405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.460728+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:10:33.460728+0000","last_peered":"2024-03-23T06:10:33.460728+0000","last_clean":"2024-03-23T06:10:33.460728+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:10:33.460728+0000","last_undegraded":"2024-03-23T06:10:33.460728+0000","last_fullsized":"2024-03-23T06:10:33.460728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982640+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:10:01.982640+0000","last_peered":"2024-03-23T06:10:01.982640+0000","last_clean":"2024-03-23T06:10:01.982640+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:10:01.982640+0000","last_undegraded":"2024-03-23T06:10:01.982640+0000","last_fullsized":"2024-03-23T06:10:01.982640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938356+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:10:01.938356+0000","last_peered":"2024-03-23T06:10:01.938356+0000","last_clean":"2024-03-23T06:10:01.938356+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:10:01.938356+0000","last_undegraded":"2024-03-23T06:10:01.938356+0000","last_fullsized":"2024-03-23T06:10:01.938356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.458019+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:10:33.458019+0000","last_peered":"2024-03-23T06:10:33.458019+0000","last_clean":"2024-03-23T06:10:33.458019+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:10:33.458019+0000","last_undegraded":"2024-03-23T06:10:33.458019+0000","last_fullsized":"2024-03-23T06:10:33.458019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982776+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:10:01.982776+0000","last_peered":"2024-03-23T06:10:01.982776+0000","last_clean":"2024-03-23T06:10:01.982776+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:10:01.982776+0000","last_undegraded":"2024-03-23T06:10:01.982776+0000","last_fullsized":"2024-03-23T06:10:01.982776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936925+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:10:01.936925+0000","last_peered":"2024-03-23T06:10:01.936925+0000","last_clean":"2024-03-23T06:10:01.936925+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:10:01.936925+0000","last_undegraded":"2024-03-23T06:10:01.936925+0000","last_fullsized":"2024-03-23T06:10:01.936925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427809+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:10:02.427809+0000","last_peered":"2024-03-23T06:10:02.427809+0000","last_clean":"2024-03-23T06:10:02.427809+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:10:02.427809+0000","last_undegraded":"2024-03-23T06:10:02.427809+0000","last_fullsized":"2024-03-23T06:10:02.427809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427188+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:10:02.427188+0000","last_peered":"2024-03-23T06:10:02.427188+0000","last_clean":"2024-03-23T06:10:02.427188+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:10:02.427188+0000","last_undegraded":"2024-03-23T06:10:02.427188+0000","last_fullsized":"2024-03-23T06:10:02.427188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938375+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:10:01.938375+0000","last_peered":"2024-03-23T06:10:01.938375+0000","last_clean":"2024-03-23T06:10:01.938375+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:10:01.938375+0000","last_undegraded":"2024-03-23T06:10:01.938375+0000","last_fullsized":"2024-03-23T06:10:01.938375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.429012+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:10:02.429012+0000","last_peered":"2024-03-23T06:10:02.429012+0000","last_clean":"2024-03-23T06:10:02.429012+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:10:02.429012+0000","last_undegraded":"2024-03-23T06:10:02.429012+0000","last_fullsized":"2024-03-23T06:10:02.429012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426879+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:10:02.426879+0000","last_peered":"2024-03-23T06:10:02.426879+0000","last_clean":"2024-03-23T06:10:02.426879+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:10:02.426879+0000","last_undegraded":"2024-03-23T06:10:02.426879+0000","last_fullsized":"2024-03-23T06:10:02.426879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.962945+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:10:01.962945+0000","last_peered":"2024-03-23T06:10:01.962945+0000","last_clean":"2024-03-23T06:10:01.962945+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:10:01.962945+0000","last_undegraded":"2024-03-23T06:10:01.962945+0000","last_fullsized":"2024-03-23T06:10:01.962945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947204+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:10:01.947204+0000","last_peered":"2024-03-23T06:10:01.947204+0000","last_clean":"2024-03-23T06:10:01.947204+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:10:01.947204+0000","last_undegraded":"2024-03-23T06:10:01.947204+0000","last_fullsized":"2024-03-23T06:10:01.947204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426681+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:10:02.426681+0000","last_peered":"2024-03-23T06:10:02.426681+0000","last_clean":"2024-03-23T06:10:02.426681+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:10:02.426681+0000","last_undegraded":"2024-03-23T06:10:02.426681+0000","last_fullsized":"2024-03-23T06:10:02.426681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956957+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:10:01.956957+0000","last_peered":"2024-03-23T06:10:01.956957+0000","last_clean":"2024-03-23T06:10:01.956957+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:10:01.956957+0000","last_undegraded":"2024-03-23T06:10:01.956957+0000","last_fullsized":"2024-03-23T06:10:01.956957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951233+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:10:01.951233+0000","last_peered":"2024-03-23T06:10:01.951233+0000","last_clean":"2024-03-23T06:10:01.951233+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:10:01.951233+0000","last_undegraded":"2024-03-23T06:10:01.951233+0000","last_fullsized":"2024-03-23T06:10:01.951233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427177+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:10:02.427177+0000","last_peered":"2024-03-23T06:10:02.427177+0000","last_clean":"2024-03-23T06:10:02.427177+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:10:02.427177+0000","last_undegraded":"2024-03-23T06:10:02.427177+0000","last_fullsized":"2024-03-23T06:10:02.427177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947571+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:10:01.947571+0000","last_peered":"2024-03-23T06:10:01.947571+0000","last_clean":"2024-03-23T06:10:01.947571+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:10:01.947571+0000","last_undegraded":"2024-03-23T06:10:01.947571+0000","last_fullsized":"2024-03-23T06:10:01.947571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929323+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:10:02.929323+0000","last_peered":"2024-03-23T06:10:02.929323+0000","last_clean":"2024-03-23T06:10:02.929323+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:10:02.929323+0000","last_undegraded":"2024-03-23T06:10:02.929323+0000","last_fullsized":"2024-03-23T06:10:02.929323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427599+0000","last_change":"2024-03-23T06:10:01.967435+0000","last_active":"2024-03-23T06:10:02.427599+0000","last_peered":"2024-03-23T06:10:02.427599+0000","last_clean":"2024-03-23T06:10:02.427599+0000","last_became_active":"2024-03-23T06:10:01.967059+0000","last_became_peered":"2024-03-23T06:10:01.967059+0000","last_unstale":"2024-03-23T06:10:02.427599+0000","last_undegraded":"2024-03-23T06:10:02.427599+0000","last_fullsized":"2024-03-23T06:10:02.427599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:51:56.777341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936633+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:10:01.936633+0000","last_peered":"2024-03-23T06:10:01.936633+0000","last_clean":"2024-03-23T06:10:01.936633+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:01.936633+0000","last_undegraded":"2024-03-23T06:10:01.936633+0000","last_fullsized":"2024-03-23T06:10:01.936633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427939+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:10:02.427939+0000","last_peered":"2024-03-23T06:10:02.427939+0000","last_clean":"2024-03-23T06:10:02.427939+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:10:02.427939+0000","last_undegraded":"2024-03-23T06:10:02.427939+0000","last_fullsized":"2024-03-23T06:10:02.427939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931695+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:10:02.931695+0000","last_peered":"2024-03-23T06:10:02.931695+0000","last_clean":"2024-03-23T06:10:02.931695+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:10:02.931695+0000","last_undegraded":"2024-03-23T06:10:02.931695+0000","last_fullsized":"2024-03-23T06:10:02.931695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938499+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:10:01.938499+0000","last_peered":"2024-03-23T06:10:01.938499+0000","last_clean":"2024-03-23T06:10:01.938499+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:10:01.938499+0000","last_undegraded":"2024-03-23T06:10:01.938499+0000","last_fullsized":"2024-03-23T06:10:01.938499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.463587+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:10:33.463587+0000","last_peered":"2024-03-23T06:10:33.463587+0000","last_clean":"2024-03-23T06:10:33.463587+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:10:33.463587+0000","last_undegraded":"2024-03-23T06:10:33.463587+0000","last_fullsized":"2024-03-23T06:10:33.463587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955598+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:10:01.955598+0000","last_peered":"2024-03-23T06:10:01.955598+0000","last_clean":"2024-03-23T06:10:01.955598+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:10:01.955598+0000","last_undegraded":"2024-03-23T06:10:01.955598+0000","last_fullsized":"2024-03-23T06:10:01.955598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982185+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:10:01.982185+0000","last_peered":"2024-03-23T06:10:01.982185+0000","last_clean":"2024-03-23T06:10:01.982185+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:10:01.982185+0000","last_undegraded":"2024-03-23T06:10:01.982185+0000","last_fullsized":"2024-03-23T06:10:01.982185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955865+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:10:01.955865+0000","last_peered":"2024-03-23T06:10:01.955865+0000","last_clean":"2024-03-23T06:10:01.955865+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:10:01.955865+0000","last_undegraded":"2024-03-23T06:10:01.955865+0000","last_fullsized":"2024-03-23T06:10:01.955865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938453+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:10:01.938453+0000","last_peered":"2024-03-23T06:10:01.938453+0000","last_clean":"2024-03-23T06:10:01.938453+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:10:01.938453+0000","last_undegraded":"2024-03-23T06:10:01.938453+0000","last_fullsized":"2024-03-23T06:10:01.938453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.980947+0000","last_change":"2024-03-23T06:10:01.975352+0000","last_active":"2024-03-23T06:10:01.980947+0000","last_peered":"2024-03-23T06:10:01.980947+0000","last_clean":"2024-03-23T06:10:01.980947+0000","last_became_active":"2024-03-23T06:10:01.974177+0000","last_became_peered":"2024-03-23T06:10:01.974177+0000","last_unstale":"2024-03-23T06:10:01.980947+0000","last_undegraded":"2024-03-23T06:10:01.980947+0000","last_fullsized":"2024-03-23T06:10:01.980947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:33.405804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958813+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:10:01.958813+0000","last_peered":"2024-03-23T06:10:01.958813+0000","last_clean":"2024-03-23T06:10:01.958813+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:10:01.958813+0000","last_undegraded":"2024-03-23T06:10:01.958813+0000","last_fullsized":"2024-03-23T06:10:01.958813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931676+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:10:02.931676+0000","last_peered":"2024-03-23T06:10:02.931676+0000","last_clean":"2024-03-23T06:10:02.931676+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:10:02.931676+0000","last_undegraded":"2024-03-23T06:10:02.931676+0000","last_fullsized":"2024-03-23T06:10:02.931676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930842+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:10:02.930842+0000","last_peered":"2024-03-23T06:10:02.930842+0000","last_clean":"2024-03-23T06:10:02.930842+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:10:02.930842+0000","last_undegraded":"2024-03-23T06:10:02.930842+0000","last_fullsized":"2024-03-23T06:10:02.930842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955953+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:10:01.955953+0000","last_peered":"2024-03-23T06:10:01.955953+0000","last_clean":"2024-03-23T06:10:01.955953+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:10:01.955953+0000","last_undegraded":"2024-03-23T06:10:01.955953+0000","last_fullsized":"2024-03-23T06:10:01.955953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.930322+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:10:02.930322+0000","last_peered":"2024-03-23T06:10:02.930322+0000","last_clean":"2024-03-23T06:10:02.930322+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:10:02.930322+0000","last_undegraded":"2024-03-23T06:10:02.930322+0000","last_fullsized":"2024-03-23T06:10:02.930322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.978341+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:10:01.978341+0000","last_peered":"2024-03-23T06:10:01.978341+0000","last_clean":"2024-03-23T06:10:01.978341+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:10:01.978341+0000","last_undegraded":"2024-03-23T06:10:01.978341+0000","last_fullsized":"2024-03-23T06:10:01.978341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961138+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:10:01.961138+0000","last_peered":"2024-03-23T06:10:01.961138+0000","last_clean":"2024-03-23T06:10:01.961138+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:10:01.961138+0000","last_undegraded":"2024-03-23T06:10:01.961138+0000","last_fullsized":"2024-03-23T06:10:01.961138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.932726+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:10:02.932726+0000","last_peered":"2024-03-23T06:10:02.932726+0000","last_clean":"2024-03-23T06:10:02.932726+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:10:02.932726+0000","last_undegraded":"2024-03-23T06:10:02.932726+0000","last_fullsized":"2024-03-23T06:10:02.932726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.987273+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:10:01.987273+0000","last_peered":"2024-03-23T06:10:01.987273+0000","last_clean":"2024-03-23T06:10:01.987273+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:10:01.987273+0000","last_undegraded":"2024-03-23T06:10:01.987273+0000","last_fullsized":"2024-03-23T06:10:01.987273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946483+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:10:01.946483+0000","last_peered":"2024-03-23T06:10:01.946483+0000","last_clean":"2024-03-23T06:10:01.946483+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:10:01.946483+0000","last_undegraded":"2024-03-23T06:10:01.946483+0000","last_fullsized":"2024-03-23T06:10:01.946483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.453012+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:10:33.453012+0000","last_peered":"2024-03-23T06:10:33.453012+0000","last_clean":"2024-03-23T06:10:33.453012+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:10:33.453012+0000","last_undegraded":"2024-03-23T06:10:33.453012+0000","last_fullsized":"2024-03-23T06:10:33.453012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931833+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:10:02.931833+0000","last_peered":"2024-03-23T06:10:02.931833+0000","last_clean":"2024-03-23T06:10:02.931833+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:10:02.931833+0000","last_undegraded":"2024-03-23T06:10:02.931833+0000","last_fullsized":"2024-03-23T06:10:02.931833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955456+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:10:01.955456+0000","last_peered":"2024-03-23T06:10:01.955456+0000","last_clean":"2024-03-23T06:10:01.955456+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:10:01.955456+0000","last_undegraded":"2024-03-23T06:10:01.955456+0000","last_fullsized":"2024-03-23T06:10:01.955456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958080+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:10:01.958080+0000","last_peered":"2024-03-23T06:10:01.958080+0000","last_clean":"2024-03-23T06:10:01.958080+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:10:01.958080+0000","last_undegraded":"2024-03-23T06:10:01.958080+0000","last_fullsized":"2024-03-23T06:10:01.958080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.931864+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:10:02.931864+0000","last_peered":"2024-03-23T06:10:02.931864+0000","last_clean":"2024-03-23T06:10:02.931864+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:10:02.931864+0000","last_undegraded":"2024-03-23T06:10:02.931864+0000","last_fullsized":"2024-03-23T06:10:02.931864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954582+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:10:01.954582+0000","last_peered":"2024-03-23T06:10:01.954582+0000","last_clean":"2024-03-23T06:10:01.954582+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:10:01.954582+0000","last_undegraded":"2024-03-23T06:10:01.954582+0000","last_fullsized":"2024-03-23T06:10:01.954582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.461196+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:10:33.461196+0000","last_peered":"2024-03-23T06:10:33.461196+0000","last_clean":"2024-03-23T06:10:33.461196+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:10:33.461196+0000","last_undegraded":"2024-03-23T06:10:33.461196+0000","last_fullsized":"2024-03-23T06:10:33.461196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427019+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:10:02.427019+0000","last_peered":"2024-03-23T06:10:02.427019+0000","last_clean":"2024-03-23T06:10:02.427019+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:10:02.427019+0000","last_undegraded":"2024-03-23T06:10:02.427019+0000","last_fullsized":"2024-03-23T06:10:02.427019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.937969+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:10:01.937969+0000","last_peered":"2024-03-23T06:10:01.937969+0000","last_clean":"2024-03-23T06:10:01.937969+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:10:01.937969+0000","last_undegraded":"2024-03-23T06:10:01.937969+0000","last_fullsized":"2024-03-23T06:10:01.937969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.456440+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:10:33.456440+0000","last_peered":"2024-03-23T06:10:33.456440+0000","last_clean":"2024-03-23T06:10:33.456440+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:10:33.456440+0000","last_undegraded":"2024-03-23T06:10:33.456440+0000","last_fullsized":"2024-03-23T06:10:33.456440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.977106+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:10:01.977106+0000","last_peered":"2024-03-23T06:10:01.977106+0000","last_clean":"2024-03-23T06:10:01.977106+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:10:01.977106+0000","last_undegraded":"2024-03-23T06:10:01.977106+0000","last_fullsized":"2024-03-23T06:10:01.977106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960157+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:10:01.960157+0000","last_peered":"2024-03-23T06:10:01.960157+0000","last_clean":"2024-03-23T06:10:01.960157+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:10:01.960157+0000","last_undegraded":"2024-03-23T06:10:01.960157+0000","last_fullsized":"2024-03-23T06:10:01.960157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'12","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.457957+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:10:33.457957+0000","last_peered":"2024-03-23T06:10:33.457957+0000","last_clean":"2024-03-23T06:10:33.457957+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:10:33.457957+0000","last_undegraded":"2024-03-23T06:10:33.457957+0000","last_fullsized":"2024-03-23T06:10:33.457957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.426645+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:10:02.426645+0000","last_peered":"2024-03-23T06:10:02.426645+0000","last_clean":"2024-03-23T06:10:02.426645+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:10:02.426645+0000","last_undegraded":"2024-03-23T06:10:02.426645+0000","last_fullsized":"2024-03-23T06:10:02.426645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951611+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:10:01.951611+0000","last_peered":"2024-03-23T06:10:01.951611+0000","last_clean":"2024-03-23T06:10:01.951611+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:10:01.951611+0000","last_undegraded":"2024-03-23T06:10:01.951611+0000","last_fullsized":"2024-03-23T06:10:01.951611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.933858+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:10:02.933858+0000","last_peered":"2024-03-23T06:10:02.933858+0000","last_clean":"2024-03-23T06:10:02.933858+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:10:02.933858+0000","last_undegraded":"2024-03-23T06:10:02.933858+0000","last_fullsized":"2024-03-23T06:10:02.933858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.981424+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:10:01.981424+0000","last_peered":"2024-03-23T06:10:01.981424+0000","last_clean":"2024-03-23T06:10:01.981424+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:10:01.981424+0000","last_undegraded":"2024-03-23T06:10:01.981424+0000","last_fullsized":"2024-03-23T06:10:01.981424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948637+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:10:01.948637+0000","last_peered":"2024-03-23T06:10:01.948637+0000","last_clean":"2024-03-23T06:10:01.948637+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:10:01.948637+0000","last_undegraded":"2024-03-23T06:10:01.948637+0000","last_fullsized":"2024-03-23T06:10:01.948637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.460726+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:10:33.460726+0000","last_peered":"2024-03-23T06:10:33.460726+0000","last_clean":"2024-03-23T06:10:33.460726+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:10:33.460726+0000","last_undegraded":"2024-03-23T06:10:33.460726+0000","last_fullsized":"2024-03-23T06:10:33.460726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929041+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:10:02.929041+0000","last_peered":"2024-03-23T06:10:02.929041+0000","last_clean":"2024-03-23T06:10:02.929041+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:10:02.929041+0000","last_undegraded":"2024-03-23T06:10:02.929041+0000","last_fullsized":"2024-03-23T06:10:02.929041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961066+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:10:01.961066+0000","last_peered":"2024-03-23T06:10:01.961066+0000","last_clean":"2024-03-23T06:10:01.961066+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:10:01.961066+0000","last_undegraded":"2024-03-23T06:10:01.961066+0000","last_fullsized":"2024-03-23T06:10:01.961066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.460568+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:10:33.460568+0000","last_peered":"2024-03-23T06:10:33.460568+0000","last_clean":"2024-03-23T06:10:33.460568+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:10:33.460568+0000","last_undegraded":"2024-03-23T06:10:33.460568+0000","last_fullsized":"2024-03-23T06:10:33.460568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427056+0000","last_change":"2024-03-23T06:10:01.963116+0000","last_active":"2024-03-23T06:10:02.427056+0000","last_peered":"2024-03-23T06:10:02.427056+0000","last_clean":"2024-03-23T06:10:02.427056+0000","last_became_active":"2024-03-23T06:10:01.962746+0000","last_became_peered":"2024-03-23T06:10:01.962746+0000","last_unstale":"2024-03-23T06:10:02.427056+0000","last_undegraded":"2024-03-23T06:10:02.427056+0000","last_fullsized":"2024-03-23T06:10:02.427056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:51:03.948467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427647+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:10:02.427647+0000","last_peered":"2024-03-23T06:10:02.427647+0000","last_clean":"2024-03-23T06:10:02.427647+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:10:02.427647+0000","last_undegraded":"2024-03-23T06:10:02.427647+0000","last_fullsized":"2024-03-23T06:10:02.427647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938885+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:10:01.938885+0000","last_peered":"2024-03-23T06:10:01.938885+0000","last_clean":"2024-03-23T06:10:01.938885+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:10:01.938885+0000","last_undegraded":"2024-03-23T06:10:01.938885+0000","last_fullsized":"2024-03-23T06:10:01.938885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427860+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:10:02.427860+0000","last_peered":"2024-03-23T06:10:02.427860+0000","last_clean":"2024-03-23T06:10:02.427860+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:10:02.427860+0000","last_undegraded":"2024-03-23T06:10:02.427860+0000","last_fullsized":"2024-03-23T06:10:02.427860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.982125+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:10:01.982125+0000","last_peered":"2024-03-23T06:10:01.982125+0000","last_clean":"2024-03-23T06:10:01.982125+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:10:01.982125+0000","last_undegraded":"2024-03-23T06:10:01.982125+0000","last_fullsized":"2024-03-23T06:10:01.982125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947907+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:10:01.947907+0000","last_peered":"2024-03-23T06:10:01.947907+0000","last_clean":"2024-03-23T06:10:01.947907+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:10:01.947907+0000","last_undegraded":"2024-03-23T06:10:01.947907+0000","last_fullsized":"2024-03-23T06:10:01.947907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936901+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:10:01.936901+0000","last_peered":"2024-03-23T06:10:01.936901+0000","last_clean":"2024-03-23T06:10:01.936901+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:10:01.936901+0000","last_undegraded":"2024-03-23T06:10:01.936901+0000","last_fullsized":"2024-03-23T06:10:01.936901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.428499+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:10:02.428499+0000","last_peered":"2024-03-23T06:10:02.428499+0000","last_clean":"2024-03-23T06:10:02.428499+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:10:02.428499+0000","last_undegraded":"2024-03-23T06:10:02.428499+0000","last_fullsized":"2024-03-23T06:10:02.428499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936867+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:10:01.936867+0000","last_peered":"2024-03-23T06:10:01.936867+0000","last_clean":"2024-03-23T06:10:01.936867+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:10:01.936867+0000","last_undegraded":"2024-03-23T06:10:01.936867+0000","last_fullsized":"2024-03-23T06:10:01.936867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.427526+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:10:02.427526+0000","last_peered":"2024-03-23T06:10:02.427526+0000","last_clean":"2024-03-23T06:10:02.427526+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:10:02.427526+0000","last_undegraded":"2024-03-23T06:10:02.427526+0000","last_fullsized":"2024-03-23T06:10:02.427526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:33.457074+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:10:33.457074+0000","last_peered":"2024-03-23T06:10:33.457074+0000","last_clean":"2024-03-23T06:10:33.457074+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:10:33.457074+0000","last_undegraded":"2024-03-23T06:10:33.457074+0000","last_fullsized":"2024-03-23T06:10:33.457074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959100+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:10:01.959100+0000","last_peered":"2024-03-23T06:10:01.959100+0000","last_clean":"2024-03-23T06:10:01.959100+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:10:01.959100+0000","last_undegraded":"2024-03-23T06:10:01.959100+0000","last_fullsized":"2024-03-23T06:10:01.959100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-23T06:10:02.929722+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:10:02.929722+0000","last_peered":"2024-03-23T06:10:02.929722+0000","last_clean":"2024-03-23T06:10:02.929722+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:10:02.929722+0000","last_undegraded":"2024-03-23T06:10:02.929722+0000","last_fullsized":"2024-03-23T06:10:02.929722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960026+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:10:01.960026+0000","last_peered":"2024-03-23T06:10:01.960026+0000","last_clean":"2024-03-23T06:10:01.960026+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:10:01.960026+0000","last_undegraded":"2024-03-23T06:10:01.960026+0000","last_fullsized":"2024-03-23T06:10:01.960026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.944307+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:10:01.944307+0000","last_peered":"2024-03-23T06:10:01.944307+0000","last_clean":"2024-03-23T06:10:01.944307+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:10:01.944307+0000","last_undegraded":"2024-03-23T06:10:01.944307+0000","last_fullsized":"2024-03-23T06:10:01.944307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951291+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:10:01.951291+0000","last_peered":"2024-03-23T06:10:01.951291+0000","last_clean":"2024-03-23T06:10:01.951291+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:10:01.951291+0000","last_undegraded":"2024-03-23T06:10:01.951291+0000","last_fullsized":"2024-03-23T06:10:01.951291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947547+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:10:01.947547+0000","last_peered":"2024-03-23T06:10:01.947547+0000","last_clean":"2024-03-23T06:10:01.947547+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:10:01.947547+0000","last_undegraded":"2024-03-23T06:10:01.947547+0000","last_fullsized":"2024-03-23T06:10:01.947547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938289+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:10:01.938289+0000","last_peered":"2024-03-23T06:10:01.938289+0000","last_clean":"2024-03-23T06:10:01.938289+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:10:01.938289+0000","last_undegraded":"2024-03-23T06:10:01.938289+0000","last_fullsized":"2024-03-23T06:10:01.938289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938341+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:10:01.938341+0000","last_peered":"2024-03-23T06:10:01.938341+0000","last_clean":"2024-03-23T06:10:01.938341+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:10:01.938341+0000","last_undegraded":"2024-03-23T06:10:01.938341+0000","last_fullsized":"2024-03-23T06:10:01.938341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960989+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:10:01.960989+0000","last_peered":"2024-03-23T06:10:01.960989+0000","last_clean":"2024-03-23T06:10:01.960989+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:10:01.960989+0000","last_undegraded":"2024-03-23T06:10:01.960989+0000","last_fullsized":"2024-03-23T06:10:01.960989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948453+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:01.948453+0000","last_peered":"2024-03-23T06:10:01.948453+0000","last_clean":"2024-03-23T06:10:01.948453+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:10:01.948453+0000","last_undegraded":"2024-03-23T06:10:01.948453+0000","last_fullsized":"2024-03-23T06:10:01.948453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.951149+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:10:01.951149+0000","last_peered":"2024-03-23T06:10:01.951149+0000","last_clean":"2024-03-23T06:10:01.951149+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:10:01.951149+0000","last_undegraded":"2024-03-23T06:10:01.951149+0000","last_fullsized":"2024-03-23T06:10:01.951149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947028+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:10:01.947028+0000","last_peered":"2024-03-23T06:10:01.947028+0000","last_clean":"2024-03-23T06:10:01.947028+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:01.947028+0000","last_undegraded":"2024-03-23T06:10:01.947028+0000","last_fullsized":"2024-03-23T06:10:01.947028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959084+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:10:01.959084+0000","last_peered":"2024-03-23T06:10:01.959084+0000","last_clean":"2024-03-23T06:10:01.959084+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:10:01.959084+0000","last_undegraded":"2024-03-23T06:10:01.959084+0000","last_fullsized":"2024-03-23T06:10:01.959084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.936782+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:10:01.936782+0000","last_peered":"2024-03-23T06:10:01.936782+0000","last_clean":"2024-03-23T06:10:01.936782+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:10:01.936782+0000","last_undegraded":"2024-03-23T06:10:01.936782+0000","last_fullsized":"2024-03-23T06:10:01.936782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.958727+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:10:01.958727+0000","last_peered":"2024-03-23T06:10:01.958727+0000","last_clean":"2024-03-23T06:10:01.958727+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:10:01.958727+0000","last_undegraded":"2024-03-23T06:10:01.958727+0000","last_fullsized":"2024-03-23T06:10:01.958727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955979+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:10:01.955979+0000","last_peered":"2024-03-23T06:10:01.955979+0000","last_clean":"2024-03-23T06:10:01.955979+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:10:01.955979+0000","last_undegraded":"2024-03-23T06:10:01.955979+0000","last_fullsized":"2024-03-23T06:10:01.955979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.942778+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:10:01.942778+0000","last_peered":"2024-03-23T06:10:01.942778+0000","last_clean":"2024-03-23T06:10:01.942778+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:10:01.942778+0000","last_undegraded":"2024-03-23T06:10:01.942778+0000","last_fullsized":"2024-03-23T06:10:01.942778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.954107+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:10:01.954107+0000","last_peered":"2024-03-23T06:10:01.954107+0000","last_clean":"2024-03-23T06:10:01.954107+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:10:01.954107+0000","last_undegraded":"2024-03-23T06:10:01.954107+0000","last_fullsized":"2024-03-23T06:10:01.954107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947698+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:01.947698+0000","last_peered":"2024-03-23T06:10:01.947698+0000","last_clean":"2024-03-23T06:10:01.947698+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:10:01.947698+0000","last_undegraded":"2024-03-23T06:10:01.947698+0000","last_fullsized":"2024-03-23T06:10:01.947698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.946933+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:10:01.946933+0000","last_peered":"2024-03-23T06:10:01.946933+0000","last_clean":"2024-03-23T06:10:01.946933+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:10:01.946933+0000","last_undegraded":"2024-03-23T06:10:01.946933+0000","last_fullsized":"2024-03-23T06:10:01.946933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.937864+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:10:01.937864+0000","last_peered":"2024-03-23T06:10:01.937864+0000","last_clean":"2024-03-23T06:10:01.937864+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:10:01.937864+0000","last_undegraded":"2024-03-23T06:10:01.937864+0000","last_fullsized":"2024-03-23T06:10:01.937864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.938183+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:10:01.938183+0000","last_peered":"2024-03-23T06:10:01.938183+0000","last_clean":"2024-03-23T06:10:01.938183+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:10:01.938183+0000","last_undegraded":"2024-03-23T06:10:01.938183+0000","last_fullsized":"2024-03-23T06:10:01.938183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.959302+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:10:01.959302+0000","last_peered":"2024-03-23T06:10:01.959302+0000","last_clean":"2024-03-23T06:10:01.959302+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:10:01.959302+0000","last_undegraded":"2024-03-23T06:10:01.959302+0000","last_fullsized":"2024-03-23T06:10:01.959302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.960084+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:10:01.960084+0000","last_peered":"2024-03-23T06:10:01.960084+0000","last_clean":"2024-03-23T06:10:01.960084+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:10:01.960084+0000","last_undegraded":"2024-03-23T06:10:01.960084+0000","last_fullsized":"2024-03-23T06:10:01.960084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955366+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:10:01.955366+0000","last_peered":"2024-03-23T06:10:01.955366+0000","last_clean":"2024-03-23T06:10:01.955366+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:10:01.955366+0000","last_undegraded":"2024-03-23T06:10:01.955366+0000","last_fullsized":"2024-03-23T06:10:01.955366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.961295+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:10:01.961295+0000","last_peered":"2024-03-23T06:10:01.961295+0000","last_clean":"2024-03-23T06:10:01.961295+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:10:01.961295+0000","last_undegraded":"2024-03-23T06:10:01.961295+0000","last_fullsized":"2024-03-23T06:10:01.961295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947495+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:10:01.947495+0000","last_peered":"2024-03-23T06:10:01.947495+0000","last_clean":"2024-03-23T06:10:01.947495+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:10:01.947495+0000","last_undegraded":"2024-03-23T06:10:01.947495+0000","last_fullsized":"2024-03-23T06:10:01.947495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.957968+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:10:01.957968+0000","last_peered":"2024-03-23T06:10:01.957968+0000","last_clean":"2024-03-23T06:10:01.957968+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:10:01.957968+0000","last_undegraded":"2024-03-23T06:10:01.957968+0000","last_fullsized":"2024-03-23T06:10:01.957968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.970135+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:10:01.970135+0000","last_peered":"2024-03-23T06:10:01.970135+0000","last_clean":"2024-03-23T06:10:01.970135+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:10:01.970135+0000","last_undegraded":"2024-03-23T06:10:01.970135+0000","last_fullsized":"2024-03-23T06:10:01.970135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.957139+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:10:01.957139+0000","last_peered":"2024-03-23T06:10:01.957139+0000","last_clean":"2024-03-23T06:10:01.957139+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:10:01.957139+0000","last_undegraded":"2024-03-23T06:10:01.957139+0000","last_fullsized":"2024-03-23T06:10:01.957139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.956477+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:10:01.956477+0000","last_peered":"2024-03-23T06:10:01.956477+0000","last_clean":"2024-03-23T06:10:01.956477+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:10:01.956477+0000","last_undegraded":"2024-03-23T06:10:01.956477+0000","last_fullsized":"2024-03-23T06:10:01.956477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.947435+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:10:01.947435+0000","last_peered":"2024-03-23T06:10:01.947435+0000","last_clean":"2024-03-23T06:10:01.947435+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:10:01.947435+0000","last_undegraded":"2024-03-23T06:10:01.947435+0000","last_fullsized":"2024-03-23T06:10:01.947435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.948381+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:10:01.948381+0000","last_peered":"2024-03-23T06:10:01.948381+0000","last_clean":"2024-03-23T06:10:01.948381+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:10:01.948381+0000","last_undegraded":"2024-03-23T06:10:01.948381+0000","last_fullsized":"2024-03-23T06:10:01.948381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-23T06:10:01.955839+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:10:01.955839+0000","last_peered":"2024-03-23T06:10:01.955839+0000","last_clean":"2024-03-23T06:10:01.955839+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:10:01.955839+0000","last_undegraded":"2024-03-23T06:10:01.955839+0000","last_fullsized":"2024-03-23T06:10:01.955839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5951,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":11902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":103943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.861}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.544}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":107134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":693777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0270000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2130000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":103485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4239999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":274432,"data_stored":104045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":270336,"data_stored":103913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":872448,"data_stored":694373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":299008,"data_stored":108590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:10:37.668 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-23T06:10:37.668 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-23T06:10:37.668 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-23T06:10:37.668 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-23T06:10:37.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.907+0000 7fdd21c00640 1 Processor -- start 2024-03-23T06:10:37.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.907+0000 7fdd21c00640 1 -- start start 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.908+0000 7fdd21c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c1513f0 0x7fdd1c0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.908+0000 7fdd21c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd1c158af0 0x7fdd1c071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.908+0000 7fdd21c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0c5f50 con 0x7fdd1c1586b0 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.908+0000 7fdd21c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c157b60 con 0x7fdd1c158af0 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.908+0000 7fdd21c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0c0570 con 0x7fdd1c1513f0 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.909+0000 7fdd1b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd1c158af0 0x7fdd1c071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.909+0000 7fdd1b400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd1c158af0 0x7fdd1c071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34836/0 (socket says 172.21.15.73:34836) 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.909+0000 7fdd1b400640 1 -- 172.21.15.73:0/471119057 learned_addr learned my addr 172.21.15.73:0/471119057 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.909+0000 7fdd1aa00640 1 --2- 172.21.15.73:0/471119057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c1513f0 0x7fdd1c0c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.909+0000 7fdd1b400640 1 -- 172.21.15.73:0/471119057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c1513f0 msgr2=0x7fdd1c0c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:37.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.909+0000 7fdd1b400640 1 --2- 172.21.15.73:0/471119057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c1513f0 0x7fdd1c0c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.909+0000 7fdd1b400640 1 -- 172.21.15.73:0/471119057 >> v1:172.21.15.73:6789/0 conn(0x7fdd1c1586b0 legacy=0x7fdd1c0bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.909+0000 7fdd1b400640 1 -- 172.21.15.73:0/471119057 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0c0830 con 0x7fdd1c158af0 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.910+0000 7fdd1b400640 1 --2- 172.21.15.73:0/471119057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c158af0 0x7fdd1c071bc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009e50 tx=0x7fdd1402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d179bdc7d974feb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.910+0000 7fdd1a000640 1 -- 172.21.15.73:0/471119057 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1402cb90 con 0x7fdd1c158af0 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.910+0000 7fdd1a000640 1 -- 172.21.15.73:0/471119057 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1402ccf0 con 0x7fdd1c158af0 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.910+0000 7fdd1a000640 1 -- 172.21.15.73:0/471119057 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14034610 con 0x7fdd1c158af0 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.911+0000 7fdd21c00640 1 -- 172.21.15.73:0/471119057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c158af0 msgr2=0x7fdd1c071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.911+0000 7fdd21c00640 1 --2- 172.21.15.73:0/471119057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c158af0 0x7fdd1c071bc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009e50 tx=0x7fdd1402bff0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.911+0000 7fdd21c00640 1 -- 172.21.15.73:0/471119057 shutdown_connections 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.911+0000 7fdd21c00640 1 --2- 172.21.15.73:0/471119057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c158af0 0x7fdd1c071bc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.911+0000 7fdd21c00640 1 --2- 172.21.15.73:0/471119057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c1513f0 0x7fdd1c0c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.911+0000 7fdd21c00640 1 -- 172.21.15.73:0/471119057 >> 172.21.15.73:0/471119057 conn(0x7fdd1c06bb40 msgr2=0x7fdd1c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.911+0000 7fdd21c00640 1 -- 172.21.15.73:0/471119057 shutdown_connections 2024-03-23T06:10:37.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.911+0000 7fdd21c00640 1 -- 172.21.15.73:0/471119057 wait complete. 2024-03-23T06:10:37.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.913+0000 7fdd21c00640 1 Processor -- start 2024-03-23T06:10:37.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.913+0000 7fdd21c00640 1 -- start start 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd21c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c1513f0 0x7fdd1c1ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd21c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd1c1586b0 0x7fdd1c0c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd21c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c158af0 0x7fdd1c0c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd21c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0ca470 con 0x7fdd1c1513f0 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd21c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c1ef8a0 con 0x7fdd1c1586b0 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd21c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0c2d80 con 0x7fdd1c158af0 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c1513f0 0x7fdd1c1ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c1513f0 0x7fdd1c1ddec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34852/0 (socket says 172.21.15.73:34852) 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1aa00640 1 -- 172.21.15.73:0/2841278270 learned_addr learned my addr 172.21.15.73:0/2841278270 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1b400640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c158af0 0x7fdd1c0c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd12000640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd1c1586b0 0x7fdd1c0c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1aa00640 1 -- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c158af0 msgr2=0x7fdd1c0c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1aa00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c158af0 0x7fdd1c0c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1aa00640 1 -- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd1c1586b0 msgr2=0x7fdd1c0c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1aa00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd1c1586b0 0x7fdd1c0c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.914+0000 7fdd1aa00640 1 -- 172.21.15.73:0/2841278270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd14009b30 con 0x7fdd1c1513f0 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.915+0000 7fdd1aa00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c1513f0 0x7fdd1c1ddec0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e870 tx=0x7fdd0c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.915+0000 7fdd13400640 1 -- 172.21.15.73:0/2841278270 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0094f0 con 0x7fdd1c1513f0 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.915+0000 7fdd13400640 1 -- 172.21.15.73:0/2841278270 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c00c940 con 0x7fdd1c1513f0 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.915+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c0c3040 con 0x7fdd1c1513f0 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.915+0000 7fdd13400640 1 -- 172.21.15.73:0/2841278270 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00ccf0 con 0x7fdd1c1513f0 2024-03-23T06:10:37.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.915+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c1ef250 con 0x7fdd1c1513f0 2024-03-23T06:10:37.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.916+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c04e110 con 0x7fdd1c1513f0 2024-03-23T06:10:37.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.917+0000 7fdd13400640 1 -- 172.21.15.73:0/2841278270 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdd0c013470 con 0x7fdd1c1513f0 2024-03-23T06:10:37.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.918+0000 7fdd13400640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdcf806ac00 0x7fdcf806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:37.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.918+0000 7fdd13400640 1 -- 172.21.15.73:0/2841278270 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdd0c089710 con 0x7fdd1c1513f0 2024-03-23T06:10:37.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.919+0000 7fdd12000640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdcf806ac00 0x7fdcf806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:37.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.919+0000 7fdd12000640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdcf806ac00 0x7fdcf806d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0b12d0 tx=0x7fdd04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:37.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:37.923+0000 7fdd13400640 1 -- 172.21.15.73:0/2841278270 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fdd0c0546b0 con 0x7fdd1c1513f0 2024-03-23T06:10:38.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.141+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdd1c0c55d0 con 0x7fdd1c1513f0 2024-03-23T06:10:38.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.142+0000 7fdd13400640 1 -- 172.21.15.73:0/2841278270 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fdd0c057cd0 con 0x7fdd1c1513f0 2024-03-23T06:10:38.142 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:38.142 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.144+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdcf806ac00 msgr2=0x7fdcf806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.144+0000 7fdd21c00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdcf806ac00 0x7fdcf806d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0b12d0 tx=0x7fdd04009040 comp rx=0 tx=0).stop 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.144+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c1513f0 msgr2=0x7fdd1c1ddec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.144+0000 7fdd21c00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c1513f0 0x7fdd1c1ddec0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e870 tx=0x7fdd0c00ed30 comp rx=0 tx=0).stop 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.145+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 shutdown_connections 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.145+0000 7fdd21c00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdcf806ac00 0x7fdcf806d0c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.145+0000 7fdd21c00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd1c158af0 0x7fdd1c0c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.145+0000 7fdd21c00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd1c1586b0 0x7fdd1c0c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.145+0000 7fdd21c00640 1 --2- 172.21.15.73:0/2841278270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd1c1513f0 0x7fdd1c1ddec0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.145+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 >> 172.21.15.73:0/2841278270 conn(0x7fdd1c06bb40 msgr2=0x7fdd1c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.145+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 shutdown_connections 2024-03-23T06:10:38.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.145+0000 7fdd21c00640 1 -- 172.21.15.73:0/2841278270 wait complete. 2024-03-23T06:10:38.162 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-23T06:10:38.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:38.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.362+0000 7f83d6a00640 1 Processor -- start 2024-03-23T06:10:38.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.363+0000 7f83d6a00640 1 -- start start 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 0x7f83d006d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d6a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83d00c4b40 0x7f83d01400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d6a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83d0072030 0x7f83d0140620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d6a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00c1d50 con 0x7f83d00c4b40 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d6a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00c2bb0 con 0x7f83d0072030 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d6a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00c1fa0 con 0x7f83d0071c50 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d4c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83d00c4b40 0x7f83d01400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d4c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83d00c4b40 0x7f83d01400e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34868/0 (socket says 172.21.15.73:34868) 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.364+0000 7f83d4c00640 1 -- 172.21.15.73:0/2299554963 learned_addr learned my addr 172.21.15.73:0/2299554963 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.365+0000 7f83d5600640 1 --2- 172.21.15.73:0/2299554963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 0x7f83d006d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.365+0000 7f83d6000640 1 --2- 172.21.15.73:0/2299554963 >> v2:172.21.15.110:3300/0 conn(0x7f83d0072030 0x7f83d0140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.365+0000 7f83d4c00640 1 -- 172.21.15.73:0/2299554963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 msgr2=0x7f83d006d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:38.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.365+0000 7f83d4c00640 1 --2- 172.21.15.73:0/2299554963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 0x7f83d006d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.365+0000 7f83d4c00640 1 -- 172.21.15.73:0/2299554963 >> v2:172.21.15.110:3300/0 conn(0x7f83d0072030 msgr2=0x7f83d0140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:38.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.365+0000 7f83d4c00640 1 --2- 172.21.15.73:0/2299554963 >> v2:172.21.15.110:3300/0 conn(0x7f83d0072030 0x7f83d0140620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.365+0000 7f83d4c00640 1 -- 172.21.15.73:0/2299554963 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d00c2280 con 0x7f83d00c4b40 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.366+0000 7f83d4c00640 1 --2- 172.21.15.73:0/2299554963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00c4b40 0x7f83d01400e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83d0154e40 tx=0x7f83bc02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6532bcae37394458 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.366+0000 7f83cfe00640 1 -- 172.21.15.73:0/2299554963 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc030850 con 0x7f83d00c4b40 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.366+0000 7f83cfe00640 1 -- 172.21.15.73:0/2299554963 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc0309b0 con 0x7f83d00c4b40 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.366+0000 7f83cfe00640 1 -- 172.21.15.73:0/2299554963 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc030d40 con 0x7f83d00c4b40 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 -- 172.21.15.73:0/2299554963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00c4b40 msgr2=0x7f83d01400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 --2- 172.21.15.73:0/2299554963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00c4b40 0x7f83d01400e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f83d0154e40 tx=0x7f83bc02b990 comp rx=0 tx=0).stop 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 -- 172.21.15.73:0/2299554963 shutdown_connections 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 --2- 172.21.15.73:0/2299554963 >> v2:172.21.15.110:3300/0 conn(0x7f83d0072030 0x7f83d0140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 --2- 172.21.15.73:0/2299554963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d00c4b40 0x7f83d01400e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 --2- 172.21.15.73:0/2299554963 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 0x7f83d006d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 -- 172.21.15.73:0/2299554963 >> 172.21.15.73:0/2299554963 conn(0x7f83d0069cb0 msgr2=0x7f83d006a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:38.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 -- 172.21.15.73:0/2299554963 shutdown_connections 2024-03-23T06:10:38.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.367+0000 7f83d6a00640 1 -- 172.21.15.73:0/2299554963 wait complete. 2024-03-23T06:10:38.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.369+0000 7f83d6a00640 1 Processor -- start 2024-03-23T06:10:38.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.369+0000 7f83d6a00640 1 -- start start 2024-03-23T06:10:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 0x7f83d01ee470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d0072030 0x7f83d015a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83d00c4b40 0x7f83d0156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d6a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0154c80 con 0x7f83d0072030 2024-03-23T06:10:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d6a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d01ee9b0 con 0x7f83d00c4b40 2024-03-23T06:10:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d6a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d01562f0 con 0x7f83d0071c50 2024-03-23T06:10:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d4c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d0072030 0x7f83d015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d4c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d0072030 0x7f83d015a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34870/0 (socket says 172.21.15.73:34870) 2024-03-23T06:10:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d4c00640 1 -- 172.21.15.73:0/979224092 learned_addr learned my addr 172.21.15.73:0/979224092 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d6000640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83d00c4b40 0x7f83d0156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d5600640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 0x7f83d01ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d4c00640 1 -- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 msgr2=0x7f83d01ee470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d4c00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 0x7f83d01ee470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d4c00640 1 -- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83d00c4b40 msgr2=0x7f83d0156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d4c00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83d00c4b40 0x7f83d0156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.370+0000 7f83d4c00640 1 -- 172.21.15.73:0/979224092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc0094d0 con 0x7f83d0072030 2024-03-23T06:10:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.371+0000 7f83d4c00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d0072030 0x7f83d015a890 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83bc02b9d0 tx=0x7f83bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.371+0000 7f83cd600640 1 -- 172.21.15.73:0/979224092 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc039a90 con 0x7f83d0072030 2024-03-23T06:10:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.371+0000 7f83cd600640 1 -- 172.21.15.73:0/979224092 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc039c10 con 0x7f83d0072030 2024-03-23T06:10:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.371+0000 7f83cd600640 1 -- 172.21.15.73:0/979224092 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc043410 con 0x7f83d0072030 2024-03-23T06:10:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.371+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d0154320 con 0x7f83d0072030 2024-03-23T06:10:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.371+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d01548e0 con 0x7f83d0072030 2024-03-23T06:10:38.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.372+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d004e030 con 0x7f83d0072030 2024-03-23T06:10:38.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.373+0000 7f83cd600640 1 -- 172.21.15.73:0/979224092 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f83bc02e070 con 0x7f83d0072030 2024-03-23T06:10:38.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.374+0000 7f83cd600640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83b006ac00 0x7f83b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.374+0000 7f83cd600640 1 -- 172.21.15.73:0/979224092 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83bc0ab480 con 0x7f83d0072030 2024-03-23T06:10:38.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.374+0000 7f83d5600640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83b006ac00 0x7f83b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.375+0000 7f83d5600640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83b006ac00 0x7f83b006d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009ac0 tx=0x7f83c4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:38.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.378+0000 7f83cd600640 1 -- 172.21.15.73:0/979224092 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f83bc076380 con 0x7f83d0072030 2024-03-23T06:10:38.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.568+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83d0156430 con 0x7f83d0072030 2024-03-23T06:10:38.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.570+0000 7f83cd600640 1 -- 172.21.15.73:0/979224092 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+17882 (secure 0 0 0) 0x7f83bc0799a0 con 0x7f83d0072030 2024-03-23T06:10:38.571 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:38.571 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":25,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:02.420630+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:38.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83b006ac00 msgr2=0x7f83b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83b006ac00 0x7f83b006d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83c4009ac0 tx=0x7f83c4009190 comp rx=0 tx=0).stop 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d0072030 msgr2=0x7f83d015a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d0072030 0x7f83d015a890 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83bc02b9d0 tx=0x7f83bc004730 comp rx=0 tx=0).stop 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 shutdown_connections 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83d00c4b40 0x7f83d0156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d0072030 0x7f83d015a890 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83b006ac00 0x7f83b006d0c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 --2- 172.21.15.73:0/979224092 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83d0071c50 0x7f83d01ee470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 >> 172.21.15.73:0/979224092 conn(0x7f83d0069cb0 msgr2=0x7f83d013e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:38.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.573+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 shutdown_connections 2024-03-23T06:10:38.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.574+0000 7f83d6a00640 1 -- 172.21.15.73:0/979224092 wait complete. 2024-03-23T06:10:38.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T06:09:56.066381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T06:09:56.917187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-23T06:09:59.981596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-23T06:10:38.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:10:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.791+0000 7fc8d6a00640 1 Processor -- start 2024-03-23T06:10:38.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.791+0000 7fc8d6a00640 1 -- start start 2024-03-23T06:10:38.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.792+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d0153660 0x7fc8d015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.792+0000 7fc8d6a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8d00cade0 0x7fc8d00cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.792+0000 7fc8d6a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d00c41f0 con 0x7fc8d00cc1c0 2024-03-23T06:10:38.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.792+0000 7fc8d6a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d00cb230 con 0x7fc8d00cade0 2024-03-23T06:10:38.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.792+0000 7fc8d6a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d00cb7f0 con 0x7fc8d0153660 2024-03-23T06:10:38.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d4c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8d00cade0 0x7fc8d00cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d4c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc8d00cade0 0x7fc8d00cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34874/0 (socket says 172.21.15.73:34874) 2024-03-23T06:10:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d4c00640 1 -- 172.21.15.73:0/1373393822 learned_addr learned my addr 172.21.15.73:0/1373393822 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d6000640 1 --1- 172.21.15.73:0/1373393822 >> v1:172.21.15.73:6789/0 conn(0x7fc8d00cc1c0 0x7fc8d00c9920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55350/0 (socket says 172.21.15.73:55350) 2024-03-23T06:10:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d5600640 1 --2- 172.21.15.73:0/1373393822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d0153660 0x7fc8d015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d4c00640 1 -- 172.21.15.73:0/1373393822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d0153660 msgr2=0x7fc8d015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d4c00640 1 --2- 172.21.15.73:0/1373393822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d0153660 0x7fc8d015c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d4c00640 1 -- 172.21.15.73:0/1373393822 >> v1:172.21.15.73:6789/0 conn(0x7fc8d00cc1c0 legacy=0x7fc8d00c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8cfe00640 1 -- 172.21.15.73:0/1373393822 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958579277 0 0) 0x7fc8d00c41f0 con 0x7fc8d00cc1c0 2024-03-23T06:10:38.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.793+0000 7fc8d4c00640 1 -- 172.21.15.73:0/1373393822 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d015ce20 con 0x7fc8d00cade0 2024-03-23T06:10:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.794+0000 7fc8d4c00640 1 --2- 172.21.15.73:0/1373393822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cbc80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009870 tx=0x7fc8bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664751e90f899982 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.794+0000 7fc8cfe00640 1 -- 172.21.15.73:0/1373393822 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc030840 con 0x7fc8d00cade0 2024-03-23T06:10:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.794+0000 7fc8cfe00640 1 -- 172.21.15.73:0/1373393822 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0309a0 con 0x7fc8d00cade0 2024-03-23T06:10:38.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.794+0000 7fc8cfe00640 1 -- 172.21.15.73:0/1373393822 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc030d30 con 0x7fc8d00cade0 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.795+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1373393822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 msgr2=0x7fc8d00cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.795+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1373393822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cbc80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009870 tx=0x7fc8bc02b980 comp rx=0 tx=0).stop 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.795+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1373393822 shutdown_connections 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.795+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1373393822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cbc80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.795+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1373393822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d0153660 0x7fc8d015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.795+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1373393822 >> 172.21.15.73:0/1373393822 conn(0x7fc8d006bcc0 msgr2=0x7fc8d006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.795+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1373393822 shutdown_connections 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.795+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1373393822 wait complete. 2024-03-23T06:10:38.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.797+0000 7fc8d6a00640 1 Processor -- start 2024-03-23T06:10:38.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.797+0000 7fc8d6a00640 1 -- start start 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d00cc1c0 0x7fc8d00c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8d0153660 0x7fc8d0146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d6a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d00b4910 con 0x7fc8d00cade0 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d6a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d00b4df0 con 0x7fc8d0153660 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d6a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d01eed40 con 0x7fc8d00cc1c0 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d5600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d5600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34888/0 (socket says 172.21.15.73:34888) 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d5600640 1 -- 172.21.15.73:0/1181349921 learned_addr learned my addr 172.21.15.73:0/1181349921 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d6000640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8d0153660 0x7fc8d0146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d4c00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d00cc1c0 0x7fc8d00c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d5600640 1 -- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d00cc1c0 msgr2=0x7fc8d00c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d5600640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d00cc1c0 0x7fc8d00c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d5600640 1 -- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8d0153660 msgr2=0x7fc8d0146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d5600640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8d0153660 0x7fc8d0146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.798+0000 7fc8d5600640 1 -- 172.21.15.73:0/1181349921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0094d0 con 0x7fc8d00cade0 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.799+0000 7fc8d5600640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cdd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000e870 tx=0x7fc8c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.799+0000 7fc8cd600640 1 -- 172.21.15.73:0/1181349921 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00094f0 con 0x7fc8d00cade0 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.799+0000 7fc8cd600640 1 -- 172.21.15.73:0/1181349921 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c000c940 con 0x7fc8d00cade0 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.799+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d01ef020 con 0x7fc8d00cade0 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.799+0000 7fc8cd600640 1 -- 172.21.15.73:0/1181349921 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c000ccf0 con 0x7fc8d00cade0 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.799+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d01f1a40 con 0x7fc8d00cade0 2024-03-23T06:10:38.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.800+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d0153a40 con 0x7fc8d00cade0 2024-03-23T06:10:38.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.801+0000 7fc8cd600640 1 -- 172.21.15.73:0/1181349921 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc8c0013470 con 0x7fc8d00cade0 2024-03-23T06:10:38.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.802+0000 7fc8cd600640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc8b006ac00 0x7fc8b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:38.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.802+0000 7fc8cd600640 1 -- 172.21.15.73:0/1181349921 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fc8c0089880 con 0x7fc8d00cade0 2024-03-23T06:10:38.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.802+0000 7fc8d4c00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc8b006ac00 0x7fc8b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:38.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.803+0000 7fc8d4c00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc8b006ac00 0x7fc8b006d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc036000 tx=0x7fc8bc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:38.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.806+0000 7fc8cd600640 1 -- 172.21.15.73:0/1181349921 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc8c0054670 con 0x7fc8d00cade0 2024-03-23T06:10:38.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.997+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8d004e030 con 0x7fc8d00cade0 2024-03-23T06:10:38.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:38.998+0000 7fc8cd600640 1 -- 172.21.15.73:0/1181349921 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8c0057c90 con 0x7fc8d00cade0 2024-03-23T06:10:38.998 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc8b006ac00 msgr2=0x7fc8b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc8b006ac00 0x7fc8b006d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc036000 tx=0x7fc8bc008030 comp rx=0 tx=0).stop 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 msgr2=0x7fc8d00cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cdd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc8c000e870 tx=0x7fc8c000ed30 comp rx=0 tx=0).stop 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 shutdown_connections 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8d0153660 0x7fc8d0146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc8b006ac00 0x7fc8b006d0c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8d00cc1c0 0x7fc8d00c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 --2- 172.21.15.73:0/1181349921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8d00cade0 0x7fc8d00cdd20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 >> 172.21.15.73:0/1181349921 conn(0x7fc8d006bcc0 msgr2=0x7fc8d00c3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 shutdown_connections 2024-03-23T06:10:39.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.001+0000 7fc8d6a00640 1 -- 172.21.15.73:0/1181349921 wait complete. 2024-03-23T06:10:39.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T06:10:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.222+0000 7fe386e00640 1 Processor -- start 2024-03-23T06:10:39.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.222+0000 7fe386e00640 1 -- start start 2024-03-23T06:10:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe386e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3800ca4d0 0x7fe380159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe386e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe3800c8eb0 0x7fe380070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe386e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38015d920 con 0x7fe3801536c0 2024-03-23T06:10:39.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe386e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38015cac0 con 0x7fe3800c8eb0 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe386e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38015cd10 con 0x7fe3800ca4d0 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe37f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3800ca4d0 0x7fe380159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe37fe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe3801536c0 0x7fe3800caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38802/0 (socket says 172.21.15.73:38802) 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe37fe00640 1 -- 172.21.15.73:0/584381563 learned_addr learned my addr 172.21.15.73:0/584381563 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe384e00640 1 --2- 172.21.15.73:0/584381563 >> v2:172.21.15.73:3300/0 conn(0x7fe3800c8eb0 0x7fe380070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe37f400640 1 -- 172.21.15.73:0/584381563 >> v2:172.21.15.73:3300/0 conn(0x7fe3800c8eb0 msgr2=0x7fe380070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe37f400640 1 --2- 172.21.15.73:0/584381563 >> v2:172.21.15.73:3300/0 conn(0x7fe3800c8eb0 0x7fe380070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe37f400640 1 -- 172.21.15.73:0/584381563 >> v1:172.21.15.110:6789/0 conn(0x7fe3801536c0 legacy=0x7fe3800caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.224+0000 7fe37f400640 1 -- 172.21.15.73:0/584381563 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38015cff0 con 0x7fe3800ca4d0 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.225+0000 7fe37f400640 1 --2- 172.21.15.73:0/584381563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3800ca4d0 0x7fe380159f00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe3800cb640 tx=0x7fe36c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f5b827ba439f022 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.226+0000 7fe37ea00640 1 -- 172.21.15.73:0/584381563 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c031830 con 0x7fe3800ca4d0 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.226+0000 7fe37ea00640 1 -- 172.21.15.73:0/584381563 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c031990 con 0x7fe3800ca4d0 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.226+0000 7fe37ea00640 1 -- 172.21.15.73:0/584381563 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c031d20 con 0x7fe3800ca4d0 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.226+0000 7fe386e00640 1 -- 172.21.15.73:0/584381563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3800ca4d0 msgr2=0x7fe380159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.226+0000 7fe386e00640 1 --2- 172.21.15.73:0/584381563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3800ca4d0 0x7fe380159f00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe3800cb640 tx=0x7fe36c02b8d0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.227+0000 7fe386e00640 1 -- 172.21.15.73:0/584381563 shutdown_connections 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.227+0000 7fe386e00640 1 --2- 172.21.15.73:0/584381563 >> v2:172.21.15.73:3300/0 conn(0x7fe3800c8eb0 0x7fe380070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.227+0000 7fe386e00640 1 --2- 172.21.15.73:0/584381563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3800ca4d0 0x7fe380159f00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.227+0000 7fe386e00640 1 -- 172.21.15.73:0/584381563 >> 172.21.15.73:0/584381563 conn(0x7fe380069cb0 msgr2=0x7fe38006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.227+0000 7fe386e00640 1 -- 172.21.15.73:0/584381563 shutdown_connections 2024-03-23T06:10:39.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.227+0000 7fe386e00640 1 -- 172.21.15.73:0/584381563 wait complete. 2024-03-23T06:10:39.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.229+0000 7fe386e00640 1 Processor -- start 2024-03-23T06:10:39.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.229+0000 7fe386e00640 1 -- start start 2024-03-23T06:10:39.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe386e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3800c8eb0 0x7fe3801ef750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe386e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3800ca4d0 0x7fe380154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe386e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3801536c0 0x7fe3800c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe386e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c1e90 con 0x7fe3800ca4d0 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe386e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800c2a10 con 0x7fe3801536c0 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe386e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801efc90 con 0x7fe3800c8eb0 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe37f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3800ca4d0 0x7fe380154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe37f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3800ca4d0 0x7fe380154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34908/0 (socket says 172.21.15.73:34908) 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe37f400640 1 -- 172.21.15.73:0/2947599389 learned_addr learned my addr 172.21.15.73:0/2947599389 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.230+0000 7fe384e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3801536c0 0x7fe3800c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe37fe00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3800c8eb0 0x7fe3801ef750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe37f400640 1 -- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3800c8eb0 msgr2=0x7fe3801ef750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe37f400640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3800c8eb0 0x7fe3801ef750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe37f400640 1 -- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3801536c0 msgr2=0x7fe3800c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe37f400640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3801536c0 0x7fe3800c2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe37f400640 1 -- 172.21.15.73:0/2947599389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c009400 con 0x7fe3800ca4d0 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe384e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3801536c0 0x7fe3800c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe37f400640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3800ca4d0 0x7fe380154030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009890 tx=0x7fe36c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.231+0000 7fe377e00640 1 -- 172.21.15.73:0/2947599389 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c03ba70 con 0x7fe3800ca4d0 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.232+0000 7fe377e00640 1 -- 172.21.15.73:0/2947599389 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c03bbf0 con 0x7fe3800ca4d0 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.232+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3800c4d70 con 0x7fe3800ca4d0 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.232+0000 7fe377e00640 1 -- 172.21.15.73:0/2947599389 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c045400 con 0x7fe3800ca4d0 2024-03-23T06:10:39.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.232+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3800c23c0 con 0x7fe3800ca4d0 2024-03-23T06:10:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.233+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3800c2b80 con 0x7fe3800ca4d0 2024-03-23T06:10:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.234+0000 7fe377e00640 1 -- 172.21.15.73:0/2947599389 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe36c04e440 con 0x7fe3800ca4d0 2024-03-23T06:10:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.234+0000 7fe377e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe36006ac30 0x7fe36006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.235+0000 7fe377e00640 1 -- 172.21.15.73:0/2947599389 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe36c0ab840 con 0x7fe3800ca4d0 2024-03-23T06:10:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.235+0000 7fe37fe00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe36006ac30 0x7fe36006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.236+0000 7fe37fe00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe36006ac30 0x7fe36006d0f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe370005880 tx=0x7fe370009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:39.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.239+0000 7fe377e00640 1 -- 172.21.15.73:0/2947599389 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe36c0767e0 con 0x7fe3800ca4d0 2024-03-23T06:10:39.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.436+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe38004e110 con 0x7fe3800ca4d0 2024-03-23T06:10:39.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.437+0000 7fe377e00640 1 -- 172.21.15.73:0/2947599389 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe36c079e00 con 0x7fe3800ca4d0 2024-03-23T06:10:39.437 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.439+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe36006ac30 msgr2=0x7fe36006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.439+0000 7fe386e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe36006ac30 0x7fe36006d0f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe370005880 tx=0x7fe370009040 comp rx=0 tx=0).stop 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.439+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3800ca4d0 msgr2=0x7fe380154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.439+0000 7fe386e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3800ca4d0 0x7fe380154030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009890 tx=0x7fe36c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.440+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 shutdown_connections 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.440+0000 7fe386e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3801536c0 0x7fe3800c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.440+0000 7fe386e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3800ca4d0 0x7fe380154030 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.440+0000 7fe386e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe36006ac30 0x7fe36006d0f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.440+0000 7fe386e00640 1 --2- 172.21.15.73:0/2947599389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3800c8eb0 0x7fe3801ef750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.440+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 >> 172.21.15.73:0/2947599389 conn(0x7fe380069cb0 msgr2=0x7fe3800c67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:39.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.440+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 shutdown_connections 2024-03-23T06:10:39.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.440+0000 7fe386e00640 1 -- 172.21.15.73:0/2947599389 wait complete. 2024-03-23T06:10:39.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T06:10:39.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.665+0000 7f38e2400640 1 Processor -- start 2024-03-23T06:10:39.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.666+0000 7f38e2400640 1 -- start start 2024-03-23T06:10:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38e2400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38dc159420 0x7f38dc0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38e2400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc0ca940 0x7f38dc0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38e2400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc0c9c80 con 0x7f38dc153760 2024-03-23T06:10:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38e2400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc159860 con 0x7f38dc159420 2024-03-23T06:10:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38e2400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0cb310 con 0x7f38dc0ca940 2024-03-23T06:10:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38db400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f38dc153760 0x7f38dc0cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:38812/0 (socket says 172.21.15.73:38812) 2024-03-23T06:10:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38db400640 1 -- 172.21.15.73:0/669502550 learned_addr learned my addr 172.21.15.73:0/669502550 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:39.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38dbe00640 1 --2- 172.21.15.73:0/669502550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc0ca940 0x7f38dc0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.668+0000 7f38daa00640 1 --2- 172.21.15.73:0/669502550 >> v2:172.21.15.73:3300/0 conn(0x7f38dc159420 0x7f38dc0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.670+0000 7f38daa00640 1 -- 172.21.15.73:0/669502550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc0ca940 msgr2=0x7f38dc0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.670+0000 7f38daa00640 1 --2- 172.21.15.73:0/669502550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc0ca940 0x7f38dc0cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.670+0000 7f38daa00640 1 -- 172.21.15.73:0/669502550 >> v1:172.21.15.110:6789/0 conn(0x7f38dc153760 legacy=0x7f38dc0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.670+0000 7f38daa00640 1 -- 172.21.15.73:0/669502550 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc06a2d0 con 0x7f38dc159420 2024-03-23T06:10:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.671+0000 7f38daa00640 1 --2- 172.21.15.73:0/669502550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc0c9740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f38c80097a0 tx=0x7f38c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93b2d49b34a6e86 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.672+0000 7f38da000640 1 -- 172.21.15.73:0/669502550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8031830 con 0x7f38dc159420 2024-03-23T06:10:39.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.672+0000 7f38da000640 1 -- 172.21.15.73:0/669502550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c8031990 con 0x7f38dc159420 2024-03-23T06:10:39.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.672+0000 7f38da000640 1 -- 172.21.15.73:0/669502550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c8031d60 con 0x7f38dc159420 2024-03-23T06:10:39.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.673+0000 7f38e2400640 1 -- 172.21.15.73:0/669502550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 msgr2=0x7f38dc0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.673+0000 7f38e2400640 1 --2- 172.21.15.73:0/669502550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc0c9740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f38c80097a0 tx=0x7f38c802b8d0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.674+0000 7f38e2400640 1 -- 172.21.15.73:0/669502550 shutdown_connections 2024-03-23T06:10:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.674+0000 7f38e2400640 1 --2- 172.21.15.73:0/669502550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc0ca940 0x7f38dc0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.674+0000 7f38e2400640 1 --2- 172.21.15.73:0/669502550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc0c9740 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.674+0000 7f38e2400640 1 -- 172.21.15.73:0/669502550 >> 172.21.15.73:0/669502550 conn(0x7f38dc06c310 msgr2=0x7f38dc0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.675+0000 7f38e2400640 1 -- 172.21.15.73:0/669502550 shutdown_connections 2024-03-23T06:10:39.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.675+0000 7f38e2400640 1 -- 172.21.15.73:0/669502550 wait complete. 2024-03-23T06:10:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.676+0000 7f38e2400640 1 Processor -- start 2024-03-23T06:10:39.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.676+0000 7f38e2400640 1 -- start start 2024-03-23T06:10:39.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.677+0000 7f38e2400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38dc0ca940 0x7f38dc1eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.677+0000 7f38e2400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc153760 0x7f38dc0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.677+0000 7f38e2400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.677+0000 7f38e2400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc1460c0 con 0x7f38dc159420 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.677+0000 7f38e2400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc145d20 con 0x7f38dc0ca940 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.677+0000 7f38e2400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc1ef4d0 con 0x7f38dc153760 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc144b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34928/0 (socket says 172.21.15.73:34928) 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 -- 172.21.15.73:0/3203907526 learned_addr learned my addr 172.21.15.73:0/3203907526 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38db400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38dc0ca940 0x7f38dc1eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38daa00640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc153760 0x7f38dc0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 -- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc153760 msgr2=0x7f38dc0c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc153760 0x7f38dc0c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 -- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38dc0ca940 msgr2=0x7f38dc1eee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38dc0ca940 0x7f38dc1eee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 -- 172.21.15.73:0/3203907526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c8009400 con 0x7f38dc159420 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38daa00640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc153760 0x7f38dc0c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.678+0000 7f38dbe00640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc144b40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f38d400efc0 tx=0x7f38d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.679+0000 7f38d3400640 1 -- 172.21.15.73:0/3203907526 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4014480 con 0x7f38dc159420 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.679+0000 7f38d3400640 1 -- 172.21.15.73:0/3203907526 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d400f040 con 0x7f38dc159420 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.679+0000 7f38d3400640 1 -- 172.21.15.73:0/3203907526 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4014820 con 0x7f38dc159420 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.679+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc1ef7b0 con 0x7f38dc159420 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.679+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc1efd70 con 0x7f38dc159420 2024-03-23T06:10:39.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.680+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc146200 con 0x7f38dc159420 2024-03-23T06:10:39.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.681+0000 7f38d3400640 1 -- 172.21.15.73:0/3203907526 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f38d4014980 con 0x7f38dc159420 2024-03-23T06:10:39.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.682+0000 7f38d3400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f38bc06ac00 0x7f38bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:39.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.682+0000 7f38d3400640 1 -- 172.21.15.73:0/3203907526 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f38d408a300 con 0x7f38dc159420 2024-03-23T06:10:39.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.682+0000 7f38db400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f38bc06ac00 0x7f38bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:39.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.683+0000 7f38db400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f38bc06ac00 0x7f38bc06d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f38cc005880 tx=0x7f38cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:39.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.686+0000 7f38d3400640 1 -- 172.21.15.73:0/3203907526 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f38dc146200 con 0x7f38dc159420 2024-03-23T06:10:39.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.889+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38dc146200 con 0x7f38dc159420 2024-03-23T06:10:39.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.889+0000 7f38d3400640 1 -- 172.21.15.73:0/3203907526 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38dc146200 con 0x7f38dc159420 2024-03-23T06:10:39.889 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-23T06:10:39.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f38bc06ac00 msgr2=0x7f38bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f38bc06ac00 0x7f38bc06d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f38cc005880 tx=0x7f38cc009040 comp rx=0 tx=0).stop 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 msgr2=0x7f38dc144b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc144b40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f38d400efc0 tx=0x7f38d400c490 comp rx=0 tx=0).stop 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 shutdown_connections 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc159420 0x7f38dc144b40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f38bc06ac00 0x7f38bc06d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38dc153760 0x7f38dc0c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 --2- 172.21.15.73:0/3203907526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38dc0ca940 0x7f38dc1eee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 >> 172.21.15.73:0/3203907526 conn(0x7f38dc06c310 msgr2=0x7f38dc0c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.892+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 shutdown_connections 2024-03-23T06:10:39.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:39.893+0000 7f38e2400640 1 -- 172.21.15.73:0/3203907526 wait complete. 2024-03-23T06:10:39.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-23T06:10:40.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.116+0000 7fe17d000640 1 Processor -- start 2024-03-23T06:10:40.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.116+0000 7fe17d000640 1 -- start start 2024-03-23T06:10:40.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.117+0000 7fe17d000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe178071580 0x7fe178159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.117+0000 7fe17d000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17815d920 con 0x7fe1780ca4d0 2024-03-23T06:10:40.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.117+0000 7fe17d000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17815cac0 con 0x7fe1781536c0 2024-03-23T06:10:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.117+0000 7fe17d000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17815cd10 con 0x7fe178071580 2024-03-23T06:10:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe176800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe178071580 0x7fe178159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe175e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe1781536c0 0x7fe1780caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58600/0 (socket says 172.21.15.73:58600) 2024-03-23T06:10:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe175e00640 1 -- 172.21.15.73:0/1136278509 learned_addr learned my addr 172.21.15.73:0/1136278509 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe176800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe178071580 0x7fe178159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48344/0 (socket says 172.21.15.73:48344) 2024-03-23T06:10:40.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe16d400640 1 --1- 172.21.15.73:0/1136278509 >> v1:172.21.15.73:6789/0 conn(0x7fe1780ca4d0 0x7fe178070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38322/0 (socket says 172.21.15.73:38322) 2024-03-23T06:10:40.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe175400640 1 -- 172.21.15.73:0/1136278509 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635427946 0 0) 0x7fe17815cac0 con 0x7fe1781536c0 2024-03-23T06:10:40.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe175400640 1 -- 172.21.15.73:0/1136278509 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe15c003520 con 0x7fe1781536c0 2024-03-23T06:10:40.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe176800640 1 -- 172.21.15.73:0/1136278509 >> v1:172.21.15.110:6789/0 conn(0x7fe1781536c0 legacy=0x7fe1780caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe176800640 1 -- 172.21.15.73:0/1136278509 >> v1:172.21.15.73:6789/0 conn(0x7fe1780ca4d0 legacy=0x7fe178070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe175400640 1 -- 172.21.15.73:0/1136278509 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391278661 0 0) 0x7fe17815d920 con 0x7fe1780ca4d0 2024-03-23T06:10:40.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.118+0000 7fe176800640 1 -- 172.21.15.73:0/1136278509 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17815cff0 con 0x7fe178071580 2024-03-23T06:10:40.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.119+0000 7fe176800640 1 --2- 172.21.15.73:0/1136278509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe178071580 0x7fe178159f00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe170009d90 tx=0x7fe17002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fddecc906658f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:40.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.120+0000 7fe175400640 1 -- 172.21.15.73:0/1136278509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17002cd00 con 0x7fe178071580 2024-03-23T06:10:40.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.120+0000 7fe175400640 1 -- 172.21.15.73:0/1136278509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17002ce60 con 0x7fe178071580 2024-03-23T06:10:40.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.120+0000 7fe175400640 1 -- 172.21.15.73:0/1136278509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170034660 con 0x7fe178071580 2024-03-23T06:10:40.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.120+0000 7fe17d000640 1 -- 172.21.15.73:0/1136278509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe178071580 msgr2=0x7fe178159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.120+0000 7fe17d000640 1 --2- 172.21.15.73:0/1136278509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe178071580 0x7fe178159f00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe170009d90 tx=0x7fe17002bf50 comp rx=0 tx=0).stop 2024-03-23T06:10:40.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.120+0000 7fe17d000640 1 -- 172.21.15.73:0/1136278509 shutdown_connections 2024-03-23T06:10:40.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.120+0000 7fe17d000640 1 --2- 172.21.15.73:0/1136278509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe178071580 0x7fe178159f00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.121+0000 7fe17d000640 1 -- 172.21.15.73:0/1136278509 >> 172.21.15.73:0/1136278509 conn(0x7fe178069cb0 msgr2=0x7fe17806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:40.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.121+0000 7fe17d000640 1 -- 172.21.15.73:0/1136278509 shutdown_connections 2024-03-23T06:10:40.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.121+0000 7fe17d000640 1 -- 172.21.15.73:0/1136278509 wait complete. 2024-03-23T06:10:40.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.122+0000 7fe17d000640 1 Processor -- start 2024-03-23T06:10:40.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.122+0000 7fe17d000640 1 -- start start 2024-03-23T06:10:40.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.123+0000 7fe17d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178071580 0x7fe1780c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.123+0000 7fe17d000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1780ca4d0 0x7fe178159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.123+0000 7fe17d000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1781536c0 0x7fe1781587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.123+0000 7fe17d000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178158340 con 0x7fe1780ca4d0 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.123+0000 7fe17d000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780c3b80 con 0x7fe178071580 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.123+0000 7fe17d000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780c3e60 con 0x7fe1781536c0 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.123+0000 7fe16d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1780ca4d0 0x7fe178159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1780ca4d0 0x7fe178159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48356/0 (socket says 172.21.15.73:48356) 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16d400640 1 -- 172.21.15.73:0/730539027 learned_addr learned my addr 172.21.15.73:0/730539027 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe175e00640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178071580 0x7fe1780c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe176800640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1781536c0 0x7fe1781587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16d400640 1 -- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1781536c0 msgr2=0x7fe1781587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16d400640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1781536c0 0x7fe1781587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16d400640 1 -- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178071580 msgr2=0x7fe1780c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16d400640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178071580 0x7fe1780c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16d400640 1 -- 172.21.15.73:0/730539027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170009a70 con 0x7fe1780ca4d0 2024-03-23T06:10:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16d400640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1780ca4d0 0x7fe178159cf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c4d0 tx=0x7fe16000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16ea00640 1 -- 172.21.15.73:0/730539027 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600074e0 con 0x7fe1780ca4d0 2024-03-23T06:10:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe16ea00640 1 -- 172.21.15.73:0/730539027 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe160007660 con 0x7fe1780ca4d0 2024-03-23T06:10:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.124+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1780c4140 con 0x7fe1780ca4d0 2024-03-23T06:10:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.125+0000 7fe16ea00640 1 -- 172.21.15.73:0/730539027 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160004a20 con 0x7fe1780ca4d0 2024-03-23T06:10:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.125+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780c3860 con 0x7fe1780ca4d0 2024-03-23T06:10:40.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.126+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17804e110 con 0x7fe1780ca4d0 2024-03-23T06:10:40.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.127+0000 7fe16ea00640 1 -- 172.21.15.73:0/730539027 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe160004b80 con 0x7fe1780ca4d0 2024-03-23T06:10:40.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.128+0000 7fe16ea00640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe15406ac00 0x7fe15406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.128+0000 7fe16ea00640 1 -- 172.21.15.73:0/730539027 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe160088c10 con 0x7fe1780ca4d0 2024-03-23T06:10:40.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.128+0000 7fe175e00640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe15406ac00 0x7fe15406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.129+0000 7fe175e00640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe15406ac00 0x7fe15406d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1680011e0 tx=0x7fe168007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:40.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.132+0000 7fe16ea00640 1 -- 172.21.15.73:0/730539027 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe160053a90 con 0x7fe1780ca4d0 2024-03-23T06:10:40.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.324+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe1780c9a10 con 0x7fe1780ca4d0 2024-03-23T06:10:40.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.325+0000 7fe16ea00640 1 -- 172.21.15.73:0/730539027 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe160018020 con 0x7fe1780ca4d0 2024-03-23T06:10:40.325 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:40.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.327+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe15406ac00 msgr2=0x7fe15406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.327+0000 7fe17d000640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe15406ac00 0x7fe15406d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1680011e0 tx=0x7fe168007d30 comp rx=0 tx=0).stop 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.327+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1780ca4d0 msgr2=0x7fe178159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.327+0000 7fe17d000640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1780ca4d0 0x7fe178159cf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c4d0 tx=0x7fe16000c990 comp rx=0 tx=0).stop 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.328+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 shutdown_connections 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.328+0000 7fe17d000640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe15406ac00 0x7fe15406d0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.328+0000 7fe17d000640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1781536c0 0x7fe1781587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.328+0000 7fe17d000640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1780ca4d0 0x7fe178159cf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.328+0000 7fe17d000640 1 --2- 172.21.15.73:0/730539027 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe178071580 0x7fe1780c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.328+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 >> 172.21.15.73:0/730539027 conn(0x7fe178069cb0 msgr2=0x7fe17814fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.328+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 shutdown_connections 2024-03-23T06:10:40.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.328+0000 7fe17d000640 1 -- 172.21.15.73:0/730539027 wait complete. 2024-03-23T06:10:40.347 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:10:40.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.556+0000 7fcfeb200640 1 Processor -- start 2024-03-23T06:10:40.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.556+0000 7fcfeb200640 1 -- start start 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.557+0000 7fcfeb200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfe40c5a10 0x7fcfe40bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.557+0000 7fcfeb200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfe40c03a0 0x7fcfe4071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfeb200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe4157b60 con 0x7fcfe41513f0 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfeb200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe4158dc0 con 0x7fcfe40c5a10 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfeb200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe40c0830 con 0x7fcfe40c03a0 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfe40c5a10 0x7fcfe40bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe9200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfe40c03a0 0x7fcfe4071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcfe41513f0 0x7fcfe41586b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58612/0 (socket says 172.21.15.73:58612) 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe3e00640 1 -- 172.21.15.73:0/2516200488 learned_addr learned my addr 172.21.15.73:0/2516200488 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:40.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe3400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfe40c5a10 0x7fcfe40bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48370/0 (socket says 172.21.15.73:48370) 2024-03-23T06:10:40.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe2a00640 1 -- 172.21.15.73:0/2516200488 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153528342 0 0) 0x7fcfe4157b60 con 0x7fcfe41513f0 2024-03-23T06:10:40.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe9200640 1 -- 172.21.15.73:0/2516200488 >> v2:172.21.15.73:3300/0 conn(0x7fcfe40c5a10 msgr2=0x7fcfe40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:40.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe9200640 1 --2- 172.21.15.73:0/2516200488 >> v2:172.21.15.73:3300/0 conn(0x7fcfe40c5a10 0x7fcfe40bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe9200640 1 -- 172.21.15.73:0/2516200488 >> v1:172.21.15.110:6789/0 conn(0x7fcfe41513f0 legacy=0x7fcfe41586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.558+0000 7fcfe9200640 1 -- 172.21.15.73:0/2516200488 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40c0b10 con 0x7fcfe40c03a0 2024-03-23T06:10:40.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfe9200640 1 --2- 172.21.15.73:0/2516200488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe40c03a0 0x7fcfe4071bc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4066590 tx=0x7fcfdc02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6688b80199afa65a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:40.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfe2a00640 1 -- 172.21.15.73:0/2516200488 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc02cd00 con 0x7fcfe40c03a0 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfe2a00640 1 -- 172.21.15.73:0/2516200488 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfdc02ce60 con 0x7fcfe40c03a0 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfe2a00640 1 -- 172.21.15.73:0/2516200488 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc034660 con 0x7fcfe40c03a0 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfeb200640 1 -- 172.21.15.73:0/2516200488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe40c03a0 msgr2=0x7fcfe4071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfeb200640 1 --2- 172.21.15.73:0/2516200488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe40c03a0 0x7fcfe4071bc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4066590 tx=0x7fcfdc02bf50 comp rx=0 tx=0).stop 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfeb200640 1 -- 172.21.15.73:0/2516200488 shutdown_connections 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfeb200640 1 --2- 172.21.15.73:0/2516200488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe40c03a0 0x7fcfe4071bc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfeb200640 1 --2- 172.21.15.73:0/2516200488 >> v2:172.21.15.73:3300/0 conn(0x7fcfe40c5a10 0x7fcfe40bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.560+0000 7fcfeb200640 1 -- 172.21.15.73:0/2516200488 >> 172.21.15.73:0/2516200488 conn(0x7fcfe406bb40 msgr2=0x7fcfe406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.561+0000 7fcfeb200640 1 -- 172.21.15.73:0/2516200488 shutdown_connections 2024-03-23T06:10:40.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.561+0000 7fcfeb200640 1 -- 172.21.15.73:0/2516200488 wait complete. 2024-03-23T06:10:40.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.562+0000 7fcfeb200640 1 Processor -- start 2024-03-23T06:10:40.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.562+0000 7fcfeb200640 1 -- start start 2024-03-23T06:10:40.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.563+0000 7fcfeb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfe40c5a10 0x7fcfe4071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.563+0000 7fcfeb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe41513f0 0x7fcfe40c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.563+0000 7fcfeb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe41527e0 0x7fcfe41f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.563+0000 7fcfeb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40c94e0 con 0x7fcfe40c5a10 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.563+0000 7fcfeb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40ca9d0 con 0x7fcfe41513f0 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.563+0000 7fcfeb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40c9200 con 0x7fcfe41527e0 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.563+0000 7fcfe3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfe40c5a10 0x7fcfe4071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfe40c5a10 0x7fcfe4071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48372/0 (socket says 172.21.15.73:48372) 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3e00640 1 -- 172.21.15.73:0/377364149 learned_addr learned my addr 172.21.15.73:0/377364149 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3400640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe41513f0 0x7fcfe40c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe9200640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe41527e0 0x7fcfe41f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3e00640 1 -- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe41527e0 msgr2=0x7fcfe41f0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3e00640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe41527e0 0x7fcfe41f0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3e00640 1 -- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe41513f0 msgr2=0x7fcfe40c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3e00640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe41513f0 0x7fcfe40c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3e00640 1 -- 172.21.15.73:0/377364149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc009a70 con 0x7fcfe40c5a10 2024-03-23T06:10:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfe3e00640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfe40c5a10 0x7fcfe4071e30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c4d0 tx=0x7fcfd400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.564+0000 7fcfdbe00640 1 -- 172.21.15.73:0/377364149 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd40074e0 con 0x7fcfe40c5a10 2024-03-23T06:10:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.565+0000 7fcfdbe00640 1 -- 172.21.15.73:0/377364149 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd4007660 con 0x7fcfe40c5a10 2024-03-23T06:10:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.565+0000 7fcfdbe00640 1 -- 172.21.15.73:0/377364149 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4004a20 con 0x7fcfe40c5a10 2024-03-23T06:10:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.565+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe40cac40 con 0x7fcfe40c5a10 2024-03-23T06:10:40.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.565+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe40cb200 con 0x7fcfe40c5a10 2024-03-23T06:10:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.566+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe40c1100 con 0x7fcfe40c5a10 2024-03-23T06:10:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.567+0000 7fcfdbe00640 1 -- 172.21.15.73:0/377364149 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcfd4004b80 con 0x7fcfe40c5a10 2024-03-23T06:10:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.568+0000 7fcfdbe00640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfc406ac00 0x7fcfc406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:40.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.568+0000 7fcfdbe00640 1 -- 172.21.15.73:0/377364149 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fcfd4088930 con 0x7fcfe40c5a10 2024-03-23T06:10:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.568+0000 7fcfe3400640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfc406ac00 0x7fcfc406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:40.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.569+0000 7fcfe3400640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfc406ac00 0x7fcfc406d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4156ef0 tx=0x7fcfd0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:40.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.572+0000 7fcfdbe00640 1 -- 172.21.15.73:0/377364149 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fcfd4053720 con 0x7fcfe40c5a10 2024-03-23T06:10:40.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.811+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfe404e110 con 0x7fcfe40c5a10 2024-03-23T06:10:40.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.811+0000 7fcfdbe00640 1 -- 172.21.15.73:0/377364149 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6280 (secure 0 0 0) 0x7fcfd4018020 con 0x7fcfe40c5a10 2024-03-23T06:10:40.812 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:40.812 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:39.659193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4256,"mds_2":4253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4256":{"gid":4256,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:10:40.812 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfc406ac00 msgr2=0x7fcfc406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfc406ac00 0x7fcfc406d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4156ef0 tx=0x7fcfd0009190 comp rx=0 tx=0).stop 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfe40c5a10 msgr2=0x7fcfe4071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfe40c5a10 0x7fcfe4071e30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c4d0 tx=0x7fcfd400c990 comp rx=0 tx=0).stop 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 shutdown_connections 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfc406ac00 0x7fcfc406d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe41527e0 0x7fcfe41f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe41513f0 0x7fcfe40c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 --2- 172.21.15.73:0/377364149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfe40c5a10 0x7fcfe4071e30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 >> 172.21.15.73:0/377364149 conn(0x7fcfe406bb40 msgr2=0x7fcfe40c7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:40.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 shutdown_connections 2024-03-23T06:10:40.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:40.815+0000 7fcfeb200640 1 -- 172.21.15.73:0/377364149 wait complete. 2024-03-23T06:10:40.832 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:41.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.036+0000 7f159ea00640 1 Processor -- start 2024-03-23T06:10:41.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.036+0000 7f159ea00640 1 -- start start 2024-03-23T06:10:41.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.038+0000 7f159ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981536a0 0x7f15980ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.038+0000 7f159ea00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15980cab20 con 0x7f15981594f0 2024-03-23T06:10:41.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.038+0000 7f159ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15981599a0 con 0x7f1598153a80 2024-03-23T06:10:41.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.038+0000 7f159ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159815a520 con 0x7f15981536a0 2024-03-23T06:10:41.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.038+0000 7f1597400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1598153a80 0x7f15980cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58618/0 (socket says 172.21.15.73:58618) 2024-03-23T06:10:41.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.038+0000 7f1597400640 1 -- 172.21.15.73:0/870472470 learned_addr learned my addr 172.21.15.73:0/870472470 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:41.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.038+0000 7f1597e00640 1 --2- 172.21.15.73:0/870472470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981536a0 0x7f15980ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.039+0000 7f1596a00640 1 -- 172.21.15.73:0/870472470 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160465264 0 0) 0x7f15981599a0 con 0x7f1598153a80 2024-03-23T06:10:41.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.039+0000 7f1596a00640 1 -- 172.21.15.73:0/870472470 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f157c003520 con 0x7f1598153a80 2024-03-23T06:10:41.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.039+0000 7f1596a00640 1 -- 172.21.15.73:0/870472470 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158115733 0 0) 0x7f15980cab20 con 0x7f15981594f0 2024-03-23T06:10:41.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.039+0000 7f1596a00640 1 -- 172.21.15.73:0/870472470 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15981599a0 con 0x7f15981594f0 2024-03-23T06:10:41.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.039+0000 7f1597e00640 1 -- 172.21.15.73:0/870472470 >> v1:172.21.15.110:6789/0 conn(0x7f1598153a80 legacy=0x7f15980cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.039+0000 7f1597e00640 1 -- 172.21.15.73:0/870472470 >> v1:172.21.15.73:6789/0 conn(0x7f15981594f0 legacy=0x7f15980cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.039+0000 7f1597e00640 1 -- 172.21.15.73:0/870472470 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1598159c80 con 0x7f15981536a0 2024-03-23T06:10:41.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.040+0000 7f1597e00640 1 --2- 172.21.15.73:0/870472470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981536a0 0x7f15980ca5e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1588009dc0 tx=0x7f158802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c5b1ede9324d144 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.040+0000 7f1596a00640 1 -- 172.21.15.73:0/870472470 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158802ccd0 con 0x7f15981536a0 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.040+0000 7f1596a00640 1 -- 172.21.15.73:0/870472470 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158802ce30 con 0x7f15981536a0 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.040+0000 7f1596a00640 1 -- 172.21.15.73:0/870472470 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588034660 con 0x7f15981536a0 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.041+0000 7f159ea00640 1 -- 172.21.15.73:0/870472470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981536a0 msgr2=0x7f15980ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.041+0000 7f159ea00640 1 --2- 172.21.15.73:0/870472470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981536a0 0x7f15980ca5e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1588009dc0 tx=0x7f158802bf20 comp rx=0 tx=0).stop 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.041+0000 7f159ea00640 1 -- 172.21.15.73:0/870472470 shutdown_connections 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.041+0000 7f159ea00640 1 --2- 172.21.15.73:0/870472470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981536a0 0x7f15980ca5e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.041+0000 7f159ea00640 1 -- 172.21.15.73:0/870472470 >> 172.21.15.73:0/870472470 conn(0x7f159806a060 msgr2=0x7f159806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.041+0000 7f159ea00640 1 -- 172.21.15.73:0/870472470 shutdown_connections 2024-03-23T06:10:41.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.041+0000 7f159ea00640 1 -- 172.21.15.73:0/870472470 wait complete. 2024-03-23T06:10:41.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.043+0000 7f159ea00640 1 Processor -- start 2024-03-23T06:10:41.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.043+0000 7f159ea00640 1 -- start start 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f159ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15981536a0 0x7f15981f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f159ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598153a80 0x7f1598155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f159ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981594f0 0x7f1598153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f159ea00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598155bc0 con 0x7f1598153a80 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f159ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598147690 con 0x7f15981536a0 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f159ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1598147ba0 con 0x7f15981594f0 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15981536a0 0x7f15981f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598153a80 0x7f1598155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15981536a0 0x7f15981f2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:47174/0 (socket says 172.21.15.73:47174) 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597e00640 1 -- 172.21.15.73:0/3532708858 learned_addr learned my addr 172.21.15.73:0/3532708858 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f159ca00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981594f0 0x7f1598153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597e00640 1 -- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981594f0 msgr2=0x7f1598153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597e00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981594f0 0x7f1598153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597e00640 1 -- 172.21.15.73:0/3532708858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598153a80 msgr2=0x7f1598155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597e00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598153a80 0x7f1598155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597e00640 1 -- 172.21.15.73:0/3532708858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1588009a70 con 0x7f15981536a0 2024-03-23T06:10:41.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.044+0000 7f1597400640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598153a80 0x7f1598155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:41.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.045+0000 7f1597e00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15981536a0 0x7f15981f2260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1588000f80 tx=0x7f1588004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.045+0000 7f158fe00640 1 -- 172.21.15.73:0/3532708858 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158803d600 con 0x7f15981536a0 2024-03-23T06:10:41.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.045+0000 7f158fe00640 1 -- 172.21.15.73:0/3532708858 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158803d760 con 0x7f15981536a0 2024-03-23T06:10:41.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.045+0000 7f158fe00640 1 -- 172.21.15.73:0/3532708858 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158803db10 con 0x7f15981536a0 2024-03-23T06:10:41.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.045+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1598154f10 con 0x7f15981536a0 2024-03-23T06:10:41.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.045+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15981551f0 con 0x7f15981536a0 2024-03-23T06:10:41.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.046+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1598073280 con 0x7f15981536a0 2024-03-23T06:10:41.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.047+0000 7f158fe00640 1 -- 172.21.15.73:0/3532708858 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f158803b040 con 0x7f15981536a0 2024-03-23T06:10:41.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.048+0000 7f158fe00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f157406ac30 0x7f157406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.048+0000 7f158fe00640 1 -- 172.21.15.73:0/3532708858 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f15880ab370 con 0x7f15981536a0 2024-03-23T06:10:41.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.048+0000 7f1597400640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f157406ac30 0x7f157406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.049+0000 7f1597400640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f157406ac30 0x7f157406d0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1598154cd0 tx=0x7f1580007d70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.052+0000 7f158fe00640 1 -- 172.21.15.73:0/3532708858 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f15880761f0 con 0x7f15981536a0 2024-03-23T06:10:41.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.250+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15980c9810 con 0x7f15981536a0 2024-03-23T06:10:41.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.251+0000 7f158fe00640 1 -- 172.21.15.73:0/3532708858 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18088 (secure 0 0 0) 0x7f1588009450 con 0x7f15981536a0 2024-03-23T06:10:41.252 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:41.252 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:39.659625+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2},{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f157406ac30 msgr2=0x7f157406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f157406ac30 0x7f157406d0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1598154cd0 tx=0x7f1580007d70 comp rx=0 tx=0).stop 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15981536a0 msgr2=0x7f15981f2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15981536a0 0x7f15981f2260 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1588000f80 tx=0x7f1588004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 shutdown_connections 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f157406ac30 0x7f157406d0f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15981594f0 0x7f1598153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1598153a80 0x7f1598155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 --2- 172.21.15.73:0/3532708858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15981536a0 0x7f15981f2260 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 >> 172.21.15.73:0/3532708858 conn(0x7f159806a060 msgr2=0x7f1598157150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 shutdown_connections 2024-03-23T06:10:41.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.254+0000 7f159ea00640 1 -- 172.21.15.73:0/3532708858 wait complete. 2024-03-23T06:10:41.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T06:09:56.066381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T06:09:56.917187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-23T06:09:59.981596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-23T06:10:41.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:10:41.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.486+0000 7f5295800640 1 Processor -- start 2024-03-23T06:10:41.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.486+0000 7f5295800640 1 -- start start 2024-03-23T06:10:41.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f5295800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f52900cb050 0x7f52900c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f5295800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52900c9c80 con 0x7f5290153760 2024-03-23T06:10:41.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f5295800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529006a2d0 con 0x7f5290159420 2024-03-23T06:10:41.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f5295800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5290159860 con 0x7f52900cb050 2024-03-23T06:10:41.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f528ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5290153760 0x7f52900cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38344/0 (socket says 172.21.15.73:38344) 2024-03-23T06:10:41.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f528ea00640 1 -- 172.21.15.73:0/2531236723 learned_addr learned my addr 172.21.15.73:0/2531236723 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:41.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f528f400640 1 --2- 172.21.15.73:0/2531236723 >> v2:172.21.15.110:3300/0 conn(0x7f52900cb050 0x7f52900c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f528d600640 1 -- 172.21.15.73:0/2531236723 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972309969 0 0) 0x7f5280001110 con 0x7f5290153760 2024-03-23T06:10:41.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f528d600640 1 -- 172.21.15.73:0/2531236723 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5270003520 con 0x7f5290153760 2024-03-23T06:10:41.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f528d600640 1 -- 172.21.15.73:0/2531236723 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061004082 0 0) 0x7f529006a2d0 con 0x7f5290159420 2024-03-23T06:10:41.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f528d600640 1 -- 172.21.15.73:0/2531236723 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5280001110 con 0x7f5290159420 2024-03-23T06:10:41.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.488+0000 7f528f400640 1 -- 172.21.15.73:0/2531236723 >> v1:172.21.15.110:6789/0 conn(0x7f5290159420 legacy=0x7f52900ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.489+0000 7f528f400640 1 -- 172.21.15.73:0/2531236723 >> v1:172.21.15.73:6789/0 conn(0x7f5290153760 legacy=0x7f52900cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.489+0000 7f528f400640 1 -- 172.21.15.73:0/2531236723 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529006a5b0 con 0x7f52900cb050 2024-03-23T06:10:41.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.490+0000 7f528f400640 1 --2- 172.21.15.73:0/2531236723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 0x7f52900c9740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f52880097a0 tx=0x7f528802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e08ba1105f7c72 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.490+0000 7f528d600640 1 -- 172.21.15.73:0/2531236723 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288030610 con 0x7f52900cb050 2024-03-23T06:10:41.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.490+0000 7f528d600640 1 -- 172.21.15.73:0/2531236723 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5288030770 con 0x7f52900cb050 2024-03-23T06:10:41.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.490+0000 7f528d600640 1 -- 172.21.15.73:0/2531236723 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288030ae0 con 0x7f52900cb050 2024-03-23T06:10:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.491+0000 7f5295800640 1 -- 172.21.15.73:0/2531236723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 msgr2=0x7f52900c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.491+0000 7f5295800640 1 --2- 172.21.15.73:0/2531236723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 0x7f52900c9740 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f52880097a0 tx=0x7f528802b960 comp rx=0 tx=0).stop 2024-03-23T06:10:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.491+0000 7f5295800640 1 -- 172.21.15.73:0/2531236723 shutdown_connections 2024-03-23T06:10:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.491+0000 7f5295800640 1 --2- 172.21.15.73:0/2531236723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 0x7f52900c9740 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.491+0000 7f5295800640 1 -- 172.21.15.73:0/2531236723 >> 172.21.15.73:0/2531236723 conn(0x7f529006c310 msgr2=0x7f52900713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.491+0000 7f5295800640 1 -- 172.21.15.73:0/2531236723 shutdown_connections 2024-03-23T06:10:41.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.491+0000 7f5295800640 1 -- 172.21.15.73:0/2531236723 wait complete. 2024-03-23T06:10:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.492+0000 7f5295800640 1 Processor -- start 2024-03-23T06:10:41.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.493+0000 7f5295800640 1 -- start start 2024-03-23T06:10:41.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f5295800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 0x7f52901503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f5295800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5290153760 0x7f52901f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f5295800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5290159420 0x7f52900c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f5295800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529014e740 con 0x7f5290153760 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f5295800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529014ff10 con 0x7f52900cb050 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f5295800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52900c8b00 con 0x7f5290159420 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5290153760 0x7f52901f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5290159420 0x7f52900c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 0x7f52901503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5290153760 0x7f52901f2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48388/0 (socket says 172.21.15.73:48388) 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528e000640 1 -- 172.21.15.73:0/644750274 learned_addr learned my addr 172.21.15.73:0/644750274 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528e000640 1 -- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5290159420 msgr2=0x7f52900c61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528e000640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5290159420 0x7f52900c61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528e000640 1 -- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 msgr2=0x7f52901503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528e000640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 0x7f52901503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.494+0000 7f528e000640 1 -- 172.21.15.73:0/644750274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5288009400 con 0x7f5290153760 2024-03-23T06:10:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.495+0000 7f528e000640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5290153760 0x7f52901f2080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f527800c7a0 tx=0x7f527800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.495+0000 7f5286a00640 1 -- 172.21.15.73:0/644750274 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278003b70 con 0x7f5290153760 2024-03-23T06:10:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.495+0000 7f5286a00640 1 -- 172.21.15.73:0/644750274 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278003cf0 con 0x7f5290153760 2024-03-23T06:10:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.495+0000 7f5286a00640 1 -- 172.21.15.73:0/644750274 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800aa30 con 0x7f5290153760 2024-03-23T06:10:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.495+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52900c8da0 con 0x7f5290153760 2024-03-23T06:10:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.495+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529014fba0 con 0x7f5290153760 2024-03-23T06:10:41.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.496+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5290150080 con 0x7f5290153760 2024-03-23T06:10:41.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.497+0000 7f5286a00640 1 -- 172.21.15.73:0/644750274 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f527800ab90 con 0x7f5290153760 2024-03-23T06:10:41.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.498+0000 7f5286a00640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f526c06ac00 0x7f526c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.498+0000 7f5286a00640 1 -- 172.21.15.73:0/644750274 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5278089490 con 0x7f5290153760 2024-03-23T06:10:41.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.499+0000 7f528ea00640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f526c06ac00 0x7f526c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.499+0000 7f528ea00640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f526c06ac00 0x7f526c06d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5280000f60 tx=0x7f5280007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.502+0000 7f5286a00640 1 -- 172.21.15.73:0/644750274 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f5278054310 con 0x7f5290153760 2024-03-23T06:10:41.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.697+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5290150910 con 0x7f5290153760 2024-03-23T06:10:41.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.698+0000 7f5286a00640 1 -- 172.21.15.73:0/644750274 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5278003e60 con 0x7f5290153760 2024-03-23T06:10:41.698 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f526c06ac00 msgr2=0x7f526c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f526c06ac00 0x7f526c06d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5280000f60 tx=0x7f5280007d30 comp rx=0 tx=0).stop 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5290153760 msgr2=0x7f52901f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5290153760 0x7f52901f2080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f527800c7a0 tx=0x7f527800cc60 comp rx=0 tx=0).stop 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 shutdown_connections 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f526c06ac00 0x7f526c06d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5290159420 0x7f52900c61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5290153760 0x7f52901f2080 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 --2- 172.21.15.73:0/644750274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52900cb050 0x7f52901503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 >> 172.21.15.73:0/644750274 conn(0x7f529006c310 msgr2=0x7f5290158240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:41.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 shutdown_connections 2024-03-23T06:10:41.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.701+0000 7f5295800640 1 -- 172.21.15.73:0/644750274 wait complete. 2024-03-23T06:10:41.718 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T06:10:41.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.918+0000 7f1e47e00640 1 Processor -- start 2024-03-23T06:10:41.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.918+0000 7f1e47e00640 1 -- start start 2024-03-23T06:10:41.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.919+0000 7f1e47e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e480c0f00 0x7f1e48156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.919+0000 7f1e47e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e480c12e0 0x7f1e480c6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.919+0000 7f1e47e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e480c2df0 con 0x7f1e480c7130 2024-03-23T06:10:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.919+0000 7f1e47e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e480c6e60 con 0x7f1e480c12e0 2024-03-23T06:10:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.919+0000 7f1e47e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e480c4fa0 con 0x7f1e480c0f00 2024-03-23T06:10:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e46000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1e480c12e0 0x7f1e480c6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e46a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e480c0f00 0x7f1e48156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e47400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1e480c7130 0x7f1e480c3260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38360/0 (socket says 172.21.15.73:38360) 2024-03-23T06:10:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e47400640 1 -- 172.21.15.73:0/3826482644 learned_addr learned my addr 172.21.15.73:0/3826482644 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:41.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e46a00640 1 -- 172.21.15.73:0/3826482644 >> v2:172.21.15.73:3300/0 conn(0x7f1e480c12e0 msgr2=0x7f1e480c6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e46a00640 1 --2- 172.21.15.73:0/3826482644 >> v2:172.21.15.73:3300/0 conn(0x7f1e480c12e0 0x7f1e480c6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e45600640 1 -- 172.21.15.73:0/3826482644 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457698732 0 0) 0x7f1e480c2df0 con 0x7f1e480c7130 2024-03-23T06:10:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e46a00640 1 -- 172.21.15.73:0/3826482644 >> v1:172.21.15.73:6789/0 conn(0x7f1e480c7130 legacy=0x7f1e480c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e46a00640 1 -- 172.21.15.73:0/3826482644 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480c5260 con 0x7f1e480c0f00 2024-03-23T06:10:41.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.920+0000 7f1e46000640 1 --2- 172.21.15.73:0/3826482644 >> v2:172.21.15.73:3300/0 conn(0x7f1e480c12e0 0x7f1e480c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:41.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.922+0000 7f1e46a00640 1 --2- 172.21.15.73:0/3826482644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e48156d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e4806de40 tx=0x7f1e3802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e1da3323f48a49 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.922+0000 7f1e45600640 1 -- 172.21.15.73:0/3826482644 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38030610 con 0x7f1e480c0f00 2024-03-23T06:10:41.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.922+0000 7f1e45600640 1 -- 172.21.15.73:0/3826482644 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e38030770 con 0x7f1e480c0f00 2024-03-23T06:10:41.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.922+0000 7f1e45600640 1 -- 172.21.15.73:0/3826482644 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38030b00 con 0x7f1e480c0f00 2024-03-23T06:10:41.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.922+0000 7f1e47e00640 1 -- 172.21.15.73:0/3826482644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 msgr2=0x7f1e48156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.922+0000 7f1e47e00640 1 --2- 172.21.15.73:0/3826482644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e48156d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e4806de40 tx=0x7f1e3802b960 comp rx=0 tx=0).stop 2024-03-23T06:10:41.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.922+0000 7f1e47e00640 1 -- 172.21.15.73:0/3826482644 shutdown_connections 2024-03-23T06:10:41.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.923+0000 7f1e47e00640 1 --2- 172.21.15.73:0/3826482644 >> v2:172.21.15.73:3300/0 conn(0x7f1e480c12e0 0x7f1e480c6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.923+0000 7f1e47e00640 1 --2- 172.21.15.73:0/3826482644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e48156d50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.923+0000 7f1e47e00640 1 -- 172.21.15.73:0/3826482644 >> 172.21.15.73:0/3826482644 conn(0x7f1e48069cb0 msgr2=0x7f1e4806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:41.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.923+0000 7f1e47e00640 1 -- 172.21.15.73:0/3826482644 shutdown_connections 2024-03-23T06:10:41.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.923+0000 7f1e47e00640 1 -- 172.21.15.73:0/3826482644 wait complete. 2024-03-23T06:10:41.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.924+0000 7f1e47e00640 1 Processor -- start 2024-03-23T06:10:41.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.924+0000 7f1e47e00640 1 -- start start 2024-03-23T06:10:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.925+0000 7f1e47e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e4813ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.925+0000 7f1e47e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e480c12e0 0x7f1e4813d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.925+0000 7f1e47e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e480c7130 0x7f1e480bfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.925+0000 7f1e47e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4813c150 con 0x7f1e480c7130 2024-03-23T06:10:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.925+0000 7f1e47e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e481f0db0 con 0x7f1e480c0f00 2024-03-23T06:10:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.925+0000 7f1e47e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e481f0850 con 0x7f1e480c12e0 2024-03-23T06:10:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e4813ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e47400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e480c7130 0x7f1e480bfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e4813ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:47212/0 (socket says 172.21.15.73:47212) 2024-03-23T06:10:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 -- 172.21.15.73:0/55960772 learned_addr learned my addr 172.21.15.73:0/55960772 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46000640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e480c12e0 0x7f1e4813d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 -- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e480c12e0 msgr2=0x7f1e4813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e480c12e0 0x7f1e4813d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 -- 172.21.15.73:0/55960772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e480c7130 msgr2=0x7f1e480bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e480c7130 0x7f1e480bfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 -- 172.21.15.73:0/55960772 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34009400 con 0x7f1e480c0f00 2024-03-23T06:10:41.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e47400640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e480c7130 0x7f1e480bfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.926+0000 7f1e46a00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e4813ae90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009890 tx=0x7f1e380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.927+0000 7f1e3f400640 1 -- 172.21.15.73:0/55960772 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3803f070 con 0x7f1e480c0f00 2024-03-23T06:10:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.927+0000 7f1e3f400640 1 -- 172.21.15.73:0/55960772 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e38006e10 con 0x7f1e480c0f00 2024-03-23T06:10:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.927+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e38009400 con 0x7f1e480c0f00 2024-03-23T06:10:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.927+0000 7f1e3f400640 1 -- 172.21.15.73:0/55960772 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38004250 con 0x7f1e480c0f00 2024-03-23T06:10:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.927+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e481f0ad0 con 0x7f1e480c0f00 2024-03-23T06:10:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.928+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e480c6fa0 con 0x7f1e480c0f00 2024-03-23T06:10:41.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.929+0000 7f1e3f400640 1 -- 172.21.15.73:0/55960772 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1e38043070 con 0x7f1e480c0f00 2024-03-23T06:10:41.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.930+0000 7f1e3f400640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e2806ac00 0x7f1e2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:41.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.930+0000 7f1e3f400640 1 -- 172.21.15.73:0/55960772 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1e380ab3a0 con 0x7f1e480c0f00 2024-03-23T06:10:41.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.930+0000 7f1e46000640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e2806ac00 0x7f1e2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:41.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.931+0000 7f1e46000640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e2806ac00 0x7f1e2806d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e4814a010 tx=0x7f1e34009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:41.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:41.935+0000 7f1e3f400640 1 -- 172.21.15.73:0/55960772 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1e38076340 con 0x7f1e480c0f00 2024-03-23T06:10:42.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.134+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e4813a250 con 0x7f1e480c0f00 2024-03-23T06:10:42.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.135+0000 7f1e3f400640 1 -- 172.21.15.73:0/55960772 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e4813a250 con 0x7f1e480c0f00 2024-03-23T06:10:42.135 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:42.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e2806ac00 msgr2=0x7f1e2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e2806ac00 0x7f1e2806d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1e4814a010 tx=0x7f1e34009190 comp rx=0 tx=0).stop 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 msgr2=0x7f1e4813ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e4813ae90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009890 tx=0x7f1e380046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 shutdown_connections 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e480c7130 0x7f1e480bfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e2806ac00 0x7f1e2806d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e480c12e0 0x7f1e4813d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 --2- 172.21.15.73:0/55960772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e480c0f00 0x7f1e4813ae90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.138+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 >> 172.21.15.73:0/55960772 conn(0x7f1e48069cb0 msgr2=0x7f1e4806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.139+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 shutdown_connections 2024-03-23T06:10:42.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.139+0000 7f1e47e00640 1 -- 172.21.15.73:0/55960772 wait complete. 2024-03-23T06:10:42.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T06:10:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.356+0000 7fb671a00640 1 Processor -- start 2024-03-23T06:10:42.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.356+0000 7fb671a00640 1 -- start start 2024-03-23T06:10:42.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb671a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb66c159d00 0x7fb66c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb671a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c15b710 con 0x7fb66c151480 2024-03-23T06:10:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb671a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c15ab90 con 0x7fb66c157e60 2024-03-23T06:10:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb671a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c1588d0 con 0x7fb66c159d00 2024-03-23T06:10:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb66aa00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb66c151480 0x7fb66c0c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38370/0 (socket says 172.21.15.73:38370) 2024-03-23T06:10:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb66aa00640 1 -- 172.21.15.73:0/2711112569 learned_addr learned my addr 172.21.15.73:0/2711112569 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb66b400640 1 --2- 172.21.15.73:0/2711112569 >> v2:172.21.15.110:3300/0 conn(0x7fb66c159d00 0x7fb66c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb66b400640 1 -- 172.21.15.73:0/2711112569 >> v1:172.21.15.110:6789/0 conn(0x7fb66c157e60 legacy=0x7fb66c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb66b400640 1 -- 172.21.15.73:0/2711112569 >> v1:172.21.15.73:6789/0 conn(0x7fb66c151480 legacy=0x7fb66c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb66b400640 1 -- 172.21.15.73:0/2711112569 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c15ae70 con 0x7fb66c159d00 2024-03-23T06:10:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.358+0000 7fb66a000640 1 -- 172.21.15.73:0/2711112569 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710452373 0 0) 0x7fb66c15b710 con 0x7fb66c151480 2024-03-23T06:10:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.360+0000 7fb66b400640 1 --2- 172.21.15.73:0/2711112569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 0x7fb66c15a170 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb664009d90 tx=0x7fb66402bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c40446e6d9aaed9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:42.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.360+0000 7fb66a000640 1 -- 172.21.15.73:0/2711112569 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66402cd80 con 0x7fb66c159d00 2024-03-23T06:10:42.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.360+0000 7fb66a000640 1 -- 172.21.15.73:0/2711112569 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb664034440 con 0x7fb66c159d00 2024-03-23T06:10:42.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.360+0000 7fb66a000640 1 -- 172.21.15.73:0/2711112569 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640347d0 con 0x7fb66c159d00 2024-03-23T06:10:42.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.360+0000 7fb671a00640 1 -- 172.21.15.73:0/2711112569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 msgr2=0x7fb66c15a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.360+0000 7fb671a00640 1 --2- 172.21.15.73:0/2711112569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 0x7fb66c15a170 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb664009d90 tx=0x7fb66402bfd0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.361+0000 7fb671a00640 1 -- 172.21.15.73:0/2711112569 shutdown_connections 2024-03-23T06:10:42.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.361+0000 7fb671a00640 1 --2- 172.21.15.73:0/2711112569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 0x7fb66c15a170 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.361+0000 7fb671a00640 1 -- 172.21.15.73:0/2711112569 >> 172.21.15.73:0/2711112569 conn(0x7fb66c069cb0 msgr2=0x7fb66c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:42.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.361+0000 7fb671a00640 1 -- 172.21.15.73:0/2711112569 shutdown_connections 2024-03-23T06:10:42.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.361+0000 7fb671a00640 1 -- 172.21.15.73:0/2711112569 wait complete. 2024-03-23T06:10:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.362+0000 7fb671a00640 1 Processor -- start 2024-03-23T06:10:42.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.362+0000 7fb671a00640 1 -- start start 2024-03-23T06:10:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.363+0000 7fb671a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb66c151480 0x7fb66c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.363+0000 7fb671a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb66c157e60 0x7fb66c14b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.363+0000 7fb671a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 0x7fb66c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.363+0000 7fb671a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0c3450 con 0x7fb66c157e60 2024-03-23T06:10:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.363+0000 7fb671a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c14dd60 con 0x7fb66c159d00 2024-03-23T06:10:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.363+0000 7fb671a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c14e0c0 con 0x7fb66c151480 2024-03-23T06:10:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.363+0000 7fb663e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb66c157e60 0x7fb66c14b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb66b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 0x7fb66c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb66aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb66c151480 0x7fb66c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb663e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb66c157e60 0x7fb66c14b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48414/0 (socket says 172.21.15.73:48414) 2024-03-23T06:10:42.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb663e00640 1 -- 172.21.15.73:0/1872969578 learned_addr learned my addr 172.21.15.73:0/1872969578 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb663e00640 1 -- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb66c151480 msgr2=0x7fb66c14d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb663e00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb66c151480 0x7fb66c14d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb663e00640 1 -- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 msgr2=0x7fb66c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb663e00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 0x7fb66c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb663e00640 1 -- 172.21.15.73:0/1872969578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009a70 con 0x7fb66c157e60 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb663e00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb66c157e60 0x7fb66c14b190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c400 tx=0x7fb65400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb662a00640 1 -- 172.21.15.73:0/1872969578 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540052d0 con 0x7fb66c157e60 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb662a00640 1 -- 172.21.15.73:0/1872969578 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654005450 con 0x7fb66c157e60 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb662a00640 1 -- 172.21.15.73:0/1872969578 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654003830 con 0x7fb66c157e60 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.364+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c0c4370 con 0x7fb66c157e60 2024-03-23T06:10:42.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.365+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c0c2d90 con 0x7fb66c157e60 2024-03-23T06:10:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.366+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c0c3590 con 0x7fb66c157e60 2024-03-23T06:10:42.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.367+0000 7fb662a00640 1 -- 172.21.15.73:0/1872969578 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb654003990 con 0x7fb66c157e60 2024-03-23T06:10:42.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.367+0000 7fb662a00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb64806ac30 0x7fb64806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.367+0000 7fb662a00640 1 -- 172.21.15.73:0/1872969578 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb654088c00 con 0x7fb66c157e60 2024-03-23T06:10:42.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.368+0000 7fb66aa00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb64806ac30 0x7fb64806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.368+0000 7fb66aa00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb64806ac30 0x7fb64806d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb65c000f60 tx=0x7fb65c007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:42.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.372+0000 7fb662a00640 1 -- 172.21.15.73:0/1872969578 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb66c0c3590 con 0x7fb66c157e60 2024-03-23T06:10:42.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.566+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb66c0c3590 con 0x7fb66c157e60 2024-03-23T06:10:42.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.567+0000 7fb662a00640 1 -- 172.21.15.73:0/1872969578 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb66c0c3590 con 0x7fb66c157e60 2024-03-23T06:10:42.567 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-23T06:10:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.569+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb64806ac30 msgr2=0x7fb64806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.569+0000 7fb671a00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb64806ac30 0x7fb64806d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb65c000f60 tx=0x7fb65c007de0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.569+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb66c157e60 msgr2=0x7fb66c14b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.569+0000 7fb671a00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb66c157e60 0x7fb66c14b190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c400 tx=0x7fb65400c8c0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.570+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 shutdown_connections 2024-03-23T06:10:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.570+0000 7fb671a00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb66c159d00 0x7fb66c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.570+0000 7fb671a00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb66c157e60 0x7fb66c14b190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.570+0000 7fb671a00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb64806ac30 0x7fb64806d0f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.570+0000 7fb671a00640 1 --2- 172.21.15.73:0/1872969578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb66c151480 0x7fb66c14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.570+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 >> 172.21.15.73:0/1872969578 conn(0x7fb66c069cb0 msgr2=0x7fb66c157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:42.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.570+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 shutdown_connections 2024-03-23T06:10:42.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.570+0000 7fb671a00640 1 -- 172.21.15.73:0/1872969578 wait complete. 2024-03-23T06:10:42.587 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-23T06:10:42.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.797+0000 7fbe4e400640 1 Processor -- start 2024-03-23T06:10:42.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.798+0000 7fbe4e400640 1 -- start start 2024-03-23T06:10:42.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.799+0000 7fbe4e400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe481537e0 0x7fbe4806e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.799+0000 7fbe4e400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe48153bc0 con 0x7fbe4806bca0 2024-03-23T06:10:42.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.799+0000 7fbe4e400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe480723b0 con 0x7fbe480709a0 2024-03-23T06:10:42.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.799+0000 7fbe4e400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe48072690 con 0x7fbe481537e0 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.799+0000 7fbe3ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbe4806bca0 0x7fbe48159460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38382/0 (socket says 172.21.15.73:38382) 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.799+0000 7fbe3ea00640 1 -- 172.21.15.73:0/923091662 learned_addr learned my addr 172.21.15.73:0/923091662 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.799+0000 7fbe47400640 1 --2- 172.21.15.73:0/923091662 >> v2:172.21.15.110:3300/0 conn(0x7fbe481537e0 0x7fbe4806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.800+0000 7fbe46a00640 1 -- 172.21.15.73:0/923091662 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203019978 0 0) 0x7fbe48153bc0 con 0x7fbe4806bca0 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.800+0000 7fbe46a00640 1 -- 172.21.15.73:0/923091662 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe2c003520 con 0x7fbe4806bca0 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.800+0000 7fbe47400640 1 -- 172.21.15.73:0/923091662 >> v1:172.21.15.110:6789/0 conn(0x7fbe480709a0 legacy=0x7fbe48163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.800+0000 7fbe46a00640 1 -- 172.21.15.73:0/923091662 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164590699 0 0) 0x7fbe480723b0 con 0x7fbe480709a0 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.800+0000 7fbe47400640 1 -- 172.21.15.73:0/923091662 >> v1:172.21.15.73:6789/0 conn(0x7fbe4806bca0 legacy=0x7fbe48159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.800+0000 7fbe47400640 1 -- 172.21.15.73:0/923091662 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480c0ff0 con 0x7fbe481537e0 2024-03-23T06:10:42.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.801+0000 7fbe47400640 1 --2- 172.21.15.73:0/923091662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 0x7fbe4806e160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009d90 tx=0x7fbe3802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15cb8d23f610906a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:42.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.801+0000 7fbe46a00640 1 -- 172.21.15.73:0/923091662 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3802cd00 con 0x7fbe481537e0 2024-03-23T06:10:42.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.801+0000 7fbe46a00640 1 -- 172.21.15.73:0/923091662 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3802ce60 con 0x7fbe481537e0 2024-03-23T06:10:42.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.801+0000 7fbe46a00640 1 -- 172.21.15.73:0/923091662 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38034640 con 0x7fbe481537e0 2024-03-23T06:10:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.802+0000 7fbe4e400640 1 -- 172.21.15.73:0/923091662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 msgr2=0x7fbe4806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.802+0000 7fbe4e400640 1 --2- 172.21.15.73:0/923091662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 0x7fbe4806e160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009d90 tx=0x7fbe3802bf50 comp rx=0 tx=0).stop 2024-03-23T06:10:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.802+0000 7fbe4e400640 1 -- 172.21.15.73:0/923091662 shutdown_connections 2024-03-23T06:10:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.802+0000 7fbe4e400640 1 --2- 172.21.15.73:0/923091662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 0x7fbe4806e160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.802+0000 7fbe4e400640 1 -- 172.21.15.73:0/923091662 >> 172.21.15.73:0/923091662 conn(0x7fbe480c88c0 msgr2=0x7fbe480c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.802+0000 7fbe4e400640 1 -- 172.21.15.73:0/923091662 shutdown_connections 2024-03-23T06:10:42.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.802+0000 7fbe4e400640 1 -- 172.21.15.73:0/923091662 wait complete. 2024-03-23T06:10:42.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.804+0000 7fbe4e400640 1 Processor -- start 2024-03-23T06:10:42.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.804+0000 7fbe4e400640 1 -- start start 2024-03-23T06:10:42.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe4e400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4806bca0 0x7fbe481571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe4e400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe480709a0 0x7fbe48157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe4e400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 0x7fbe481404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe4e400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481f2190 con 0x7fbe480709a0 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe4e400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481560a0 con 0x7fbe481537e0 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe4e400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48156340 con 0x7fbe4806bca0 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe3ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe480709a0 0x7fbe48157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe3ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe480709a0 0x7fbe48157700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48422/0 (socket says 172.21.15.73:48422) 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.805+0000 7fbe3ea00640 1 -- 172.21.15.73:0/674901490 learned_addr learned my addr 172.21.15.73:0/674901490 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe47e00640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 0x7fbe481404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe47400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4806bca0 0x7fbe481571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe3ea00640 1 -- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4806bca0 msgr2=0x7fbe481571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe3ea00640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4806bca0 0x7fbe481571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe3ea00640 1 -- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 msgr2=0x7fbe481404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe3ea00640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 0x7fbe481404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe3ea00640 1 -- 172.21.15.73:0/674901490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38009a70 con 0x7fbe480709a0 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe3ea00640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe480709a0 0x7fbe48157700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe30001eb0 tx=0x7fbe3000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.806+0000 7fbe3fe00640 1 -- 172.21.15.73:0/674901490 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30005ce0 con 0x7fbe480709a0 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.807+0000 7fbe3fe00640 1 -- 172.21.15.73:0/674901490 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30005e60 con 0x7fbe480709a0 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.807+0000 7fbe3fe00640 1 -- 172.21.15.73:0/674901490 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30007310 con 0x7fbe480709a0 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.807+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe48156620 con 0x7fbe480709a0 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.807+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe48156be0 con 0x7fbe480709a0 2024-03-23T06:10:42.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.808+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4804e110 con 0x7fbe480709a0 2024-03-23T06:10:42.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.810+0000 7fbe3fe00640 1 -- 172.21.15.73:0/674901490 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbe30007470 con 0x7fbe480709a0 2024-03-23T06:10:42.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.810+0000 7fbe3fe00640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe2406ac30 0x7fbe2406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:42.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.810+0000 7fbe3fe00640 1 -- 172.21.15.73:0/674901490 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fbe30088b20 con 0x7fbe480709a0 2024-03-23T06:10:42.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.811+0000 7fbe47400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe2406ac30 0x7fbe2406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:42.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.811+0000 7fbe47400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe2406ac30 0x7fbe2406d0f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe38036000 tx=0x7fbe38030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:42.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:42.815+0000 7fbe3fe00640 1 -- 172.21.15.73:0/674901490 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbe30053ad0 con 0x7fbe480709a0 2024-03-23T06:10:43.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.009+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbe480c83a0 con 0x7fbe480709a0 2024-03-23T06:10:43.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.011+0000 7fbe3fe00640 1 -- 172.21.15.73:0/674901490 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbe30017020 con 0x7fbe480709a0 2024-03-23T06:10:43.011 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:43.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe2406ac30 msgr2=0x7fbe2406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe2406ac30 0x7fbe2406d0f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe38036000 tx=0x7fbe38030000 comp rx=0 tx=0).stop 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe480709a0 msgr2=0x7fbe48157700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe480709a0 0x7fbe48157700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe30001eb0 tx=0x7fbe3000c820 comp rx=0 tx=0).stop 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 shutdown_connections 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe481537e0 0x7fbe481404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe480709a0 0x7fbe48157700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe2406ac30 0x7fbe2406d0f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 --2- 172.21.15.73:0/674901490 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe4806bca0 0x7fbe481571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 >> 172.21.15.73:0/674901490 conn(0x7fbe480c88c0 msgr2=0x7fbe48070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.013+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 shutdown_connections 2024-03-23T06:10:43.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.014+0000 7fbe4e400640 1 -- 172.21.15.73:0/674901490 wait complete. 2024-03-23T06:10:43.032 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:10:43.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.236+0000 7f5873600640 1 Processor -- start 2024-03-23T06:10:43.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.237+0000 7f5873600640 1 -- start start 2024-03-23T06:10:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5873600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1513f0 0x7f586c0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5873600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f586c1586b0 0x7f586c0bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5873600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586c0c5f50 con 0x7f586c0c03a0 2024-03-23T06:10:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5873600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586c157b60 con 0x7f586c1586b0 2024-03-23T06:10:43.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5873600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0c0830 con 0x7f586c1513f0 2024-03-23T06:10:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5870c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1513f0 0x7f586c0c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5863e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f586c1586b0 0x7f586c0bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5870c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1513f0 0x7f586c0c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:38176/0 (socket says 172.21.15.73:38176) 2024-03-23T06:10:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5870c00640 1 -- 172.21.15.73:0/3419734157 learned_addr learned my addr 172.21.15.73:0/3419734157 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.238+0000 7f5871600640 1 --1- 172.21.15.73:0/3419734157 >> v1:172.21.15.110:6789/0 conn(0x7f586c0c03a0 0x7f586c071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58662/0 (socket says 172.21.15.73:58662) 2024-03-23T06:10:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.239+0000 7f5870c00640 1 -- 172.21.15.73:0/3419734157 >> v2:172.21.15.110:3300/0 conn(0x7f586c1586b0 msgr2=0x7f586c0bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:43.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.239+0000 7f5870c00640 1 --2- 172.21.15.73:0/3419734157 >> v2:172.21.15.110:3300/0 conn(0x7f586c1586b0 0x7f586c0bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.239+0000 7f5870c00640 1 -- 172.21.15.73:0/3419734157 >> v1:172.21.15.110:6789/0 conn(0x7f586c0c03a0 legacy=0x7f586c071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.239+0000 7f5870c00640 1 -- 172.21.15.73:0/3419734157 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c0c0b10 con 0x7f586c1513f0 2024-03-23T06:10:43.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.240+0000 7f5870c00640 1 --2- 172.21.15.73:0/3419734157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1513f0 0x7f586c0c5a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f585c009870 tx=0x7f585c02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c05ba316fef53f73 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:43.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.240+0000 7f586be00640 1 -- 172.21.15.73:0/3419734157 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c02f830 con 0x7f586c1513f0 2024-03-23T06:10:43.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.240+0000 7f586be00640 1 -- 172.21.15.73:0/3419734157 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c02f990 con 0x7f586c1513f0 2024-03-23T06:10:43.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.240+0000 7f586be00640 1 -- 172.21.15.73:0/3419734157 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c02fd20 con 0x7f586c1513f0 2024-03-23T06:10:43.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.241+0000 7f5873600640 1 -- 172.21.15.73:0/3419734157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1513f0 msgr2=0x7f586c0c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.241+0000 7f5873600640 1 --2- 172.21.15.73:0/3419734157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1513f0 0x7f586c0c5a10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f585c009870 tx=0x7f585c02ba10 comp rx=0 tx=0).stop 2024-03-23T06:10:43.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.241+0000 7f5873600640 1 -- 172.21.15.73:0/3419734157 shutdown_connections 2024-03-23T06:10:43.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.241+0000 7f5873600640 1 --2- 172.21.15.73:0/3419734157 >> v2:172.21.15.110:3300/0 conn(0x7f586c1586b0 0x7f586c0bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.241+0000 7f5873600640 1 --2- 172.21.15.73:0/3419734157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1513f0 0x7f586c0c5a10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.241+0000 7f5873600640 1 -- 172.21.15.73:0/3419734157 >> 172.21.15.73:0/3419734157 conn(0x7f586c06bb40 msgr2=0x7f586c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:43.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.241+0000 7f5873600640 1 -- 172.21.15.73:0/3419734157 shutdown_connections 2024-03-23T06:10:43.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.241+0000 7f5873600640 1 -- 172.21.15.73:0/3419734157 wait complete. 2024-03-23T06:10:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.243+0000 7f5873600640 1 Processor -- start 2024-03-23T06:10:43.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.243+0000 7f5873600640 1 -- start start 2024-03-23T06:10:43.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5873600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1513f0 0x7f586c1e4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5873600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f586c1586b0 0x7f586c1e2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5873600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1e33e0 0x7f586c14c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5873600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0b0aa0 con 0x7f586c1513f0 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5873600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c1e3860 con 0x7f586c1586b0 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5873600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0b0fd0 con 0x7f586c1e33e0 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5870c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1513f0 0x7f586c1e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5870c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1513f0 0x7f586c1e4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48432/0 (socket says 172.21.15.73:48432) 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5870c00640 1 -- 172.21.15.73:0/975132560 learned_addr learned my addr 172.21.15.73:0/975132560 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5863e00640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f586c1586b0 0x7f586c1e2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.244+0000 7f5871600640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1e33e0 0x7f586c14c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5870c00640 1 -- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1e33e0 msgr2=0x7f586c14c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5870c00640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1e33e0 0x7f586c14c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5870c00640 1 -- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f586c1586b0 msgr2=0x7f586c1e2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5870c00640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f586c1586b0 0x7f586c1e2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5870c00640 1 -- 172.21.15.73:0/975132560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0094d0 con 0x7f586c1513f0 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5863e00640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f586c1586b0 0x7f586c1e2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5870c00640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1513f0 0x7f586c1e4140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f585c000c00 tx=0x7f585c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5869600640 1 -- 172.21.15.73:0/975132560 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c037c40 con 0x7f586c1513f0 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5869600640 1 -- 172.21.15.73:0/975132560 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c037da0 con 0x7f586c1513f0 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586c1efc80 con 0x7f586c1513f0 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5869600640 1 -- 172.21.15.73:0/975132560 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c041640 con 0x7f586c1513f0 2024-03-23T06:10:43.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.245+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586c1e1ec0 con 0x7f586c1513f0 2024-03-23T06:10:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.246+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586c04e110 con 0x7f586c1513f0 2024-03-23T06:10:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.247+0000 7f5869600640 1 -- 172.21.15.73:0/975132560 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f585c0417a0 con 0x7f586c1513f0 2024-03-23T06:10:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.249+0000 7f5869600640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f584806ac00 0x7f584806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.249+0000 7f5869600640 1 -- 172.21.15.73:0/975132560 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f585c03c070 con 0x7f586c1513f0 2024-03-23T06:10:43.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.249+0000 7f5863e00640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f584806ac00 0x7f584806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.250+0000 7f5863e00640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f584806ac00 0x7f584806d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f586c0c98c0 tx=0x7f5854009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:43.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.253+0000 7f5869600640 1 -- 172.21.15.73:0/975132560 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f585c0770a0 con 0x7f586c1513f0 2024-03-23T06:10:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.485+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f586c0c55d0 con 0x7f586c1513f0 2024-03-23T06:10:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.487+0000 7f5869600640 1 -- 172.21.15.73:0/975132560 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6280 (secure 0 0 0) 0x7f585c07a6c0 con 0x7f586c1513f0 2024-03-23T06:10:43.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:43.487 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:39.659193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4256,"mds_2":4253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4256":{"gid":4256,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:10:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.489+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f584806ac00 msgr2=0x7f584806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.489+0000 7f5873600640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f584806ac00 0x7f584806d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f586c0c98c0 tx=0x7f5854009190 comp rx=0 tx=0).stop 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.489+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1513f0 msgr2=0x7f586c1e4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.489+0000 7f5873600640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1513f0 0x7f586c1e4140 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f585c000c00 tx=0x7f585c004730 comp rx=0 tx=0).stop 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.490+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 shutdown_connections 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.490+0000 7f5873600640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f584806ac00 0x7f584806d0c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.490+0000 7f5873600640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f586c1e33e0 0x7f586c14c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.490+0000 7f5873600640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f586c1586b0 0x7f586c1e2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.490+0000 7f5873600640 1 --2- 172.21.15.73:0/975132560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1513f0 0x7f586c1e4140 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.490+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 >> 172.21.15.73:0/975132560 conn(0x7f586c06bb40 msgr2=0x7f586c071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.490+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 shutdown_connections 2024-03-23T06:10:43.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.490+0000 7f5873600640 1 -- 172.21.15.73:0/975132560 wait complete. 2024-03-23T06:10:43.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:43.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.716+0000 7f635d200640 1 Processor -- start 2024-03-23T06:10:43.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.716+0000 7f635d200640 1 -- start start 2024-03-23T06:10:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.717+0000 7f635d200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63581513f0 0x7f63580c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f635d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6358158b20 0x7f6358071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f635d200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63580c5f50 con 0x7f63581586b0 2024-03-23T06:10:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f635d200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6358157b60 con 0x7f6358158b20 2024-03-23T06:10:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f635d200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63580c0570 con 0x7f63581513f0 2024-03-23T06:10:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f6355e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63581513f0 0x7f63580c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f6356800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6358158b20 0x7f6358071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f6355e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63581513f0 0x7f63580c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:47282/0 (socket says 172.21.15.73:47282) 2024-03-23T06:10:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f6355e00640 1 -- 172.21.15.73:0/3136078581 learned_addr learned my addr 172.21.15.73:0/3136078581 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f6355e00640 1 -- 172.21.15.73:0/3136078581 >> v2:172.21.15.73:3300/0 conn(0x7f6358158b20 msgr2=0x7f6358071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f6355e00640 1 --2- 172.21.15.73:0/3136078581 >> v2:172.21.15.73:3300/0 conn(0x7f6358158b20 0x7f6358071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f6355e00640 1 -- 172.21.15.73:0/3136078581 >> v1:172.21.15.73:6789/0 conn(0x7f63581586b0 legacy=0x7f63580bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.718+0000 7f6355e00640 1 -- 172.21.15.73:0/3136078581 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63580c0830 con 0x7f63581513f0 2024-03-23T06:10:43.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.720+0000 7f6355e00640 1 --2- 172.21.15.73:0/3136078581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63581513f0 0x7f63580c5a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f63580c8670 tx=0x7f634802c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=297d87abbab6a7ee server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:43.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.720+0000 7f6354a00640 1 -- 172.21.15.73:0/3136078581 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634802cbb0 con 0x7f63581513f0 2024-03-23T06:10:43.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.720+0000 7f6354a00640 1 -- 172.21.15.73:0/3136078581 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634802cd10 con 0x7f63581513f0 2024-03-23T06:10:43.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.720+0000 7f6354a00640 1 -- 172.21.15.73:0/3136078581 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348034610 con 0x7f63581513f0 2024-03-23T06:10:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.721+0000 7f635d200640 1 -- 172.21.15.73:0/3136078581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63581513f0 msgr2=0x7f63580c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.721+0000 7f635d200640 1 --2- 172.21.15.73:0/3136078581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63581513f0 0x7f63580c5a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f63580c8670 tx=0x7f634802c010 comp rx=0 tx=0).stop 2024-03-23T06:10:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.721+0000 7f635d200640 1 -- 172.21.15.73:0/3136078581 shutdown_connections 2024-03-23T06:10:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.721+0000 7f635d200640 1 --2- 172.21.15.73:0/3136078581 >> v2:172.21.15.73:3300/0 conn(0x7f6358158b20 0x7f6358071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.721+0000 7f635d200640 1 --2- 172.21.15.73:0/3136078581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63581513f0 0x7f63580c5a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.721+0000 7f635d200640 1 -- 172.21.15.73:0/3136078581 >> 172.21.15.73:0/3136078581 conn(0x7f635806bb40 msgr2=0x7f635806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.721+0000 7f635d200640 1 -- 172.21.15.73:0/3136078581 shutdown_connections 2024-03-23T06:10:43.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.721+0000 7f635d200640 1 -- 172.21.15.73:0/3136078581 wait complete. 2024-03-23T06:10:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.722+0000 7f635d200640 1 Processor -- start 2024-03-23T06:10:43.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.723+0000 7f635d200640 1 -- start start 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.723+0000 7f635d200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63581513f0 0x7f635814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.723+0000 7f635d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63581586b0 0x7f635814b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f635d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6358158b20 0x7f635814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f635d200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635814d2d0 con 0x7f63581586b0 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f635d200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635814d800 con 0x7f6358158b20 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f635d200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635814b3a0 con 0x7f63581513f0 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63581586b0 0x7f635814b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63581586b0 0x7f635814b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48448/0 (socket says 172.21.15.73:48448) 2024-03-23T06:10:43.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355400640 1 -- 172.21.15.73:0/1246839818 learned_addr learned my addr 172.21.15.73:0/1246839818 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6356800640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6358158b20 0x7f635814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355e00640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63581513f0 0x7f635814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355400640 1 -- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63581513f0 msgr2=0x7f635814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355400640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63581513f0 0x7f635814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355400640 1 -- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6358158b20 msgr2=0x7f635814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355400640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6358158b20 0x7f635814fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.724+0000 7f6355400640 1 -- 172.21.15.73:0/1246839818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348009b30 con 0x7f63581586b0 2024-03-23T06:10:43.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.725+0000 7f6355400640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63581586b0 0x7f635814b900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f634400c400 tx=0x7f634400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:43.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.725+0000 7f634e000640 1 -- 172.21.15.73:0/1246839818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63440052d0 con 0x7f63581586b0 2024-03-23T06:10:43.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.725+0000 7f634e000640 1 -- 172.21.15.73:0/1246839818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344005430 con 0x7f63581586b0 2024-03-23T06:10:43.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.725+0000 7f634e000640 1 -- 172.21.15.73:0/1246839818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344003830 con 0x7f63581586b0 2024-03-23T06:10:43.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.725+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635814d520 con 0x7f63581586b0 2024-03-23T06:10:43.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.725+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63581ece40 con 0x7f63581586b0 2024-03-23T06:10:43.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.726+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635804e110 con 0x7f63581586b0 2024-03-23T06:10:43.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.727+0000 7f634e000640 1 -- 172.21.15.73:0/1246839818 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6344003990 con 0x7f63581586b0 2024-03-23T06:10:43.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.728+0000 7f634e000640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f633806ac30 0x7f633806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:43.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.728+0000 7f634e000640 1 -- 172.21.15.73:0/1246839818 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f63440889d0 con 0x7f63581586b0 2024-03-23T06:10:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.728+0000 7f6355e00640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f633806ac30 0x7f633806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:43.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.729+0000 7f6355e00640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f633806ac30 0x7f633806d0f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6348035000 tx=0x7f6348030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:43.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.732+0000 7f634e000640 1 -- 172.21.15.73:0/1246839818 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f63440538e0 con 0x7f63581586b0 2024-03-23T06:10:43.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.928+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63580c5f50 con 0x7f63581586b0 2024-03-23T06:10:43.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.930+0000 7f634e000640 1 -- 172.21.15.73:0/1246839818 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18088 (secure 0 0 0) 0x7f63580c5f50 con 0x7f63581586b0 2024-03-23T06:10:43.930 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:43.930 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:39.659625+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2},{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:43.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f633806ac30 msgr2=0x7f633806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f633806ac30 0x7f633806d0f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6348035000 tx=0x7f6348030000 comp rx=0 tx=0).stop 2024-03-23T06:10:43.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63581586b0 msgr2=0x7f635814b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:43.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63581586b0 0x7f635814b900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f634400c400 tx=0x7f634400c8c0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 shutdown_connections 2024-03-23T06:10:43.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6358158b20 0x7f635814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63581586b0 0x7f635814b900 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f633806ac30 0x7f633806d0f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 --2- 172.21.15.73:0/1246839818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63581513f0 0x7f635814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:43.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 >> 172.21.15.73:0/1246839818 conn(0x7f635806bb40 msgr2=0x7f63580ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:43.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 shutdown_connections 2024-03-23T06:10:43.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:43.933+0000 7f635d200640 1 -- 172.21.15.73:0/1246839818 wait complete. 2024-03-23T06:10:43.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:10:44.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.160+0000 7f4360a00640 1 Processor -- start 2024-03-23T06:10:44.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.160+0000 7f4360a00640 1 -- start start 2024-03-23T06:10:44.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f4360a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f435c071d20 0x7f435c0721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:44.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f4360a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c06f9b0 con 0x7f435c0c7e10 2024-03-23T06:10:44.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f4360a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c070250 con 0x7f435c150100 2024-03-23T06:10:44.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f4360a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0c0150 con 0x7f435c071d20 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f435a800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f435c071d20 0x7f435c0721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f435a800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f435c071d20 0x7f435c0721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48458/0 (socket says 172.21.15.73:48458) 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f435a800640 1 -- 172.21.15.73:0/3931744956 learned_addr learned my addr 172.21.15.73:0/3931744956 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f4359e00640 1 --1- 172.21.15.73:0/3931744956 >> v1:172.21.15.110:6789/0 conn(0x7f435c150100 0x7f435c0c6aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58676/0 (socket says 172.21.15.73:58676) 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.162+0000 7f4351400640 1 --1- 172.21.15.73:0/3931744956 >> v1:172.21.15.73:6789/0 conn(0x7f435c0c7e10 0x7f435c156070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38412/0 (socket says 172.21.15.73:38412) 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.163+0000 7f435a800640 1 -- 172.21.15.73:0/3931744956 >> v1:172.21.15.110:6789/0 conn(0x7f435c150100 legacy=0x7f435c0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.163+0000 7f435a800640 1 -- 172.21.15.73:0/3931744956 >> v1:172.21.15.73:6789/0 conn(0x7f435c0c7e10 legacy=0x7f435c156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.163+0000 7f4359400640 1 -- 172.21.15.73:0/3931744956 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873932063 0 0) 0x7f435c070250 con 0x7f435c150100 2024-03-23T06:10:44.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.163+0000 7f435a800640 1 -- 172.21.15.73:0/3931744956 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0c71b0 con 0x7f435c071d20 2024-03-23T06:10:44.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.164+0000 7f435a800640 1 --2- 172.21.15.73:0/3931744956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c0721d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4354009e50 tx=0x7f435402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3372d766a3d552 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:44.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.164+0000 7f4359400640 1 -- 172.21.15.73:0/3931744956 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435402c8d0 con 0x7f435c071d20 2024-03-23T06:10:44.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.164+0000 7f4359400640 1 -- 172.21.15.73:0/3931744956 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435402ca30 con 0x7f435c071d20 2024-03-23T06:10:44.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.164+0000 7f4359400640 1 -- 172.21.15.73:0/3931744956 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435402cdc0 con 0x7f435c071d20 2024-03-23T06:10:44.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.165+0000 7f4360a00640 1 -- 172.21.15.73:0/3931744956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 msgr2=0x7f435c0721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:44.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.165+0000 7f4360a00640 1 --2- 172.21.15.73:0/3931744956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c0721d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4354009e50 tx=0x7f435402bdb0 comp rx=0 tx=0).stop 2024-03-23T06:10:44.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.165+0000 7f4360a00640 1 -- 172.21.15.73:0/3931744956 shutdown_connections 2024-03-23T06:10:44.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.165+0000 7f4360a00640 1 --2- 172.21.15.73:0/3931744956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c0721d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:44.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.165+0000 7f4360a00640 1 -- 172.21.15.73:0/3931744956 >> 172.21.15.73:0/3931744956 conn(0x7f435c06bb40 msgr2=0x7f435c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:44.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.165+0000 7f4360a00640 1 -- 172.21.15.73:0/3931744956 shutdown_connections 2024-03-23T06:10:44.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.165+0000 7f4360a00640 1 -- 172.21.15.73:0/3931744956 wait complete. 2024-03-23T06:10:44.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.167+0000 7f4360a00640 1 Processor -- start 2024-03-23T06:10:44.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.167+0000 7f4360a00640 1 -- start start 2024-03-23T06:10:44.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4360a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:44.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4360a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c0c7e10 0x7f435c0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:44.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4360a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c150100 0x7f435c152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:44.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4360a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c151110 con 0x7f435c071d20 2024-03-23T06:10:44.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4360a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c3000 con 0x7f435c150100 2024-03-23T06:10:44.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4360a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c14e490 con 0x7f435c0c7e10 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4359e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4359e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48472/0 (socket says 172.21.15.73:48472) 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4359e00640 1 -- 172.21.15.73:0/560015 learned_addr learned my addr 172.21.15.73:0/560015 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f435a800640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c150100 0x7f435c152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.168+0000 7f4351400640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c0c7e10 0x7f435c0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4359e00640 1 -- 172.21.15.73:0/560015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c0c7e10 msgr2=0x7f435c0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4359e00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c0c7e10 0x7f435c0af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4359e00640 1 -- 172.21.15.73:0/560015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c150100 msgr2=0x7f435c152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4359e00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c150100 0x7f435c152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:44.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4359e00640 1 -- 172.21.15.73:0/560015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354009b30 con 0x7f435c071d20 2024-03-23T06:10:44.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4359e00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c151eb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f434c00c4d0 tx=0x7f434c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:44.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4352a00640 1 -- 172.21.15.73:0/560015 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c0074e0 con 0x7f435c071d20 2024-03-23T06:10:44.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4352a00640 1 -- 172.21.15.73:0/560015 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c007660 con 0x7f435c071d20 2024-03-23T06:10:44.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4352a00640 1 -- 172.21.15.73:0/560015 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c004a20 con 0x7f435c071d20 2024-03-23T06:10:44.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c0c9af0 con 0x7f435c071d20 2024-03-23T06:10:44.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.169+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c0c9d90 con 0x7f435c071d20 2024-03-23T06:10:44.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.171+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c04e110 con 0x7f435c071d20 2024-03-23T06:10:44.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.171+0000 7f4352a00640 1 -- 172.21.15.73:0/560015 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f434c004b80 con 0x7f435c071d20 2024-03-23T06:10:44.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.173+0000 7f4352a00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f433806ac00 0x7f433806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:44.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.173+0000 7f4352a00640 1 -- 172.21.15.73:0/560015 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f434c088890 con 0x7f435c071d20 2024-03-23T06:10:44.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.173+0000 7f4351400640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f433806ac00 0x7f433806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:44.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.174+0000 7f4351400640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f433806ac00 0x7f433806d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f435c0c8430 tx=0x7f4344007e60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:44.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.177+0000 7f4352a00640 1 -- 172.21.15.73:0/560015 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f434c053680 con 0x7f435c071d20 2024-03-23T06:10:44.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.413+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f435c0bff30 con 0x7f435c071d20 2024-03-23T06:10:44.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.414+0000 7f4352a00640 1 -- 172.21.15.73:0/560015 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6280 (secure 0 0 0) 0x7f434c018020 con 0x7f435c071d20 2024-03-23T06:10:44.414 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:44.415 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:39.659193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4256,"mds_2":4253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4256":{"gid":4256,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:10:44.415 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.417+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f433806ac00 msgr2=0x7f433806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.417+0000 7f4360a00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f433806ac00 0x7f433806d0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f435c0c8430 tx=0x7f4344007e60 comp rx=0 tx=0).stop 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.417+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 msgr2=0x7f435c151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.417+0000 7f4360a00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c151eb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f434c00c4d0 tx=0x7f434c00c990 comp rx=0 tx=0).stop 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.418+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 shutdown_connections 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.418+0000 7f4360a00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c150100 0x7f435c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.418+0000 7f4360a00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f433806ac00 0x7f433806d0c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.418+0000 7f4360a00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c0c7e10 0x7f435c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.418+0000 7f4360a00640 1 --2- 172.21.15.73:0/560015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f435c071d20 0x7f435c151eb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:44.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.418+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 >> 172.21.15.73:0/560015 conn(0x7f435c06bb40 msgr2=0x7f435c06d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:44.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.418+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 shutdown_connections 2024-03-23T06:10:44.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:44.418+0000 7f4360a00640 1 -- 172.21.15.73:0/560015 wait complete. 2024-03-23T06:10:45.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-23T06:09:57.917296+0000', 'modified': '2024-03-23T06:10:39.659193+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4282, 'mds_1': 4256, 'mds_2': 4253}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4253': {'gid': 4253, 'name': 'c', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.73:6835/3116000384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 3116000384}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3116000384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4256': {'gid': 4256, 'name': 'e', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.73:6837/712461133', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 712461133}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 712461133}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4282': {'gid': 4282, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.110:6837/3132183330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 3132183330}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 3132183330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-23T06:10:45.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-23T06:10:45.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-23T06:10:45.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.259+0000 7f6dd2200640 1 Processor -- start 2024-03-23T06:10:45.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.259+0000 7f6dd2200640 1 -- start start 2024-03-23T06:10:45.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dd2200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6dcc153760 0x7f6dcc159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dd2200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6dcc0c9740 0x7f6dcc0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dd2200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc06a2d0 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dd2200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc06a5b0 con 0x7f6dcc0c9740 2024-03-23T06:10:45.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dd2200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc06a890 con 0x7f6dcc153760 2024-03-23T06:10:45.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dc2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6dcc0c9740 0x7f6dcc0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dc2a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6dcc0c9740 0x7f6dcc0cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48484/0 (socket says 172.21.15.73:48484) 2024-03-23T06:10:45.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dcb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6dcc153760 0x7f6dcc159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.261+0000 7f6dc2a00640 1 -- 172.21.15.73:0/3119538647 learned_addr learned my addr 172.21.15.73:0/3119538647 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.262+0000 7f6dc2a00640 1 -- 172.21.15.73:0/3119538647 >> v2:172.21.15.110:3300/0 conn(0x7f6dcc153760 msgr2=0x7f6dcc159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.262+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/3119538647 >> v2:172.21.15.110:3300/0 conn(0x7f6dcc153760 0x7f6dcc159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.262+0000 7f6dc2a00640 1 -- 172.21.15.73:0/3119538647 >> v1:172.21.15.73:6789/0 conn(0x7f6dcc0cbd10 legacy=0x7f6dcc0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.262+0000 7f6dc2a00640 1 -- 172.21.15.73:0/3119538647 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc06ab70 con 0x7f6dcc0c9740 2024-03-23T06:10:45.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.262+0000 7f6dcaa00640 1 -- 172.21.15.73:0/3119538647 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193146089 0 0) 0x7f6dcc06a2d0 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.263+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/3119538647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0c9740 0x7f6dcc0cb7d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0cfe30 tx=0x7f6db402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fe70cf1749e885 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.263+0000 7f6dcaa00640 1 -- 172.21.15.73:0/3119538647 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4030860 con 0x7f6dcc0c9740 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dcaa00640 1 -- 172.21.15.73:0/3119538647 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db40309c0 con 0x7f6dcc0c9740 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dcaa00640 1 -- 172.21.15.73:0/3119538647 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4030d50 con 0x7f6dcc0c9740 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dd2200640 1 -- 172.21.15.73:0/3119538647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0c9740 msgr2=0x7f6dcc0cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dd2200640 1 --2- 172.21.15.73:0/3119538647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0c9740 0x7f6dcc0cb7d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0cfe30 tx=0x7f6db402b9a0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dd2200640 1 -- 172.21.15.73:0/3119538647 shutdown_connections 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dd2200640 1 --2- 172.21.15.73:0/3119538647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0c9740 0x7f6dcc0cb7d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dd2200640 1 --2- 172.21.15.73:0/3119538647 >> v2:172.21.15.110:3300/0 conn(0x7f6dcc153760 0x7f6dcc159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dd2200640 1 -- 172.21.15.73:0/3119538647 >> 172.21.15.73:0/3119538647 conn(0x7f6dcc06c310 msgr2=0x7f6dcc0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dd2200640 1 -- 172.21.15.73:0/3119538647 shutdown_connections 2024-03-23T06:10:45.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.264+0000 7f6dd2200640 1 -- 172.21.15.73:0/3119538647 wait complete. 2024-03-23T06:10:45.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.266+0000 7f6dd2200640 1 Processor -- start 2024-03-23T06:10:45.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.266+0000 7f6dd2200640 1 -- start start 2024-03-23T06:10:45.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dd2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc0c9740 0x7f6dcc0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dd2200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0cbd10 0x7f6dcc0c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dd2200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dcc153760 0x7f6dcc1f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dd2200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc0c6dc0 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dd2200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1f2710 con 0x7f6dcc0c9740 2024-03-23T06:10:45.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dd2200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1ef410 con 0x7f6dcc153760 2024-03-23T06:10:45.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dc2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0cbd10 0x7f6dcc0c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dc2a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0cbd10 0x7f6dcc0c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48492/0 (socket says 172.21.15.73:48492) 2024-03-23T06:10:45.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dc2a00640 1 -- 172.21.15.73:0/4054059399 learned_addr learned my addr 172.21.15.73:0/4054059399 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dcb400640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc0c9740 0x7f6dcc0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.267+0000 7f6dcbe00640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dcc153760 0x7f6dcc1f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.268+0000 7f6dc2a00640 1 -- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dcc153760 msgr2=0x7f6dcc1f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.268+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dcc153760 0x7f6dcc1f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.268+0000 7f6dc2a00640 1 -- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc0c9740 msgr2=0x7f6dcc0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.268+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc0c9740 0x7f6dcc0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.268+0000 7f6dc2a00640 1 -- 172.21.15.73:0/4054059399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db40094d0 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.268+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0cbd10 0x7f6dcc0c60e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6db4000c00 tx=0x7f6db4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.268+0000 7f6dc3e00640 1 -- 172.21.15.73:0/4054059399 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4039c90 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.269+0000 7f6dc3e00640 1 -- 172.21.15.73:0/4054059399 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4039df0 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.269+0000 7f6dc3e00640 1 -- 172.21.15.73:0/4054059399 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4043640 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.269+0000 7f6dd2200640 1 -- 172.21.15.73:0/4054059399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc1ef6f0 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.269+0000 7f6dd2200640 1 -- 172.21.15.73:0/4054059399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc1efcb0 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.271+0000 7f6dc3e00640 1 -- 172.21.15.73:0/4054059399 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6db40437a0 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.272+0000 7f6dc3e00640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6da806ac00 0x7f6da806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.272+0000 7f6dc3e00640 1 -- 172.21.15.73:0/4054059399 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f6db403e070 con 0x7f6dcc0cbd10 2024-03-23T06:10:45.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.272+0000 7f6dcb400640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6da806ac00 0x7f6da806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.273+0000 7f6dd4e3e740 1 Processor -- start 2024-03-23T06:10:45.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.273+0000 7f6dd4e3e740 1 -- start start 2024-03-23T06:10:45.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.273+0000 7f6dcb400640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6da806ac00 0x7f6da806d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009aa0 tx=0x7f6dbc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 0x556e184fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fa160 0x556e1853af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e184d12c0 con 0x556e184fb700 2024-03-23T06:10:45.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e184668f0 con 0x556e184fa160 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e18464080 con 0x556e18545580 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48504/0 (socket says 172.21.15.73:48504) 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dcb400640 1 -- 172.21.15.73:0/4012162011 learned_addr learned my addr 172.21.15.73:0/4012162011 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dcbe00640 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fa160 0x556e1853af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.274+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 0x556e184fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dcb400640 1 -- 172.21.15.73:0/4012162011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 msgr2=0x556e184fc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dcb400640 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 0x556e184fc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dcb400640 1 -- 172.21.15.73:0/4012162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fa160 msgr2=0x556e1853af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dcb400640 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fa160 0x556e1853af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dcb400640 1 -- 172.21.15.73:0/4012162011 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e1842aa10 con 0x556e184fb700 2024-03-23T06:10:45.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dcb400640 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbae0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc004440 tx=0x7f6dbc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7017592cd963893b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dbbe00640 1 -- 172.21.15.73:0/4012162011 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc01c040 con 0x556e184fb700 2024-03-23T06:10:45.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dbbe00640 1 -- 172.21.15.73:0/4012162011 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc003820 con 0x556e184fb700 2024-03-23T06:10:45.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.275+0000 7f6dbbe00640 1 -- 172.21.15.73:0/4012162011 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc003b90 con 0x556e184fb700 2024-03-23T06:10:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/4012162011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 msgr2=0x556e184fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbae0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc004440 tx=0x7f6dbc014000 comp rx=0 tx=0).stop 2024-03-23T06:10:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/4012162011 shutdown_connections 2024-03-23T06:10:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fa160 0x556e1853af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 0x556e184fc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/4012162011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbae0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/4012162011 >> 172.21.15.73:0/4012162011 conn(0x556e184f7e70 msgr2=0x556e184fa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/4012162011 shutdown_connections 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.276+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/4012162011 wait complete. 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.277+0000 7f6dd4e3e740 1 -- start start 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.277+0000 7f6dd4e3e740 1 Processor -- start 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fb700 0x556e18536f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 0x556e18543710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e185443f0 0x556e1854f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1845f970 con 0x556e185443f0 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e184010a0 con 0x556e184fb700 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e18400d40 con 0x556e18545580 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dd4e3e740 10 client.0 _ll_register_callbacks cb 0x556e18458fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T06:10:45.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dcbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e185443f0 0x556e1854f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dcbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e185443f0 0x556e1854f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48516/0 (socket says 172.21.15.73:48516) 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dcbe00640 1 -- 172.21.15.73:0/1428118127 learned_addr learned my addr 172.21.15.73:0/1428118127 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 0x556e18543710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.278+0000 7f6dcb400640 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fb700 0x556e18536f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6dcbe00640 1 -- 172.21.15.73:0/1428118127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 msgr2=0x556e18543710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6dcbe00640 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 0x556e18543710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6dcbe00640 1 -- 172.21.15.73:0/1428118127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fb700 msgr2=0x556e18536f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6dcbe00640 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fb700 0x556e18536f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6dcbe00640 1 -- 172.21.15.73:0/1428118127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc004120 con 0x556e185443f0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6dcbe00640 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e185443f0 0x556e1854f520 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4012690 tx=0x7f6dc4012a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c0d18bbefaa33e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6db8c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6db8c00640 1 -- 172.21.15.73:0/1428118127 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4003c40 con 0x556e185443f0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6db8c00640 1 -- 172.21.15.73:0/1428118127 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f6dc4003da0 con 0x556e185443f0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.279+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1428118127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e18489b10 con 0x556e185443f0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6db8c00640 1 -- 172.21.15.73:0/1428118127 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dc40050d0 con 0x556e185443f0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dd4e3e740 10 client.4737 fetch_fsmap learned FSMap version 15 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1428118127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556e1845dff0 con 0x556e185443f0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6db8c00640 1 -- 172.21.15.73:0/1428118127 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e18489b10 con 0x556e185443f0 2024-03-23T06:10:45.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6db8c00640 1 -- 172.21.15.73:0/1428118127 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7f6dc4005230 con 0x556e185443f0 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dd4e3e740 10 client.4737 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dd4e3e740 10 client.4737 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dd4e3e740 20 client.4737 populate_metadata read hostname 'smithi073' 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1854c460 0x556e1855a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dd4e3e740 4 client.4737 mds_command: new command op to 4253 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1428118127 --> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e181533c0 con 0x556e1854c460 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.280+0000 7f6dcb400640 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1854c460 0x556e1855a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.281+0000 7f6dcb400640 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1854c460 0x556e1855a970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=15d83c4cf75d2d51 server_cookie=bd3599ce1f35f077 in_seq=0 out_seq=0 2024-03-23T06:10:45.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.281+0000 7f6db8c00640 10 client.4737 ms_handle_connect on v2:172.21.15.73:6834/3116000384 2024-03-23T06:10:45.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6db8c00640 1 -- 172.21.15.73:0/1428118127 <== mds.2 v2:172.21.15.73:6834/3116000384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x556e181533c0 con 0x556e1854c460 2024-03-23T06:10:45.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6db8c00640 10 client.4737 handle_command_reply: tid=0 2024-03-23T06:10:45.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 client.4737 shutdown 2024-03-23T06:10:45.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1428118127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e185443f0 msgr2=0x556e1854f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e185443f0 0x556e1854f520 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4012690 tx=0x7f6dc4012a90 comp rx=0 tx=0).stop 2024-03-23T06:10:45.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1428118127 shutdown_connections 2024-03-23T06:10:45.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1854c460 0x556e1855a970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e185443f0 0x556e1854f520 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e18545580 0x556e18543710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1428118127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e184fb700 0x556e18536f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1428118127 >> 172.21.15.73:0/1428118127 conn(0x556e184fa160 msgr2=0x556e184fbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6db8c00640 0 client.4737 ms_handle_reset on v2:172.21.15.73:6834/3116000384 2024-03-23T06:10:45.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1428118127 shutdown_connections 2024-03-23T06:10:45.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1428118127 wait complete. 2024-03-23T06:10:45.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.282+0000 7f6dd4e3e740 20 client.4737 trim_cache size 0 max 16384 2024-03-23T06:10:45.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.299+0000 7f6dd4e3e740 1 Processor -- start 2024-03-23T06:10:45.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.299+0000 7f6dd4e3e740 1 -- start start 2024-03-23T06:10:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.299+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.299+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 0x556e1855e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.299+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e1855eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.299+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1853a210 con 0x556e184fb700 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.299+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e181c6f20 con 0x556e18545580 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.299+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e181533c0 con 0x556e185443f0 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48530/0 (socket says 172.21.15.73:48530) 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 -- 172.21.15.73:0/2089913342 learned_addr learned my addr 172.21.15.73:0/2089913342 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 0x556e1855e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcbe00640 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e1855eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 -- 172.21.15.73:0/2089913342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 msgr2=0x556e1855e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 0x556e1855e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 -- 172.21.15.73:0/2089913342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 msgr2=0x556e1855eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e1855eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 -- 172.21.15.73:0/2089913342 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e184937c0 con 0x556e184fb700 2024-03-23T06:10:45.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.300+0000 7f6dcb400640 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbf00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc011690 tx=0x7f6dbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce294334b569743 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dc0c00640 1 -- 172.21.15.73:0/2089913342 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc004530 con 0x556e184fb700 2024-03-23T06:10:45.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dc0c00640 1 -- 172.21.15.73:0/2089913342 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc033040 con 0x556e184fb700 2024-03-23T06:10:45.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dc0c00640 1 -- 172.21.15.73:0/2089913342 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc003d50 con 0x556e184fb700 2024-03-23T06:10:45.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/2089913342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 msgr2=0x556e184fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbf00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc011690 tx=0x7f6dbc016000 comp rx=0 tx=0).stop 2024-03-23T06:10:45.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/2089913342 shutdown_connections 2024-03-23T06:10:45.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e1855eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 0x556e1855e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/2089913342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e184fbf00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/2089913342 >> 172.21.15.73:0/2089913342 conn(0x556e184fa160 msgr2=0x556e1854f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/2089913342 shutdown_connections 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.301+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/2089913342 wait complete. 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.302+0000 7f6dd4e3e740 1 -- start start 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.302+0000 7f6dd4e3e740 1 Processor -- start 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e1854f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 0x556e185a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dd4e3e740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e185a5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1854fa60 con 0x556e184fb700 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e185a5790 con 0x556e18545580 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dd4e3e740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e18553810 con 0x556e185443f0 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dd4e3e740 10 client.0 _ll_register_callbacks cb 0x7f6dc4001ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T06:10:45.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e1854f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e1854f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48540/0 (socket says 172.21.15.73:48540) 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dcb400640 1 -- 172.21.15.73:0/1251208879 learned_addr learned my addr 172.21.15.73:0/1251208879 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 0x556e185a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.303+0000 7f6dcbe00640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e185a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dcb400640 1 -- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 msgr2=0x556e185a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dcb400640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 0x556e185a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dcb400640 1 -- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 msgr2=0x556e185a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dcb400640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e185a5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dcb400640 1 -- 172.21.15.73:0/1251208879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e1842aa10 con 0x556e184fb700 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dcbe00640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e185a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dcb400640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e1854f520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc023000 tx=0x7f6dbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead0e292c45638d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6db8c00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6db8c00640 1 -- 172.21.15.73:0/1251208879 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc003d10 con 0x556e184fb700 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6db8c00640 1 -- 172.21.15.73:0/1251208879 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f6dbc003e70 con 0x556e184fb700 2024-03-23T06:10:45.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1251208879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6dbc003820 con 0x556e184fb700 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6db8c00640 1 -- 172.21.15.73:0/1251208879 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6dbc005990 con 0x556e184fb700 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dd4e3e740 10 client.4743 fetch_fsmap learned FSMap version 15 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.304+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1251208879 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556e184002b0 con 0x556e184fb700 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6db8c00640 1 -- 172.21.15.73:0/1251208879 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc003820 con 0x556e184fb700 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6db8c00640 1 -- 172.21.15.73:0/1251208879 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7f6dbc005af0 con 0x556e184fb700 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dd4e3e740 10 client.4743 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dd4e3e740 10 client.4743 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dd4e3e740 20 client.4743 populate_metadata read hostname 'smithi073' 2024-03-23T06:10:45.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 0x556e1853b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dd4e3e740 4 client.4743 mds_command: new command op to 4253 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-23T06:10:45.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1251208879 --> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556e181646c0 con 0x556e1853ae20 2024-03-23T06:10:45.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 0x556e1853b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dc2a00640 1 -- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 msgr2=0x556e1853b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-03-23T06:10:45.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dc2a00640 1 -- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 msgr2=0x556e1853b200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:10:45.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 0x556e1853b200 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:10:45.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.305+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 0x556e1853b200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:10:45.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.506+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 0x556e1853b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.507+0000 7f6dc2a00640 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 0x556e1853b200 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65eb881ffcbf6a0a server_cookie=813a49002e366a19 in_seq=0 out_seq=0 2024-03-23T06:10:45.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.507+0000 7f6db8c00640 10 client.4743 ms_handle_connect on v2:172.21.15.73:6834/3116000384 2024-03-23T06:10:45.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.508+0000 7f6db8c00640 1 -- 172.21.15.73:0/1251208879 <== mds.2 v2:172.21.15.73:6834/3116000384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x556e181646c0 con 0x556e1853ae20 2024-03-23T06:10:45.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.508+0000 7f6db8c00640 10 client.4743 handle_command_reply: tid=0 2024-03-23T06:10:45.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.508+0000 7f6dd4e3e740 1 client.4743 shutdown 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 msgr2=0x556e1854f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e1854f520 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc023000 tx=0x7f6dbc004730 comp rx=0 tx=0).stop 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1251208879 shutdown_connections 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:6834/3116000384,v1:172.21.15.73:6835/3116000384] conn(0x556e1853ae20 0x556e1853b200 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x556e18545580 0x556e185a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x556e185443f0 0x556e185a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 --2- 172.21.15.73:0/1251208879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556e184fb700 0x556e1854f520 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6db8c00640 0 client.4743 ms_handle_reset on v2:172.21.15.73:6834/3116000384 2024-03-23T06:10:45.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1251208879 >> 172.21.15.73:0/1251208879 conn(0x556e184fa160 msgr2=0x556e1855e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1251208879 shutdown_connections 2024-03-23T06:10:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.509+0000 7f6dd4e3e740 1 -- 172.21.15.73:0/1251208879 wait complete. 2024-03-23T06:10:45.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.510+0000 7f6dd4e3e740 20 client.4743 trim_cache size 0 max 16384 2024-03-23T06:10:45.510 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 2, 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4253, 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 12.029645402, 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 15, 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 27, 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 26, 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 52.393449193999999 2024-03-23T06:10:45.511 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:10:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 -- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6da806ac00 msgr2=0x7f6da806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6da806ac00 0x7f6da806d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009aa0 tx=0x7f6dbc009190 comp rx=0 tx=0).stop 2024-03-23T06:10:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 -- 172.21.15.73:0/4054059399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0cbd10 msgr2=0x7f6dcc0c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0cbd10 0x7f6dcc0c60e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6db4000c00 tx=0x7f6db4004730 comp rx=0 tx=0).stop 2024-03-23T06:10:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 -- 172.21.15.73:0/4054059399 shutdown_connections 2024-03-23T06:10:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6da806ac00 0x7f6da806d0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6dcc153760 0x7f6dcc1f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dcc0cbd10 0x7f6dcc0c60e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 --2- 172.21.15.73:0/4054059399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6dcc0c9740 0x7f6dcc0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 -- 172.21.15.73:0/4054059399 >> 172.21.15.73:0/4054059399 conn(0x7f6dcc06c310 msgr2=0x7f6dcc0c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 -- 172.21.15.73:0/4054059399 shutdown_connections 2024-03-23T06:10:45.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.511+0000 7f6dd2200640 1 -- 172.21.15.73:0/4054059399 wait complete. 2024-03-23T06:10:45.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-23T06:10:45.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.744+0000 7f0a61c00640 1 Processor -- start 2024-03-23T06:10:45.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.744+0000 7f0a61c00640 1 -- start start 2024-03-23T06:10:45.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a61c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0a5c157e60 0x7f0a5c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a61c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c072090 0x7f0a5c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a61c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5c15b710 con 0x7f0a5c151480 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a61c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5c1588d0 con 0x7f0a5c157e60 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a61c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c1582d0 con 0x7f0a5c072090 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a52000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0a5c157e60 0x7f0a5c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a52000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0a5c157e60 0x7f0a5c071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48550/0 (socket says 172.21.15.73:48550) 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a52000640 1 -- 172.21.15.73:0/2665194352 learned_addr learned my addr 172.21.15.73:0/2665194352 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.746+0000 7f0a5b400640 1 --2- 172.21.15.73:0/2665194352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c072090 0x7f0a5c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.747+0000 7f0a52000640 1 -- 172.21.15.73:0/2665194352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c072090 msgr2=0x7f0a5c158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.747+0000 7f0a52000640 1 --2- 172.21.15.73:0/2665194352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c072090 0x7f0a5c158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.747+0000 7f0a52000640 1 -- 172.21.15.73:0/2665194352 >> v1:172.21.15.73:6789/0 conn(0x7f0a5c151480 legacy=0x7f0a5c0c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.747+0000 7f0a52000640 1 -- 172.21.15.73:0/2665194352 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c15ab90 con 0x7f0a5c157e60 2024-03-23T06:10:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.747+0000 7f0a5a000640 1 -- 172.21.15.73:0/2665194352 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401008765 0 0) 0x7f0a5c15b710 con 0x7f0a5c151480 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.748+0000 7f0a52000640 1 --2- 172.21.15.73:0/2665194352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 0x7f0a5c071b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009870 tx=0x7f0a4402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69ff3d5a40584bb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.748+0000 7f0a5a000640 1 -- 172.21.15.73:0/2665194352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4402f840 con 0x7f0a5c157e60 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.748+0000 7f0a5a000640 1 -- 172.21.15.73:0/2665194352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4402f9a0 con 0x7f0a5c157e60 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.748+0000 7f0a5a000640 1 -- 172.21.15.73:0/2665194352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4402fd30 con 0x7f0a5c157e60 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.749+0000 7f0a61c00640 1 -- 172.21.15.73:0/2665194352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 msgr2=0x7f0a5c071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.749+0000 7f0a61c00640 1 --2- 172.21.15.73:0/2665194352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 0x7f0a5c071b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009870 tx=0x7f0a4402ba20 comp rx=0 tx=0).stop 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.749+0000 7f0a61c00640 1 -- 172.21.15.73:0/2665194352 shutdown_connections 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.749+0000 7f0a61c00640 1 --2- 172.21.15.73:0/2665194352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c072090 0x7f0a5c158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.749+0000 7f0a61c00640 1 --2- 172.21.15.73:0/2665194352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 0x7f0a5c071b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.749+0000 7f0a61c00640 1 -- 172.21.15.73:0/2665194352 >> 172.21.15.73:0/2665194352 conn(0x7f0a5c069cb0 msgr2=0x7f0a5c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.749+0000 7f0a61c00640 1 -- 172.21.15.73:0/2665194352 shutdown_connections 2024-03-23T06:10:45.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.749+0000 7f0a61c00640 1 -- 172.21.15.73:0/2665194352 wait complete. 2024-03-23T06:10:45.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.751+0000 7f0a61c00640 1 Processor -- start 2024-03-23T06:10:45.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.751+0000 7f0a61c00640 1 -- start start 2024-03-23T06:10:45.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a61c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a5c072090 0x7f0a5c0c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a61c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c151480 0x7f0a5c0c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a61c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 0x7f0a5c071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a61c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0ca8b0 con 0x7f0a5c157e60 2024-03-23T06:10:45.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a61c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0c4010 con 0x7f0a5c072090 2024-03-23T06:10:45.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a61c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c0c8cf0 con 0x7f0a5c151480 2024-03-23T06:10:45.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a5aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a5c072090 0x7f0a5c0c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a5b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 0x7f0a5c071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a5aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a5c072090 0x7f0a5c0c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:47356/0 (socket says 172.21.15.73:47356) 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a5aa00640 1 -- 172.21.15.73:0/1693348493 learned_addr learned my addr 172.21.15.73:0/1693348493 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.752+0000 7f0a52000640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c151480 0x7f0a5c0c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a5aa00640 1 -- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c151480 msgr2=0x7f0a5c0c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c151480 0x7f0a5c0c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a5aa00640 1 -- 172.21.15.73:0/1693348493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 msgr2=0x7f0a5c071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 0x7f0a5c071480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a5aa00640 1 -- 172.21.15.73:0/1693348493 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a440094d0 con 0x7f0a5c072090 2024-03-23T06:10:45.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a52000640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c151480 0x7f0a5c0c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:45.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a5c072090 0x7f0a5c0c3ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c890 tx=0x7f0a4c00cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a53400640 1 -- 172.21.15.73:0/1693348493 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c003da0 con 0x7f0a5c072090 2024-03-23T06:10:45.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a53400640 1 -- 172.21.15.73:0/1693348493 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c005070 con 0x7f0a5c072090 2024-03-23T06:10:45.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a53400640 1 -- 172.21.15.73:0/1693348493 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c005420 con 0x7f0a5c072090 2024-03-23T06:10:45.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a61c00640 1 -- 172.21.15.73:0/1693348493 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5c06fac0 con 0x7f0a5c072090 2024-03-23T06:10:45.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.753+0000 7f0a61c00640 1 -- 172.21.15.73:0/1693348493 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c0cada0 con 0x7f0a5c072090 2024-03-23T06:10:45.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.755+0000 7f0a53400640 1 -- 172.21.15.73:0/1693348493 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0a4c005580 con 0x7f0a5c072090 2024-03-23T06:10:45.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.756+0000 7f0a53400640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0a3806ac00 0x7f0a3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.756+0000 7f0a53400640 1 -- 172.21.15.73:0/1693348493 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f0a4c088f90 con 0x7f0a5c072090 2024-03-23T06:10:45.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.757+0000 7f0a52000640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0a3806ac00 0x7f0a3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.757+0000 7f0a649d6740 1 Processor -- start 2024-03-23T06:10:45.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.757+0000 7f0a649d6740 1 -- start start 2024-03-23T06:10:45.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.757+0000 7f0a52000640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0a3806ac00 0x7f0a3806d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a44036000 tx=0x7f0a44008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x56532968bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296d5580 0x56532968c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968a160 0x5653296caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a649d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653296612c0 con 0x56532968a160 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a649d6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653295f68f0 con 0x5653296d5580 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a649d6740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653295f4080 con 0x56532968b700 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a52000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296d5580 0x56532968c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a5b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968a160 0x5653296caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a5aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x56532968bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a52000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296d5580 0x56532968c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:47372/0 (socket says 172.21.15.73:47372) 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.758+0000 7f0a52000640 1 -- 172.21.15.73:0/704300680 learned_addr learned my addr 172.21.15.73:0/704300680 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a5aa00640 1 -- 172.21.15.73:0/704300680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296d5580 msgr2=0x56532968c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/704300680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296d5580 0x56532968c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a5aa00640 1 -- 172.21.15.73:0/704300680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968a160 msgr2=0x5653296caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/704300680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968a160 0x5653296caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a5aa00640 1 -- 172.21.15.73:0/704300680 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653295baa10 con 0x56532968b700 2024-03-23T06:10:45.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/704300680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x56532968bae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c087140 tx=0x7f0a4c0574c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9404a399a9113a3e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a4b400640 1 -- 172.21.15.73:0/704300680 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c05fea0 con 0x56532968b700 2024-03-23T06:10:45.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a4b400640 1 -- 172.21.15.73:0/704300680 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c055f00 con 0x56532968b700 2024-03-23T06:10:45.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.759+0000 7f0a4b400640 1 -- 172.21.15.73:0/704300680 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c057050 con 0x56532968b700 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 -- 172.21.15.73:0/704300680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 msgr2=0x56532968bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 --2- 172.21.15.73:0/704300680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x56532968bae0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c087140 tx=0x7f0a4c0574c0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 -- 172.21.15.73:0/704300680 shutdown_connections 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 --2- 172.21.15.73:0/704300680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968a160 0x5653296caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 --2- 172.21.15.73:0/704300680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296d5580 0x56532968c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 --2- 172.21.15.73:0/704300680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x56532968bae0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 -- 172.21.15.73:0/704300680 >> 172.21.15.73:0/704300680 conn(0x565329687e70 msgr2=0x56532968a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 -- 172.21.15.73:0/704300680 shutdown_connections 2024-03-23T06:10:45.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.760+0000 7f0a649d6740 1 -- 172.21.15.73:0/704300680 wait complete. 2024-03-23T06:10:45.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.761+0000 7f0a649d6740 1 -- start start 2024-03-23T06:10:45.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.761+0000 7f0a649d6740 1 Processor -- start 2024-03-23T06:10:45.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968b700 0x5653296ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 0x5653296d3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 0x5653296cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a649d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653295ef970 con 0x56532968b700 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a649d6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653295910a0 con 0x5653296c5320 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a649d6740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x565329590d40 con 0x5653296d5580 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a649d6740 10 client.0 _ll_register_callbacks cb 0x5653295e8fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968b700 0x5653296ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968b700 0x5653296ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48576/0 (socket says 172.21.15.73:48576) 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5aa00640 1 -- 172.21.15.73:0/1551278524 learned_addr learned my addr 172.21.15.73:0/1551278524 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a52000640 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 0x5653296d3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5b400640 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 0x5653296cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5aa00640 1 -- 172.21.15.73:0/1551278524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 msgr2=0x5653296d3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 0x5653296d3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5aa00640 1 -- 172.21.15.73:0/1551278524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 msgr2=0x5653296cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 0x5653296cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.762+0000 7f0a5aa00640 1 -- 172.21.15.73:0/1551278524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5c0cada0 con 0x56532968b700 2024-03-23T06:10:45.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968b700 0x5653296ce7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c057860 tx=0x7f0a4c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790a75a5d73bb863 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a3fe00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a3fe00640 1 -- 172.21.15.73:0/1551278524 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c073070 con 0x56532968b700 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a3fe00640 1 -- 172.21.15.73:0/1551278524 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f0a4c086030 con 0x56532968b700 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a649d6740 1 -- 172.21.15.73:0/1551278524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565329619b10 con 0x56532968b700 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a3fe00640 1 -- 172.21.15.73:0/1551278524 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4c05fea0 con 0x56532968b700 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a649d6740 10 client.4758 fetch_fsmap learned FSMap version 15 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a649d6740 1 -- 172.21.15.73:0/1551278524 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5653295edff0 con 0x56532968b700 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.763+0000 7f0a3fe00640 1 -- 172.21.15.73:0/1551278524 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565329619b10 con 0x56532968b700 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.764+0000 7f0a3fe00640 1 -- 172.21.15.73:0/1551278524 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7f0a4c076030 con 0x56532968b700 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.764+0000 7f0a649d6740 10 client.4758 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.764+0000 7f0a649d6740 10 client.4758 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.764+0000 7f0a649d6740 20 client.4758 populate_metadata read hostname 'smithi073' 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.764+0000 7f0a649d6740 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] conn(0x5653296dfbc0 0x5653296ea810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.764+0000 7f0a649d6740 4 client.4758 mds_command: new command op to 4256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-23T06:10:45.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.764+0000 7f0a649d6740 1 -- 172.21.15.73:0/1551278524 --> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653292e33c0 con 0x5653296dfbc0 2024-03-23T06:10:45.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.764+0000 7f0a52000640 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] conn(0x5653296dfbc0 0x5653296ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.765+0000 7f0a3fe00640 10 client.4758 ms_handle_connect on v2:172.21.15.73:6836/712461133 2024-03-23T06:10:45.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.765+0000 7f0a52000640 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] conn(0x5653296dfbc0 0x5653296ea810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f78abfb78e41d31 server_cookie=49a07a7e67137630 in_seq=0 out_seq=0 2024-03-23T06:10:45.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.765+0000 7f0a3fe00640 1 -- 172.21.15.73:0/1551278524 <== mds.1 v2:172.21.15.73:6836/712461133 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5653292e33c0 con 0x5653296dfbc0 2024-03-23T06:10:45.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.765+0000 7f0a3fe00640 10 client.4758 handle_command_reply: tid=0 2024-03-23T06:10:45.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.765+0000 7f0a649d6740 1 client.4758 shutdown 2024-03-23T06:10:45.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 -- 172.21.15.73:0/1551278524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968b700 msgr2=0x5653296ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968b700 0x5653296ce7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c057860 tx=0x7f0a4c001250 comp rx=0 tx=0).stop 2024-03-23T06:10:45.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 -- 172.21.15.73:0/1551278524 shutdown_connections 2024-03-23T06:10:45.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] conn(0x5653296dfbc0 0x5653296ea810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 0x5653296cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 0x5653296d3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 --2- 172.21.15.73:0/1551278524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56532968b700 0x5653296ce7a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a3fe00640 0 client.4758 ms_handle_reset on v2:172.21.15.73:6836/712461133 2024-03-23T06:10:45.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 -- 172.21.15.73:0/1551278524 >> 172.21.15.73:0/1551278524 conn(0x56532968a160 msgr2=0x56532968bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 -- 172.21.15.73:0/1551278524 shutdown_connections 2024-03-23T06:10:45.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 1 -- 172.21.15.73:0/1551278524 wait complete. 2024-03-23T06:10:45.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.766+0000 7f0a649d6740 20 client.4758 trim_cache size 0 max 16384 2024-03-23T06:10:45.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.782+0000 7f0a649d6740 1 Processor -- start 2024-03-23T06:10:45.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.782+0000 7f0a649d6740 1 -- start start 2024-03-23T06:10:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x5653296eea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 0x5653296c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296d5580 0x5653296c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a649d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x565329356f20 con 0x5653296d5580 2024-03-23T06:10:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a649d6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653296ce120 con 0x5653296c5320 2024-03-23T06:10:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a649d6740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653296c5d60 con 0x56532968b700 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a5b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296d5580 0x5653296c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a5b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296d5580 0x5653296c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48588/0 (socket says 172.21.15.73:48588) 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a5b400640 1 -- 172.21.15.73:0/827215780 learned_addr learned my addr 172.21.15.73:0/827215780 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a52000640 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 0x5653296c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x5653296eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a5b400640 1 -- 172.21.15.73:0/827215780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 msgr2=0x5653296eea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.783+0000 7f0a5b400640 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x5653296eea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.784+0000 7f0a5b400640 1 -- 172.21.15.73:0/827215780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 msgr2=0x5653296c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.784+0000 7f0a5b400640 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 0x5653296c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.784+0000 7f0a5b400640 1 -- 172.21.15.73:0/827215780 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653295902b0 con 0x5653296d5580 2024-03-23T06:10:45.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.784+0000 7f0a5b400640 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296d5580 0x5653296c9c60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009ce0 tx=0x7f0a54009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e420c44ab5ee992c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.784+0000 7f0a4be00640 1 -- 172.21.15.73:0/827215780 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5401a070 con 0x5653296d5580 2024-03-23T06:10:45.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.784+0000 7f0a4be00640 1 -- 172.21.15.73:0/827215780 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54015c90 con 0x5653296d5580 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.784+0000 7f0a4be00640 1 -- 172.21.15.73:0/827215780 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54015e40 con 0x5653296d5580 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 -- 172.21.15.73:0/827215780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296d5580 msgr2=0x5653296c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296d5580 0x5653296c9c60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009ce0 tx=0x7f0a54009dd0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 -- 172.21.15.73:0/827215780 shutdown_connections 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296d5580 0x5653296c9c60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5653296c5320 0x5653296c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 --2- 172.21.15.73:0/827215780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56532968b700 0x5653296eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 -- 172.21.15.73:0/827215780 >> 172.21.15.73:0/827215780 conn(0x56532968a160 msgr2=0x56532968cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 -- 172.21.15.73:0/827215780 shutdown_connections 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 -- 172.21.15.73:0/827215780 wait complete. 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.785+0000 7f0a649d6740 1 -- start start 2024-03-23T06:10:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.786+0000 7f0a649d6740 1 Processor -- start 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56532968b700 0x565329732600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296c5320 0x56532973c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a649d6740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 0x5653296d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a649d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532973ef80 con 0x5653296c5320 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a649d6740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x565329732b40 con 0x56532968b700 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a649d6740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653296c9fe0 con 0x5653296d5580 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a649d6740 10 client.0 _ll_register_callbacks cb 0x7f0a540096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56532968b700 0x565329732600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a52000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296c5320 0x56532973c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 0x5653296d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56532968b700 0x565329732600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:47394/0 (socket says 172.21.15.73:47394) 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 -- 172.21.15.73:0/2556614851 learned_addr learned my addr 172.21.15.73:0/2556614851 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 -- 172.21.15.73:0/2556614851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 msgr2=0x5653296d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 0x5653296d01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 -- 172.21.15.73:0/2556614851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296c5320 msgr2=0x56532973c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296c5320 0x56532973c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 -- 172.21.15.73:0/2556614851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a54009930 con 0x56532968b700 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a5aa00640 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56532968b700 0x565329732600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c057500 tx=0x7f0a4c001400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c95db6d72b1a7e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.787+0000 7f0a3fe00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a3fe00640 1 -- 172.21.15.73:0/2556614851 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c073020 con 0x56532968b700 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a3fe00640 1 -- 172.21.15.73:0/2556614851 <== mon.1 v2:172.21.15.110:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f0a4c086070 con 0x56532968b700 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 1 -- 172.21.15.73:0/2556614851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a4c055f00 con 0x56532968b700 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a3fe00640 1 -- 172.21.15.73:0/2556614851 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4c076530 con 0x56532968b700 2024-03-23T06:10:45.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 10 client.4894 fetch_fsmap learned FSMap version 15 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 1 -- 172.21.15.73:0/2556614851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5653295b57c0 con 0x56532968b700 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a3fe00640 1 -- 172.21.15.73:0/2556614851 <== mon.1 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c055f00 con 0x56532968b700 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a3fe00640 1 -- 172.21.15.73:0/2556614851 <== mon.1 v2:172.21.15.110:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7f0a4c076040 con 0x56532968b700 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 10 client.4894 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 10 client.4894 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 20 client.4894 populate_metadata read hostname 'smithi073' 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] conn(0x5653296d0830 0x5653296c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 4 client.4894 mds_command: new command op to 4256 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a649d6740 1 -- 172.21.15.73:0/2556614851 --> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5653292f46c0 con 0x5653296d0830 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.788+0000 7f0a52000640 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] conn(0x5653296d0830 0x5653296c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a52000640 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] conn(0x5653296d0830 0x5653296c38a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=842b9d1385feb541 server_cookie=b4d3afa39814366f in_seq=0 out_seq=0 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a3fe00640 10 client.4894 ms_handle_connect on v2:172.21.15.73:6836/712461133 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a3fe00640 1 -- 172.21.15.73:0/2556614851 <== mds.1 v2:172.21.15.73:6836/712461133 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5653292f46c0 con 0x5653296d0830 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a3fe00640 10 client.4894 handle_command_reply: tid=0 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a649d6740 1 client.4894 shutdown 2024-03-23T06:10:45.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a649d6740 1 -- 172.21.15.73:0/2556614851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56532968b700 msgr2=0x565329732600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a649d6740 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56532968b700 0x565329732600 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c057500 tx=0x7f0a4c001400 comp rx=0 tx=0).stop 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a649d6740 1 -- 172.21.15.73:0/2556614851 shutdown_connections 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a649d6740 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.73:6836/712461133,v1:172.21.15.73:6837/712461133] conn(0x5653296d0830 0x5653296c38a0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a649d6740 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5653296d5580 0x5653296d01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a3fe00640 0 client.4894 ms_handle_reset on v2:172.21.15.73:6836/712461133 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.789+0000 7f0a649d6740 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5653296c5320 0x56532973c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a649d6740 1 --2- 172.21.15.73:0/2556614851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56532968b700 0x565329732600 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a649d6740 1 -- 172.21.15.73:0/2556614851 >> 172.21.15.73:0/2556614851 conn(0x56532968a160 msgr2=0x5653296b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a649d6740 1 -- 172.21.15.73:0/2556614851 shutdown_connections 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a649d6740 1 -- 172.21.15.73:0/2556614851 wait complete. 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a649d6740 20 client.4894 trim_cache size 0 max 16384 2024-03-23T06:10:45.793 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 1, 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4256, 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 17.348050279999999, 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 15, 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 27, 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 26, 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 52.670682311999997 2024-03-23T06:10:45.794 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:10:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 -- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0a3806ac00 msgr2=0x7f0a3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0a3806ac00 0x7f0a3806d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a44036000 tx=0x7f0a44008030 comp rx=0 tx=0).stop 2024-03-23T06:10:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 -- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a5c072090 msgr2=0x7f0a5c0c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a5c072090 0x7f0a5c0c3ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c890 tx=0x7f0a4c00cd50 comp rx=0 tx=0).stop 2024-03-23T06:10:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 -- 172.21.15.73:0/1693348493 shutdown_connections 2024-03-23T06:10:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a5c157e60 0x7f0a5c071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0a3806ac00 0x7f0a3806d0c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a5c151480 0x7f0a5c0c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 --2- 172.21.15.73:0/1693348493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a5c072090 0x7f0a5c0c3ad0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:45.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.790+0000 7f0a61c00640 1 -- 172.21.15.73:0/1693348493 >> 172.21.15.73:0/1693348493 conn(0x7f0a5c069cb0 msgr2=0x7f0a5c157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:45.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.791+0000 7f0a61c00640 1 -- 172.21.15.73:0/1693348493 shutdown_connections 2024-03-23T06:10:45.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:45.791+0000 7f0a61c00640 1 -- 172.21.15.73:0/1693348493 wait complete. 2024-03-23T06:10:45.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-23T06:10:46.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.011+0000 7ff7c1800640 1 Processor -- start 2024-03-23T06:10:46.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.011+0000 7ff7c1800640 1 -- start start 2024-03-23T06:10:46.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7c1800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff7bc1536c0 0x7ff7bc159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7c1800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7c1800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc15d920 con 0x7ff7bc0ca4d0 2024-03-23T06:10:46.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7c1800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc15cac0 con 0x7ff7bc1536c0 2024-03-23T06:10:46.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7c1800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc15cd10 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7bb400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7baa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff7bc1536c0 0x7ff7bc159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7b2000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff7bc0ca4d0 0x7ff7bc0caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58680/0 (socket says 172.21.15.73:58680) 2024-03-23T06:10:46.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.013+0000 7ff7b2000640 1 -- 172.21.15.73:0/3178019883 learned_addr learned my addr 172.21.15.73:0/3178019883 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:46.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.014+0000 7ff7bb400640 1 -- 172.21.15.73:0/3178019883 >> v2:172.21.15.110:3300/0 conn(0x7ff7bc1536c0 msgr2=0x7ff7bc159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.014+0000 7ff7bb400640 1 --2- 172.21.15.73:0/3178019883 >> v2:172.21.15.110:3300/0 conn(0x7ff7bc1536c0 0x7ff7bc159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.014+0000 7ff7bb400640 1 -- 172.21.15.73:0/3178019883 >> v1:172.21.15.110:6789/0 conn(0x7ff7bc0ca4d0 legacy=0x7ff7bc0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.014+0000 7ff7bb400640 1 -- 172.21.15.73:0/3178019883 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc15cff0 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.015+0000 7ff7bb400640 1 --2- 172.21.15.73:0/3178019883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc070e70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009d90 tx=0x7ff7b402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222cfcb86653db8a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7ba000640 1 -- 172.21.15.73:0/3178019883 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b402cc50 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7ba000640 1 -- 172.21.15.73:0/3178019883 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b402cdb0 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7ba000640 1 -- 172.21.15.73:0/3178019883 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4034660 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7c1800640 1 -- 172.21.15.73:0/3178019883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 msgr2=0x7ff7bc070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7c1800640 1 --2- 172.21.15.73:0/3178019883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc070e70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009d90 tx=0x7ff7b402bea0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7c1800640 1 -- 172.21.15.73:0/3178019883 shutdown_connections 2024-03-23T06:10:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7c1800640 1 --2- 172.21.15.73:0/3178019883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc070e70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7c1800640 1 --2- 172.21.15.73:0/3178019883 >> v2:172.21.15.110:3300/0 conn(0x7ff7bc1536c0 0x7ff7bc159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.016+0000 7ff7c1800640 1 -- 172.21.15.73:0/3178019883 >> 172.21.15.73:0/3178019883 conn(0x7ff7bc069cb0 msgr2=0x7ff7bc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.017+0000 7ff7c1800640 1 -- 172.21.15.73:0/3178019883 shutdown_connections 2024-03-23T06:10:46.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.017+0000 7ff7c1800640 1 -- 172.21.15.73:0/3178019883 wait complete. 2024-03-23T06:10:46.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.018+0000 7ff7c1800640 1 Processor -- start 2024-03-23T06:10:46.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.018+0000 7ff7c1800640 1 -- start start 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.019+0000 7ff7c1800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc14df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.019+0000 7ff7c1800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0ca4d0 0x7ff7bc1f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.019+0000 7ff7c1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7bc1536c0 0x7ff7bc15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.019+0000 7ff7c1800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1f32c0 con 0x7ff7bc0ca4d0 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.019+0000 7ff7c1800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc15b340 con 0x7ff7bc1536c0 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.019+0000 7ff7c1800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1f3000 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7b2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0ca4d0 0x7ff7bc1f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7b2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0ca4d0 0x7ff7bc1f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48608/0 (socket says 172.21.15.73:48608) 2024-03-23T06:10:46.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7b2000640 1 -- 172.21.15.73:0/649306644 learned_addr learned my addr 172.21.15.73:0/649306644 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:46.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7baa00640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc14df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7bb400640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7bc1536c0 0x7ff7bc15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7baa00640 1 -- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7bc1536c0 msgr2=0x7ff7bc15b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7baa00640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7bc1536c0 0x7ff7bc15b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7baa00640 1 -- 172.21.15.73:0/649306644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0ca4d0 msgr2=0x7ff7bc1f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7baa00640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0ca4d0 0x7ff7bc1f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7baa00640 1 -- 172.21.15.73:0/649306644 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4009a70 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.020+0000 7ff7baa00640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc14df00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00e870 tx=0x7ff7ac00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.021+0000 7ff7b3400640 1 -- 172.21.15.73:0/649306644 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00ee60 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.021+0000 7ff7b3400640 1 -- 172.21.15.73:0/649306644 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac00c940 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.021+0000 7ff7c1800640 1 -- 172.21.15.73:0/649306644 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc15c3f0 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.021+0000 7ff7b3400640 1 -- 172.21.15.73:0/649306644 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00ccd0 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.021+0000 7ff7c1800640 1 -- 172.21.15.73:0/649306644 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc14e440 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.023+0000 7ff7b3400640 1 -- 172.21.15.73:0/649306644 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff7ac013470 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.024+0000 7ff7b3400640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff79806ac30 0x7ff79806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.024+0000 7ff7b3400640 1 -- 172.21.15.73:0/649306644 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff7ac089770 con 0x7ff7bc0c8eb0 2024-03-23T06:10:46.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.024+0000 7ff7b2000640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff79806ac30 0x7ff79806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.024+0000 7ff7c43fd740 1 Processor -- start 2024-03-23T06:10:46.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.025+0000 7ff7c43fd740 1 -- start start 2024-03-23T06:10:46.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.025+0000 7ff7b2000640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff79806ac30 0x7ff79806d0f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc072110 tx=0x7ff7a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.025+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.025+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 0x5634d67a7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a5160 0x5634d67e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d677c2c0 con 0x5634d67a6700 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d67118f0 con 0x5634d67a5160 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634d670f080 con 0x5634d67f0580 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7baa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7b2000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 0x5634d67a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7bb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a5160 0x5634d67e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7baa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48620/0 (socket says 172.21.15.73:48620) 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7baa00640 1 -- 172.21.15.73:0/3087402470 learned_addr learned my addr 172.21.15.73:0/3087402470 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7bb400640 1 -- 172.21.15.73:0/3087402470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 msgr2=0x5634d67a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7bb400640 1 --2- 172.21.15.73:0/3087402470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 0x5634d67a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7bb400640 1 -- 172.21.15.73:0/3087402470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 msgr2=0x5634d67a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7bb400640 1 --2- 172.21.15.73:0/3087402470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.026+0000 7ff7bb400640 1 -- 172.21.15.73:0/3087402470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634d66d5a10 con 0x5634d67a5160 2024-03-23T06:10:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7bb400640 1 --2- 172.21.15.73:0/3087402470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a5160 0x5634d67e5f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4033000 tx=0x7ff7b402e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec5270ee7faaa9c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7ab400640 1 -- 172.21.15.73:0/3087402470 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4034640 con 0x5634d67a5160 2024-03-23T06:10:46.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7ab400640 1 -- 172.21.15.73:0/3087402470 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b40347a0 con 0x5634d67a5160 2024-03-23T06:10:46.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7ab400640 1 -- 172.21.15.73:0/3087402470 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4034b50 con 0x5634d67a5160 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7c43fd740 1 -- 172.21.15.73:0/3087402470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a5160 msgr2=0x5634d67e5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/3087402470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a5160 0x5634d67e5f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4033000 tx=0x7ff7b402e000 comp rx=0 tx=0).stop 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7c43fd740 1 -- 172.21.15.73:0/3087402470 shutdown_connections 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/3087402470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a5160 0x5634d67e5f60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/3087402470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 0x5634d67a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.027+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/3087402470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.028+0000 7ff7c43fd740 1 -- 172.21.15.73:0/3087402470 >> 172.21.15.73:0/3087402470 conn(0x5634d67a2e70 msgr2=0x5634d67a57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.028+0000 7ff7c43fd740 1 -- 172.21.15.73:0/3087402470 shutdown_connections 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.028+0000 7ff7c43fd740 1 -- 172.21.15.73:0/3087402470 wait complete. 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.028+0000 7ff7c43fd740 1 -- start start 2024-03-23T06:10:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.029+0000 7ff7c43fd740 1 Processor -- start 2024-03-23T06:10:46.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.029+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67e7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.029+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67f0580 0x5634d67f7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d67bf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d670a970 con 0x5634d67a6700 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d66ac0a0 con 0x5634d67f0580 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634d66abd40 con 0x5634d67efb20 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7c43fd740 10 client.0 _ll_register_callbacks cb 0x5634d6703fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67e7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67e7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48636/0 (socket says 172.21.15.73:48636) 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 -- 172.21.15.73:0/1671671850 learned_addr learned my addr 172.21.15.73:0/1671671850 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7b2000640 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67f0580 0x5634d67f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7bb400640 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d67bf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 -- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 msgr2=0x5634d67bf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d67bf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 -- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67f0580 msgr2=0x5634d67f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67f0580 0x5634d67f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 -- 172.21.15.73:0/1671671850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc15cff0 con 0x5634d67a6700 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7bb400640 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d67bf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff7baa00640 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67e7450 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac087830 tx=0x7ff7ac00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73115663226be4b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.030+0000 7ff79fe00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff79fe00640 1 -- 172.21.15.73:0/1671671850 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0605f0 con 0x5634d67a6700 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff79fe00640 1 -- 172.21.15.73:0/1671671850 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff7ac060160 con 0x5634d67a6700 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 1 -- 172.21.15.73:0/1671671850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634d6734b10 con 0x5634d67a6700 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff79fe00640 1 -- 172.21.15.73:0/1671671850 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7ac060320 con 0x5634d67a6700 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 10 client.4773 fetch_fsmap learned FSMap version 15 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 1 -- 172.21.15.73:0/1671671850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5634d6708ff0 con 0x5634d67a6700 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff79fe00640 1 -- 172.21.15.73:0/1671671850 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac075020 con 0x5634d67a6700 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff79fe00640 1 -- 172.21.15.73:0/1671671850 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7ff7ac011070 con 0x5634d67a6700 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 10 client.4773 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 10 client.4773 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-23T06:10:46.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 20 client.4773 populate_metadata read hostname 'smithi073' 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x5634d67faf80 0x5634d6805ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 4 client.4773 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.031+0000 7ff7c43fd740 1 -- 172.21.15.73:0/1671671850 --> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634d63fe3c0 con 0x5634d67faf80 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.032+0000 7ff7b2000640 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x5634d67faf80 0x5634d6805ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.032+0000 7ff7b2000640 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x5634d67faf80 0x5634d6805ac0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2abe8a9fdc04a165 server_cookie=e7c6ecb6caa59022 in_seq=0 out_seq=0 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.032+0000 7ff79fe00640 10 client.4773 ms_handle_connect on v2:172.21.15.110:6834/3132183330 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.033+0000 7ff79fe00640 1 -- 172.21.15.73:0/1671671850 <== mds.0 v2:172.21.15.110:6834/3132183330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5634d63fe3c0 con 0x5634d67faf80 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.033+0000 7ff79fe00640 10 client.4773 handle_command_reply: tid=0 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.033+0000 7ff7c43fd740 1 client.4773 shutdown 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.033+0000 7ff7c43fd740 1 -- 172.21.15.73:0/1671671850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 msgr2=0x5634d67e7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.033+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67e7450 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac087830 tx=0x7ff7ac00cef0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 1 -- 172.21.15.73:0/1671671850 shutdown_connections 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x5634d67faf80 0x5634d6805ac0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d67bf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67f0580 0x5634d67f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/1671671850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67a6700 0x5634d67e7450 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 1 -- 172.21.15.73:0/1671671850 >> 172.21.15.73:0/1671671850 conn(0x5634d67a5160 msgr2=0x5634d67a6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:46.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff79fe00640 0 client.4773 ms_handle_reset on v2:172.21.15.110:6834/3132183330 2024-03-23T06:10:46.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 1 -- 172.21.15.73:0/1671671850 shutdown_connections 2024-03-23T06:10:46.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 1 -- 172.21.15.73:0/1671671850 wait complete. 2024-03-23T06:10:46.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.034+0000 7ff7c43fd740 20 client.4773 trim_cache size 0 max 16384 2024-03-23T06:10:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.050+0000 7ff7c43fd740 1 Processor -- start 2024-03-23T06:10:46.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.050+0000 7ff7c43fd740 1 -- start start 2024-03-23T06:10:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67f7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67efb20 0x5634d6809ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 0x5634d680a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d6471f20 con 0x5634d67efb20 2024-03-23T06:10:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d67a83e0 con 0x5634d67a6700 2024-03-23T06:10:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634d67a07e0 con 0x5634d67f0580 2024-03-23T06:10:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7b2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67efb20 0x5634d6809ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7b2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67efb20 0x5634d6809ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48642/0 (socket says 172.21.15.73:48642) 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7b2000640 1 -- 172.21.15.73:0/402839403 learned_addr learned my addr 172.21.15.73:0/402839403 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7bb400640 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 0x5634d680a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.051+0000 7ff7baa00640 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7b2000640 1 -- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 msgr2=0x5634d680a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7b2000640 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 0x5634d680a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7b2000640 1 -- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 msgr2=0x5634d67f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7b2000640 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7b2000640 1 -- 172.21.15.73:0/402839403 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634d66ab2b0 con 0x5634d67efb20 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7baa00640 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:46.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7b2000640 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67efb20 0x5634d6809ae0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4005880 tx=0x7ff7a4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0b6016cd769e9a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7abe00640 1 -- 172.21.15.73:0/402839403 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4028040 con 0x5634d67efb20 2024-03-23T06:10:46.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7abe00640 1 -- 172.21.15.73:0/402839403 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a4029240 con 0x5634d67efb20 2024-03-23T06:10:46.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.052+0000 7ff7abe00640 1 -- 172.21.15.73:0/402839403 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400fc80 con 0x5634d67efb20 2024-03-23T06:10:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 -- 172.21.15.73:0/402839403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67efb20 msgr2=0x5634d6809ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67efb20 0x5634d6809ae0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4005880 tx=0x7ff7a4014000 comp rx=0 tx=0).stop 2024-03-23T06:10:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 -- 172.21.15.73:0/402839403 shutdown_connections 2024-03-23T06:10:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67f0580 0x5634d680a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67efb20 0x5634d6809ae0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/402839403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 -- 172.21.15.73:0/402839403 >> 172.21.15.73:0/402839403 conn(0x5634d67a5160 msgr2=0x5634d67a46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 -- 172.21.15.73:0/402839403 shutdown_connections 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 -- 172.21.15.73:0/402839403 wait complete. 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.053+0000 7ff7c43fd740 1 -- start start 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.054+0000 7ff7c43fd740 1 Processor -- start 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67e1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d6809ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7c43fd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67f0580 0x5634d67c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d680a420 con 0x5634d67f0580 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634d684e030 con 0x5634d67a6700 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7c43fd740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634d68015d0 con 0x5634d67efb20 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7c43fd740 10 client.0 _ll_register_callbacks cb 0x5634d67a8720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-23T06:10:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7bb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67f0580 0x5634d67c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7bb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67f0580 0x5634d67c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48652/0 (socket says 172.21.15.73:48652) 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7bb400640 1 -- 172.21.15.73:0/158485690 learned_addr learned my addr 172.21.15.73:0/158485690 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7b2000640 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d6809ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7baa00640 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7bb400640 1 -- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 msgr2=0x5634d6809ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7bb400640 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d6809ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7bb400640 1 -- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 msgr2=0x5634d67e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7bb400640 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.055+0000 7ff7bb400640 1 -- 172.21.15.73:0/158485690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc15d920 con 0x5634d67f0580 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff7bb400640 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67f0580 0x5634d67c5b40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009d90 tx=0x7ff7b4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba7afb80d684ad server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff79fe00640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff79fe00640 1 -- 172.21.15.73:0/158485690 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4034910 con 0x5634d67f0580 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff79fe00640 1 -- 172.21.15.73:0/158485690 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff7b404f070 con 0x5634d67f0580 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff7c43fd740 1 -- 172.21.15.73:0/158485690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7b40347a0 con 0x5634d67f0580 2024-03-23T06:10:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff79fe00640 1 -- 172.21.15.73:0/158485690 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7b4034a70 con 0x5634d67f0580 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff7c43fd740 10 client.4779 fetch_fsmap learned FSMap version 15 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff7c43fd740 1 -- 172.21.15.73:0/158485690 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5634d66d07c0 con 0x5634d67f0580 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.056+0000 7ff79fe00640 1 -- 172.21.15.73:0/158485690 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b40347a0 con 0x5634d67f0580 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.057+0000 7ff79fe00640 1 -- 172.21.15.73:0/158485690 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) v1 ==== 4236+0+0 (secure 0 0 0) 0x7ff7b4034bd0 con 0x5634d67f0580 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.057+0000 7ff7c43fd740 10 client.4779 fetch_fsmap finished waiting for FSMap version 15 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.057+0000 7ff7c43fd740 10 client.4779 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.057+0000 7ff7c43fd740 20 client.4779 populate_metadata read hostname 'smithi073' 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.057+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x5634d68510d0 0x5634d67c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.057+0000 7ff7c43fd740 4 client.4779 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.057+0000 7ff7c43fd740 1 -- 172.21.15.73:0/158485690 --> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5634d640f6c0 con 0x5634d68510d0 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.057+0000 7ff7baa00640 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x5634d68510d0 0x5634d67c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7baa00640 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x5634d68510d0 0x5634d67c6080 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cab54104d8adbadd server_cookie=832c44cd9202dac in_seq=0 out_seq=0 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff79fe00640 10 client.4779 ms_handle_connect on v2:172.21.15.110:6834/3132183330 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff79fe00640 1 -- 172.21.15.73:0/158485690 <== mds.0 v2:172.21.15.110:6834/3132183330 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5634d640f6c0 con 0x5634d68510d0 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff79fe00640 10 client.4779 handle_command_reply: tid=0 2024-03-23T06:10:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 client.4779 shutdown 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 -- 172.21.15.73:0/158485690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67f0580 msgr2=0x5634d67c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67f0580 0x5634d67c5b40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009d90 tx=0x7ff7b4004ab0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 -- 172.21.15.73:0/158485690 shutdown_connections 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:6834/3132183330,v1:172.21.15.110:6837/3132183330] conn(0x5634d68510d0 0x5634d67c6080 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5634d67f0580 0x5634d67c5b40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5634d67efb20 0x5634d6809ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 --2- 172.21.15.73:0/158485690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5634d67a6700 0x5634d67e1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff79fe00640 0 client.4779 ms_handle_reset on v2:172.21.15.110:6834/3132183330 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 -- 172.21.15.73:0/158485690 >> 172.21.15.73:0/158485690 conn(0x5634d67a5160 msgr2=0x5634d67a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 -- 172.21.15.73:0/158485690 shutdown_connections 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 1 -- 172.21.15.73:0/158485690 wait complete. 2024-03-23T06:10:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.058+0000 7ff7c43fd740 20 client.4779 trim_cache size 0 max 16384 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4282, 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 48.137901098999997, 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 15, 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 27, 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 26, 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 53.007876244000002 2024-03-23T06:10:46.063 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:10:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 -- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff79806ac30 msgr2=0x7ff79806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff79806ac30 0x7ff79806d0f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc072110 tx=0x7ff7a4009040 comp rx=0 tx=0).stop 2024-03-23T06:10:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 -- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 msgr2=0x7ff7bc14df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc14df00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00e870 tx=0x7ff7ac00ed30 comp rx=0 tx=0).stop 2024-03-23T06:10:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 -- 172.21.15.73:0/649306644 shutdown_connections 2024-03-23T06:10:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7bc1536c0 0x7ff7bc15b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7bc0ca4d0 0x7ff7bc1f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff79806ac30 0x7ff79806d0f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 --2- 172.21.15.73:0/649306644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7bc0c8eb0 0x7ff7bc14df00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 -- 172.21.15.73:0/649306644 >> 172.21.15.73:0/649306644 conn(0x7ff7bc069cb0 msgr2=0x7ff7bc0caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 -- 172.21.15.73:0/649306644 shutdown_connections 2024-03-23T06:10:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.059+0000 7ff7c1800640 1 -- 172.21.15.73:0/649306644 wait complete. 2024-03-23T06:10:46.076 INFO:teuthology.run_tasks:Running task kclient... 2024-03-23T06:10:46.093 INFO:tasks.kclient:Mounting kernel clients... 2024-03-23T06:10:46.093 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-23T06:10:46.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:46.093 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-23T06:10:46.144 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-23T06:10:46.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:46.146 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-23T06:10:46.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:46.240 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-03-23T06:10:46.364 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-23T06:10:46.364 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-23T06:10:46.364 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-23T06:10:46.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-23T06:10:46.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.548+0000 7fdcb2000640 1 Processor -- start 2024-03-23T06:10:46.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.548+0000 7fdcb2000640 1 -- start start 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.549+0000 7fdcb2000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdcac0c5a10 0x7fdcac0bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.549+0000 7fdcb2000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c03a0 0x7fdcac071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdcb2000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac157b60 con 0x7fdcac1513f0 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdcb2000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac158dc0 con 0x7fdcac0c5a10 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdcb2000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0c0830 con 0x7fdcac0c03a0 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdca2a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdcac0c5a10 0x7fdcac0bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdcabe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c03a0 0x7fdcac071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdcab400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fdcac1513f0 0x7fdcac1586b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58696/0 (socket says 172.21.15.73:58696) 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdcab400640 1 -- 172.21.15.73:0/55635606 learned_addr learned my addr 172.21.15.73:0/55635606 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:46.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdca2a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdcac0c5a10 0x7fdcac0bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:47464/0 (socket says 172.21.15.73:47464) 2024-03-23T06:10:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdca2a00640 1 -- 172.21.15.73:0/55635606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c03a0 msgr2=0x7fdcac071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdca2a00640 1 --2- 172.21.15.73:0/55635606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c03a0 0x7fdcac071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdca2a00640 1 -- 172.21.15.73:0/55635606 >> v1:172.21.15.110:6789/0 conn(0x7fdcac1513f0 legacy=0x7fdcac1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdcaaa00640 1 -- 172.21.15.73:0/55635606 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484388038 0 0) 0x7fdcac157b60 con 0x7fdcac1513f0 2024-03-23T06:10:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.550+0000 7fdca2a00640 1 -- 172.21.15.73:0/55635606 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac0c0b10 con 0x7fdcac0c5a10 2024-03-23T06:10:46.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.552+0000 7fdca2a00640 1 --2- 172.21.15.73:0/55635606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac0c5a10 0x7fdcac0bfe60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdc940097a0 tx=0x7fdc9402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8c96f0bde10fe63 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.552+0000 7fdcaaa00640 1 -- 172.21.15.73:0/55635606 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94030610 con 0x7fdcac0c5a10 2024-03-23T06:10:46.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.552+0000 7fdcaaa00640 1 -- 172.21.15.73:0/55635606 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94030770 con 0x7fdcac0c5a10 2024-03-23T06:10:46.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.552+0000 7fdcaaa00640 1 -- 172.21.15.73:0/55635606 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94030b00 con 0x7fdcac0c5a10 2024-03-23T06:10:46.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.553+0000 7fdcb2000640 1 -- 172.21.15.73:0/55635606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac0c5a10 msgr2=0x7fdcac0bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.553+0000 7fdcb2000640 1 --2- 172.21.15.73:0/55635606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac0c5a10 0x7fdcac0bfe60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdc940097a0 tx=0x7fdc9402b960 comp rx=0 tx=0).stop 2024-03-23T06:10:46.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.553+0000 7fdcb2000640 1 -- 172.21.15.73:0/55635606 shutdown_connections 2024-03-23T06:10:46.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.553+0000 7fdcb2000640 1 --2- 172.21.15.73:0/55635606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c03a0 0x7fdcac071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.553+0000 7fdcb2000640 1 --2- 172.21.15.73:0/55635606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac0c5a10 0x7fdcac0bfe60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.553+0000 7fdcb2000640 1 -- 172.21.15.73:0/55635606 >> 172.21.15.73:0/55635606 conn(0x7fdcac06bb40 msgr2=0x7fdcac06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:46.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.553+0000 7fdcb2000640 1 -- 172.21.15.73:0/55635606 shutdown_connections 2024-03-23T06:10:46.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.553+0000 7fdcb2000640 1 -- 172.21.15.73:0/55635606 wait complete. 2024-03-23T06:10:46.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.555+0000 7fdcb2000640 1 Processor -- start 2024-03-23T06:10:46.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.555+0000 7fdcb2000640 1 -- start start 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcb2000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcac0c5a10 0x7fdcac155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcb2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac1513f0 0x7fdcac0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcb2000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c2370 0x7fdcac070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcb2000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac155030 con 0x7fdcac0c5a10 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcb2000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac1555f0 con 0x7fdcac1513f0 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcb2000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac156a10 con 0x7fdcac0c2370 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcab400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcac0c5a10 0x7fdcac155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcab400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcac0c5a10 0x7fdcac155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48668/0 (socket says 172.21.15.73:48668) 2024-03-23T06:10:46.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcab400640 1 -- 172.21.15.73:0/2666188145 learned_addr learned my addr 172.21.15.73:0/2666188145 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdcabe00640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c2370 0x7fdcac070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.556+0000 7fdca2a00640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac1513f0 0x7fdcac0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdcab400640 1 -- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c2370 msgr2=0x7fdcac070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdcab400640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c2370 0x7fdcac070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdcab400640 1 -- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac1513f0 msgr2=0x7fdcac0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdcab400640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac1513f0 0x7fdcac0707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdcab400640 1 -- 172.21.15.73:0/2666188145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc94009400 con 0x7fdcac0c5a10 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdca2a00640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac1513f0 0x7fdcac0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdcab400640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcac0c5a10 0x7fdcac155a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c430 tx=0x7fdc9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdca3e00640 1 -- 172.21.15.73:0/2666188145 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0074e0 con 0x7fdcac0c5a10 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdca3e00640 1 -- 172.21.15.73:0/2666188145 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c007660 con 0x7fdcac0c5a10 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdca3e00640 1 -- 172.21.15.73:0/2666188145 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c004a20 con 0x7fdcac0c5a10 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac1e1680 con 0x7fdcac0c5a10 2024-03-23T06:10:46.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.557+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac156cb0 con 0x7fdcac0c5a10 2024-03-23T06:10:46.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.558+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac0ca8e0 con 0x7fdcac0c5a10 2024-03-23T06:10:46.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.559+0000 7fdca3e00640 1 -- 172.21.15.73:0/2666188145 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdc9c004b80 con 0x7fdcac0c5a10 2024-03-23T06:10:46.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.560+0000 7fdca3e00640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdc8806ac30 0x7fdc8806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:46.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.560+0000 7fdca3e00640 1 -- 172.21.15.73:0/2666188145 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fdc9c089540 con 0x7fdcac0c5a10 2024-03-23T06:10:46.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.561+0000 7fdca2a00640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdc8806ac30 0x7fdc8806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:46.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.561+0000 7fdca2a00640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdc8806ac30 0x7fdc8806d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc94036000 tx=0x7fdc94008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:46.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.565+0000 7fdca3e00640 1 -- 172.21.15.73:0/2666188145 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fdc9c054310 con 0x7fdcac0c5a10 2024-03-23T06:10:46.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.802+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdcac04e110 con 0x7fdcac0c5a10 2024-03-23T06:10:46.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.802+0000 7fdca3e00640 1 -- 172.21.15.73:0/2666188145 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdc9c057930 con 0x7fdcac0c5a10 2024-03-23T06:10:46.802 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-23T06:10:46.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdc8806ac30 msgr2=0x7fdc8806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdc8806ac30 0x7fdc8806d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc94036000 tx=0x7fdc94008030 comp rx=0 tx=0).stop 2024-03-23T06:10:46.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcac0c5a10 msgr2=0x7fdcac155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:46.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcac0c5a10 0x7fdcac155a80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c430 tx=0x7fdc9c00c8f0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 shutdown_connections 2024-03-23T06:10:46.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdc8806ac30 0x7fdc8806d0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdcac0c2370 0x7fdcac070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcac1513f0 0x7fdcac0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 --2- 172.21.15.73:0/2666188145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcac0c5a10 0x7fdcac155a80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:46.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 >> 172.21.15.73:0/2666188145 conn(0x7fdcac06bb40 msgr2=0x7fdcac14f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:46.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 shutdown_connections 2024-03-23T06:10:46.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:46.805+0000 7fdcb2000640 1 -- 172.21.15.73:0/2666188145 wait complete. 2024-03-23T06:10:46.823 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-23T06:10:46.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-23T06:10:46.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-03-23T06:10:46.823 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-23T06:10:46.823 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-23T06:10:46.823 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-23T06:10:46.823 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-23T06:10:46.823 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-23T06:10:46.824 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-23T06:10:46.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:46.824 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-03-23T06:10:46.870 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-23T06:10:46.871 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-03-23T06:10:46.872 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-23T06:10:46.872 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-03-23T06:10:46.872 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-23T06:10:46.872 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42452sec preferred_lft 42452sec 2024-03-23T06:10:46.872 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-03-23T06:10:46.872 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-23T06:10:46.873 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-23T06:10:46.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:46.873 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:46.873 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:46.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-03-23T06:10:46.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-03-23T06:10:46.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-03-23T06:10:46.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-23T06:10:46.873 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:47.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:47.081 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-23T06:10:47.153 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-03-23T06:10:47.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:47.157 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-03-23T06:10:47.204 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-03-23T06:10:47.204 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-23T06:10:47.204 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-23T06:10:47.204 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-23T06:10:47.204 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-23T06:10:47.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:47.204 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:47.204 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:47.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-23T06:10:47.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-23T06:10:47.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-23T06:10:47.205 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:47.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:47.432 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-23T06:10:47.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:47.484 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-03-23T06:10:47.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:47.535 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:47.535 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:47.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-23T06:10:47.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-23T06:10:47.536 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:47.670 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-23T06:10:47.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:47.670 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:47.670 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:47.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-23T06:10:47.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-23T06:10:47.670 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-23T06:10:47.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-23T06:10:47.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-23T06:10:47.671 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:47.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:47.926 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-03-23T06:10:47.927 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-23T06:10:47.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-03-23T06:10:47.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-03-23T06:10:47.927 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-23T06:10:48.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-23T06:10:48.085 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-23T06:10:48.134 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-23T06:10:48.134 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-23T06:10:48.134 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-23T06:10:48.229 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-23T06:10:48.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:48.230 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-23T06:10:48.365 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-23T06:10:48.365 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-23T06:10:48.365 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-23T06:10:49.016 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-23T06:10:49.017 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-23T06:10:49.017 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-23T06:10:49.017 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-03-23T06:10:49.017 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-23T06:10:49.051 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-23T06:10:49.051 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-23T06:10:49.051 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-23T06:10:49.051 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-03-23T06:10:49.051 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-23T06:10:49.051 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.110:6789,172.21.15.110:6790" 2024-03-23T06:10:49.051 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.110:6789,172.21.15.110:6790:/ 2024-03-23T06:10:49.051 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=4707007f-1ceb-450e-b69b-d09789f75edc" will pass to kernel 2024-03-23T06:10:49.056 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-23T06:10:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2024-03-23T06:10:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-23T06:10:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2024-03-23T06:10:49.056 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-23T06:10:49.062 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-23T06:10:49.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:49.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-23T06:10:49.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:49.148 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T06:10:49.206 INFO:teuthology.orchestra.run.smithi073.stdout:client4927 2024-03-23T06:10:49.206 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:10:49.206 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T06:10:49.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:49.258 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T06:10:49.313 INFO:teuthology.orchestra.run.smithi073.stdout:client4927 2024-03-23T06:10:49.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:49.314 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-23T06:10:49.368 INFO:teuthology.orchestra.run.smithi073.stdout:client4927 2024-03-23T06:10:49.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:10:49.368 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4707007f-1ceb-450e-b69b-d09789f75edc.client4927/status') 2024-03-23T06:10:49.454 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4927 (3)172.21.15.73:0/4285372265 2024-03-23T06:10:49.455 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2024-03-23T06:10:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2024-03-23T06:10:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2024-03-23T06:10:49.455 INFO:teuthology.orchestra.run.smithi073.stderr:70 bytes copied, 6.4458e-05 s, 1.1 MB/s 2024-03-23T06:10:49.459 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-03-23T06:10:49.470 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-03-23T06:10:49.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:49.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.673+0000 7fa9a9c00640 1 Processor -- start 2024-03-23T06:10:49.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.673+0000 7fa9a9c00640 1 -- start start 2024-03-23T06:10:49.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.674+0000 7fa9a9c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a40c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:49.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.674+0000 7fa9a9c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a40c60a0 con 0x7fa9a4159ce0 2024-03-23T06:10:49.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a9c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a40c6c50 con 0x7fa9a4159900 2024-03-23T06:10:49.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a9c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40c6f30 con 0x7fa9a40c6780 2024-03-23T06:10:49.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a9200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa9a4159ce0 0x7fa9a414fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38436/0 (socket says 172.21.15.73:38436) 2024-03-23T06:10:49.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa9a4159900 0x7fa9a40c31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:58710/0 (socket says 172.21.15.73:58710) 2024-03-23T06:10:49.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a9200640 1 -- 172.21.15.73:0/1524453701 learned_addr learned my addr 172.21.15.73:0/1524453701 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:49.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a3400640 1 --2- 172.21.15.73:0/1524453701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a40c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:49.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a2a00640 1 -- 172.21.15.73:0/1524453701 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373770278 0 0) 0x7fa9a40c6c50 con 0x7fa9a4159900 2024-03-23T06:10:49.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a2a00640 1 -- 172.21.15.73:0/1524453701 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa988005730 con 0x7fa9a4159900 2024-03-23T06:10:49.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a2a00640 1 -- 172.21.15.73:0/1524453701 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806549095 0 0) 0x7fa9a40c60a0 con 0x7fa9a4159ce0 2024-03-23T06:10:49.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a3400640 1 -- 172.21.15.73:0/1524453701 >> v1:172.21.15.110:6789/0 conn(0x7fa9a4159900 legacy=0x7fa9a40c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:49.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a3400640 1 -- 172.21.15.73:0/1524453701 >> v1:172.21.15.73:6789/0 conn(0x7fa9a4159ce0 legacy=0x7fa9a414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:49.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.675+0000 7fa9a3400640 1 -- 172.21.15.73:0/1524453701 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a40c7210 con 0x7fa9a40c6780 2024-03-23T06:10:49.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.676+0000 7fa9a3400640 1 --2- 172.21.15.73:0/1524453701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a40c5b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa9900097d0 tx=0x7fa99002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f6bf871b5725ef server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:49.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a2a00640 1 -- 172.21.15.73:0/1524453701 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990031890 con 0x7fa9a40c6780 2024-03-23T06:10:49.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a2a00640 1 -- 172.21.15.73:0/1524453701 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9900319f0 con 0x7fa9a40c6780 2024-03-23T06:10:49.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a2a00640 1 -- 172.21.15.73:0/1524453701 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990031d80 con 0x7fa9a40c6780 2024-03-23T06:10:49.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a9c00640 1 -- 172.21.15.73:0/1524453701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 msgr2=0x7fa9a40c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:49.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a9c00640 1 --2- 172.21.15.73:0/1524453701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a40c5b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa9900097d0 tx=0x7fa99002b930 comp rx=0 tx=0).stop 2024-03-23T06:10:49.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a9c00640 1 -- 172.21.15.73:0/1524453701 shutdown_connections 2024-03-23T06:10:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a9c00640 1 --2- 172.21.15.73:0/1524453701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a40c5b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a9c00640 1 -- 172.21.15.73:0/1524453701 >> 172.21.15.73:0/1524453701 conn(0x7fa9a4069cb0 msgr2=0x7fa9a406a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a9c00640 1 -- 172.21.15.73:0/1524453701 shutdown_connections 2024-03-23T06:10:49.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.677+0000 7fa9a9c00640 1 -- 172.21.15.73:0/1524453701 wait complete. 2024-03-23T06:10:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.679+0000 7fa9a9c00640 1 Processor -- start 2024-03-23T06:10:49.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.679+0000 7fa9a9c00640 1 -- start start 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.680+0000 7fa9a9c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a4150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.680+0000 7fa9a9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9a4159900 0x7fa9a40bc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.680+0000 7fa9a9c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a4159ce0 0x7fa9a40bc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.680+0000 7fa9a9c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40bdd60 con 0x7fa9a4159ce0 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.680+0000 7fa9a9c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40be4d0 con 0x7fa9a4159900 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.680+0000 7fa9a9c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40bdf10 con 0x7fa9a40c6780 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.680+0000 7fa9a9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a4159ce0 0x7fa9a40bc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a4150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9a4159900 0x7fa9a40bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a4159ce0 0x7fa9a40bc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48678/0 (socket says 172.21.15.73:48678) 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a9200640 1 -- 172.21.15.73:0/2394590196 learned_addr learned my addr 172.21.15.73:0/2394590196 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:49.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a3e00640 1 -- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9a4159900 msgr2=0x7fa9a40bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:49.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a3e00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9a4159900 0x7fa9a40bc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:49.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a3e00640 1 -- 172.21.15.73:0/2394590196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a4159ce0 msgr2=0x7fa9a40bc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:49.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a3e00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a4159ce0 0x7fa9a40bc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:49.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a3e00640 1 -- 172.21.15.73:0/2394590196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990009400 con 0x7fa9a40c6780 2024-03-23T06:10:49.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a9200640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a4159ce0 0x7fa9a40bc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:49.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa9a3e00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a4150a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c430 tx=0x7fa99400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:49.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.681+0000 7fa99be00640 1 -- 172.21.15.73:0/2394590196 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9940074e0 con 0x7fa9a40c6780 2024-03-23T06:10:49.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.682+0000 7fa99be00640 1 -- 172.21.15.73:0/2394590196 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa994007660 con 0x7fa9a40c6780 2024-03-23T06:10:49.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.682+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a40be1f0 con 0x7fa9a40c6780 2024-03-23T06:10:49.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.682+0000 7fa99be00640 1 -- 172.21.15.73:0/2394590196 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa994004a20 con 0x7fa9a40c6780 2024-03-23T06:10:49.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.682+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a4156470 con 0x7fa9a40c6780 2024-03-23T06:10:49.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.683+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a404e030 con 0x7fa9a40c6780 2024-03-23T06:10:49.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.684+0000 7fa99be00640 1 -- 172.21.15.73:0/2394590196 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa994004b80 con 0x7fa9a40c6780 2024-03-23T06:10:49.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.685+0000 7fa99be00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa98406ac30 0x7fa98406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:49.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.685+0000 7fa99be00640 1 -- 172.21.15.73:0/2394590196 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fa994088ff0 con 0x7fa9a40c6780 2024-03-23T06:10:49.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.685+0000 7fa9a3400640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa98406ac30 0x7fa98406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:49.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.686+0000 7fa9a3400640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa98406ac30 0x7fa98406d0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa990036000 tx=0x7fa99003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:49.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.689+0000 7fa99be00640 1 -- 172.21.15.73:0/2394590196 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa994053f00 con 0x7fa9a40c6780 2024-03-23T06:10:49.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.884+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9a40c3270 con 0x7fa9a40c6780 2024-03-23T06:10:49.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.886+0000 7fa99be00640 1 -- 172.21.15.73:0/2394590196 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18088 (secure 0 0 0) 0x7fa994057520 con 0x7fa9a40c6780 2024-03-23T06:10:49.886 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:49.886 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:39.659625+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2},{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:49.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa98406ac30 msgr2=0x7fa98406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:49.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa98406ac30 0x7fa98406d0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa990036000 tx=0x7fa99003c040 comp rx=0 tx=0).stop 2024-03-23T06:10:49.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 msgr2=0x7fa9a4150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:49.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a4150a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c430 tx=0x7fa99400c8f0 comp rx=0 tx=0).stop 2024-03-23T06:10:49.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 shutdown_connections 2024-03-23T06:10:49.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9a4159ce0 0x7fa9a40bc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:49.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9a4159900 0x7fa9a40bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:49.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa98406ac30 0x7fa98406d0f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:49.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 --2- 172.21.15.73:0/2394590196 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9a40c6780 0x7fa9a4150a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:49.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 >> 172.21.15.73:0/2394590196 conn(0x7fa9a4069cb0 msgr2=0x7fa9a414f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:49.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 shutdown_connections 2024-03-23T06:10:49.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:49.888+0000 7fa9a9c00640 1 -- 172.21.15.73:0/2394590196 wait complete. 2024-03-23T06:10:49.906 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T06:09:56.066381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T06:09:56.917187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-23T06:09:59.981596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-23T06:10:49.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:10:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.122+0000 7f9599800640 1 Processor -- start 2024-03-23T06:10:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.122+0000 7f9599800640 1 -- start start 2024-03-23T06:10:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9599800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594151480 0x7f9594157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9599800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9594158cf0 0x7f9594159130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9599800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959415b710 con 0x7f95940c7e40 2024-03-23T06:10:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9599800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95941588d0 con 0x7f9594158cf0 2024-03-23T06:10:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9599800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959415a680 con 0x7f9594151480 2024-03-23T06:10:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9592000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f95940c7e40 0x7f9594071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52024/0 (socket says 172.21.15.73:52024) 2024-03-23T06:10:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9592000640 1 -- 172.21.15.73:0/1236810126 learned_addr learned my addr 172.21.15.73:0/1236810126 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:50.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9592a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594151480 0x7f9594157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.124+0000 7f9593400640 1 --2- 172.21.15.73:0/1236810126 >> v2:172.21.15.110:3300/0 conn(0x7f9594158cf0 0x7f9594159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.125+0000 7f9592a00640 1 -- 172.21.15.73:0/1236810126 >> v2:172.21.15.110:3300/0 conn(0x7f9594158cf0 msgr2=0x7f9594159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.125+0000 7f9592a00640 1 --2- 172.21.15.73:0/1236810126 >> v2:172.21.15.110:3300/0 conn(0x7f9594158cf0 0x7f9594159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.125+0000 7f9592a00640 1 -- 172.21.15.73:0/1236810126 >> v1:172.21.15.73:6789/0 conn(0x7f95940c7e40 legacy=0x7f9594071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.125+0000 7f9592a00640 1 -- 172.21.15.73:0/1236810126 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959415ab90 con 0x7f9594151480 2024-03-23T06:10:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.126+0000 7f9592a00640 1 --2- 172.21.15.73:0/1236810126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594151480 0x7f9594157e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95840097a0 tx=0x7f958402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acbb211db00c6965 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.126+0000 7f9591600640 1 -- 172.21.15.73:0/1236810126 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584030800 con 0x7f9594151480 2024-03-23T06:10:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.126+0000 7f9591600640 1 -- 172.21.15.73:0/1236810126 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584030960 con 0x7f9594151480 2024-03-23T06:10:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.126+0000 7f9591600640 1 -- 172.21.15.73:0/1236810126 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584030cf0 con 0x7f9594151480 2024-03-23T06:10:50.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.127+0000 7f9599800640 1 -- 172.21.15.73:0/1236810126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594151480 msgr2=0x7f9594157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.127+0000 7f9599800640 1 --2- 172.21.15.73:0/1236810126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594151480 0x7f9594157e60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95840097a0 tx=0x7f958402b940 comp rx=0 tx=0).stop 2024-03-23T06:10:50.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.127+0000 7f9599800640 1 -- 172.21.15.73:0/1236810126 shutdown_connections 2024-03-23T06:10:50.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.127+0000 7f9599800640 1 --2- 172.21.15.73:0/1236810126 >> v2:172.21.15.110:3300/0 conn(0x7f9594158cf0 0x7f9594159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.127+0000 7f9599800640 1 --2- 172.21.15.73:0/1236810126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594151480 0x7f9594157e60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.127+0000 7f9599800640 1 -- 172.21.15.73:0/1236810126 >> 172.21.15.73:0/1236810126 conn(0x7f9594069cb0 msgr2=0x7f959406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.127+0000 7f9599800640 1 -- 172.21.15.73:0/1236810126 shutdown_connections 2024-03-23T06:10:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.127+0000 7f9599800640 1 -- 172.21.15.73:0/1236810126 wait complete. 2024-03-23T06:10:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.128+0000 7f9599800640 1 Processor -- start 2024-03-23T06:10:50.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.129+0000 7f9599800640 1 -- start start 2024-03-23T06:10:50.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.129+0000 7f9599800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95940c7e40 0x7f95940c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.129+0000 7f9599800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9594151480 0x7f95941ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.129+0000 7f9599800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594158cf0 0x7f9594071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9599800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959406f940 con 0x7f9594151480 2024-03-23T06:10:50.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9599800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95941eee10 con 0x7f95940c7e40 2024-03-23T06:10:50.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9599800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95940afad0 con 0x7f9594158cf0 2024-03-23T06:10:50.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9594151480 0x7f95941ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95940c7e40 0x7f95940c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9594151480 0x7f95941ef5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49954/0 (socket says 172.21.15.73:49954) 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592000640 1 -- 172.21.15.73:0/2657536350 learned_addr learned my addr 172.21.15.73:0/2657536350 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9593400640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594158cf0 0x7f9594071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592a00640 1 -- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594158cf0 msgr2=0x7f9594071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592a00640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594158cf0 0x7f9594071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592a00640 1 -- 172.21.15.73:0/2657536350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9594151480 msgr2=0x7f95941ef5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592a00640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9594151480 0x7f95941ef5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592a00640 1 -- 172.21.15.73:0/2657536350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584009400 con 0x7f95940c7e40 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.130+0000 7f9592000640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9594151480 0x7f95941ef5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:50.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.131+0000 7f9592a00640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95940c7e40 0x7f95940c0c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9584033000 tx=0x7f9584004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.131+0000 7f958aa00640 1 -- 172.21.15.73:0/2657536350 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958403e040 con 0x7f95940c7e40 2024-03-23T06:10:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.131+0000 7f958aa00640 1 -- 172.21.15.73:0/2657536350 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584039cb0 con 0x7f95940c7e40 2024-03-23T06:10:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.131+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95940afdb0 con 0x7f95940c7e40 2024-03-23T06:10:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.131+0000 7f958aa00640 1 -- 172.21.15.73:0/2657536350 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584044630 con 0x7f95940c7e40 2024-03-23T06:10:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.131+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95940b0370 con 0x7f95940c7e40 2024-03-23T06:10:50.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.132+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95940cb720 con 0x7f95940c7e40 2024-03-23T06:10:50.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.133+0000 7f958aa00640 1 -- 172.21.15.73:0/2657536350 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9584044790 con 0x7f95940c7e40 2024-03-23T06:10:50.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.134+0000 7f958aa00640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f957406ac30 0x7f957406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.134+0000 7f958aa00640 1 -- 172.21.15.73:0/2657536350 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f95840abd90 con 0x7f95940c7e40 2024-03-23T06:10:50.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.134+0000 7f9592000640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f957406ac30 0x7f957406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.135+0000 7f9592000640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f957406ac30 0x7f957406d0f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f95940c1a60 tx=0x7f9580009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:50.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.137+0000 7f958aa00640 1 -- 172.21.15.73:0/2657536350 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9584076c90 con 0x7f95940c7e40 2024-03-23T06:10:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.331+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f959404e110 con 0x7f95940c7e40 2024-03-23T06:10:50.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.332+0000 7f958aa00640 1 -- 172.21.15.73:0/2657536350 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f958407a2b0 con 0x7f95940c7e40 2024-03-23T06:10:50.331 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f957406ac30 msgr2=0x7f957406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f957406ac30 0x7f957406d0f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f95940c1a60 tx=0x7f9580009040 comp rx=0 tx=0).stop 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95940c7e40 msgr2=0x7f95940c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95940c7e40 0x7f95940c0c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9584033000 tx=0x7f9584004730 comp rx=0 tx=0).stop 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 shutdown_connections 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f957406ac30 0x7f957406d0f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9594158cf0 0x7f9594071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9594151480 0x7f95941ef5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 --2- 172.21.15.73:0/2657536350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95940c7e40 0x7f95940c0c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.334+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 >> 172.21.15.73:0/2657536350 conn(0x7f9594069cb0 msgr2=0x7f959414f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.335+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 shutdown_connections 2024-03-23T06:10:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.335+0000 7f9599800640 1 -- 172.21.15.73:0/2657536350 wait complete. 2024-03-23T06:10:50.354 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T06:10:50.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.561+0000 7f4c3b000640 1 Processor -- start 2024-03-23T06:10:50.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.562+0000 7f4c3b000640 1 -- start start 2024-03-23T06:10:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.563+0000 7f4c3b000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406b7f0 0x7f4c3406f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.563+0000 7f4c3b000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4c3406fc80 0x7f4c3415ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.563+0000 7f4c3b000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3406bc10 con 0x7f4c341534f0 2024-03-23T06:10:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.563+0000 7f4c3b000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c34159600 con 0x7f4c3406fc80 2024-03-23T06:10:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.563+0000 7f4c3b000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341598e0 con 0x7f4c3406b7f0 2024-03-23T06:10:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.563+0000 7f4c33e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4c341534f0 0x7f4c340c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52032/0 (socket says 172.21.15.73:52032) 2024-03-23T06:10:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.563+0000 7f4c33e00640 1 -- 172.21.15.73:0/2851920828 learned_addr learned my addr 172.21.15.73:0/2851920828 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c39000640 1 --2- 172.21.15.73:0/2851920828 >> v2:172.21.15.110:3300/0 conn(0x7f4c3406fc80 0x7f4c3415ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c33400640 1 --2- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406b7f0 0x7f4c3406f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c32a00640 1 -- 172.21.15.73:0/2851920828 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738622380 0 0) 0x7f4c3406bc10 con 0x7f4c341534f0 2024-03-23T06:10:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c32a00640 1 -- 172.21.15.73:0/2851920828 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c18003520 con 0x7f4c341534f0 2024-03-23T06:10:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c39000640 1 -- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406b7f0 msgr2=0x7f4c3406f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c39000640 1 --2- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406b7f0 0x7f4c3406f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c39000640 1 -- 172.21.15.73:0/2851920828 >> v1:172.21.15.73:6789/0 conn(0x7f4c341534f0 legacy=0x7f4c340c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c39000640 1 -- 172.21.15.73:0/2851920828 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34159bc0 con 0x7f4c3406fc80 2024-03-23T06:10:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.564+0000 7f4c33400640 1 --2- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406b7f0 0x7f4c3406f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.565+0000 7f4c39000640 1 --2- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406fc80 0x7f4c3415ce30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009d90 tx=0x7f4c2402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=919e47351633153b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.565+0000 7f4c32a00640 1 -- 172.21.15.73:0/2851920828 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2402cce0 con 0x7f4c3406fc80 2024-03-23T06:10:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c32a00640 1 -- 172.21.15.73:0/2851920828 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2402ce40 con 0x7f4c3406fc80 2024-03-23T06:10:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c32a00640 1 -- 172.21.15.73:0/2851920828 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24034660 con 0x7f4c3406fc80 2024-03-23T06:10:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c3b000640 1 -- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406fc80 msgr2=0x7f4c3415ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c3b000640 1 --2- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406fc80 0x7f4c3415ce30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009d90 tx=0x7f4c2402bf30 comp rx=0 tx=0).stop 2024-03-23T06:10:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c3b000640 1 -- 172.21.15.73:0/2851920828 shutdown_connections 2024-03-23T06:10:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c3b000640 1 --2- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406fc80 0x7f4c3415ce30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c3b000640 1 --2- 172.21.15.73:0/2851920828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406b7f0 0x7f4c3406f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c3b000640 1 -- 172.21.15.73:0/2851920828 >> 172.21.15.73:0/2851920828 conn(0x7f4c3406a0a0 msgr2=0x7f4c34071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c3b000640 1 -- 172.21.15.73:0/2851920828 shutdown_connections 2024-03-23T06:10:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.566+0000 7f4c3b000640 1 -- 172.21.15.73:0/2851920828 wait complete. 2024-03-23T06:10:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.568+0000 7f4c3b000640 1 Processor -- start 2024-03-23T06:10:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.568+0000 7f4c3b000640 1 -- start start 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c3b000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406b7f0 0x7f4c340cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c3b000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406fc80 0x7f4c340cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c3b000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c341534f0 0x7f4c340cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c3b000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341f0030 con 0x7f4c341534f0 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c3b000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340c2a90 con 0x7f4c3406b7f0 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c3b000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340c2d30 con 0x7f4c3406fc80 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c39000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c341534f0 0x7f4c340cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c39000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c341534f0 0x7f4c340cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49956/0 (socket says 172.21.15.73:49956) 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c39000640 1 -- 172.21.15.73:0/3874076382 learned_addr learned my addr 172.21.15.73:0/3874076382 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.569+0000 7f4c33e00640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406b7f0 0x7f4c340cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c33400640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406fc80 0x7f4c340cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c39000640 1 -- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406fc80 msgr2=0x7f4c340cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c39000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406fc80 0x7f4c340cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c39000640 1 -- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406b7f0 msgr2=0x7f4c340cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c39000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406b7f0 0x7f4c340cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c39000640 1 -- 172.21.15.73:0/3874076382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0093a0 con 0x7f4c341534f0 2024-03-23T06:10:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c39000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c341534f0 0x7f4c340cc6f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009d90 tx=0x7f4c24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c2be00640 1 -- 172.21.15.73:0/3874076382 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2403d600 con 0x7f4c341534f0 2024-03-23T06:10:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c2be00640 1 -- 172.21.15.73:0/3874076382 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2403d780 con 0x7f4c341534f0 2024-03-23T06:10:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.570+0000 7f4c2be00640 1 -- 172.21.15.73:0/3874076382 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2403db30 con 0x7f4c341534f0 2024-03-23T06:10:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.571+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c24009a70 con 0x7f4c341534f0 2024-03-23T06:10:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.571+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c340c3670 con 0x7f4c341534f0 2024-03-23T06:10:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.572+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c340c3800 con 0x7f4c341534f0 2024-03-23T06:10:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.573+0000 7f4c2be00640 1 -- 172.21.15.73:0/3874076382 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4c2403b040 con 0x7f4c341534f0 2024-03-23T06:10:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.573+0000 7f4c2be00640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c1006ac30 0x7f4c1006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.573+0000 7f4c2be00640 1 -- 172.21.15.73:0/3874076382 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f4c240abb90 con 0x7f4c341534f0 2024-03-23T06:10:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.574+0000 7f4c33e00640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c1006ac30 0x7f4c1006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:50.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.574+0000 7f4c33e00640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c1006ac30 0x7f4c1006d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0011e0 tx=0x7f4c2c007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:50.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.578+0000 7f4c2be00640 1 -- 172.21.15.73:0/3874076382 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4c24076a10 con 0x7f4c341534f0 2024-03-23T06:10:50.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.770+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c340724a0 con 0x7f4c341534f0 2024-03-23T06:10:50.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.770+0000 7f4c2be00640 1 -- 172.21.15.73:0/3874076382 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c240390a0 con 0x7f4c341534f0 2024-03-23T06:10:50.770 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c1006ac30 msgr2=0x7f4c1006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c1006ac30 0x7f4c1006d0f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0011e0 tx=0x7f4c2c007d30 comp rx=0 tx=0).stop 2024-03-23T06:10:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c341534f0 msgr2=0x7f4c340cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c341534f0 0x7f4c340cc6f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009d90 tx=0x7f4c24004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 shutdown_connections 2024-03-23T06:10:50.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c341534f0 0x7f4c340cc6f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4c1006ac30 0x7f4c1006d0f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c3406fc80 0x7f4c340cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 --2- 172.21.15.73:0/3874076382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c3406b7f0 0x7f4c340cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 >> 172.21.15.73:0/3874076382 conn(0x7f4c3406a0a0 msgr2=0x7f4c341580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 shutdown_connections 2024-03-23T06:10:50.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:50.773+0000 7f4c3b000640 1 -- 172.21.15.73:0/3874076382 wait complete. 2024-03-23T06:10:50.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T06:10:51.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.000+0000 7fb637400640 1 Processor -- start 2024-03-23T06:10:51.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.001+0000 7fb637400640 1 -- start start 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb637400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6301536c0 0x7fb630159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb637400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb6300ca4d0 0x7fb6300caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb637400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63015d920 con 0x7fb6300c8eb0 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb637400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63015cac0 con 0x7fb6301536c0 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb637400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63015cd10 con 0x7fb6300ca4d0 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb634a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6301536c0 0x7fb630159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb634a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6301536c0 0x7fb630159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49970/0 (socket says 172.21.15.73:49970) 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb634a00640 1 -- 172.21.15.73:0/1904989871 learned_addr learned my addr 172.21.15.73:0/1904989871 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.002+0000 7fb635400640 1 --1- 172.21.15.73:0/1904989871 >> v1:172.21.15.73:6789/0 conn(0x7fb6300c8eb0 0x7fb630070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52048/0 (socket says 172.21.15.73:52048) 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.003+0000 7fb627e00640 1 --2- 172.21.15.73:0/1904989871 >> v2:172.21.15.110:3300/0 conn(0x7fb6300ca4d0 0x7fb6300caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.003+0000 7fb634a00640 1 -- 172.21.15.73:0/1904989871 >> v2:172.21.15.110:3300/0 conn(0x7fb6300ca4d0 msgr2=0x7fb6300caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.003+0000 7fb634a00640 1 --2- 172.21.15.73:0/1904989871 >> v2:172.21.15.110:3300/0 conn(0x7fb6300ca4d0 0x7fb6300caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.003+0000 7fb634a00640 1 -- 172.21.15.73:0/1904989871 >> v1:172.21.15.73:6789/0 conn(0x7fb6300c8eb0 legacy=0x7fb630070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.003+0000 7fb634a00640 1 -- 172.21.15.73:0/1904989871 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63015cff0 con 0x7fb6301536c0 2024-03-23T06:10:51.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.003+0000 7fb62fe00640 1 -- 172.21.15.73:0/1904989871 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154873858 0 0) 0x7fb63015d920 con 0x7fb6300c8eb0 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.004+0000 7fb634a00640 1 --2- 172.21.15.73:0/1904989871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 0x7fb630159f00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6300cb640 tx=0x7fb61802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a2e381a9846e6e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.004+0000 7fb62fe00640 1 -- 172.21.15.73:0/1904989871 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618030860 con 0x7fb6301536c0 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.004+0000 7fb62fe00640 1 -- 172.21.15.73:0/1904989871 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6180309c0 con 0x7fb6301536c0 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.004+0000 7fb62fe00640 1 -- 172.21.15.73:0/1904989871 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618030d50 con 0x7fb6301536c0 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.005+0000 7fb637400640 1 -- 172.21.15.73:0/1904989871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 msgr2=0x7fb630159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.005+0000 7fb637400640 1 --2- 172.21.15.73:0/1904989871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 0x7fb630159f00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb6300cb640 tx=0x7fb61802b9a0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.005+0000 7fb637400640 1 -- 172.21.15.73:0/1904989871 shutdown_connections 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.005+0000 7fb637400640 1 --2- 172.21.15.73:0/1904989871 >> v2:172.21.15.110:3300/0 conn(0x7fb6300ca4d0 0x7fb6300caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.005+0000 7fb637400640 1 --2- 172.21.15.73:0/1904989871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 0x7fb630159f00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.005+0000 7fb637400640 1 -- 172.21.15.73:0/1904989871 >> 172.21.15.73:0/1904989871 conn(0x7fb630069cb0 msgr2=0x7fb63006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.005+0000 7fb637400640 1 -- 172.21.15.73:0/1904989871 shutdown_connections 2024-03-23T06:10:51.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.005+0000 7fb637400640 1 -- 172.21.15.73:0/1904989871 wait complete. 2024-03-23T06:10:51.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.007+0000 7fb637400640 1 Processor -- start 2024-03-23T06:10:51.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.007+0000 7fb637400640 1 -- start start 2024-03-23T06:10:51.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb637400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6300c8eb0 0x7fb6301558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb637400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6300ca4d0 0x7fb6301f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb637400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 0x7fb63015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb637400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300aec80 con 0x7fb6301536c0 2024-03-23T06:10:51.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb637400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb630155e30 con 0x7fb6300ca4d0 2024-03-23T06:10:51.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb637400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6301f3550 con 0x7fb6300c8eb0 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb627e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6300ca4d0 0x7fb6301f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb634a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6300c8eb0 0x7fb6301558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb635400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 0x7fb63015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb627e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6300ca4d0 0x7fb6301f3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57870/0 (socket says 172.21.15.73:57870) 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb627e00640 1 -- 172.21.15.73:0/4221936809 learned_addr learned my addr 172.21.15.73:0/4221936809 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb635400640 1 -- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6300c8eb0 msgr2=0x7fb6301558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb635400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6300c8eb0 0x7fb6301558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb635400640 1 -- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6300ca4d0 msgr2=0x7fb6301f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb635400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6300ca4d0 0x7fb6301f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.008+0000 7fb635400640 1 -- 172.21.15.73:0/4221936809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6180094d0 con 0x7fb6301536c0 2024-03-23T06:10:51.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.009+0000 7fb635400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 0x7fb63015bd90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c750 tx=0x7fb62800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.009+0000 7fb62d600640 1 -- 172.21.15.73:0/4221936809 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800ce60 con 0x7fb6301536c0 2024-03-23T06:10:51.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.009+0000 7fb62d600640 1 -- 172.21.15.73:0/4221936809 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800a640 con 0x7fb6301536c0 2024-03-23T06:10:51.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.009+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb630156c20 con 0x7fb6301536c0 2024-03-23T06:10:51.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.009+0000 7fb62d600640 1 -- 172.21.15.73:0/4221936809 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800a9d0 con 0x7fb6301536c0 2024-03-23T06:10:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.009+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63014d760 con 0x7fb6301536c0 2024-03-23T06:10:51.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.010+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6300704c0 con 0x7fb6301536c0 2024-03-23T06:10:51.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.011+0000 7fb62d600640 1 -- 172.21.15.73:0/4221936809 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb62800ab30 con 0x7fb6301536c0 2024-03-23T06:10:51.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.012+0000 7fb62d600640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb60c06ac30 0x7fb60c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.012+0000 7fb62d600640 1 -- 172.21.15.73:0/4221936809 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb628088e20 con 0x7fb6301536c0 2024-03-23T06:10:51.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.013+0000 7fb634a00640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb60c06ac30 0x7fb60c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.013+0000 7fb634a00640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb60c06ac30 0x7fb60c06d0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb618036000 tx=0x7fb618008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.016+0000 7fb62d600640 1 -- 172.21.15.73:0/4221936809 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb628053c10 con 0x7fb6301536c0 2024-03-23T06:10:51.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.209+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb630156e80 con 0x7fb6301536c0 2024-03-23T06:10:51.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.210+0000 7fb62d600640 1 -- 172.21.15.73:0/4221936809 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb628018070 con 0x7fb6301536c0 2024-03-23T06:10:51.209 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-23T06:10:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb60c06ac30 msgr2=0x7fb60c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb60c06ac30 0x7fb60c06d0f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb618036000 tx=0x7fb618008030 comp rx=0 tx=0).stop 2024-03-23T06:10:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 msgr2=0x7fb63015bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 0x7fb63015bd90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb62800c750 tx=0x7fb62800cc10 comp rx=0 tx=0).stop 2024-03-23T06:10:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 shutdown_connections 2024-03-23T06:10:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6301536c0 0x7fb63015bd90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6300ca4d0 0x7fb6301f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb60c06ac30 0x7fb60c06d0f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 --2- 172.21.15.73:0/4221936809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6300c8eb0 0x7fb6301558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 >> 172.21.15.73:0/4221936809 conn(0x7fb630069cb0 msgr2=0x7fb6300c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:51.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 shutdown_connections 2024-03-23T06:10:51.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.212+0000 7fb637400640 1 -- 172.21.15.73:0/4221936809 wait complete. 2024-03-23T06:10:51.232 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-23T06:10:51.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.444+0000 7f80cce00640 1 Processor -- start 2024-03-23T06:10:51.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.445+0000 7f80cce00640 1 -- start start 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.446+0000 7f80cce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80cce00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80c80b1c40 0x7f80c8163e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80cce00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c80b2460 con 0x7f80c81537b0 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80cce00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c80ca140 con 0x7f80c80b1c40 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80cce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c815a4b0 con 0x7f80c80ca7d0 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c5400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f80c81537b0 0x7f80c806a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:53598/0 (socket says 172.21.15.73:53598) 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:57152/0 (socket says 172.21.15.73:57152) 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c5400640 1 -- 172.21.15.73:0/3427561444 learned_addr learned my addr 172.21.15.73:0/3427561444 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c6800640 1 --2- 172.21.15.73:0/3427561444 >> v2:172.21.15.73:3300/0 conn(0x7f80c80b1c40 0x7f80c8163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c5e00640 1 -- 172.21.15.73:0/3427561444 >> v2:172.21.15.73:3300/0 conn(0x7f80c80b1c40 msgr2=0x7f80c8163e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c5e00640 1 --2- 172.21.15.73:0/3427561444 >> v2:172.21.15.73:3300/0 conn(0x7f80c80b1c40 0x7f80c8163e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c5e00640 1 -- 172.21.15.73:0/3427561444 >> v1:172.21.15.110:6789/0 conn(0x7f80c81537b0 legacy=0x7f80c806a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.447+0000 7f80c5e00640 1 -- 172.21.15.73:0/3427561444 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c80c9e60 con 0x7f80c80ca7d0 2024-03-23T06:10:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.448+0000 7f80c5e00640 1 --2- 172.21.15.73:0/3427561444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80cabb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80b80097a0 tx=0x7f80b802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b34b567363186a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.449+0000 7f80c4a00640 1 -- 172.21.15.73:0/3427561444 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8031780 con 0x7f80c80ca7d0 2024-03-23T06:10:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.449+0000 7f80c4a00640 1 -- 172.21.15.73:0/3427561444 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b80318e0 con 0x7f80c80ca7d0 2024-03-23T06:10:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.449+0000 7f80c4a00640 1 -- 172.21.15.73:0/3427561444 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8031c70 con 0x7f80c80ca7d0 2024-03-23T06:10:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.449+0000 7f80cce00640 1 -- 172.21.15.73:0/3427561444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 msgr2=0x7f80c80cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.449+0000 7f80cce00640 1 --2- 172.21.15.73:0/3427561444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80cabb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f80b80097a0 tx=0x7f80b802b820 comp rx=0 tx=0).stop 2024-03-23T06:10:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.450+0000 7f80cce00640 1 -- 172.21.15.73:0/3427561444 shutdown_connections 2024-03-23T06:10:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.450+0000 7f80cce00640 1 --2- 172.21.15.73:0/3427561444 >> v2:172.21.15.73:3300/0 conn(0x7f80c80b1c40 0x7f80c8163e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.450+0000 7f80cce00640 1 --2- 172.21.15.73:0/3427561444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80cabb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.450+0000 7f80cce00640 1 -- 172.21.15.73:0/3427561444 >> 172.21.15.73:0/3427561444 conn(0x7f80c8071800 msgr2=0x7f80c8071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.450+0000 7f80cce00640 1 -- 172.21.15.73:0/3427561444 shutdown_connections 2024-03-23T06:10:51.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.450+0000 7f80cce00640 1 -- 172.21.15.73:0/3427561444 wait complete. 2024-03-23T06:10:51.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.451+0000 7f80cce00640 1 Processor -- start 2024-03-23T06:10:51.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.452+0000 7f80cce00640 1 -- start start 2024-03-23T06:10:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.452+0000 7f80cce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c80b1c40 0x7f80c81e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.452+0000 7f80cce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80cce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80c80c7b30 0x7f80c80c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80cce00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c81f3230 con 0x7f80c80b1c40 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80cce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c80c6ae0 con 0x7f80c80c7b30 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80cce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c81f2cb0 con 0x7f80c80ca7d0 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c80b1c40 0x7f80c81e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80c80c7b30 0x7f80c80c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c5e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c80b1c40 0x7f80c81e3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49998/0 (socket says 172.21.15.73:49998) 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c5e00640 1 -- 172.21.15.73:0/4134410240 learned_addr learned my addr 172.21.15.73:0/4134410240 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c6800640 1 -- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 msgr2=0x7f80c80c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c6800640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c6800640 1 -- 172.21.15.73:0/4134410240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c80b1c40 msgr2=0x7f80c81e3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c6800640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c80b1c40 0x7f80c81e3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c6800640 1 -- 172.21.15.73:0/4134410240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b8009400 con 0x7f80c80c7b30 2024-03-23T06:10:51.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c5400640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.453+0000 7f80c5e00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c80b1c40 0x7f80c81e3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.454+0000 7f80c6800640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80c80c7b30 0x7f80c80c6f70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f80c000ef90 tx=0x7f80c000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.455+0000 7f80be000640 1 -- 172.21.15.73:0/4134410240 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0009c00 con 0x7f80c80c7b30 2024-03-23T06:10:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.455+0000 7f80be000640 1 -- 172.21.15.73:0/4134410240 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c000f040 con 0x7f80c80c7b30 2024-03-23T06:10:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.455+0000 7f80be000640 1 -- 172.21.15.73:0/4134410240 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00146c0 con 0x7f80c80c7b30 2024-03-23T06:10:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.455+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c81e2a90 con 0x7f80c80c7b30 2024-03-23T06:10:51.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.456+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c80c6770 con 0x7f80c80c7b30 2024-03-23T06:10:51.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.457+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c804e110 con 0x7f80c80c7b30 2024-03-23T06:10:51.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.457+0000 7f80be000640 1 -- 172.21.15.73:0/4134410240 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f80c0014820 con 0x7f80c80c7b30 2024-03-23T06:10:51.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.458+0000 7f80be000640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f80a806ac80 0x7f80a806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.458+0000 7f80be000640 1 -- 172.21.15.73:0/4134410240 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f80c008a2f0 con 0x7f80c80c7b30 2024-03-23T06:10:51.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.459+0000 7f80c5e00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f80a806ac80 0x7f80a806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.459+0000 7f80c5e00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f80a806ac80 0x7f80a806d140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80b8000c00 tx=0x7f80b803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.463+0000 7f80be000640 1 -- 172.21.15.73:0/4134410240 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f80c0055280 con 0x7f80c80c7b30 2024-03-23T06:10:51.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.657+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f80c80ca5b0 con 0x7f80c80c7b30 2024-03-23T06:10:51.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.658+0000 7f80be000640 1 -- 172.21.15.73:0/4134410240 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f80c00588a0 con 0x7f80c80c7b30 2024-03-23T06:10:51.657 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:51.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f80a806ac80 msgr2=0x7f80a806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f80a806ac80 0x7f80a806d140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f80b8000c00 tx=0x7f80b803d040 comp rx=0 tx=0).stop 2024-03-23T06:10:51.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80c80c7b30 msgr2=0x7f80c80c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80c80c7b30 0x7f80c80c6f70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f80c000ef90 tx=0x7f80c000c490 comp rx=0 tx=0).stop 2024-03-23T06:10:51.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 shutdown_connections 2024-03-23T06:10:51.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80c80c7b30 0x7f80c80c6f70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f80a806ac80 0x7f80a806d140 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80c80ca7d0 0x7f80c80c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 --2- 172.21.15.73:0/4134410240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80c80b1c40 0x7f80c81e3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 >> 172.21.15.73:0/4134410240 conn(0x7f80c8071800 msgr2=0x7f80c8157350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:51.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.660+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 shutdown_connections 2024-03-23T06:10:51.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.661+0000 7f80cce00640 1 -- 172.21.15.73:0/4134410240 wait complete. 2024-03-23T06:10:51.679 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-03-23T06:10:51.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:10:51.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.882+0000 7f8b8a600640 1 Processor -- start 2024-03-23T06:10:51.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.883+0000 7f8b8a600640 1 -- start start 2024-03-23T06:10:51.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.884+0000 7f8b8a600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b840c6d70 0x7f8b84159e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.884+0000 7f8b8a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.884+0000 7f8b8a600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8406dad0 con 0x7f8b841536a0 2024-03-23T06:10:51.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.884+0000 7f8b8a600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b8415a390 con 0x7f8b840c6d70 2024-03-23T06:10:51.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.884+0000 7f8b8a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840c5f20 con 0x7f8b840c7890 2024-03-23T06:10:51.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.884+0000 7f8b7aa00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8b840c6d70 0x7f8b84159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.884+0000 7f8b83400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8b841536a0 0x7f8b840bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52064/0 (socket says 172.21.15.73:52064) 2024-03-23T06:10:51.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.885+0000 7f8b83400640 1 -- 172.21.15.73:0/3211888555 learned_addr learned my addr 172.21.15.73:0/3211888555 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:51.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.885+0000 7f8b83e00640 1 --2- 172.21.15.73:0/3211888555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.885+0000 7f8b7aa00640 1 -- 172.21.15.73:0/3211888555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 msgr2=0x7f8b840c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:51.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.885+0000 7f8b7aa00640 1 --2- 172.21.15.73:0/3211888555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.885+0000 7f8b7aa00640 1 -- 172.21.15.73:0/3211888555 >> v1:172.21.15.73:6789/0 conn(0x7f8b841536a0 legacy=0x7f8b840bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.885+0000 7f8b7aa00640 1 -- 172.21.15.73:0/3211888555 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840c6260 con 0x7f8b840c6d70 2024-03-23T06:10:51.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.885+0000 7f8b82a00640 1 -- 172.21.15.73:0/3211888555 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310497574 0 0) 0x7f8b8406dad0 con 0x7f8b841536a0 2024-03-23T06:10:51.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.886+0000 7f8b7aa00640 1 --2- 172.21.15.73:0/3211888555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b840c6d70 0x7f8b84159e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0097a0 tx=0x7f8b6c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533e68f2ffc00b3a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.886+0000 7f8b82a00640 1 -- 172.21.15.73:0/3211888555 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c030610 con 0x7f8b840c6d70 2024-03-23T06:10:51.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.886+0000 7f8b82a00640 1 -- 172.21.15.73:0/3211888555 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c030770 con 0x7f8b840c6d70 2024-03-23T06:10:51.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.886+0000 7f8b82a00640 1 -- 172.21.15.73:0/3211888555 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c030b00 con 0x7f8b840c6d70 2024-03-23T06:10:51.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.887+0000 7f8b8a600640 1 -- 172.21.15.73:0/3211888555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b840c6d70 msgr2=0x7f8b84159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.887+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3211888555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b840c6d70 0x7f8b84159e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0097a0 tx=0x7f8b6c02b960 comp rx=0 tx=0).stop 2024-03-23T06:10:51.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.887+0000 7f8b8a600640 1 -- 172.21.15.73:0/3211888555 shutdown_connections 2024-03-23T06:10:51.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.887+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3211888555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.887+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3211888555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b840c6d70 0x7f8b84159e50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.887+0000 7f8b8a600640 1 -- 172.21.15.73:0/3211888555 >> 172.21.15.73:0/3211888555 conn(0x7f8b8406bb40 msgr2=0x7f8b8406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:51.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.887+0000 7f8b8a600640 1 -- 172.21.15.73:0/3211888555 shutdown_connections 2024-03-23T06:10:51.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.887+0000 7f8b8a600640 1 -- 172.21.15.73:0/3211888555 wait complete. 2024-03-23T06:10:51.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.889+0000 7f8b8a600640 1 Processor -- start 2024-03-23T06:10:51.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.889+0000 7f8b8a600640 1 -- start start 2024-03-23T06:10:51.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b8a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b840c6d70 0x7f8b840c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b8a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b8a600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b841536a0 0x7f8b841effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b8a600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b84155ee0 con 0x7f8b841536a0 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b8a600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840c4f80 con 0x7f8b840c6d70 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b8a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840c1fa0 con 0x7f8b840c7890 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b83400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b840c6d70 0x7f8b840c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b7aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b83400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b840c6d70 0x7f8b840c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57882/0 (socket says 172.21.15.73:57882) 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b83400640 1 -- 172.21.15.73:0/3141069636 learned_addr learned my addr 172.21.15.73:0/3141069636 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.890+0000 7f8b83e00640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b841536a0 0x7f8b841effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b83400640 1 -- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 msgr2=0x7f8b840cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b83400640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b83400640 1 -- 172.21.15.73:0/3141069636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b841536a0 msgr2=0x7f8b841effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:51.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b83400640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b841536a0 0x7f8b841effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b83400640 1 -- 172.21.15.73:0/3141069636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c009400 con 0x7f8b840c6d70 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b7aa00640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b83e00640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b841536a0 0x7f8b841effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b83400640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b840c6d70 0x7f8b840c48f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c460 tx=0x7f8b7400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b7be00640 1 -- 172.21.15.73:0/3141069636 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b740074e0 con 0x7f8b840c6d70 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b7be00640 1 -- 172.21.15.73:0/3141069636 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74007660 con 0x7f8b840c6d70 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b7be00640 1 -- 172.21.15.73:0/3141069636 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74004a20 con 0x7f8b840c6d70 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b840c2240 con 0x7f8b840c6d70 2024-03-23T06:10:51.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.891+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b840c2800 con 0x7f8b840c6d70 2024-03-23T06:10:51.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.892+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8404e110 con 0x7f8b840c6d70 2024-03-23T06:10:51.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.893+0000 7f8b7be00640 1 -- 172.21.15.73:0/3141069636 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8b74004b80 con 0x7f8b840c6d70 2024-03-23T06:10:51.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.894+0000 7f8b7be00640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8b6006ac00 0x7f8b6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:51.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.894+0000 7f8b7be00640 1 -- 172.21.15.73:0/3141069636 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f8b74088960 con 0x7f8b840c6d70 2024-03-23T06:10:51.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.894+0000 7f8b7aa00640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8b6006ac00 0x7f8b6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:51.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.895+0000 7f8b7aa00640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8b6006ac00 0x7f8b6006d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c036000 tx=0x7f8b6c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:51.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:51.899+0000 7f8b7be00640 1 -- 172.21.15.73:0/3141069636 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8b74053750 con 0x7f8b840c6d70 2024-03-23T06:10:52.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.088+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b8406d480 con 0x7f8b6006ac00 2024-03-23T06:10:52.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.098+0000 7f8b7be00640 1 -- 172.21.15.73:0/3141069636 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+347969 (secure 0 0 0) 0x7f8b6c0423b0 con 0x7f8b6006ac00 2024-03-23T06:10:52.104 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:52.106 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.105+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8b6006ac00 msgr2=0x7f8b6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.105+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8b6006ac00 0x7f8b6006d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c036000 tx=0x7f8b6c008030 comp rx=0 tx=0).stop 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.105+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b840c6d70 msgr2=0x7f8b840c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.105+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b840c6d70 0x7f8b840c48f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400c460 tx=0x7f8b7400c920 comp rx=0 tx=0).stop 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.105+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 shutdown_connections 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.105+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8b841536a0 0x7f8b841effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.106+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8b6006ac00 0x7f8b6006d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.106+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b840c7890 0x7f8b840cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.106+0000 7f8b8a600640 1 --2- 172.21.15.73:0/3141069636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b840c6d70 0x7f8b840c48f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.106+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 >> 172.21.15.73:0/3141069636 conn(0x7f8b8406bb40 msgr2=0x7f8b841576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.106+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 shutdown_connections 2024-03-23T06:10:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.106+0000 7f8b8a600640 1 -- 172.21.15.73:0/3141069636 wait complete. 2024-03-23T06:10:52.123 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-23T06:10:50.623487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597677,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236128,"kb_used_data":3560,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738592,"statfs":{"total":773094113280,"available":772852318208,"internally_reserved":0,"allocated":3645440,"data_stored":2131858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.958054"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662964+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:10:38.662964+0000","last_peered":"2024-03-23T06:10:38.662964+0000","last_clean":"2024-03-23T06:10:38.662964+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:10:38.662964+0000","last_undegraded":"2024-03-23T06:10:38.662964+0000","last_fullsized":"2024-03-23T06:10:38.662964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666626+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:10:38.666626+0000","last_peered":"2024-03-23T06:10:38.666626+0000","last_clean":"2024-03-23T06:10:38.666626+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:10:38.666626+0000","last_undegraded":"2024-03-23T06:10:38.666626+0000","last_fullsized":"2024-03-23T06:10:38.666626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665663+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:10:38.665663+0000","last_peered":"2024-03-23T06:10:38.665663+0000","last_clean":"2024-03-23T06:10:38.665663+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:10:38.665663+0000","last_undegraded":"2024-03-23T06:10:38.665663+0000","last_fullsized":"2024-03-23T06:10:38.665663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.691098+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:10:38.691098+0000","last_peered":"2024-03-23T06:10:38.691098+0000","last_clean":"2024-03-23T06:10:38.691098+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:10:38.691098+0000","last_undegraded":"2024-03-23T06:10:38.691098+0000","last_fullsized":"2024-03-23T06:10:38.691098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666370+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:10:38.666370+0000","last_peered":"2024-03-23T06:10:38.666370+0000","last_clean":"2024-03-23T06:10:38.666370+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:10:38.666370+0000","last_undegraded":"2024-03-23T06:10:38.666370+0000","last_fullsized":"2024-03-23T06:10:38.666370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670002+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:10:38.670002+0000","last_peered":"2024-03-23T06:10:38.670002+0000","last_clean":"2024-03-23T06:10:38.670002+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:10:38.670002+0000","last_undegraded":"2024-03-23T06:10:38.670002+0000","last_fullsized":"2024-03-23T06:10:38.670002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677234+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:10:38.677234+0000","last_peered":"2024-03-23T06:10:38.677234+0000","last_clean":"2024-03-23T06:10:38.677234+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:10:38.677234+0000","last_undegraded":"2024-03-23T06:10:38.677234+0000","last_fullsized":"2024-03-23T06:10:38.677234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.674095+0000","last_change":"2024-03-23T06:10:39.674095+0000","last_active":"2024-03-23T06:10:39.674095+0000","last_peered":"2024-03-23T06:10:39.674095+0000","last_clean":"2024-03-23T06:10:39.674095+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:10:39.674095+0000","last_undegraded":"2024-03-23T06:10:39.674095+0000","last_fullsized":"2024-03-23T06:10:39.674095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:13:50.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670763+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:10:38.670763+0000","last_peered":"2024-03-23T06:10:38.670763+0000","last_clean":"2024-03-23T06:10:38.670763+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:10:38.670763+0000","last_undegraded":"2024-03-23T06:10:38.670763+0000","last_fullsized":"2024-03-23T06:10:38.670763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675444+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:10:38.675444+0000","last_peered":"2024-03-23T06:10:38.675444+0000","last_clean":"2024-03-23T06:10:38.675444+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:10:38.675444+0000","last_undegraded":"2024-03-23T06:10:38.675444+0000","last_fullsized":"2024-03-23T06:10:38.675444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673140+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:10:38.673140+0000","last_peered":"2024-03-23T06:10:38.673140+0000","last_clean":"2024-03-23T06:10:38.673140+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:10:38.673140+0000","last_undegraded":"2024-03-23T06:10:38.673140+0000","last_fullsized":"2024-03-23T06:10:38.673140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.674577+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:10:38.674577+0000","last_peered":"2024-03-23T06:10:38.674577+0000","last_clean":"2024-03-23T06:10:38.674577+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:10:38.674577+0000","last_undegraded":"2024-03-23T06:10:38.674577+0000","last_fullsized":"2024-03-23T06:10:38.674577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669165+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:10:38.669165+0000","last_peered":"2024-03-23T06:10:38.669165+0000","last_clean":"2024-03-23T06:10:38.669165+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:10:38.669165+0000","last_undegraded":"2024-03-23T06:10:38.669165+0000","last_fullsized":"2024-03-23T06:10:38.669165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670478+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:10:38.670478+0000","last_peered":"2024-03-23T06:10:38.670478+0000","last_clean":"2024-03-23T06:10:38.670478+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:10:38.670478+0000","last_undegraded":"2024-03-23T06:10:38.670478+0000","last_fullsized":"2024-03-23T06:10:38.670478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672887+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:10:38.672887+0000","last_peered":"2024-03-23T06:10:38.672887+0000","last_clean":"2024-03-23T06:10:38.672887+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:10:38.672887+0000","last_undegraded":"2024-03-23T06:10:38.672887+0000","last_fullsized":"2024-03-23T06:10:38.672887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665763+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:10:38.665763+0000","last_peered":"2024-03-23T06:10:38.665763+0000","last_clean":"2024-03-23T06:10:38.665763+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:10:38.665763+0000","last_undegraded":"2024-03-23T06:10:38.665763+0000","last_fullsized":"2024-03-23T06:10:38.665763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664168+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:10:38.664168+0000","last_peered":"2024-03-23T06:10:38.664168+0000","last_clean":"2024-03-23T06:10:38.664168+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:10:38.664168+0000","last_undegraded":"2024-03-23T06:10:38.664168+0000","last_fullsized":"2024-03-23T06:10:38.664168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672799+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:10:38.672799+0000","last_peered":"2024-03-23T06:10:38.672799+0000","last_clean":"2024-03-23T06:10:38.672799+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:10:38.672799+0000","last_undegraded":"2024-03-23T06:10:38.672799+0000","last_fullsized":"2024-03-23T06:10:38.672799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.661979+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:10:38.661979+0000","last_peered":"2024-03-23T06:10:38.661979+0000","last_clean":"2024-03-23T06:10:38.661979+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:10:38.661979+0000","last_undegraded":"2024-03-23T06:10:38.661979+0000","last_fullsized":"2024-03-23T06:10:38.661979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662318+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:10:38.662318+0000","last_peered":"2024-03-23T06:10:38.662318+0000","last_clean":"2024-03-23T06:10:38.662318+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:10:38.662318+0000","last_undegraded":"2024-03-23T06:10:38.662318+0000","last_fullsized":"2024-03-23T06:10:38.662318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666359+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:10:38.666359+0000","last_peered":"2024-03-23T06:10:38.666359+0000","last_clean":"2024-03-23T06:10:38.666359+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:10:38.666359+0000","last_undegraded":"2024-03-23T06:10:38.666359+0000","last_fullsized":"2024-03-23T06:10:38.666359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.668380+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:10:38.668380+0000","last_peered":"2024-03-23T06:10:38.668380+0000","last_clean":"2024-03-23T06:10:38.668380+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:10:38.668380+0000","last_undegraded":"2024-03-23T06:10:38.668380+0000","last_fullsized":"2024-03-23T06:10:38.668380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676694+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:10:38.676694+0000","last_peered":"2024-03-23T06:10:38.676694+0000","last_clean":"2024-03-23T06:10:38.676694+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:10:38.676694+0000","last_undegraded":"2024-03-23T06:10:38.676694+0000","last_fullsized":"2024-03-23T06:10:38.676694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672985+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:10:38.672985+0000","last_peered":"2024-03-23T06:10:38.672985+0000","last_clean":"2024-03-23T06:10:38.672985+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:10:38.672985+0000","last_undegraded":"2024-03-23T06:10:38.672985+0000","last_fullsized":"2024-03-23T06:10:38.672985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662784+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:10:38.662784+0000","last_peered":"2024-03-23T06:10:38.662784+0000","last_clean":"2024-03-23T06:10:38.662784+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:10:38.662784+0000","last_undegraded":"2024-03-23T06:10:38.662784+0000","last_fullsized":"2024-03-23T06:10:38.662784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.671634+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:10:38.671634+0000","last_peered":"2024-03-23T06:10:38.671634+0000","last_clean":"2024-03-23T06:10:38.671634+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:10:38.671634+0000","last_undegraded":"2024-03-23T06:10:38.671634+0000","last_fullsized":"2024-03-23T06:10:38.671634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670242+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:10:38.670242+0000","last_peered":"2024-03-23T06:10:38.670242+0000","last_clean":"2024-03-23T06:10:38.670242+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:10:38.670242+0000","last_undegraded":"2024-03-23T06:10:38.670242+0000","last_fullsized":"2024-03-23T06:10:38.670242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662864+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:10:38.662864+0000","last_peered":"2024-03-23T06:10:38.662864+0000","last_clean":"2024-03-23T06:10:38.662864+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:10:38.662864+0000","last_undegraded":"2024-03-23T06:10:38.662864+0000","last_fullsized":"2024-03-23T06:10:38.662864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662866+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:10:38.662866+0000","last_peered":"2024-03-23T06:10:38.662866+0000","last_clean":"2024-03-23T06:10:38.662866+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:10:38.662866+0000","last_undegraded":"2024-03-23T06:10:38.662866+0000","last_fullsized":"2024-03-23T06:10:38.662866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662008+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:10:38.662008+0000","last_peered":"2024-03-23T06:10:38.662008+0000","last_clean":"2024-03-23T06:10:38.662008+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:10:38.662008+0000","last_undegraded":"2024-03-23T06:10:38.662008+0000","last_fullsized":"2024-03-23T06:10:38.662008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664263+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:10:38.664263+0000","last_peered":"2024-03-23T06:10:38.664263+0000","last_clean":"2024-03-23T06:10:38.664263+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:10:38.664263+0000","last_undegraded":"2024-03-23T06:10:38.664263+0000","last_fullsized":"2024-03-23T06:10:38.664263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673486+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:10:38.673486+0000","last_peered":"2024-03-23T06:10:38.673486+0000","last_clean":"2024-03-23T06:10:38.673486+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:10:38.673486+0000","last_undegraded":"2024-03-23T06:10:38.673486+0000","last_fullsized":"2024-03-23T06:10:38.673486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663884+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:10:38.663884+0000","last_peered":"2024-03-23T06:10:38.663884+0000","last_clean":"2024-03-23T06:10:38.663884+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:10:38.663884+0000","last_undegraded":"2024-03-23T06:10:38.663884+0000","last_fullsized":"2024-03-23T06:10:38.663884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672701+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:10:38.672701+0000","last_peered":"2024-03-23T06:10:38.672701+0000","last_clean":"2024-03-23T06:10:38.672701+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:10:38.672701+0000","last_undegraded":"2024-03-23T06:10:38.672701+0000","last_fullsized":"2024-03-23T06:10:38.672701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666692+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:10:38.666692+0000","last_peered":"2024-03-23T06:10:38.666692+0000","last_clean":"2024-03-23T06:10:38.666692+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:10:38.666692+0000","last_undegraded":"2024-03-23T06:10:38.666692+0000","last_fullsized":"2024-03-23T06:10:38.666692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663861+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:10:38.663861+0000","last_peered":"2024-03-23T06:10:38.663861+0000","last_clean":"2024-03-23T06:10:38.663861+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:10:38.663861+0000","last_undegraded":"2024-03-23T06:10:38.663861+0000","last_fullsized":"2024-03-23T06:10:38.663861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675616+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:10:38.675616+0000","last_peered":"2024-03-23T06:10:38.675616+0000","last_clean":"2024-03-23T06:10:38.675616+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:10:38.675616+0000","last_undegraded":"2024-03-23T06:10:38.675616+0000","last_fullsized":"2024-03-23T06:10:38.675616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669635+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:10:38.669635+0000","last_peered":"2024-03-23T06:10:38.669635+0000","last_clean":"2024-03-23T06:10:38.669635+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:10:38.669635+0000","last_undegraded":"2024-03-23T06:10:38.669635+0000","last_fullsized":"2024-03-23T06:10:38.669635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663918+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:10:38.663918+0000","last_peered":"2024-03-23T06:10:38.663918+0000","last_clean":"2024-03-23T06:10:38.663918+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:10:38.663918+0000","last_undegraded":"2024-03-23T06:10:38.663918+0000","last_fullsized":"2024-03-23T06:10:38.663918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665101+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:10:38.665101+0000","last_peered":"2024-03-23T06:10:38.665101+0000","last_clean":"2024-03-23T06:10:38.665101+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:10:38.665101+0000","last_undegraded":"2024-03-23T06:10:38.665101+0000","last_fullsized":"2024-03-23T06:10:38.665101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666097+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:10:38.666097+0000","last_peered":"2024-03-23T06:10:38.666097+0000","last_clean":"2024-03-23T06:10:38.666097+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:10:38.666097+0000","last_undegraded":"2024-03-23T06:10:38.666097+0000","last_fullsized":"2024-03-23T06:10:38.666097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.799662+0000","last_change":"2024-03-23T06:10:39.799662+0000","last_active":"2024-03-23T06:10:39.799662+0000","last_peered":"2024-03-23T06:10:39.799662+0000","last_clean":"2024-03-23T06:10:39.799662+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:10:39.799662+0000","last_undegraded":"2024-03-23T06:10:39.799662+0000","last_fullsized":"2024-03-23T06:10:39.799662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:17:27.260098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663693+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:10:38.663693+0000","last_peered":"2024-03-23T06:10:38.663693+0000","last_clean":"2024-03-23T06:10:38.663693+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:38.663693+0000","last_undegraded":"2024-03-23T06:10:38.663693+0000","last_fullsized":"2024-03-23T06:10:38.663693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667511+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:10:38.667511+0000","last_peered":"2024-03-23T06:10:38.667511+0000","last_clean":"2024-03-23T06:10:38.667511+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:10:38.667511+0000","last_undegraded":"2024-03-23T06:10:38.667511+0000","last_fullsized":"2024-03-23T06:10:38.667511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666359+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:10:38.666359+0000","last_peered":"2024-03-23T06:10:38.666359+0000","last_clean":"2024-03-23T06:10:38.666359+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:10:38.666359+0000","last_undegraded":"2024-03-23T06:10:38.666359+0000","last_fullsized":"2024-03-23T06:10:38.666359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662212+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:10:38.662212+0000","last_peered":"2024-03-23T06:10:38.662212+0000","last_clean":"2024-03-23T06:10:38.662212+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:10:38.662212+0000","last_undegraded":"2024-03-23T06:10:38.662212+0000","last_fullsized":"2024-03-23T06:10:38.662212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670543+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:10:38.670543+0000","last_peered":"2024-03-23T06:10:38.670543+0000","last_clean":"2024-03-23T06:10:38.670543+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:10:38.670543+0000","last_undegraded":"2024-03-23T06:10:38.670543+0000","last_fullsized":"2024-03-23T06:10:38.670543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676301+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:10:38.676301+0000","last_peered":"2024-03-23T06:10:38.676301+0000","last_clean":"2024-03-23T06:10:38.676301+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:10:38.676301+0000","last_undegraded":"2024-03-23T06:10:38.676301+0000","last_fullsized":"2024-03-23T06:10:38.676301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673306+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:10:38.673306+0000","last_peered":"2024-03-23T06:10:38.673306+0000","last_clean":"2024-03-23T06:10:38.673306+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:10:38.673306+0000","last_undegraded":"2024-03-23T06:10:38.673306+0000","last_fullsized":"2024-03-23T06:10:38.673306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673218+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:10:38.673218+0000","last_peered":"2024-03-23T06:10:38.673218+0000","last_clean":"2024-03-23T06:10:38.673218+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:10:38.673218+0000","last_undegraded":"2024-03-23T06:10:38.673218+0000","last_fullsized":"2024-03-23T06:10:38.673218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664273+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:10:38.664273+0000","last_peered":"2024-03-23T06:10:38.664273+0000","last_clean":"2024-03-23T06:10:38.664273+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:10:38.664273+0000","last_undegraded":"2024-03-23T06:10:38.664273+0000","last_fullsized":"2024-03-23T06:10:38.664273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.804956+0000","last_change":"2024-03-23T06:10:39.804956+0000","last_active":"2024-03-23T06:10:39.804956+0000","last_peered":"2024-03-23T06:10:39.804956+0000","last_clean":"2024-03-23T06:10:39.804956+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:10:39.804956+0000","last_undegraded":"2024-03-23T06:10:39.804956+0000","last_fullsized":"2024-03-23T06:10:39.804956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:15:46.873772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675197+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:10:38.675197+0000","last_peered":"2024-03-23T06:10:38.675197+0000","last_clean":"2024-03-23T06:10:38.675197+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:10:38.675197+0000","last_undegraded":"2024-03-23T06:10:38.675197+0000","last_fullsized":"2024-03-23T06:10:38.675197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666210+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:10:38.666210+0000","last_peered":"2024-03-23T06:10:38.666210+0000","last_clean":"2024-03-23T06:10:38.666210+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:10:38.666210+0000","last_undegraded":"2024-03-23T06:10:38.666210+0000","last_fullsized":"2024-03-23T06:10:38.666210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665779+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:10:38.665779+0000","last_peered":"2024-03-23T06:10:38.665779+0000","last_clean":"2024-03-23T06:10:38.665779+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:10:38.665779+0000","last_undegraded":"2024-03-23T06:10:38.665779+0000","last_fullsized":"2024-03-23T06:10:38.665779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677106+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:10:38.677106+0000","last_peered":"2024-03-23T06:10:38.677106+0000","last_clean":"2024-03-23T06:10:38.677106+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:10:38.677106+0000","last_undegraded":"2024-03-23T06:10:38.677106+0000","last_fullsized":"2024-03-23T06:10:38.677106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663129+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:10:38.663129+0000","last_peered":"2024-03-23T06:10:38.663129+0000","last_clean":"2024-03-23T06:10:38.663129+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:10:38.663129+0000","last_undegraded":"2024-03-23T06:10:38.663129+0000","last_fullsized":"2024-03-23T06:10:38.663129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667299+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:10:38.667299+0000","last_peered":"2024-03-23T06:10:38.667299+0000","last_clean":"2024-03-23T06:10:38.667299+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:10:38.667299+0000","last_undegraded":"2024-03-23T06:10:38.667299+0000","last_fullsized":"2024-03-23T06:10:38.667299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673187+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:10:38.673187+0000","last_peered":"2024-03-23T06:10:38.673187+0000","last_clean":"2024-03-23T06:10:38.673187+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:10:38.673187+0000","last_undegraded":"2024-03-23T06:10:38.673187+0000","last_fullsized":"2024-03-23T06:10:38.673187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.799843+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:10:39.799843+0000","last_peered":"2024-03-23T06:10:39.799843+0000","last_clean":"2024-03-23T06:10:39.799843+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:10:39.799843+0000","last_undegraded":"2024-03-23T06:10:39.799843+0000","last_fullsized":"2024-03-23T06:10:39.799843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676335+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:10:38.676335+0000","last_peered":"2024-03-23T06:10:38.676335+0000","last_clean":"2024-03-23T06:10:38.676335+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:10:38.676335+0000","last_undegraded":"2024-03-23T06:10:38.676335+0000","last_fullsized":"2024-03-23T06:10:38.676335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.668256+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:10:38.668256+0000","last_peered":"2024-03-23T06:10:38.668256+0000","last_clean":"2024-03-23T06:10:38.668256+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:10:38.668256+0000","last_undegraded":"2024-03-23T06:10:38.668256+0000","last_fullsized":"2024-03-23T06:10:38.668256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662081+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:10:38.662081+0000","last_peered":"2024-03-23T06:10:38.662081+0000","last_clean":"2024-03-23T06:10:38.662081+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:10:38.662081+0000","last_undegraded":"2024-03-23T06:10:38.662081+0000","last_fullsized":"2024-03-23T06:10:38.662081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666545+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:10:38.666545+0000","last_peered":"2024-03-23T06:10:38.666545+0000","last_clean":"2024-03-23T06:10:38.666545+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:10:38.666545+0000","last_undegraded":"2024-03-23T06:10:38.666545+0000","last_fullsized":"2024-03-23T06:10:38.666545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676086+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:10:38.676086+0000","last_peered":"2024-03-23T06:10:38.676086+0000","last_clean":"2024-03-23T06:10:38.676086+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:10:38.676086+0000","last_undegraded":"2024-03-23T06:10:38.676086+0000","last_fullsized":"2024-03-23T06:10:38.676086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.693367+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:10:38.693367+0000","last_peered":"2024-03-23T06:10:38.693367+0000","last_clean":"2024-03-23T06:10:38.693367+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:10:38.693367+0000","last_undegraded":"2024-03-23T06:10:38.693367+0000","last_fullsized":"2024-03-23T06:10:38.693367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666303+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:10:38.666303+0000","last_peered":"2024-03-23T06:10:38.666303+0000","last_clean":"2024-03-23T06:10:38.666303+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:10:38.666303+0000","last_undegraded":"2024-03-23T06:10:38.666303+0000","last_fullsized":"2024-03-23T06:10:38.666303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670288+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:10:38.670288+0000","last_peered":"2024-03-23T06:10:38.670288+0000","last_clean":"2024-03-23T06:10:38.670288+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:10:38.670288+0000","last_undegraded":"2024-03-23T06:10:38.670288+0000","last_fullsized":"2024-03-23T06:10:38.670288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669529+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:10:38.669529+0000","last_peered":"2024-03-23T06:10:38.669529+0000","last_clean":"2024-03-23T06:10:38.669529+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:10:38.669529+0000","last_undegraded":"2024-03-23T06:10:38.669529+0000","last_fullsized":"2024-03-23T06:10:38.669529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663822+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:10:38.663822+0000","last_peered":"2024-03-23T06:10:38.663822+0000","last_clean":"2024-03-23T06:10:38.663822+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:10:38.663822+0000","last_undegraded":"2024-03-23T06:10:38.663822+0000","last_fullsized":"2024-03-23T06:10:38.663822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664230+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:10:38.664230+0000","last_peered":"2024-03-23T06:10:38.664230+0000","last_clean":"2024-03-23T06:10:38.664230+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:10:38.664230+0000","last_undegraded":"2024-03-23T06:10:38.664230+0000","last_fullsized":"2024-03-23T06:10:38.664230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665917+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:10:38.665917+0000","last_peered":"2024-03-23T06:10:38.665917+0000","last_clean":"2024-03-23T06:10:38.665917+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:10:38.665917+0000","last_undegraded":"2024-03-23T06:10:38.665917+0000","last_fullsized":"2024-03-23T06:10:38.665917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673058+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:10:38.673058+0000","last_peered":"2024-03-23T06:10:38.673058+0000","last_clean":"2024-03-23T06:10:38.673058+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:10:38.673058+0000","last_undegraded":"2024-03-23T06:10:38.673058+0000","last_fullsized":"2024-03-23T06:10:38.673058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677104+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:10:38.677104+0000","last_peered":"2024-03-23T06:10:38.677104+0000","last_clean":"2024-03-23T06:10:38.677104+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:10:38.677104+0000","last_undegraded":"2024-03-23T06:10:38.677104+0000","last_fullsized":"2024-03-23T06:10:38.677104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'12","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672360+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:10:38.672360+0000","last_peered":"2024-03-23T06:10:38.672360+0000","last_clean":"2024-03-23T06:10:38.672360+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:10:38.672360+0000","last_undegraded":"2024-03-23T06:10:38.672360+0000","last_fullsized":"2024-03-23T06:10:38.672360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.661997+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:10:38.661997+0000","last_peered":"2024-03-23T06:10:38.661997+0000","last_clean":"2024-03-23T06:10:38.661997+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:10:38.661997+0000","last_undegraded":"2024-03-23T06:10:38.661997+0000","last_fullsized":"2024-03-23T06:10:38.661997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670833+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:10:38.670833+0000","last_peered":"2024-03-23T06:10:38.670833+0000","last_clean":"2024-03-23T06:10:38.670833+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:10:38.670833+0000","last_undegraded":"2024-03-23T06:10:38.670833+0000","last_fullsized":"2024-03-23T06:10:38.670833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666316+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:10:38.666316+0000","last_peered":"2024-03-23T06:10:38.666316+0000","last_clean":"2024-03-23T06:10:38.666316+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:10:38.666316+0000","last_undegraded":"2024-03-23T06:10:38.666316+0000","last_fullsized":"2024-03-23T06:10:38.666316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670911+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:10:38.670911+0000","last_peered":"2024-03-23T06:10:38.670911+0000","last_clean":"2024-03-23T06:10:38.670911+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:10:38.670911+0000","last_undegraded":"2024-03-23T06:10:38.670911+0000","last_fullsized":"2024-03-23T06:10:38.670911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666437+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:10:38.666437+0000","last_peered":"2024-03-23T06:10:38.666437+0000","last_clean":"2024-03-23T06:10:38.666437+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:10:38.666437+0000","last_undegraded":"2024-03-23T06:10:38.666437+0000","last_fullsized":"2024-03-23T06:10:38.666437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677477+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:10:38.677477+0000","last_peered":"2024-03-23T06:10:38.677477+0000","last_clean":"2024-03-23T06:10:38.677477+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:10:38.677477+0000","last_undegraded":"2024-03-23T06:10:38.677477+0000","last_fullsized":"2024-03-23T06:10:38.677477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665258+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:10:38.665258+0000","last_peered":"2024-03-23T06:10:38.665258+0000","last_clean":"2024-03-23T06:10:38.665258+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:10:38.665258+0000","last_undegraded":"2024-03-23T06:10:38.665258+0000","last_fullsized":"2024-03-23T06:10:38.665258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673128+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:10:38.673128+0000","last_peered":"2024-03-23T06:10:38.673128+0000","last_clean":"2024-03-23T06:10:38.673128+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:10:38.673128+0000","last_undegraded":"2024-03-23T06:10:38.673128+0000","last_fullsized":"2024-03-23T06:10:38.673128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675558+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:10:38.675558+0000","last_peered":"2024-03-23T06:10:38.675558+0000","last_clean":"2024-03-23T06:10:38.675558+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:10:38.675558+0000","last_undegraded":"2024-03-23T06:10:38.675558+0000","last_fullsized":"2024-03-23T06:10:38.675558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.801920+0000","last_change":"2024-03-23T06:10:39.801920+0000","last_active":"2024-03-23T06:10:39.801920+0000","last_peered":"2024-03-23T06:10:39.801920+0000","last_clean":"2024-03-23T06:10:39.801920+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:10:39.801920+0000","last_undegraded":"2024-03-23T06:10:39.801920+0000","last_fullsized":"2024-03-23T06:10:39.801920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:39:07.343046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662421+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:10:38.662421+0000","last_peered":"2024-03-23T06:10:38.662421+0000","last_clean":"2024-03-23T06:10:38.662421+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:10:38.662421+0000","last_undegraded":"2024-03-23T06:10:38.662421+0000","last_fullsized":"2024-03-23T06:10:38.662421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662221+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:10:38.662221+0000","last_peered":"2024-03-23T06:10:38.662221+0000","last_clean":"2024-03-23T06:10:38.662221+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:10:38.662221+0000","last_undegraded":"2024-03-23T06:10:38.662221+0000","last_fullsized":"2024-03-23T06:10:38.662221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667477+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:10:38.667477+0000","last_peered":"2024-03-23T06:10:38.667477+0000","last_clean":"2024-03-23T06:10:38.667477+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:10:38.667477+0000","last_undegraded":"2024-03-23T06:10:38.667477+0000","last_fullsized":"2024-03-23T06:10:38.667477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.671249+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:10:38.671249+0000","last_peered":"2024-03-23T06:10:38.671249+0000","last_clean":"2024-03-23T06:10:38.671249+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:10:38.671249+0000","last_undegraded":"2024-03-23T06:10:38.671249+0000","last_fullsized":"2024-03-23T06:10:38.671249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665232+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:10:38.665232+0000","last_peered":"2024-03-23T06:10:38.665232+0000","last_clean":"2024-03-23T06:10:38.665232+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:10:38.665232+0000","last_undegraded":"2024-03-23T06:10:38.665232+0000","last_fullsized":"2024-03-23T06:10:38.665232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663692+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:10:38.663692+0000","last_peered":"2024-03-23T06:10:38.663692+0000","last_clean":"2024-03-23T06:10:38.663692+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:10:38.663692+0000","last_undegraded":"2024-03-23T06:10:38.663692+0000","last_fullsized":"2024-03-23T06:10:38.663692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669401+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:10:38.669401+0000","last_peered":"2024-03-23T06:10:38.669401+0000","last_clean":"2024-03-23T06:10:38.669401+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:10:38.669401+0000","last_undegraded":"2024-03-23T06:10:38.669401+0000","last_fullsized":"2024-03-23T06:10:38.669401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663036+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:10:38.663036+0000","last_peered":"2024-03-23T06:10:38.663036+0000","last_clean":"2024-03-23T06:10:38.663036+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:10:38.663036+0000","last_undegraded":"2024-03-23T06:10:38.663036+0000","last_fullsized":"2024-03-23T06:10:38.663036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663133+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:10:38.663133+0000","last_peered":"2024-03-23T06:10:38.663133+0000","last_clean":"2024-03-23T06:10:38.663133+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:10:38.663133+0000","last_undegraded":"2024-03-23T06:10:38.663133+0000","last_fullsized":"2024-03-23T06:10:38.663133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665953+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:10:38.665953+0000","last_peered":"2024-03-23T06:10:38.665953+0000","last_clean":"2024-03-23T06:10:38.665953+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:10:38.665953+0000","last_undegraded":"2024-03-23T06:10:38.665953+0000","last_fullsized":"2024-03-23T06:10:38.665953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676697+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:10:38.676697+0000","last_peered":"2024-03-23T06:10:38.676697+0000","last_clean":"2024-03-23T06:10:38.676697+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:10:38.676697+0000","last_undegraded":"2024-03-23T06:10:38.676697+0000","last_fullsized":"2024-03-23T06:10:38.676697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666721+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:10:38.666721+0000","last_peered":"2024-03-23T06:10:38.666721+0000","last_clean":"2024-03-23T06:10:38.666721+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:10:38.666721+0000","last_undegraded":"2024-03-23T06:10:38.666721+0000","last_fullsized":"2024-03-23T06:10:38.666721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670185+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:10:38.670185+0000","last_peered":"2024-03-23T06:10:38.670185+0000","last_clean":"2024-03-23T06:10:38.670185+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:10:38.670185+0000","last_undegraded":"2024-03-23T06:10:38.670185+0000","last_fullsized":"2024-03-23T06:10:38.670185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666043+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:10:38.666043+0000","last_peered":"2024-03-23T06:10:38.666043+0000","last_clean":"2024-03-23T06:10:38.666043+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:10:38.666043+0000","last_undegraded":"2024-03-23T06:10:38.666043+0000","last_fullsized":"2024-03-23T06:10:38.666043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669086+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:10:38.669086+0000","last_peered":"2024-03-23T06:10:38.669086+0000","last_clean":"2024-03-23T06:10:38.669086+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:10:38.669086+0000","last_undegraded":"2024-03-23T06:10:38.669086+0000","last_fullsized":"2024-03-23T06:10:38.669086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665863+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:10:38.665863+0000","last_peered":"2024-03-23T06:10:38.665863+0000","last_clean":"2024-03-23T06:10:38.665863+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:10:38.665863+0000","last_undegraded":"2024-03-23T06:10:38.665863+0000","last_fullsized":"2024-03-23T06:10:38.665863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664171+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:10:38.664171+0000","last_peered":"2024-03-23T06:10:38.664171+0000","last_clean":"2024-03-23T06:10:38.664171+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:10:38.664171+0000","last_undegraded":"2024-03-23T06:10:38.664171+0000","last_fullsized":"2024-03-23T06:10:38.664171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664436+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:10:38.664436+0000","last_peered":"2024-03-23T06:10:38.664436+0000","last_clean":"2024-03-23T06:10:38.664436+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:10:38.664436+0000","last_undegraded":"2024-03-23T06:10:38.664436+0000","last_fullsized":"2024-03-23T06:10:38.664436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673062+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:10:38.673062+0000","last_peered":"2024-03-23T06:10:38.673062+0000","last_clean":"2024-03-23T06:10:38.673062+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:10:38.673062+0000","last_undegraded":"2024-03-23T06:10:38.673062+0000","last_fullsized":"2024-03-23T06:10:38.673062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666232+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:38.666232+0000","last_peered":"2024-03-23T06:10:38.666232+0000","last_clean":"2024-03-23T06:10:38.666232+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:10:38.666232+0000","last_undegraded":"2024-03-23T06:10:38.666232+0000","last_fullsized":"2024-03-23T06:10:38.666232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667410+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:10:38.667410+0000","last_peered":"2024-03-23T06:10:38.667410+0000","last_clean":"2024-03-23T06:10:38.667410+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:10:38.667410+0000","last_undegraded":"2024-03-23T06:10:38.667410+0000","last_fullsized":"2024-03-23T06:10:38.667410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665471+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:10:38.665471+0000","last_peered":"2024-03-23T06:10:38.665471+0000","last_clean":"2024-03-23T06:10:38.665471+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:38.665471+0000","last_undegraded":"2024-03-23T06:10:38.665471+0000","last_fullsized":"2024-03-23T06:10:38.665471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676615+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:10:38.676615+0000","last_peered":"2024-03-23T06:10:38.676615+0000","last_clean":"2024-03-23T06:10:38.676615+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:10:38.676615+0000","last_undegraded":"2024-03-23T06:10:38.676615+0000","last_fullsized":"2024-03-23T06:10:38.676615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662325+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:10:38.662325+0000","last_peered":"2024-03-23T06:10:38.662325+0000","last_clean":"2024-03-23T06:10:38.662325+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:10:38.662325+0000","last_undegraded":"2024-03-23T06:10:38.662325+0000","last_fullsized":"2024-03-23T06:10:38.662325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.674989+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:10:38.674989+0000","last_peered":"2024-03-23T06:10:38.674989+0000","last_clean":"2024-03-23T06:10:38.674989+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:10:38.674989+0000","last_undegraded":"2024-03-23T06:10:38.674989+0000","last_fullsized":"2024-03-23T06:10:38.674989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673390+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:10:38.673390+0000","last_peered":"2024-03-23T06:10:38.673390+0000","last_clean":"2024-03-23T06:10:38.673390+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:10:38.673390+0000","last_undegraded":"2024-03-23T06:10:38.673390+0000","last_fullsized":"2024-03-23T06:10:38.673390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666912+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:10:38.666912+0000","last_peered":"2024-03-23T06:10:38.666912+0000","last_clean":"2024-03-23T06:10:38.666912+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:10:38.666912+0000","last_undegraded":"2024-03-23T06:10:38.666912+0000","last_fullsized":"2024-03-23T06:10:38.666912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.671497+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:10:38.671497+0000","last_peered":"2024-03-23T06:10:38.671497+0000","last_clean":"2024-03-23T06:10:38.671497+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:10:38.671497+0000","last_undegraded":"2024-03-23T06:10:38.671497+0000","last_fullsized":"2024-03-23T06:10:38.671497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667374+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:38.667374+0000","last_peered":"2024-03-23T06:10:38.667374+0000","last_clean":"2024-03-23T06:10:38.667374+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:10:38.667374+0000","last_undegraded":"2024-03-23T06:10:38.667374+0000","last_fullsized":"2024-03-23T06:10:38.667374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665385+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:10:38.665385+0000","last_peered":"2024-03-23T06:10:38.665385+0000","last_clean":"2024-03-23T06:10:38.665385+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:10:38.665385+0000","last_undegraded":"2024-03-23T06:10:38.665385+0000","last_fullsized":"2024-03-23T06:10:38.665385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664023+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:10:38.664023+0000","last_peered":"2024-03-23T06:10:38.664023+0000","last_clean":"2024-03-23T06:10:38.664023+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:10:38.664023+0000","last_undegraded":"2024-03-23T06:10:38.664023+0000","last_fullsized":"2024-03-23T06:10:38.664023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664126+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:10:38.664126+0000","last_peered":"2024-03-23T06:10:38.664126+0000","last_clean":"2024-03-23T06:10:38.664126+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:10:38.664126+0000","last_undegraded":"2024-03-23T06:10:38.664126+0000","last_fullsized":"2024-03-23T06:10:38.664126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.674768+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:10:38.674768+0000","last_peered":"2024-03-23T06:10:38.674768+0000","last_clean":"2024-03-23T06:10:38.674768+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:10:38.674768+0000","last_undegraded":"2024-03-23T06:10:38.674768+0000","last_fullsized":"2024-03-23T06:10:38.674768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677024+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:10:38.677024+0000","last_peered":"2024-03-23T06:10:38.677024+0000","last_clean":"2024-03-23T06:10:38.677024+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:10:38.677024+0000","last_undegraded":"2024-03-23T06:10:38.677024+0000","last_fullsized":"2024-03-23T06:10:38.677024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677394+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:10:38.677394+0000","last_peered":"2024-03-23T06:10:38.677394+0000","last_clean":"2024-03-23T06:10:38.677394+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:10:38.677394+0000","last_undegraded":"2024-03-23T06:10:38.677394+0000","last_fullsized":"2024-03-23T06:10:38.677394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675459+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:10:38.675459+0000","last_peered":"2024-03-23T06:10:38.675459+0000","last_clean":"2024-03-23T06:10:38.675459+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:10:38.675459+0000","last_undegraded":"2024-03-23T06:10:38.675459+0000","last_fullsized":"2024-03-23T06:10:38.675459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665087+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:10:38.665087+0000","last_peered":"2024-03-23T06:10:38.665087+0000","last_clean":"2024-03-23T06:10:38.665087+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:10:38.665087+0000","last_undegraded":"2024-03-23T06:10:38.665087+0000","last_fullsized":"2024-03-23T06:10:38.665087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.678427+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:10:38.678427+0000","last_peered":"2024-03-23T06:10:38.678427+0000","last_clean":"2024-03-23T06:10:38.678427+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:10:38.678427+0000","last_undegraded":"2024-03-23T06:10:38.678427+0000","last_fullsized":"2024-03-23T06:10:38.678427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672101+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:10:38.672101+0000","last_peered":"2024-03-23T06:10:38.672101+0000","last_clean":"2024-03-23T06:10:38.672101+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:10:38.672101+0000","last_undegraded":"2024-03-23T06:10:38.672101+0000","last_fullsized":"2024-03-23T06:10:38.672101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675852+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:10:38.675852+0000","last_peered":"2024-03-23T06:10:38.675852+0000","last_clean":"2024-03-23T06:10:38.675852+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:10:38.675852+0000","last_undegraded":"2024-03-23T06:10:38.675852+0000","last_fullsized":"2024-03-23T06:10:38.675852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672224+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:10:38.672224+0000","last_peered":"2024-03-23T06:10:38.672224+0000","last_clean":"2024-03-23T06:10:38.672224+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:10:38.672224+0000","last_undegraded":"2024-03-23T06:10:38.672224+0000","last_fullsized":"2024-03-23T06:10:38.672224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666070+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:10:38.666070+0000","last_peered":"2024-03-23T06:10:38.666070+0000","last_clean":"2024-03-23T06:10:38.666070+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:10:38.666070+0000","last_undegraded":"2024-03-23T06:10:38.666070+0000","last_fullsized":"2024-03-23T06:10:38.666070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666455+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:10:38.666455+0000","last_peered":"2024-03-23T06:10:38.666455+0000","last_clean":"2024-03-23T06:10:38.666455+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:10:38.666455+0000","last_undegraded":"2024-03-23T06:10:38.666455+0000","last_fullsized":"2024-03-23T06:10:38.666455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677038+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:10:38.677038+0000","last_peered":"2024-03-23T06:10:38.677038+0000","last_clean":"2024-03-23T06:10:38.677038+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:10:38.677038+0000","last_undegraded":"2024-03-23T06:10:38.677038+0000","last_fullsized":"2024-03-23T06:10:38.677038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7309,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":118241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":120892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":707591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":118331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":311296,"data_stored":117971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Mar 23 06:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.36199999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.377}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":299008,"data_stored":118219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":708187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.495}]},{"osd":6,"last update":"Sat Mar 23 06:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.41599999999999998}]},{"osd":7,"last update":"Sat Mar 23 06:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":331776,"data_stored":122426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:10:52.129 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:10:52.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.378+0000 7f0508000640 1 Processor -- start 2024-03-23T06:10:52.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.378+0000 7f0508000640 1 -- start start 2024-03-23T06:10:52.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0508000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001513f0 0x7f05000c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0508000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05001586b0 0x7f05000bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0508000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f05000c03a0 0x7f0500071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0508000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05000c5f50 con 0x7f05000c03a0 2024-03-23T06:10:52.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0508000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0500157b60 con 0x7f05001586b0 2024-03-23T06:10:52.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0508000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000c0830 con 0x7f05001513f0 2024-03-23T06:10:52.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0506000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f05000c03a0 0x7f0500071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0504c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05001586b0 0x7f05000bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0505600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001513f0 0x7f05000c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0504c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05001586b0 0x7f05000bfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57884/0 (socket says 172.21.15.73:57884) 2024-03-23T06:10:52.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.380+0000 7f0504c00640 1 -- 172.21.15.73:0/958005493 learned_addr learned my addr 172.21.15.73:0/958005493 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:52.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.381+0000 7f0505600640 1 -- 172.21.15.73:0/958005493 >> v2:172.21.15.110:3300/0 conn(0x7f05001586b0 msgr2=0x7f05000bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:52.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.381+0000 7f0505600640 1 --2- 172.21.15.73:0/958005493 >> v2:172.21.15.110:3300/0 conn(0x7f05001586b0 0x7f05000bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.381+0000 7f0505600640 1 -- 172.21.15.73:0/958005493 >> v2:172.21.15.73:3300/0 conn(0x7f05000c03a0 msgr2=0x7f0500071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:52.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.381+0000 7f0505600640 1 --2- 172.21.15.73:0/958005493 >> v2:172.21.15.73:3300/0 conn(0x7f05000c03a0 0x7f0500071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.381+0000 7f0505600640 1 -- 172.21.15.73:0/958005493 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000c0b10 con 0x7f05001513f0 2024-03-23T06:10:52.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.381+0000 7f0504c00640 1 --2- 172.21.15.73:0/958005493 >> v2:172.21.15.110:3300/0 conn(0x7f05001586b0 0x7f05000bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:52.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.382+0000 7f0505600640 1 --2- 172.21.15.73:0/958005493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001513f0 0x7f05000c5a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f050006c870 tx=0x7f04f402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc9b0b5f5ba5f6c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:52.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.382+0000 7f04ffe00640 1 -- 172.21.15.73:0/958005493 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4031830 con 0x7f05001513f0 2024-03-23T06:10:52.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.382+0000 7f04ffe00640 1 -- 172.21.15.73:0/958005493 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f4031990 con 0x7f05001513f0 2024-03-23T06:10:52.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.382+0000 7f04ffe00640 1 -- 172.21.15.73:0/958005493 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4031d20 con 0x7f05001513f0 2024-03-23T06:10:52.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 -- 172.21.15.73:0/958005493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001513f0 msgr2=0x7f05000c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 --2- 172.21.15.73:0/958005493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001513f0 0x7f05000c5a10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f050006c870 tx=0x7f04f402b8d0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 -- 172.21.15.73:0/958005493 shutdown_connections 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 --2- 172.21.15.73:0/958005493 >> v2:172.21.15.73:3300/0 conn(0x7f05000c03a0 0x7f0500071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 --2- 172.21.15.73:0/958005493 >> v2:172.21.15.110:3300/0 conn(0x7f05001586b0 0x7f05000bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 --2- 172.21.15.73:0/958005493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001513f0 0x7f05000c5a10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 -- 172.21.15.73:0/958005493 >> 172.21.15.73:0/958005493 conn(0x7f050006bb40 msgr2=0x7f050006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 -- 172.21.15.73:0/958005493 shutdown_connections 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.383+0000 7f0508000640 1 -- 172.21.15.73:0/958005493 wait complete. 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.385+0000 7f0508000640 1 Processor -- start 2024-03-23T06:10:52.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.385+0000 7f0508000640 1 -- start start 2024-03-23T06:10:52.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0508000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05001513f0 0x7f0500071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0508000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001586b0 0x7f05001e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0508000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05001e2030 0x7f050014bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0508000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05001e3440 con 0x7f05001e2030 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0508000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05001e44f0 con 0x7f05001513f0 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0508000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05001efc00 con 0x7f05001586b0 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0506000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05001e2030 0x7f050014bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0506000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05001e2030 0x7f050014bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50034/0 (socket says 172.21.15.73:50034) 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0506000640 1 -- 172.21.15.73:0/3488377032 learned_addr learned my addr 172.21.15.73:0/3488377032 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0505600640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05001513f0 0x7f0500071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.386+0000 7f0504c00640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001586b0 0x7f05001e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f0506000640 1 -- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001586b0 msgr2=0x7f05001e3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f0506000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001586b0 0x7f05001e3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f0506000640 1 -- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05001513f0 msgr2=0x7f0500071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f0506000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05001513f0 0x7f0500071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f0506000640 1 -- 172.21.15.73:0/3488377032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec0094d0 con 0x7f05001e2030 2024-03-23T06:10:52.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f0506000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05001e2030 0x7f050014bf00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04f800eed0 tx=0x7f04f800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:52.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f04fd600640 1 -- 172.21.15.73:0/3488377032 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8010040 con 0x7f05001e2030 2024-03-23T06:10:52.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f04fd600640 1 -- 172.21.15.73:0/3488377032 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f800bd20 con 0x7f05001e2030 2024-03-23T06:10:52.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f04fd600640 1 -- 172.21.15.73:0/3488377032 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8014640 con 0x7f05001e2030 2024-03-23T06:10:52.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f4009400 con 0x7f05001e2030 2024-03-23T06:10:52.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.387+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05001f2de0 con 0x7f05001e2030 2024-03-23T06:10:52.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.389+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0500157fd0 con 0x7f05001e2030 2024-03-23T06:10:52.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.390+0000 7f04fd600640 1 -- 172.21.15.73:0/3488377032 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f04f80147a0 con 0x7f05001e2030 2024-03-23T06:10:52.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.391+0000 7f04fd600640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f04e006ac00 0x7f04e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.391+0000 7f04fd600640 1 -- 172.21.15.73:0/3488377032 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f04f8089fb0 con 0x7f05001e2030 2024-03-23T06:10:52.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.391+0000 7f0505600640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f04e006ac00 0x7f04e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.392+0000 7f0505600640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f04e006ac00 0x7f04e006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04f4036000 tx=0x7f04f403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:52.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.396+0000 7f04fd600640 1 -- 172.21.15.73:0/3488377032 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0500157fd0 con 0x7f05001e2030 2024-03-23T06:10:52.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.584+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0500157fd0 con 0x7f04e006ac00 2024-03-23T06:10:52.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.594+0000 7f04fd600640 1 -- 172.21.15.73:0/3488377032 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+347969 (secure 0 0 0) 0x7f0500157fd0 con 0x7f04e006ac00 2024-03-23T06:10:52.599 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:52.601 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.601+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f04e006ac00 msgr2=0x7f04e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.601+0000 7f0508000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f04e006ac00 0x7f04e006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04f4036000 tx=0x7f04f403c040 comp rx=0 tx=0).stop 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.601+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05001e2030 msgr2=0x7f050014bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.601+0000 7f0508000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05001e2030 0x7f050014bf00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f04f800eed0 tx=0x7f04f800b480 comp rx=0 tx=0).stop 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.602+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 shutdown_connections 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.602+0000 7f0508000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05001e2030 0x7f050014bf00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.602+0000 7f0508000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f04e006ac00 0x7f04e006d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.602+0000 7f0508000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05001586b0 0x7f05001e3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.602+0000 7f0508000640 1 --2- 172.21.15.73:0/3488377032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05001513f0 0x7f0500071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.602+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 >> 172.21.15.73:0/3488377032 conn(0x7f050006bb40 msgr2=0x7f0500071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.602+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 shutdown_connections 2024-03-23T06:10:52.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.602+0000 7f0508000640 1 -- 172.21.15.73:0/3488377032 wait complete. 2024-03-23T06:10:52.619 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-23T06:10:50.623487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597677,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236128,"kb_used_data":3560,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738592,"statfs":{"total":773094113280,"available":772852318208,"internally_reserved":0,"allocated":3645440,"data_stored":2131858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.958054"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662964+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:10:38.662964+0000","last_peered":"2024-03-23T06:10:38.662964+0000","last_clean":"2024-03-23T06:10:38.662964+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:10:38.662964+0000","last_undegraded":"2024-03-23T06:10:38.662964+0000","last_fullsized":"2024-03-23T06:10:38.662964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666626+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:10:38.666626+0000","last_peered":"2024-03-23T06:10:38.666626+0000","last_clean":"2024-03-23T06:10:38.666626+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:10:38.666626+0000","last_undegraded":"2024-03-23T06:10:38.666626+0000","last_fullsized":"2024-03-23T06:10:38.666626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665663+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:10:38.665663+0000","last_peered":"2024-03-23T06:10:38.665663+0000","last_clean":"2024-03-23T06:10:38.665663+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:10:38.665663+0000","last_undegraded":"2024-03-23T06:10:38.665663+0000","last_fullsized":"2024-03-23T06:10:38.665663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.691098+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:10:38.691098+0000","last_peered":"2024-03-23T06:10:38.691098+0000","last_clean":"2024-03-23T06:10:38.691098+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:10:38.691098+0000","last_undegraded":"2024-03-23T06:10:38.691098+0000","last_fullsized":"2024-03-23T06:10:38.691098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666370+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:10:38.666370+0000","last_peered":"2024-03-23T06:10:38.666370+0000","last_clean":"2024-03-23T06:10:38.666370+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:10:38.666370+0000","last_undegraded":"2024-03-23T06:10:38.666370+0000","last_fullsized":"2024-03-23T06:10:38.666370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670002+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:10:38.670002+0000","last_peered":"2024-03-23T06:10:38.670002+0000","last_clean":"2024-03-23T06:10:38.670002+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:10:38.670002+0000","last_undegraded":"2024-03-23T06:10:38.670002+0000","last_fullsized":"2024-03-23T06:10:38.670002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677234+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:10:38.677234+0000","last_peered":"2024-03-23T06:10:38.677234+0000","last_clean":"2024-03-23T06:10:38.677234+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:10:38.677234+0000","last_undegraded":"2024-03-23T06:10:38.677234+0000","last_fullsized":"2024-03-23T06:10:38.677234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.674095+0000","last_change":"2024-03-23T06:10:39.674095+0000","last_active":"2024-03-23T06:10:39.674095+0000","last_peered":"2024-03-23T06:10:39.674095+0000","last_clean":"2024-03-23T06:10:39.674095+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:10:39.674095+0000","last_undegraded":"2024-03-23T06:10:39.674095+0000","last_fullsized":"2024-03-23T06:10:39.674095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:13:50.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670763+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:10:38.670763+0000","last_peered":"2024-03-23T06:10:38.670763+0000","last_clean":"2024-03-23T06:10:38.670763+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:10:38.670763+0000","last_undegraded":"2024-03-23T06:10:38.670763+0000","last_fullsized":"2024-03-23T06:10:38.670763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675444+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:10:38.675444+0000","last_peered":"2024-03-23T06:10:38.675444+0000","last_clean":"2024-03-23T06:10:38.675444+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:10:38.675444+0000","last_undegraded":"2024-03-23T06:10:38.675444+0000","last_fullsized":"2024-03-23T06:10:38.675444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673140+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:10:38.673140+0000","last_peered":"2024-03-23T06:10:38.673140+0000","last_clean":"2024-03-23T06:10:38.673140+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:10:38.673140+0000","last_undegraded":"2024-03-23T06:10:38.673140+0000","last_fullsized":"2024-03-23T06:10:38.673140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.674577+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:10:38.674577+0000","last_peered":"2024-03-23T06:10:38.674577+0000","last_clean":"2024-03-23T06:10:38.674577+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:10:38.674577+0000","last_undegraded":"2024-03-23T06:10:38.674577+0000","last_fullsized":"2024-03-23T06:10:38.674577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669165+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:10:38.669165+0000","last_peered":"2024-03-23T06:10:38.669165+0000","last_clean":"2024-03-23T06:10:38.669165+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:10:38.669165+0000","last_undegraded":"2024-03-23T06:10:38.669165+0000","last_fullsized":"2024-03-23T06:10:38.669165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670478+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:10:38.670478+0000","last_peered":"2024-03-23T06:10:38.670478+0000","last_clean":"2024-03-23T06:10:38.670478+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:10:38.670478+0000","last_undegraded":"2024-03-23T06:10:38.670478+0000","last_fullsized":"2024-03-23T06:10:38.670478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672887+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:10:38.672887+0000","last_peered":"2024-03-23T06:10:38.672887+0000","last_clean":"2024-03-23T06:10:38.672887+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:10:38.672887+0000","last_undegraded":"2024-03-23T06:10:38.672887+0000","last_fullsized":"2024-03-23T06:10:38.672887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665763+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:10:38.665763+0000","last_peered":"2024-03-23T06:10:38.665763+0000","last_clean":"2024-03-23T06:10:38.665763+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:10:38.665763+0000","last_undegraded":"2024-03-23T06:10:38.665763+0000","last_fullsized":"2024-03-23T06:10:38.665763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664168+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:10:38.664168+0000","last_peered":"2024-03-23T06:10:38.664168+0000","last_clean":"2024-03-23T06:10:38.664168+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:10:38.664168+0000","last_undegraded":"2024-03-23T06:10:38.664168+0000","last_fullsized":"2024-03-23T06:10:38.664168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672799+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:10:38.672799+0000","last_peered":"2024-03-23T06:10:38.672799+0000","last_clean":"2024-03-23T06:10:38.672799+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:10:38.672799+0000","last_undegraded":"2024-03-23T06:10:38.672799+0000","last_fullsized":"2024-03-23T06:10:38.672799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.661979+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:10:38.661979+0000","last_peered":"2024-03-23T06:10:38.661979+0000","last_clean":"2024-03-23T06:10:38.661979+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:10:38.661979+0000","last_undegraded":"2024-03-23T06:10:38.661979+0000","last_fullsized":"2024-03-23T06:10:38.661979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662318+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:10:38.662318+0000","last_peered":"2024-03-23T06:10:38.662318+0000","last_clean":"2024-03-23T06:10:38.662318+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:10:38.662318+0000","last_undegraded":"2024-03-23T06:10:38.662318+0000","last_fullsized":"2024-03-23T06:10:38.662318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666359+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:10:38.666359+0000","last_peered":"2024-03-23T06:10:38.666359+0000","last_clean":"2024-03-23T06:10:38.666359+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:10:38.666359+0000","last_undegraded":"2024-03-23T06:10:38.666359+0000","last_fullsized":"2024-03-23T06:10:38.666359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.668380+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:10:38.668380+0000","last_peered":"2024-03-23T06:10:38.668380+0000","last_clean":"2024-03-23T06:10:38.668380+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:10:38.668380+0000","last_undegraded":"2024-03-23T06:10:38.668380+0000","last_fullsized":"2024-03-23T06:10:38.668380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676694+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:10:38.676694+0000","last_peered":"2024-03-23T06:10:38.676694+0000","last_clean":"2024-03-23T06:10:38.676694+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:10:38.676694+0000","last_undegraded":"2024-03-23T06:10:38.676694+0000","last_fullsized":"2024-03-23T06:10:38.676694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672985+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:10:38.672985+0000","last_peered":"2024-03-23T06:10:38.672985+0000","last_clean":"2024-03-23T06:10:38.672985+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:10:38.672985+0000","last_undegraded":"2024-03-23T06:10:38.672985+0000","last_fullsized":"2024-03-23T06:10:38.672985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662784+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:10:38.662784+0000","last_peered":"2024-03-23T06:10:38.662784+0000","last_clean":"2024-03-23T06:10:38.662784+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:10:38.662784+0000","last_undegraded":"2024-03-23T06:10:38.662784+0000","last_fullsized":"2024-03-23T06:10:38.662784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.671634+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:10:38.671634+0000","last_peered":"2024-03-23T06:10:38.671634+0000","last_clean":"2024-03-23T06:10:38.671634+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:10:38.671634+0000","last_undegraded":"2024-03-23T06:10:38.671634+0000","last_fullsized":"2024-03-23T06:10:38.671634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670242+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:10:38.670242+0000","last_peered":"2024-03-23T06:10:38.670242+0000","last_clean":"2024-03-23T06:10:38.670242+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:10:38.670242+0000","last_undegraded":"2024-03-23T06:10:38.670242+0000","last_fullsized":"2024-03-23T06:10:38.670242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662864+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:10:38.662864+0000","last_peered":"2024-03-23T06:10:38.662864+0000","last_clean":"2024-03-23T06:10:38.662864+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:10:38.662864+0000","last_undegraded":"2024-03-23T06:10:38.662864+0000","last_fullsized":"2024-03-23T06:10:38.662864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662866+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:10:38.662866+0000","last_peered":"2024-03-23T06:10:38.662866+0000","last_clean":"2024-03-23T06:10:38.662866+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:10:38.662866+0000","last_undegraded":"2024-03-23T06:10:38.662866+0000","last_fullsized":"2024-03-23T06:10:38.662866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662008+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:10:38.662008+0000","last_peered":"2024-03-23T06:10:38.662008+0000","last_clean":"2024-03-23T06:10:38.662008+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:10:38.662008+0000","last_undegraded":"2024-03-23T06:10:38.662008+0000","last_fullsized":"2024-03-23T06:10:38.662008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664263+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:10:38.664263+0000","last_peered":"2024-03-23T06:10:38.664263+0000","last_clean":"2024-03-23T06:10:38.664263+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:10:38.664263+0000","last_undegraded":"2024-03-23T06:10:38.664263+0000","last_fullsized":"2024-03-23T06:10:38.664263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673486+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:10:38.673486+0000","last_peered":"2024-03-23T06:10:38.673486+0000","last_clean":"2024-03-23T06:10:38.673486+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:10:38.673486+0000","last_undegraded":"2024-03-23T06:10:38.673486+0000","last_fullsized":"2024-03-23T06:10:38.673486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663884+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:10:38.663884+0000","last_peered":"2024-03-23T06:10:38.663884+0000","last_clean":"2024-03-23T06:10:38.663884+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:10:38.663884+0000","last_undegraded":"2024-03-23T06:10:38.663884+0000","last_fullsized":"2024-03-23T06:10:38.663884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672701+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:10:38.672701+0000","last_peered":"2024-03-23T06:10:38.672701+0000","last_clean":"2024-03-23T06:10:38.672701+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:10:38.672701+0000","last_undegraded":"2024-03-23T06:10:38.672701+0000","last_fullsized":"2024-03-23T06:10:38.672701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666692+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:10:38.666692+0000","last_peered":"2024-03-23T06:10:38.666692+0000","last_clean":"2024-03-23T06:10:38.666692+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:10:38.666692+0000","last_undegraded":"2024-03-23T06:10:38.666692+0000","last_fullsized":"2024-03-23T06:10:38.666692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663861+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:10:38.663861+0000","last_peered":"2024-03-23T06:10:38.663861+0000","last_clean":"2024-03-23T06:10:38.663861+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:10:38.663861+0000","last_undegraded":"2024-03-23T06:10:38.663861+0000","last_fullsized":"2024-03-23T06:10:38.663861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675616+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:10:38.675616+0000","last_peered":"2024-03-23T06:10:38.675616+0000","last_clean":"2024-03-23T06:10:38.675616+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:10:38.675616+0000","last_undegraded":"2024-03-23T06:10:38.675616+0000","last_fullsized":"2024-03-23T06:10:38.675616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669635+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:10:38.669635+0000","last_peered":"2024-03-23T06:10:38.669635+0000","last_clean":"2024-03-23T06:10:38.669635+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:10:38.669635+0000","last_undegraded":"2024-03-23T06:10:38.669635+0000","last_fullsized":"2024-03-23T06:10:38.669635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663918+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:10:38.663918+0000","last_peered":"2024-03-23T06:10:38.663918+0000","last_clean":"2024-03-23T06:10:38.663918+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:10:38.663918+0000","last_undegraded":"2024-03-23T06:10:38.663918+0000","last_fullsized":"2024-03-23T06:10:38.663918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665101+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:10:38.665101+0000","last_peered":"2024-03-23T06:10:38.665101+0000","last_clean":"2024-03-23T06:10:38.665101+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:10:38.665101+0000","last_undegraded":"2024-03-23T06:10:38.665101+0000","last_fullsized":"2024-03-23T06:10:38.665101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666097+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:10:38.666097+0000","last_peered":"2024-03-23T06:10:38.666097+0000","last_clean":"2024-03-23T06:10:38.666097+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:10:38.666097+0000","last_undegraded":"2024-03-23T06:10:38.666097+0000","last_fullsized":"2024-03-23T06:10:38.666097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.799662+0000","last_change":"2024-03-23T06:10:39.799662+0000","last_active":"2024-03-23T06:10:39.799662+0000","last_peered":"2024-03-23T06:10:39.799662+0000","last_clean":"2024-03-23T06:10:39.799662+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:10:39.799662+0000","last_undegraded":"2024-03-23T06:10:39.799662+0000","last_fullsized":"2024-03-23T06:10:39.799662+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:17:27.260098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663693+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:10:38.663693+0000","last_peered":"2024-03-23T06:10:38.663693+0000","last_clean":"2024-03-23T06:10:38.663693+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:38.663693+0000","last_undegraded":"2024-03-23T06:10:38.663693+0000","last_fullsized":"2024-03-23T06:10:38.663693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667511+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:10:38.667511+0000","last_peered":"2024-03-23T06:10:38.667511+0000","last_clean":"2024-03-23T06:10:38.667511+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:10:38.667511+0000","last_undegraded":"2024-03-23T06:10:38.667511+0000","last_fullsized":"2024-03-23T06:10:38.667511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666359+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:10:38.666359+0000","last_peered":"2024-03-23T06:10:38.666359+0000","last_clean":"2024-03-23T06:10:38.666359+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:10:38.666359+0000","last_undegraded":"2024-03-23T06:10:38.666359+0000","last_fullsized":"2024-03-23T06:10:38.666359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662212+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:10:38.662212+0000","last_peered":"2024-03-23T06:10:38.662212+0000","last_clean":"2024-03-23T06:10:38.662212+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:10:38.662212+0000","last_undegraded":"2024-03-23T06:10:38.662212+0000","last_fullsized":"2024-03-23T06:10:38.662212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670543+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:10:38.670543+0000","last_peered":"2024-03-23T06:10:38.670543+0000","last_clean":"2024-03-23T06:10:38.670543+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:10:38.670543+0000","last_undegraded":"2024-03-23T06:10:38.670543+0000","last_fullsized":"2024-03-23T06:10:38.670543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676301+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:10:38.676301+0000","last_peered":"2024-03-23T06:10:38.676301+0000","last_clean":"2024-03-23T06:10:38.676301+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:10:38.676301+0000","last_undegraded":"2024-03-23T06:10:38.676301+0000","last_fullsized":"2024-03-23T06:10:38.676301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673306+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:10:38.673306+0000","last_peered":"2024-03-23T06:10:38.673306+0000","last_clean":"2024-03-23T06:10:38.673306+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:10:38.673306+0000","last_undegraded":"2024-03-23T06:10:38.673306+0000","last_fullsized":"2024-03-23T06:10:38.673306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673218+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:10:38.673218+0000","last_peered":"2024-03-23T06:10:38.673218+0000","last_clean":"2024-03-23T06:10:38.673218+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:10:38.673218+0000","last_undegraded":"2024-03-23T06:10:38.673218+0000","last_fullsized":"2024-03-23T06:10:38.673218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664273+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:10:38.664273+0000","last_peered":"2024-03-23T06:10:38.664273+0000","last_clean":"2024-03-23T06:10:38.664273+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:10:38.664273+0000","last_undegraded":"2024-03-23T06:10:38.664273+0000","last_fullsized":"2024-03-23T06:10:38.664273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.804956+0000","last_change":"2024-03-23T06:10:39.804956+0000","last_active":"2024-03-23T06:10:39.804956+0000","last_peered":"2024-03-23T06:10:39.804956+0000","last_clean":"2024-03-23T06:10:39.804956+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:10:39.804956+0000","last_undegraded":"2024-03-23T06:10:39.804956+0000","last_fullsized":"2024-03-23T06:10:39.804956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:15:46.873772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675197+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:10:38.675197+0000","last_peered":"2024-03-23T06:10:38.675197+0000","last_clean":"2024-03-23T06:10:38.675197+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:10:38.675197+0000","last_undegraded":"2024-03-23T06:10:38.675197+0000","last_fullsized":"2024-03-23T06:10:38.675197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666210+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:10:38.666210+0000","last_peered":"2024-03-23T06:10:38.666210+0000","last_clean":"2024-03-23T06:10:38.666210+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:10:38.666210+0000","last_undegraded":"2024-03-23T06:10:38.666210+0000","last_fullsized":"2024-03-23T06:10:38.666210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665779+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:10:38.665779+0000","last_peered":"2024-03-23T06:10:38.665779+0000","last_clean":"2024-03-23T06:10:38.665779+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:10:38.665779+0000","last_undegraded":"2024-03-23T06:10:38.665779+0000","last_fullsized":"2024-03-23T06:10:38.665779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677106+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:10:38.677106+0000","last_peered":"2024-03-23T06:10:38.677106+0000","last_clean":"2024-03-23T06:10:38.677106+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:10:38.677106+0000","last_undegraded":"2024-03-23T06:10:38.677106+0000","last_fullsized":"2024-03-23T06:10:38.677106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663129+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:10:38.663129+0000","last_peered":"2024-03-23T06:10:38.663129+0000","last_clean":"2024-03-23T06:10:38.663129+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:10:38.663129+0000","last_undegraded":"2024-03-23T06:10:38.663129+0000","last_fullsized":"2024-03-23T06:10:38.663129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667299+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:10:38.667299+0000","last_peered":"2024-03-23T06:10:38.667299+0000","last_clean":"2024-03-23T06:10:38.667299+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:10:38.667299+0000","last_undegraded":"2024-03-23T06:10:38.667299+0000","last_fullsized":"2024-03-23T06:10:38.667299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673187+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:10:38.673187+0000","last_peered":"2024-03-23T06:10:38.673187+0000","last_clean":"2024-03-23T06:10:38.673187+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:10:38.673187+0000","last_undegraded":"2024-03-23T06:10:38.673187+0000","last_fullsized":"2024-03-23T06:10:38.673187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.799843+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:10:39.799843+0000","last_peered":"2024-03-23T06:10:39.799843+0000","last_clean":"2024-03-23T06:10:39.799843+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:10:39.799843+0000","last_undegraded":"2024-03-23T06:10:39.799843+0000","last_fullsized":"2024-03-23T06:10:39.799843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676335+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:10:38.676335+0000","last_peered":"2024-03-23T06:10:38.676335+0000","last_clean":"2024-03-23T06:10:38.676335+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:10:38.676335+0000","last_undegraded":"2024-03-23T06:10:38.676335+0000","last_fullsized":"2024-03-23T06:10:38.676335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.668256+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:10:38.668256+0000","last_peered":"2024-03-23T06:10:38.668256+0000","last_clean":"2024-03-23T06:10:38.668256+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:10:38.668256+0000","last_undegraded":"2024-03-23T06:10:38.668256+0000","last_fullsized":"2024-03-23T06:10:38.668256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662081+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:10:38.662081+0000","last_peered":"2024-03-23T06:10:38.662081+0000","last_clean":"2024-03-23T06:10:38.662081+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:10:38.662081+0000","last_undegraded":"2024-03-23T06:10:38.662081+0000","last_fullsized":"2024-03-23T06:10:38.662081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666545+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:10:38.666545+0000","last_peered":"2024-03-23T06:10:38.666545+0000","last_clean":"2024-03-23T06:10:38.666545+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:10:38.666545+0000","last_undegraded":"2024-03-23T06:10:38.666545+0000","last_fullsized":"2024-03-23T06:10:38.666545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676086+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:10:38.676086+0000","last_peered":"2024-03-23T06:10:38.676086+0000","last_clean":"2024-03-23T06:10:38.676086+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:10:38.676086+0000","last_undegraded":"2024-03-23T06:10:38.676086+0000","last_fullsized":"2024-03-23T06:10:38.676086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.693367+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:10:38.693367+0000","last_peered":"2024-03-23T06:10:38.693367+0000","last_clean":"2024-03-23T06:10:38.693367+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:10:38.693367+0000","last_undegraded":"2024-03-23T06:10:38.693367+0000","last_fullsized":"2024-03-23T06:10:38.693367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666303+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:10:38.666303+0000","last_peered":"2024-03-23T06:10:38.666303+0000","last_clean":"2024-03-23T06:10:38.666303+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:10:38.666303+0000","last_undegraded":"2024-03-23T06:10:38.666303+0000","last_fullsized":"2024-03-23T06:10:38.666303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670288+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:10:38.670288+0000","last_peered":"2024-03-23T06:10:38.670288+0000","last_clean":"2024-03-23T06:10:38.670288+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:10:38.670288+0000","last_undegraded":"2024-03-23T06:10:38.670288+0000","last_fullsized":"2024-03-23T06:10:38.670288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669529+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:10:38.669529+0000","last_peered":"2024-03-23T06:10:38.669529+0000","last_clean":"2024-03-23T06:10:38.669529+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:10:38.669529+0000","last_undegraded":"2024-03-23T06:10:38.669529+0000","last_fullsized":"2024-03-23T06:10:38.669529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663822+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:10:38.663822+0000","last_peered":"2024-03-23T06:10:38.663822+0000","last_clean":"2024-03-23T06:10:38.663822+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:10:38.663822+0000","last_undegraded":"2024-03-23T06:10:38.663822+0000","last_fullsized":"2024-03-23T06:10:38.663822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664230+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:10:38.664230+0000","last_peered":"2024-03-23T06:10:38.664230+0000","last_clean":"2024-03-23T06:10:38.664230+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:10:38.664230+0000","last_undegraded":"2024-03-23T06:10:38.664230+0000","last_fullsized":"2024-03-23T06:10:38.664230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665917+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:10:38.665917+0000","last_peered":"2024-03-23T06:10:38.665917+0000","last_clean":"2024-03-23T06:10:38.665917+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:10:38.665917+0000","last_undegraded":"2024-03-23T06:10:38.665917+0000","last_fullsized":"2024-03-23T06:10:38.665917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673058+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:10:38.673058+0000","last_peered":"2024-03-23T06:10:38.673058+0000","last_clean":"2024-03-23T06:10:38.673058+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:10:38.673058+0000","last_undegraded":"2024-03-23T06:10:38.673058+0000","last_fullsized":"2024-03-23T06:10:38.673058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677104+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:10:38.677104+0000","last_peered":"2024-03-23T06:10:38.677104+0000","last_clean":"2024-03-23T06:10:38.677104+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:10:38.677104+0000","last_undegraded":"2024-03-23T06:10:38.677104+0000","last_fullsized":"2024-03-23T06:10:38.677104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'12","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672360+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:10:38.672360+0000","last_peered":"2024-03-23T06:10:38.672360+0000","last_clean":"2024-03-23T06:10:38.672360+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:10:38.672360+0000","last_undegraded":"2024-03-23T06:10:38.672360+0000","last_fullsized":"2024-03-23T06:10:38.672360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.661997+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:10:38.661997+0000","last_peered":"2024-03-23T06:10:38.661997+0000","last_clean":"2024-03-23T06:10:38.661997+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:10:38.661997+0000","last_undegraded":"2024-03-23T06:10:38.661997+0000","last_fullsized":"2024-03-23T06:10:38.661997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670833+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:10:38.670833+0000","last_peered":"2024-03-23T06:10:38.670833+0000","last_clean":"2024-03-23T06:10:38.670833+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:10:38.670833+0000","last_undegraded":"2024-03-23T06:10:38.670833+0000","last_fullsized":"2024-03-23T06:10:38.670833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666316+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:10:38.666316+0000","last_peered":"2024-03-23T06:10:38.666316+0000","last_clean":"2024-03-23T06:10:38.666316+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:10:38.666316+0000","last_undegraded":"2024-03-23T06:10:38.666316+0000","last_fullsized":"2024-03-23T06:10:38.666316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670911+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:10:38.670911+0000","last_peered":"2024-03-23T06:10:38.670911+0000","last_clean":"2024-03-23T06:10:38.670911+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:10:38.670911+0000","last_undegraded":"2024-03-23T06:10:38.670911+0000","last_fullsized":"2024-03-23T06:10:38.670911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666437+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:10:38.666437+0000","last_peered":"2024-03-23T06:10:38.666437+0000","last_clean":"2024-03-23T06:10:38.666437+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:10:38.666437+0000","last_undegraded":"2024-03-23T06:10:38.666437+0000","last_fullsized":"2024-03-23T06:10:38.666437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677477+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:10:38.677477+0000","last_peered":"2024-03-23T06:10:38.677477+0000","last_clean":"2024-03-23T06:10:38.677477+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:10:38.677477+0000","last_undegraded":"2024-03-23T06:10:38.677477+0000","last_fullsized":"2024-03-23T06:10:38.677477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665258+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:10:38.665258+0000","last_peered":"2024-03-23T06:10:38.665258+0000","last_clean":"2024-03-23T06:10:38.665258+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:10:38.665258+0000","last_undegraded":"2024-03-23T06:10:38.665258+0000","last_fullsized":"2024-03-23T06:10:38.665258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673128+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:10:38.673128+0000","last_peered":"2024-03-23T06:10:38.673128+0000","last_clean":"2024-03-23T06:10:38.673128+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:10:38.673128+0000","last_undegraded":"2024-03-23T06:10:38.673128+0000","last_fullsized":"2024-03-23T06:10:38.673128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675558+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:10:38.675558+0000","last_peered":"2024-03-23T06:10:38.675558+0000","last_clean":"2024-03-23T06:10:38.675558+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:10:38.675558+0000","last_undegraded":"2024-03-23T06:10:38.675558+0000","last_fullsized":"2024-03-23T06:10:38.675558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:10:39.801920+0000","last_change":"2024-03-23T06:10:39.801920+0000","last_active":"2024-03-23T06:10:39.801920+0000","last_peered":"2024-03-23T06:10:39.801920+0000","last_clean":"2024-03-23T06:10:39.801920+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:10:39.801920+0000","last_undegraded":"2024-03-23T06:10:39.801920+0000","last_fullsized":"2024-03-23T06:10:39.801920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:39:07.343046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662421+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:10:38.662421+0000","last_peered":"2024-03-23T06:10:38.662421+0000","last_clean":"2024-03-23T06:10:38.662421+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:10:38.662421+0000","last_undegraded":"2024-03-23T06:10:38.662421+0000","last_fullsized":"2024-03-23T06:10:38.662421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662221+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:10:38.662221+0000","last_peered":"2024-03-23T06:10:38.662221+0000","last_clean":"2024-03-23T06:10:38.662221+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:10:38.662221+0000","last_undegraded":"2024-03-23T06:10:38.662221+0000","last_fullsized":"2024-03-23T06:10:38.662221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667477+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:10:38.667477+0000","last_peered":"2024-03-23T06:10:38.667477+0000","last_clean":"2024-03-23T06:10:38.667477+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:10:38.667477+0000","last_undegraded":"2024-03-23T06:10:38.667477+0000","last_fullsized":"2024-03-23T06:10:38.667477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.671249+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:10:38.671249+0000","last_peered":"2024-03-23T06:10:38.671249+0000","last_clean":"2024-03-23T06:10:38.671249+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:10:38.671249+0000","last_undegraded":"2024-03-23T06:10:38.671249+0000","last_fullsized":"2024-03-23T06:10:38.671249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665232+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:10:38.665232+0000","last_peered":"2024-03-23T06:10:38.665232+0000","last_clean":"2024-03-23T06:10:38.665232+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:10:38.665232+0000","last_undegraded":"2024-03-23T06:10:38.665232+0000","last_fullsized":"2024-03-23T06:10:38.665232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663692+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:10:38.663692+0000","last_peered":"2024-03-23T06:10:38.663692+0000","last_clean":"2024-03-23T06:10:38.663692+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:10:38.663692+0000","last_undegraded":"2024-03-23T06:10:38.663692+0000","last_fullsized":"2024-03-23T06:10:38.663692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669401+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:10:38.669401+0000","last_peered":"2024-03-23T06:10:38.669401+0000","last_clean":"2024-03-23T06:10:38.669401+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:10:38.669401+0000","last_undegraded":"2024-03-23T06:10:38.669401+0000","last_fullsized":"2024-03-23T06:10:38.669401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663036+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:10:38.663036+0000","last_peered":"2024-03-23T06:10:38.663036+0000","last_clean":"2024-03-23T06:10:38.663036+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:10:38.663036+0000","last_undegraded":"2024-03-23T06:10:38.663036+0000","last_fullsized":"2024-03-23T06:10:38.663036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.663133+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:10:38.663133+0000","last_peered":"2024-03-23T06:10:38.663133+0000","last_clean":"2024-03-23T06:10:38.663133+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:10:38.663133+0000","last_undegraded":"2024-03-23T06:10:38.663133+0000","last_fullsized":"2024-03-23T06:10:38.663133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665953+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:10:38.665953+0000","last_peered":"2024-03-23T06:10:38.665953+0000","last_clean":"2024-03-23T06:10:38.665953+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:10:38.665953+0000","last_undegraded":"2024-03-23T06:10:38.665953+0000","last_fullsized":"2024-03-23T06:10:38.665953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676697+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:10:38.676697+0000","last_peered":"2024-03-23T06:10:38.676697+0000","last_clean":"2024-03-23T06:10:38.676697+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:10:38.676697+0000","last_undegraded":"2024-03-23T06:10:38.676697+0000","last_fullsized":"2024-03-23T06:10:38.676697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666721+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:10:38.666721+0000","last_peered":"2024-03-23T06:10:38.666721+0000","last_clean":"2024-03-23T06:10:38.666721+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:10:38.666721+0000","last_undegraded":"2024-03-23T06:10:38.666721+0000","last_fullsized":"2024-03-23T06:10:38.666721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.670185+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:10:38.670185+0000","last_peered":"2024-03-23T06:10:38.670185+0000","last_clean":"2024-03-23T06:10:38.670185+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:10:38.670185+0000","last_undegraded":"2024-03-23T06:10:38.670185+0000","last_fullsized":"2024-03-23T06:10:38.670185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666043+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:10:38.666043+0000","last_peered":"2024-03-23T06:10:38.666043+0000","last_clean":"2024-03-23T06:10:38.666043+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:10:38.666043+0000","last_undegraded":"2024-03-23T06:10:38.666043+0000","last_fullsized":"2024-03-23T06:10:38.666043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.669086+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:10:38.669086+0000","last_peered":"2024-03-23T06:10:38.669086+0000","last_clean":"2024-03-23T06:10:38.669086+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:10:38.669086+0000","last_undegraded":"2024-03-23T06:10:38.669086+0000","last_fullsized":"2024-03-23T06:10:38.669086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665863+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:10:38.665863+0000","last_peered":"2024-03-23T06:10:38.665863+0000","last_clean":"2024-03-23T06:10:38.665863+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:10:38.665863+0000","last_undegraded":"2024-03-23T06:10:38.665863+0000","last_fullsized":"2024-03-23T06:10:38.665863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664171+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:10:38.664171+0000","last_peered":"2024-03-23T06:10:38.664171+0000","last_clean":"2024-03-23T06:10:38.664171+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:10:38.664171+0000","last_undegraded":"2024-03-23T06:10:38.664171+0000","last_fullsized":"2024-03-23T06:10:38.664171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664436+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:10:38.664436+0000","last_peered":"2024-03-23T06:10:38.664436+0000","last_clean":"2024-03-23T06:10:38.664436+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:10:38.664436+0000","last_undegraded":"2024-03-23T06:10:38.664436+0000","last_fullsized":"2024-03-23T06:10:38.664436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673062+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:10:38.673062+0000","last_peered":"2024-03-23T06:10:38.673062+0000","last_clean":"2024-03-23T06:10:38.673062+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:10:38.673062+0000","last_undegraded":"2024-03-23T06:10:38.673062+0000","last_fullsized":"2024-03-23T06:10:38.673062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666232+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:38.666232+0000","last_peered":"2024-03-23T06:10:38.666232+0000","last_clean":"2024-03-23T06:10:38.666232+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:10:38.666232+0000","last_undegraded":"2024-03-23T06:10:38.666232+0000","last_fullsized":"2024-03-23T06:10:38.666232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667410+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:10:38.667410+0000","last_peered":"2024-03-23T06:10:38.667410+0000","last_clean":"2024-03-23T06:10:38.667410+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:10:38.667410+0000","last_undegraded":"2024-03-23T06:10:38.667410+0000","last_fullsized":"2024-03-23T06:10:38.667410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665471+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:10:38.665471+0000","last_peered":"2024-03-23T06:10:38.665471+0000","last_clean":"2024-03-23T06:10:38.665471+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:10:38.665471+0000","last_undegraded":"2024-03-23T06:10:38.665471+0000","last_fullsized":"2024-03-23T06:10:38.665471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.676615+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:10:38.676615+0000","last_peered":"2024-03-23T06:10:38.676615+0000","last_clean":"2024-03-23T06:10:38.676615+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:10:38.676615+0000","last_undegraded":"2024-03-23T06:10:38.676615+0000","last_fullsized":"2024-03-23T06:10:38.676615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.662325+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:10:38.662325+0000","last_peered":"2024-03-23T06:10:38.662325+0000","last_clean":"2024-03-23T06:10:38.662325+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:10:38.662325+0000","last_undegraded":"2024-03-23T06:10:38.662325+0000","last_fullsized":"2024-03-23T06:10:38.662325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.674989+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:10:38.674989+0000","last_peered":"2024-03-23T06:10:38.674989+0000","last_clean":"2024-03-23T06:10:38.674989+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:10:38.674989+0000","last_undegraded":"2024-03-23T06:10:38.674989+0000","last_fullsized":"2024-03-23T06:10:38.674989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.673390+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:10:38.673390+0000","last_peered":"2024-03-23T06:10:38.673390+0000","last_clean":"2024-03-23T06:10:38.673390+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:10:38.673390+0000","last_undegraded":"2024-03-23T06:10:38.673390+0000","last_fullsized":"2024-03-23T06:10:38.673390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666912+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:10:38.666912+0000","last_peered":"2024-03-23T06:10:38.666912+0000","last_clean":"2024-03-23T06:10:38.666912+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:10:38.666912+0000","last_undegraded":"2024-03-23T06:10:38.666912+0000","last_fullsized":"2024-03-23T06:10:38.666912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.671497+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:10:38.671497+0000","last_peered":"2024-03-23T06:10:38.671497+0000","last_clean":"2024-03-23T06:10:38.671497+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:10:38.671497+0000","last_undegraded":"2024-03-23T06:10:38.671497+0000","last_fullsized":"2024-03-23T06:10:38.671497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.667374+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:10:38.667374+0000","last_peered":"2024-03-23T06:10:38.667374+0000","last_clean":"2024-03-23T06:10:38.667374+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:10:38.667374+0000","last_undegraded":"2024-03-23T06:10:38.667374+0000","last_fullsized":"2024-03-23T06:10:38.667374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665385+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:10:38.665385+0000","last_peered":"2024-03-23T06:10:38.665385+0000","last_clean":"2024-03-23T06:10:38.665385+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:10:38.665385+0000","last_undegraded":"2024-03-23T06:10:38.665385+0000","last_fullsized":"2024-03-23T06:10:38.665385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664023+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:10:38.664023+0000","last_peered":"2024-03-23T06:10:38.664023+0000","last_clean":"2024-03-23T06:10:38.664023+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:10:38.664023+0000","last_undegraded":"2024-03-23T06:10:38.664023+0000","last_fullsized":"2024-03-23T06:10:38.664023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.664126+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:10:38.664126+0000","last_peered":"2024-03-23T06:10:38.664126+0000","last_clean":"2024-03-23T06:10:38.664126+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:10:38.664126+0000","last_undegraded":"2024-03-23T06:10:38.664126+0000","last_fullsized":"2024-03-23T06:10:38.664126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.674768+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:10:38.674768+0000","last_peered":"2024-03-23T06:10:38.674768+0000","last_clean":"2024-03-23T06:10:38.674768+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:10:38.674768+0000","last_undegraded":"2024-03-23T06:10:38.674768+0000","last_fullsized":"2024-03-23T06:10:38.674768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677024+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:10:38.677024+0000","last_peered":"2024-03-23T06:10:38.677024+0000","last_clean":"2024-03-23T06:10:38.677024+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:10:38.677024+0000","last_undegraded":"2024-03-23T06:10:38.677024+0000","last_fullsized":"2024-03-23T06:10:38.677024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677394+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:10:38.677394+0000","last_peered":"2024-03-23T06:10:38.677394+0000","last_clean":"2024-03-23T06:10:38.677394+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:10:38.677394+0000","last_undegraded":"2024-03-23T06:10:38.677394+0000","last_fullsized":"2024-03-23T06:10:38.677394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675459+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:10:38.675459+0000","last_peered":"2024-03-23T06:10:38.675459+0000","last_clean":"2024-03-23T06:10:38.675459+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:10:38.675459+0000","last_undegraded":"2024-03-23T06:10:38.675459+0000","last_fullsized":"2024-03-23T06:10:38.675459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.665087+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:10:38.665087+0000","last_peered":"2024-03-23T06:10:38.665087+0000","last_clean":"2024-03-23T06:10:38.665087+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:10:38.665087+0000","last_undegraded":"2024-03-23T06:10:38.665087+0000","last_fullsized":"2024-03-23T06:10:38.665087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.678427+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:10:38.678427+0000","last_peered":"2024-03-23T06:10:38.678427+0000","last_clean":"2024-03-23T06:10:38.678427+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:10:38.678427+0000","last_undegraded":"2024-03-23T06:10:38.678427+0000","last_fullsized":"2024-03-23T06:10:38.678427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672101+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:10:38.672101+0000","last_peered":"2024-03-23T06:10:38.672101+0000","last_clean":"2024-03-23T06:10:38.672101+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:10:38.672101+0000","last_undegraded":"2024-03-23T06:10:38.672101+0000","last_fullsized":"2024-03-23T06:10:38.672101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.675852+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:10:38.675852+0000","last_peered":"2024-03-23T06:10:38.675852+0000","last_clean":"2024-03-23T06:10:38.675852+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:10:38.675852+0000","last_undegraded":"2024-03-23T06:10:38.675852+0000","last_fullsized":"2024-03-23T06:10:38.675852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.672224+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:10:38.672224+0000","last_peered":"2024-03-23T06:10:38.672224+0000","last_clean":"2024-03-23T06:10:38.672224+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:10:38.672224+0000","last_undegraded":"2024-03-23T06:10:38.672224+0000","last_fullsized":"2024-03-23T06:10:38.672224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666070+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:10:38.666070+0000","last_peered":"2024-03-23T06:10:38.666070+0000","last_clean":"2024-03-23T06:10:38.666070+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:10:38.666070+0000","last_undegraded":"2024-03-23T06:10:38.666070+0000","last_fullsized":"2024-03-23T06:10:38.666070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.666455+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:10:38.666455+0000","last_peered":"2024-03-23T06:10:38.666455+0000","last_clean":"2024-03-23T06:10:38.666455+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:10:38.666455+0000","last_undegraded":"2024-03-23T06:10:38.666455+0000","last_fullsized":"2024-03-23T06:10:38.666455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-23T06:10:38.677038+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:10:38.677038+0000","last_peered":"2024-03-23T06:10:38.677038+0000","last_clean":"2024-03-23T06:10:38.677038+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:10:38.677038+0000","last_undegraded":"2024-03-23T06:10:38.677038+0000","last_fullsized":"2024-03-23T06:10:38.677038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7309,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":118241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":120892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]}]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":707591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":118331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":311296,"data_stored":117971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":4,"last update":"Sat Mar 23 06:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.36199999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:10:44 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.377}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":299008,"data_stored":118219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":901120,"data_stored":708187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.495}]},{"osd":6,"last update":"Sat Mar 23 06:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.41599999999999998}]},{"osd":7,"last update":"Sat Mar 23 06:10:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":331776,"data_stored":122426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:10:52.625 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-03-23T06:10:52.625 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:10:52.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.859+0000 7f6eb4000640 1 Processor -- start 2024-03-23T06:10:52.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.860+0000 7f6eb4000640 1 -- start start 2024-03-23T06:10:52.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.861+0000 7f6eb4000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6eac1513f0 0x7f6eac0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.861+0000 7f6eb4000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac0c5f50 con 0x7f6eac158b20 2024-03-23T06:10:52.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.861+0000 7f6eb4000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eac157b60 con 0x7f6eac1586b0 2024-03-23T06:10:52.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.861+0000 7f6eb4000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eac0c0570 con 0x7f6eac1513f0 2024-03-23T06:10:52.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.861+0000 7f6eb1600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6eac1513f0 0x7f6eac0c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.861+0000 7f6eb1600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6eac1513f0 0x7f6eac0c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57894/0 (socket says 172.21.15.73:57894) 2024-03-23T06:10:52.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.861+0000 7f6eb1600640 1 -- 172.21.15.73:0/2656812506 learned_addr learned my addr 172.21.15.73:0/2656812506 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:52.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.862+0000 7f6eb1600640 1 -- 172.21.15.73:0/2656812506 >> v1:172.21.15.110:6789/0 conn(0x7f6eac1586b0 legacy=0x7f6eac0bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:52.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.862+0000 7f6eb1600640 1 -- 172.21.15.73:0/2656812506 >> v1:172.21.15.73:6789/0 conn(0x7f6eac158b20 legacy=0x7f6eac071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:52.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.862+0000 7f6eb1600640 1 -- 172.21.15.73:0/2656812506 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0c0830 con 0x7f6eac1513f0 2024-03-23T06:10:52.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.863+0000 7f6eb1600640 1 --2- 172.21.15.73:0/2656812506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac1513f0 0x7f6eac0c5a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009870 tx=0x7f6ea002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9d7fa8cfda803b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.863+0000 7f6eabe00640 1 -- 172.21.15.73:0/2656812506 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea002f840 con 0x7f6eac1513f0 2024-03-23T06:10:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.863+0000 7f6eabe00640 1 -- 172.21.15.73:0/2656812506 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea002f9a0 con 0x7f6eac1513f0 2024-03-23T06:10:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.863+0000 7f6eabe00640 1 -- 172.21.15.73:0/2656812506 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea002fd30 con 0x7f6eac1513f0 2024-03-23T06:10:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.864+0000 7f6eb4000640 1 -- 172.21.15.73:0/2656812506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac1513f0 msgr2=0x7f6eac0c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.864+0000 7f6eb4000640 1 --2- 172.21.15.73:0/2656812506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac1513f0 0x7f6eac0c5a10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009870 tx=0x7f6ea002ba20 comp rx=0 tx=0).stop 2024-03-23T06:10:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.864+0000 7f6eb4000640 1 -- 172.21.15.73:0/2656812506 shutdown_connections 2024-03-23T06:10:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.864+0000 7f6eb4000640 1 --2- 172.21.15.73:0/2656812506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac1513f0 0x7f6eac0c5a10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.864+0000 7f6eb4000640 1 -- 172.21.15.73:0/2656812506 >> 172.21.15.73:0/2656812506 conn(0x7f6eac06bb40 msgr2=0x7f6eac06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.864+0000 7f6eb4000640 1 -- 172.21.15.73:0/2656812506 shutdown_connections 2024-03-23T06:10:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.864+0000 7f6eb4000640 1 -- 172.21.15.73:0/2656812506 wait complete. 2024-03-23T06:10:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.866+0000 7f6eb4000640 1 Processor -- start 2024-03-23T06:10:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.866+0000 7f6eb4000640 1 -- start start 2024-03-23T06:10:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb4000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eac1513f0 0x7f6eac0c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb4000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1586b0 0x7f6eac1e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb4000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac158b20 0x7f6eac0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb4000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac0c63a0 con 0x7f6eac1586b0 2024-03-23T06:10:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb4000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac1eed90 con 0x7f6eac158b20 2024-03-23T06:10:52.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb4000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac1eefa0 con 0x7f6eac1513f0 2024-03-23T06:10:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb0c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1586b0 0x7f6eac1e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac158b20 0x7f6eac0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb1600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eac1513f0 0x7f6eac0c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac158b20 0x7f6eac0c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57904/0 (socket says 172.21.15.73:57904) 2024-03-23T06:10:52.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.867+0000 7f6eb2000640 1 -- 172.21.15.73:0/2831857480 learned_addr learned my addr 172.21.15.73:0/2831857480 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6eb2000640 1 -- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eac1513f0 msgr2=0x7f6eac0c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6eb2000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eac1513f0 0x7f6eac0c2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6eb2000640 1 -- 172.21.15.73:0/2831857480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1586b0 msgr2=0x7f6eac1e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6eb2000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1586b0 0x7f6eac1e4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6eb2000640 1 -- 172.21.15.73:0/2831857480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00094d0 con 0x7f6eac158b20 2024-03-23T06:10:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6eb1600640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eac1513f0 0x7f6eac0c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6eb0c00640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1586b0 0x7f6eac1e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6eb2000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac158b20 0x7f6eac0c67c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c7b0 tx=0x7f6ea400cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6ea9600640 1 -- 172.21.15.73:0/2831857480 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4004b60 con 0x7f6eac158b20 2024-03-23T06:10:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6ea9600640 1 -- 172.21.15.73:0/2831857480 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4004cc0 con 0x7f6eac158b20 2024-03-23T06:10:52.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.868+0000 7f6ea9600640 1 -- 172.21.15.73:0/2831857480 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400aa90 con 0x7f6eac158b20 2024-03-23T06:10:52.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.869+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac1ef280 con 0x7f6eac158b20 2024-03-23T06:10:52.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.869+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac1ef840 con 0x7f6eac158b20 2024-03-23T06:10:52.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.870+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac0c64e0 con 0x7f6eac158b20 2024-03-23T06:10:52.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.871+0000 7f6ea9600640 1 -- 172.21.15.73:0/2831857480 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6ea400abf0 con 0x7f6eac158b20 2024-03-23T06:10:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.872+0000 7f6ea9600640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.872+0000 7f6ea9600640 1 -- 172.21.15.73:0/2831857480 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f6ea40897d0 con 0x7f6eac158b20 2024-03-23T06:10:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.872+0000 7f6eb1600640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:52.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.873+0000 7f6eb1600640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0036000 tx=0x7f6ea0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:52.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:52.876+0000 7f6ea9600640 1 -- 172.21.15.73:0/2831857480 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6eac0c64e0 con 0x7f6eac158b20 2024-03-23T06:10:53.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.068+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6eac0c64e0 con 0x7f6eac158b20 2024-03-23T06:10:53.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.071+0000 7f6ea9600640 1 -- 172.21.15.73:0/2831857480 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18088 (secure 0 0 0) 0x7f6eac0c64e0 con 0x7f6eac158b20 2024-03-23T06:10:53.071 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:53.071 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:39.659625+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2},{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:10:53.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6e8c06ac00 msgr2=0x7f6e8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0036000 tx=0x7f6ea0008030 comp rx=0 tx=0).stop 2024-03-23T06:10:53.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac158b20 msgr2=0x7f6eac0c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac158b20 0x7f6eac0c67c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c7b0 tx=0x7f6ea400cc70 comp rx=0 tx=0).stop 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 shutdown_connections 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eac158b20 0x7f6eac0c67c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6eac1586b0 0x7f6eac1e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6e8c06ac00 0x7f6e8c06d0c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 --2- 172.21.15.73:0/2831857480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eac1513f0 0x7f6eac0c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 >> 172.21.15.73:0/2831857480 conn(0x7f6eac06bb40 msgr2=0x7f6eac0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.073+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 shutdown_connections 2024-03-23T06:10:53.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.074+0000 7f6eb4000640 1 -- 172.21.15.73:0/2831857480 wait complete. 2024-03-23T06:10:53.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T06:09:56.066381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T06:09:56.917187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-23T06:09:59.981596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-23T06:10:53.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:10:53.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.304+0000 7f6d2d800640 1 Processor -- start 2024-03-23T06:10:53.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.304+0000 7f6d2d800640 1 -- start start 2024-03-23T06:10:53.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.306+0000 7f6d2d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.306+0000 7f6d2d800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2806a2d0 con 0x7f6d280ca940 2024-03-23T06:10:53.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.306+0000 7f6d2d800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2806a5b0 con 0x7f6d280c9740 2024-03-23T06:10:53.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.306+0000 7f6d2d800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2806a890 con 0x7f6d28153760 2024-03-23T06:10:53.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.306+0000 7f6d27400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6d280ca940 0x7f6d280cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52080/0 (socket says 172.21.15.73:52080) 2024-03-23T06:10:53.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.306+0000 7f6d27400640 1 -- 172.21.15.73:0/1335468147 learned_addr learned my addr 172.21.15.73:0/1335468147 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:53.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.306+0000 7f6d26a00640 1 --2- 172.21.15.73:0/1335468147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.307+0000 7f6d26a00640 1 -- 172.21.15.73:0/1335468147 >> v1:172.21.15.110:6789/0 conn(0x7f6d280c9740 legacy=0x7f6d280cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.307+0000 7f6d26a00640 1 -- 172.21.15.73:0/1335468147 >> v1:172.21.15.73:6789/0 conn(0x7f6d280ca940 legacy=0x7f6d280cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.307+0000 7f6d25600640 1 -- 172.21.15.73:0/1335468147 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278117753 0 0) 0x7f6d2806a2d0 con 0x7f6d280ca940 2024-03-23T06:10:53.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.307+0000 7f6d26a00640 1 -- 172.21.15.73:0/1335468147 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2806ab70 con 0x7f6d28153760 2024-03-23T06:10:53.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.308+0000 7f6d26a00640 1 --2- 172.21.15.73:0/1335468147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28159420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009df0 tx=0x7f6d1802bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4abcefc0498858a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.308+0000 7f6d25600640 1 -- 172.21.15.73:0/1335468147 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1802caa0 con 0x7f6d28153760 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.308+0000 7f6d25600640 1 -- 172.21.15.73:0/1335468147 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1802cc00 con 0x7f6d28153760 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.308+0000 7f6d25600640 1 -- 172.21.15.73:0/1335468147 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18034440 con 0x7f6d28153760 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.309+0000 7f6d2d800640 1 -- 172.21.15.73:0/1335468147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 msgr2=0x7f6d28159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.309+0000 7f6d2d800640 1 --2- 172.21.15.73:0/1335468147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28159420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009df0 tx=0x7f6d1802bd70 comp rx=0 tx=0).stop 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.309+0000 7f6d2d800640 1 -- 172.21.15.73:0/1335468147 shutdown_connections 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.309+0000 7f6d2d800640 1 --2- 172.21.15.73:0/1335468147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28159420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.309+0000 7f6d2d800640 1 -- 172.21.15.73:0/1335468147 >> 172.21.15.73:0/1335468147 conn(0x7f6d2806c310 msgr2=0x7f6d280713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.309+0000 7f6d2d800640 1 -- 172.21.15.73:0/1335468147 shutdown_connections 2024-03-23T06:10:53.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.309+0000 7f6d2d800640 1 -- 172.21.15.73:0/1335468147 wait complete. 2024-03-23T06:10:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.310+0000 7f6d2d800640 1 Processor -- start 2024-03-23T06:10:53.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.311+0000 7f6d2d800640 1 -- start start 2024-03-23T06:10:53.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d2d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280c9740 0x7f6d281581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d2d800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d280ca940 0x7f6d281491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d2d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d2d800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d281f2ab0 con 0x7f6d280ca940 2024-03-23T06:10:53.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d2d800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d28145550 con 0x7f6d280c9740 2024-03-23T06:10:53.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d2d800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d281f1ec0 con 0x7f6d28153760 2024-03-23T06:10:53.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280c9740 0x7f6d281581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280c9740 0x7f6d281581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57918/0 (socket says 172.21.15.73:57918) 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d280ca940 0x7f6d281491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d27400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26a00640 1 -- 172.21.15.73:0/4164155006 learned_addr learned my addr 172.21.15.73:0/4164155006 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26a00640 1 -- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 msgr2=0x7f6d28153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26a00640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26a00640 1 -- 172.21.15.73:0/4164155006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d280ca940 msgr2=0x7f6d281491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26a00640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d280ca940 0x7f6d281491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.312+0000 7f6d26a00640 1 -- 172.21.15.73:0/4164155006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d18009a70 con 0x7f6d280c9740 2024-03-23T06:10:53.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.313+0000 7f6d26a00640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280c9740 0x7f6d281581a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009d90 tx=0x7f6d18004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:53.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.313+0000 7f6d1ea00640 1 -- 172.21.15.73:0/4164155006 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18003990 con 0x7f6d280c9740 2024-03-23T06:10:53.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.313+0000 7f6d1ea00640 1 -- 172.21.15.73:0/4164155006 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d18003af0 con 0x7f6d280c9740 2024-03-23T06:10:53.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.313+0000 7f6d1ea00640 1 -- 172.21.15.73:0/4164155006 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18003e80 con 0x7f6d280c9740 2024-03-23T06:10:53.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.313+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d28158830 con 0x7f6d280c9740 2024-03-23T06:10:53.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.313+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d281f23f0 con 0x7f6d280c9740 2024-03-23T06:10:53.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.314+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2815d850 con 0x7f6d280c9740 2024-03-23T06:10:53.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.315+0000 7f6d1ea00640 1 -- 172.21.15.73:0/4164155006 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6d18003fe0 con 0x7f6d280c9740 2024-03-23T06:10:53.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.316+0000 7f6d1ea00640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6d0806ac00 0x7f6d0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.316+0000 7f6d1ea00640 1 -- 172.21.15.73:0/4164155006 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f6d180abcf0 con 0x7f6d280c9740 2024-03-23T06:10:53.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.316+0000 7f6d26000640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6d0806ac00 0x7f6d0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.317+0000 7f6d26000640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6d0806ac00 0x7f6d0806d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6d280c4120 tx=0x7f6d14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:53.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.320+0000 7f6d1ea00640 1 -- 172.21.15.73:0/4164155006 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6d18076c00 con 0x7f6d280c9740 2024-03-23T06:10:53.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.518+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d2804e110 con 0x7f6d280c9740 2024-03-23T06:10:53.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.519+0000 7f6d1ea00640 1 -- 172.21.15.73:0/4164155006 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d18039020 con 0x7f6d280c9740 2024-03-23T06:10:53.520 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:10:53.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6d0806ac00 msgr2=0x7f6d0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6d0806ac00 0x7f6d0806d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6d280c4120 tx=0x7f6d14009040 comp rx=0 tx=0).stop 2024-03-23T06:10:53.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280c9740 msgr2=0x7f6d281581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280c9740 0x7f6d281581a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009d90 tx=0x7f6d18004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:53.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 shutdown_connections 2024-03-23T06:10:53.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6d0806ac00 0x7f6d0806d0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d28153760 0x7f6d28153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d280ca940 0x7f6d281491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 --2- 172.21.15.73:0/4164155006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d280c9740 0x7f6d281581a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 >> 172.21.15.73:0/4164155006 conn(0x7f6d2806c310 msgr2=0x7f6d28150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:53.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 shutdown_connections 2024-03-23T06:10:53.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.522+0000 7f6d2d800640 1 -- 172.21.15.73:0/4164155006 wait complete. 2024-03-23T06:10:53.540 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T06:10:53.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.747+0000 7fed5ac00640 1 Processor -- start 2024-03-23T06:10:53.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.747+0000 7fed5ac00640 1 -- start start 2024-03-23T06:10:53.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed5ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54157e60 0x7fed54071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed5ac00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5415b710 con 0x7fed54072090 2024-03-23T06:10:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed5ac00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5415ab90 con 0x7fed54151480 2024-03-23T06:10:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed5ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed541588d0 con 0x7fed54157e60 2024-03-23T06:10:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed58c00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fed54072090 0x7fed54158cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52090/0 (socket says 172.21.15.73:52090) 2024-03-23T06:10:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed53e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fed54151480 0x7fed540c7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:53626/0 (socket says 172.21.15.73:53626) 2024-03-23T06:10:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed53400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54157e60 0x7fed54071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed58c00640 1 -- 172.21.15.73:0/2196748480 learned_addr learned my addr 172.21.15.73:0/2196748480 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.749+0000 7fed52a00640 1 -- 172.21.15.73:0/2196748480 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389234755 0 0) 0x7fed5415ab90 con 0x7fed54151480 2024-03-23T06:10:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.750+0000 7fed53400640 1 -- 172.21.15.73:0/2196748480 >> v1:172.21.15.110:6789/0 conn(0x7fed54151480 legacy=0x7fed540c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.750+0000 7fed53400640 1 -- 172.21.15.73:0/2196748480 >> v1:172.21.15.73:6789/0 conn(0x7fed54072090 legacy=0x7fed54158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.750+0000 7fed53400640 1 -- 172.21.15.73:0/2196748480 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5415ae70 con 0x7fed54157e60 2024-03-23T06:10:53.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.751+0000 7fed53400640 1 --2- 172.21.15.73:0/2196748480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54157e60 0x7fed54071b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed400097d0 tx=0x7fed4002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b61fe2e0f825b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:53.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.751+0000 7fed52a00640 1 -- 172.21.15.73:0/2196748480 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40030710 con 0x7fed54157e60 2024-03-23T06:10:53.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.751+0000 7fed52a00640 1 -- 172.21.15.73:0/2196748480 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4002e050 con 0x7fed54157e60 2024-03-23T06:10:53.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.751+0000 7fed52a00640 1 -- 172.21.15.73:0/2196748480 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40030a90 con 0x7fed54157e60 2024-03-23T06:10:53.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.752+0000 7fed5ac00640 1 -- 172.21.15.73:0/2196748480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54157e60 msgr2=0x7fed54071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.752+0000 7fed5ac00640 1 --2- 172.21.15.73:0/2196748480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54157e60 0x7fed54071b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fed400097d0 tx=0x7fed4002b800 comp rx=0 tx=0).stop 2024-03-23T06:10:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.752+0000 7fed5ac00640 1 -- 172.21.15.73:0/2196748480 shutdown_connections 2024-03-23T06:10:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.752+0000 7fed5ac00640 1 --2- 172.21.15.73:0/2196748480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54157e60 0x7fed54071b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.752+0000 7fed5ac00640 1 -- 172.21.15.73:0/2196748480 >> 172.21.15.73:0/2196748480 conn(0x7fed54069cb0 msgr2=0x7fed5406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.752+0000 7fed5ac00640 1 -- 172.21.15.73:0/2196748480 shutdown_connections 2024-03-23T06:10:53.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.752+0000 7fed5ac00640 1 -- 172.21.15.73:0/2196748480 wait complete. 2024-03-23T06:10:53.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.753+0000 7fed5ac00640 1 Processor -- start 2024-03-23T06:10:53.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.754+0000 7fed5ac00640 1 -- start start 2024-03-23T06:10:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.754+0000 7fed5ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed54072090 0x7fed540c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.754+0000 7fed5ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54151480 0x7fed540c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.754+0000 7fed5ac00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54157e60 0x7fed5414ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.754+0000 7fed5ac00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed541eee10 con 0x7fed54157e60 2024-03-23T06:10:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.754+0000 7fed5ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540c36f0 con 0x7fed54072090 2024-03-23T06:10:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.754+0000 7fed5ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540c39d0 con 0x7fed54151480 2024-03-23T06:10:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed58c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54157e60 0x7fed5414ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed58c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54157e60 0x7fed5414ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50054/0 (socket says 172.21.15.73:50054) 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed58c00640 1 -- 172.21.15.73:0/2028482224 learned_addr learned my addr 172.21.15.73:0/2028482224 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed53e00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed54072090 0x7fed540c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed53400640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54151480 0x7fed540c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed58c00640 1 -- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54151480 msgr2=0x7fed540c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed58c00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54151480 0x7fed540c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed58c00640 1 -- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed54072090 msgr2=0x7fed540c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed58c00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed54072090 0x7fed540c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.755+0000 7fed58c00640 1 -- 172.21.15.73:0/2028482224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40009400 con 0x7fed54157e60 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.756+0000 7fed58c00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54157e60 0x7fed5414ff30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c8e0 tx=0x7fed4c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.756+0000 7fed4be00640 1 -- 172.21.15.73:0/2028482224 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00a640 con 0x7fed54157e60 2024-03-23T06:10:53.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.756+0000 7fed4be00640 1 -- 172.21.15.73:0/2028482224 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c00a7c0 con 0x7fed54157e60 2024-03-23T06:10:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.756+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed541ef0d0 con 0x7fed54157e60 2024-03-23T06:10:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.756+0000 7fed4be00640 1 -- 172.21.15.73:0/2028482224 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00abf0 con 0x7fed54157e60 2024-03-23T06:10:53.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.756+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed541ef690 con 0x7fed54157e60 2024-03-23T06:10:53.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.757+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed541ef880 con 0x7fed54157e60 2024-03-23T06:10:53.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.758+0000 7fed4be00640 1 -- 172.21.15.73:0/2028482224 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fed4c00ad50 con 0x7fed54157e60 2024-03-23T06:10:53.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.759+0000 7fed4be00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fed3406ac30 0x7fed3406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:53.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.759+0000 7fed4be00640 1 -- 172.21.15.73:0/2028482224 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fed4c089030 con 0x7fed54157e60 2024-03-23T06:10:53.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.759+0000 7fed53e00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fed3406ac30 0x7fed3406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:53.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.760+0000 7fed53e00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fed3406ac30 0x7fed3406d0f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fed44007f70 tx=0x7fed44007f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:53.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.763+0000 7fed4be00640 1 -- 172.21.15.73:0/2028482224 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fed4c053f50 con 0x7fed54157e60 2024-03-23T06:10:53.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.959+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed540b04c0 con 0x7fed54157e60 2024-03-23T06:10:53.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.959+0000 7fed4be00640 1 -- 172.21.15.73:0/2028482224 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed4c018020 con 0x7fed54157e60 2024-03-23T06:10:53.960 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:53.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fed3406ac30 msgr2=0x7fed3406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fed3406ac30 0x7fed3406d0f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fed44007f70 tx=0x7fed44007f00 comp rx=0 tx=0).stop 2024-03-23T06:10:53.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54157e60 msgr2=0x7fed5414ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:53.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54157e60 0x7fed5414ff30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c8e0 tx=0x7fed4c00cda0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 shutdown_connections 2024-03-23T06:10:53.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed54157e60 0x7fed5414ff30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fed3406ac30 0x7fed3406d0f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed54151480 0x7fed540c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 --2- 172.21.15.73:0/2028482224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed54072090 0x7fed540c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:53.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 >> 172.21.15.73:0/2028482224 conn(0x7fed54069cb0 msgr2=0x7fed540c0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:53.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 shutdown_connections 2024-03-23T06:10:53.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:53.962+0000 7fed5ac00640 1 -- 172.21.15.73:0/2028482224 wait complete. 2024-03-23T06:10:53.982 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T06:10:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.178+0000 7f1fb7200640 1 Processor -- start 2024-03-23T06:10:54.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.178+0000 7f1fb7200640 1 -- start start 2024-03-23T06:10:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.180+0000 7f1fb7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb0151480 0x7f1fb0157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.180+0000 7f1fb7200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb015b710 con 0x7f1fb00c7e40 2024-03-23T06:10:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.180+0000 7f1fb7200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb015ab90 con 0x7f1fb0158cf0 2024-03-23T06:10:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.180+0000 7f1fb7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01588d0 con 0x7f1fb0151480 2024-03-23T06:10:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.180+0000 7f1faf400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1fb00c7e40 0x7f1fb0071b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52094/0 (socket says 172.21.15.73:52094) 2024-03-23T06:10:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.180+0000 7f1faf400640 1 -- 172.21.15.73:0/2748172108 learned_addr learned my addr 172.21.15.73:0/2748172108 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.180+0000 7f1fafe00640 1 --2- 172.21.15.73:0/2748172108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb0151480 0x7f1fb0157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.181+0000 7f1faea00640 1 -- 172.21.15.73:0/2748172108 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092986840 0 0) 0x7f1fb015ab90 con 0x7f1fb0158cf0 2024-03-23T06:10:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.181+0000 7f1faea00640 1 -- 172.21.15.73:0/2748172108 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f94003520 con 0x7f1fb0158cf0 2024-03-23T06:10:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.181+0000 7f1faea00640 1 -- 172.21.15.73:0/2748172108 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750409644 0 0) 0x7f1fb015b710 con 0x7f1fb00c7e40 2024-03-23T06:10:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.181+0000 7f1fafe00640 1 -- 172.21.15.73:0/2748172108 >> v1:172.21.15.110:6789/0 conn(0x7f1fb0158cf0 legacy=0x7f1fb0159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.181+0000 7f1fafe00640 1 -- 172.21.15.73:0/2748172108 >> v1:172.21.15.73:6789/0 conn(0x7f1fb00c7e40 legacy=0x7f1fb0071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.181+0000 7f1fafe00640 1 -- 172.21.15.73:0/2748172108 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb015ae70 con 0x7f1fb0151480 2024-03-23T06:10:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.182+0000 7f1fafe00640 1 --2- 172.21.15.73:0/2748172108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb0151480 0x7f1fb0157e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00097d0 tx=0x7f1fa002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75667816df143c51 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.182+0000 7f1faea00640 1 -- 172.21.15.73:0/2748172108 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0030880 con 0x7f1fb0151480 2024-03-23T06:10:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.182+0000 7f1faea00640 1 -- 172.21.15.73:0/2748172108 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00309e0 con 0x7f1fb0151480 2024-03-23T06:10:54.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.182+0000 7f1faea00640 1 -- 172.21.15.73:0/2748172108 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0030d70 con 0x7f1fb0151480 2024-03-23T06:10:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.183+0000 7f1fb7200640 1 -- 172.21.15.73:0/2748172108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb0151480 msgr2=0x7f1fb0157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.183+0000 7f1fb7200640 1 --2- 172.21.15.73:0/2748172108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb0151480 0x7f1fb0157e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00097d0 tx=0x7f1fa002b9c0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.183+0000 7f1fb7200640 1 -- 172.21.15.73:0/2748172108 shutdown_connections 2024-03-23T06:10:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.183+0000 7f1fb7200640 1 --2- 172.21.15.73:0/2748172108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb0151480 0x7f1fb0157e60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.183+0000 7f1fb7200640 1 -- 172.21.15.73:0/2748172108 >> 172.21.15.73:0/2748172108 conn(0x7f1fb0069cb0 msgr2=0x7f1fb006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.183+0000 7f1fb7200640 1 -- 172.21.15.73:0/2748172108 shutdown_connections 2024-03-23T06:10:54.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.183+0000 7f1fb7200640 1 -- 172.21.15.73:0/2748172108 wait complete. 2024-03-23T06:10:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.185+0000 7f1fb7200640 1 Processor -- start 2024-03-23T06:10:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.185+0000 7f1fb7200640 1 -- start start 2024-03-23T06:10:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb00c7e40 0x7f1fb01f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0151480 0x7f1fb01f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb7200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fb0158cf0 0x7f1fb01f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb7200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00caca0 con 0x7f1fb0158cf0 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00caa00 con 0x7f1fb0151480 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01f2680 con 0x7f1fb00c7e40 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fb0158cf0 0x7f1fb01f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1faf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0151480 0x7f1fb01f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fb0158cf0 0x7f1fb01f0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50064/0 (socket says 172.21.15.73:50064) 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fb5200640 1 -- 172.21.15.73:0/1816615879 learned_addr learned my addr 172.21.15.73:0/1816615879 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.186+0000 7f1fafe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb00c7e40 0x7f1fb01f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1faf400640 1 -- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb00c7e40 msgr2=0x7f1fb01f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1faf400640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb00c7e40 0x7f1fb01f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1faf400640 1 -- 172.21.15.73:0/1816615879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fb0158cf0 msgr2=0x7f1fb01f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1faf400640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fb0158cf0 0x7f1fb01f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1faf400640 1 -- 172.21.15.73:0/1816615879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0009400 con 0x7f1fb0151480 2024-03-23T06:10:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1fb5200640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fb0158cf0 0x7f1fb01f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:54.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1faf400640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0151480 0x7f1fb01f02f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00c450 tx=0x7f1f9c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:54.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1fa7e00640 1 -- 172.21.15.73:0/1816615879 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0074e0 con 0x7f1fb0151480 2024-03-23T06:10:54.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1fa7e00640 1 -- 172.21.15.73:0/1816615879 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c007640 con 0x7f1fb0151480 2024-03-23T06:10:54.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb01f2960 con 0x7f1fb0151480 2024-03-23T06:10:54.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1fa7e00640 1 -- 172.21.15.73:0/1816615879 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c004a20 con 0x7f1fb0151480 2024-03-23T06:10:54.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.187+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb01efdd0 con 0x7f1fb0151480 2024-03-23T06:10:54.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.189+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb01efff0 con 0x7f1fb0151480 2024-03-23T06:10:54.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.189+0000 7f1fa7e00640 1 -- 172.21.15.73:0/1816615879 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1f9c004b80 con 0x7f1fb0151480 2024-03-23T06:10:54.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.190+0000 7f1fa7e00640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f9006ac00 0x7f1f9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.190+0000 7f1fa7e00640 1 -- 172.21.15.73:0/1816615879 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1f9c0886d0 con 0x7f1fb0151480 2024-03-23T06:10:54.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.191+0000 7f1fafe00640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f9006ac00 0x7f1f9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.191+0000 7f1fafe00640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f9006ac00 0x7f1f9006d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0036000 tx=0x7f1fa0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:54.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.195+0000 7f1fa7e00640 1 -- 172.21.15.73:0/1816615879 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1f9c053680 con 0x7f1fb0151480 2024-03-23T06:10:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.389+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fb004e110 con 0x7f1fb0151480 2024-03-23T06:10:54.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.390+0000 7f1fa7e00640 1 -- 172.21.15.73:0/1816615879 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f9c056ca0 con 0x7f1fb0151480 2024-03-23T06:10:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f9006ac00 msgr2=0x7f1f9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f9006ac00 0x7f1f9006d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0036000 tx=0x7f1fa0008030 comp rx=0 tx=0).stop 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0151480 msgr2=0x7f1fb01f02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0151480 0x7f1fb01f02f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00c450 tx=0x7f1f9c00c910 comp rx=0 tx=0).stop 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 shutdown_connections 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fb0158cf0 0x7f1fb01f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fb0151480 0x7f1fb01f02f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f9006ac00 0x7f1f9006d0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 --2- 172.21.15.73:0/1816615879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fb00c7e40 0x7f1fb01f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 >> 172.21.15.73:0/1816615879 conn(0x7f1fb0069cb0 msgr2=0x7f1fb0159130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 shutdown_connections 2024-03-23T06:10:54.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.393+0000 7f1fb7200640 1 -- 172.21.15.73:0/1816615879 wait complete. 2024-03-23T06:10:54.412 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-23T06:10:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.624+0000 7ff745600640 1 Processor -- start 2024-03-23T06:10:54.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.624+0000 7ff745600640 1 -- start start 2024-03-23T06:10:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff745600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff745600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7400cc1c0 0x7ff7400c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff745600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7400c41f0 con 0x7ff740153660 2024-03-23T06:10:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff745600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7400cb230 con 0x7ff7400cc1c0 2024-03-23T06:10:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff745600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400cb7f0 con 0x7ff7400cade0 2024-03-23T06:10:54.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff73fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff740153660 0x7ff74015c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52096/0 (socket says 172.21.15.73:52096) 2024-03-23T06:10:54.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff744c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7400cc1c0 0x7ff7400c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff73fe00640 1 -- 172.21.15.73:0/3554013772 learned_addr learned my addr 172.21.15.73:0/3554013772 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:54.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.626+0000 7ff73f400640 1 --2- 172.21.15.73:0/3554013772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.627+0000 7ff73ea00640 1 -- 172.21.15.73:0/3554013772 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020290441 0 0) 0x7ff7400c41f0 con 0x7ff740153660 2024-03-23T06:10:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.627+0000 7ff73ea00640 1 -- 172.21.15.73:0/3554013772 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff724003520 con 0x7ff740153660 2024-03-23T06:10:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.627+0000 7ff73f400640 1 -- 172.21.15.73:0/3554013772 >> v2:172.21.15.73:3300/0 conn(0x7ff7400cc1c0 msgr2=0x7ff7400c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.627+0000 7ff73f400640 1 --2- 172.21.15.73:0/3554013772 >> v2:172.21.15.73:3300/0 conn(0x7ff7400cc1c0 0x7ff7400c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.627+0000 7ff73f400640 1 -- 172.21.15.73:0/3554013772 >> v1:172.21.15.73:6789/0 conn(0x7ff740153660 legacy=0x7ff74015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.627+0000 7ff73f400640 1 -- 172.21.15.73:0/3554013772 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74015d0b0 con 0x7ff7400cade0 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.627+0000 7ff744c00640 1 --2- 172.21.15.73:0/3554013772 >> v2:172.21.15.73:3300/0 conn(0x7ff7400cc1c0 0x7ff7400c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.628+0000 7ff73f400640 1 --2- 172.21.15.73:0/3554013772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400cbc80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0097a0 tx=0x7ff72c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9592b4b94ee58f17 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.628+0000 7ff73ea00640 1 -- 172.21.15.73:0/3554013772 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c02d040 con 0x7ff7400cade0 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.628+0000 7ff73ea00640 1 -- 172.21.15.73:0/3554013772 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72c031810 con 0x7ff7400cade0 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.628+0000 7ff73ea00640 1 -- 172.21.15.73:0/3554013772 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c031ba0 con 0x7ff7400cade0 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.629+0000 7ff745600640 1 -- 172.21.15.73:0/3554013772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 msgr2=0x7ff7400cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.629+0000 7ff745600640 1 --2- 172.21.15.73:0/3554013772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400cbc80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0097a0 tx=0x7ff72c02b8b0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.629+0000 7ff745600640 1 -- 172.21.15.73:0/3554013772 shutdown_connections 2024-03-23T06:10:54.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.629+0000 7ff745600640 1 --2- 172.21.15.73:0/3554013772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400cbc80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.629+0000 7ff745600640 1 --2- 172.21.15.73:0/3554013772 >> v2:172.21.15.73:3300/0 conn(0x7ff7400cc1c0 0x7ff7400c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.629+0000 7ff745600640 1 -- 172.21.15.73:0/3554013772 >> 172.21.15.73:0/3554013772 conn(0x7ff74006bcc0 msgr2=0x7ff74006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.629+0000 7ff745600640 1 -- 172.21.15.73:0/3554013772 shutdown_connections 2024-03-23T06:10:54.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.629+0000 7ff745600640 1 -- 172.21.15.73:0/3554013772 wait complete. 2024-03-23T06:10:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.631+0000 7ff745600640 1 Processor -- start 2024-03-23T06:10:54.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.631+0000 7ff745600640 1 -- start start 2024-03-23T06:10:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff745600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff745600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7400cc1c0 0x7ff7401ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff745600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff740153660 0x7ff7401eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff745600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c6460 con 0x7ff740153660 2024-03-23T06:10:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff745600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c72f0 con 0x7ff7400cc1c0 2024-03-23T06:10:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff745600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c75d0 con 0x7ff7400cade0 2024-03-23T06:10:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff744c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff740153660 0x7ff7401eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff73fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff744c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff740153660 0x7ff7401eef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50090/0 (socket says 172.21.15.73:50090) 2024-03-23T06:10:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff744c00640 1 -- 172.21.15.73:0/3803419364 learned_addr learned my addr 172.21.15.73:0/3803419364 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.632+0000 7ff73f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7400cc1c0 0x7ff7401ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff744c00640 1 -- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 msgr2=0x7ff7400b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff744c00640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff744c00640 1 -- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7400cc1c0 msgr2=0x7ff7401ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff744c00640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7400cc1c0 0x7ff7401ee9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff744c00640 1 -- 172.21.15.73:0/3803419364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff738009a70 con 0x7ff740153660 2024-03-23T06:10:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff744c00640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff740153660 0x7ff7401eef30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff73800efc0 tx=0x7ff738009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff737e00640 1 -- 172.21.15.73:0/3803419364 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738009d70 con 0x7ff740153660 2024-03-23T06:10:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff737e00640 1 -- 172.21.15.73:0/3803419364 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73800f040 con 0x7ff740153660 2024-03-23T06:10:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff737e00640 1 -- 172.21.15.73:0/3803419364 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738003990 con 0x7ff740153660 2024-03-23T06:10:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c009400 con 0x7ff740153660 2024-03-23T06:10:54.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.633+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7400c6180 con 0x7ff740153660 2024-03-23T06:10:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.634+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74004e030 con 0x7ff740153660 2024-03-23T06:10:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.635+0000 7ff737e00640 1 -- 172.21.15.73:0/3803419364 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff7380144a0 con 0x7ff740153660 2024-03-23T06:10:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.637+0000 7ff737e00640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff72006ac00 0x7ff72006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:54.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.637+0000 7ff737e00640 1 -- 172.21.15.73:0/3803419364 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff73808a330 con 0x7ff740153660 2024-03-23T06:10:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.637+0000 7ff73fe00640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff72006ac00 0x7ff72006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:54.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.637+0000 7ff73fe00640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff72006ac00 0x7ff72006d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7300011e0 tx=0x7ff730007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:54.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.641+0000 7ff737e00640 1 -- 172.21.15.73:0/3803419364 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff7380551b0 con 0x7ff740153660 2024-03-23T06:10:54.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.834+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff7400ca4d0 con 0x7ff740153660 2024-03-23T06:10:54.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.834+0000 7ff737e00640 1 -- 172.21.15.73:0/3803419364 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff7380587d0 con 0x7ff740153660 2024-03-23T06:10:54.835 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff72006ac00 msgr2=0x7ff72006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff72006ac00 0x7ff72006d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7300011e0 tx=0x7ff730007d30 comp rx=0 tx=0).stop 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff740153660 msgr2=0x7ff7401eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff740153660 0x7ff7401eef30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff73800efc0 tx=0x7ff738009f90 comp rx=0 tx=0).stop 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 shutdown_connections 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff740153660 0x7ff7401eef30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7400cc1c0 0x7ff7401ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff72006ac00 0x7ff72006d0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 --2- 172.21.15.73:0/3803419364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7400cade0 0x7ff7400b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 >> 172.21.15.73:0/3803419364 conn(0x7ff74006bcc0 msgr2=0x7ff7400c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 shutdown_connections 2024-03-23T06:10:54.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:54.837+0000 7ff745600640 1 -- 172.21.15.73:0/3803419364 wait complete. 2024-03-23T06:10:54.856 DEBUG:tasks.mon_thrash:Yielding 2024-03-23T06:10:54.857 INFO:teuthology.run_tasks:Running task workunit... 2024-03-23T06:10:54.868 INFO:tasks.workunit:Pulling workunits from ref 82316b04821a6c2c1d458a881920454bbadb8837 2024-03-23T06:10:54.868 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-23T06:10:54.868 INFO:tasks.workunit:timeout=3h 2024-03-23T06:10:54.868 INFO:tasks.workunit:cleanup=True 2024-03-23T06:10:54.869 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-23T06:10:54.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-23 06:10:02.922082637 +0000 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-23 06:10:13.935431125 +0000 2024-03-23T06:10:54.914 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-23 06:10:02.922082637 +0000 2024-03-23T06:10:54.914 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-23T06:10:54.915 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-23T06:10:55.053 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 82316b04821a6c2c1d458a881920454bbadb8837 2024-03-23T06:10:55.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.058+0000 7f059bc00640 1 Processor -- start 2024-03-23T06:10:55.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.058+0000 7f059bc00640 1 -- start start 2024-03-23T06:10:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.059+0000 7f059bc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05941536a0 0x7f05940ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.059+0000 7f059bc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0594153a80 0x7f05940cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.059+0000 7f059bc00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05940cab20 con 0x7f05941594f0 2024-03-23T06:10:55.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.059+0000 7f059bc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059415a520 con 0x7f05941536a0 2024-03-23T06:10:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.059+0000 7f059bc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05941599a0 con 0x7f0594153a80 2024-03-23T06:10:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.060+0000 7f0599200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05941536a0 0x7f05940ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.060+0000 7f0599200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05941536a0 0x7f05940ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57960/0 (socket says 172.21.15.73:57960) 2024-03-23T06:10:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.060+0000 7f0599200640 1 -- 172.21.15.73:0/2384735207 learned_addr learned my addr 172.21.15.73:0/2384735207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.060+0000 7f0593e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0594153a80 0x7f05940cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.060+0000 7f0599200640 1 -- 172.21.15.73:0/2384735207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0594153a80 msgr2=0x7f05940cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.060+0000 7f0599200640 1 --2- 172.21.15.73:0/2384735207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0594153a80 0x7f05940cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.060+0000 7f0599200640 1 -- 172.21.15.73:0/2384735207 >> v1:172.21.15.73:6789/0 conn(0x7f05941594f0 legacy=0x7f05940cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.060+0000 7f0599200640 1 -- 172.21.15.73:0/2384735207 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594159c80 con 0x7f05941536a0 2024-03-23T06:10:55.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.061+0000 7f0599200640 1 --2- 172.21.15.73:0/2384735207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05941536a0 0x7f05940ca5e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f058802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f7504d7196a12d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.061+0000 7f0593400640 1 -- 172.21.15.73:0/2384735207 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588030840 con 0x7f05941536a0 2024-03-23T06:10:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.061+0000 7f0593400640 1 -- 172.21.15.73:0/2384735207 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05880309a0 con 0x7f05941536a0 2024-03-23T06:10:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.061+0000 7f0593400640 1 -- 172.21.15.73:0/2384735207 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588030d30 con 0x7f05941536a0 2024-03-23T06:10:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.062+0000 7f059bc00640 1 -- 172.21.15.73:0/2384735207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05941536a0 msgr2=0x7f05940ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.062+0000 7f059bc00640 1 --2- 172.21.15.73:0/2384735207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05941536a0 0x7f05940ca5e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f058802b980 comp rx=0 tx=0).stop 2024-03-23T06:10:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.062+0000 7f059bc00640 1 -- 172.21.15.73:0/2384735207 shutdown_connections 2024-03-23T06:10:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.062+0000 7f059bc00640 1 --2- 172.21.15.73:0/2384735207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0594153a80 0x7f05940cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.062+0000 7f059bc00640 1 --2- 172.21.15.73:0/2384735207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05941536a0 0x7f05940ca5e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.062+0000 7f059bc00640 1 -- 172.21.15.73:0/2384735207 >> 172.21.15.73:0/2384735207 conn(0x7f059406a060 msgr2=0x7f059406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.062+0000 7f059bc00640 1 -- 172.21.15.73:0/2384735207 shutdown_connections 2024-03-23T06:10:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.062+0000 7f059bc00640 1 -- 172.21.15.73:0/2384735207 wait complete. 2024-03-23T06:10:55.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.064+0000 7f059bc00640 1 Processor -- start 2024-03-23T06:10:55.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.064+0000 7f059bc00640 1 -- start start 2024-03-23T06:10:55.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f059bc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05941536a0 0x7f05941552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f059bc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0594153a80 0x7f05941540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f059bc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05941594f0 0x7f05941ef930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f059bc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0594155810 con 0x7f05941536a0 2024-03-23T06:10:55.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f059bc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05940b3fc0 con 0x7f0594153a80 2024-03-23T06:10:55.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f059bc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05940b41b0 con 0x7f05941594f0 2024-03-23T06:10:55.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f0599200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05941536a0 0x7f05941552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f0599200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05941536a0 0x7f05941552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50092/0 (socket says 172.21.15.73:50092) 2024-03-23T06:10:55.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f0599200640 1 -- 172.21.15.73:0/2412516887 learned_addr learned my addr 172.21.15.73:0/2412516887 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:55.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f0599c00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05941594f0 0x7f05941ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.065+0000 7f0593e00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0594153a80 0x7f05941540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.066+0000 7f0599c00640 1 -- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0594153a80 msgr2=0x7f05941540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.066+0000 7f0599c00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0594153a80 0x7f05941540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.066+0000 7f0599c00640 1 -- 172.21.15.73:0/2412516887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05941536a0 msgr2=0x7f05941552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.066+0000 7f0599c00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05941536a0 0x7f05941552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.066+0000 7f0599c00640 1 -- 172.21.15.73:0/2412516887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05880094d0 con 0x7f05941594f0 2024-03-23T06:10:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.066+0000 7f0599c00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05941594f0 0x7f05941ef930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f058c00c700 tx=0x7f058c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:55.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.066+0000 7f0590c00640 1 -- 172.21.15.73:0/2412516887 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c003b70 con 0x7f05941594f0 2024-03-23T06:10:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.067+0000 7f0590c00640 1 -- 172.21.15.73:0/2412516887 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c003cd0 con 0x7f05941594f0 2024-03-23T06:10:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.067+0000 7f0590c00640 1 -- 172.21.15.73:0/2412516887 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c005310 con 0x7f05941594f0 2024-03-23T06:10:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.067+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05940ccc70 con 0x7f05941594f0 2024-03-23T06:10:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.067+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05941521c0 con 0x7f05941594f0 2024-03-23T06:10:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.068+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0594152a10 con 0x7f05941594f0 2024-03-23T06:10:55.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.069+0000 7f0590c00640 1 -- 172.21.15.73:0/2412516887 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f058c005470 con 0x7f05941594f0 2024-03-23T06:10:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.070+0000 7f0590c00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f057406ac00 0x7f057406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.070+0000 7f0590c00640 1 -- 172.21.15.73:0/2412516887 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f058c089230 con 0x7f05941594f0 2024-03-23T06:10:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.070+0000 7f0599200640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f057406ac00 0x7f057406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.071+0000 7f0599200640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f057406ac00 0x7f057406d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f0588008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:55.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.075+0000 7f0590c00640 1 -- 172.21.15.73:0/2412516887 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f058c054140 con 0x7f05941594f0 2024-03-23T06:10:55.095 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-23T06:10:55.127 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:10:55.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:10:55.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.309+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05940c9810 con 0x7f05941594f0 2024-03-23T06:10:55.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.310+0000 7f0590c00640 1 -- 172.21.15.73:0/2412516887 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6280 (secure 0 0 0) 0x7f058c057760 con 0x7f05941594f0 2024-03-23T06:10:55.311 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:10:55.311 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:39.659193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4256,"mds_2":4253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4256":{"gid":4256,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:10:55.311 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-23T06:10:55.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f057406ac00 msgr2=0x7f057406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f057406ac00 0x7f057406d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0588009870 tx=0x7f0588008030 comp rx=0 tx=0).stop 2024-03-23T06:10:55.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05941594f0 msgr2=0x7f05941ef930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05941594f0 0x7f05941ef930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f058c00c700 tx=0x7f058c00cbc0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 shutdown_connections 2024-03-23T06:10:55.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f057406ac00 0x7f057406d0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05941594f0 0x7f05941ef930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0594153a80 0x7f05941540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 --2- 172.21.15.73:0/2412516887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f05941536a0 0x7f05941552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 >> 172.21.15.73:0/2412516887 conn(0x7f059406a060 msgr2=0x7f059414c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:55.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 shutdown_connections 2024-03-23T06:10:55.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.313+0000 7f059bc00640 1 -- 172.21.15.73:0/2412516887 wait complete. 2024-03-23T06:10:55.333 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-03-23T06:10:55.334 INFO:tasks.mon_thrash.mon_thrasher:seed: 1711174252, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-03-23T06:10:55.334 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:10:55.334 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:10:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.526+0000 7fce74e00640 1 Processor -- start 2024-03-23T06:10:55.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.526+0000 7fce74e00640 1 -- start start 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce74e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce70150100 0x7fce700c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce74e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce700c6fe0 0x7fce70156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce74e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7006f9b0 con 0x7fce700c7e10 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce74e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce70070250 con 0x7fce70150100 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce74e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce700c0150 con 0x7fce700c6fe0 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce6de00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce70150100 0x7fce700c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce6de00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce70150100 0x7fce700c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50094/0 (socket says 172.21.15.73:50094) 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce6de00640 1 -- 172.21.15.73:0/3903239494 learned_addr learned my addr 172.21.15.73:0/3903239494 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:55.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce65400640 1 --2- 172.21.15.73:0/3903239494 >> v2:172.21.15.110:3300/0 conn(0x7fce700c6fe0 0x7fce70156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce6de00640 1 -- 172.21.15.73:0/3903239494 >> v2:172.21.15.110:3300/0 conn(0x7fce700c6fe0 msgr2=0x7fce70156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce6de00640 1 --2- 172.21.15.73:0/3903239494 >> v2:172.21.15.110:3300/0 conn(0x7fce700c6fe0 0x7fce70156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.528+0000 7fce6de00640 1 -- 172.21.15.73:0/3903239494 >> v1:172.21.15.110:6789/0 conn(0x7fce700c7e10 legacy=0x7fce70071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.529+0000 7fce6de00640 1 -- 172.21.15.73:0/3903239494 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce700c03f0 con 0x7fce70150100 2024-03-23T06:10:55.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.530+0000 7fce6de00640 1 --2- 172.21.15.73:0/3903239494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce70150100 0x7fce700c6aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce700b11b0 tx=0x7fce6002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ad0b991cf6f7d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:55.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.530+0000 7fce6d400640 1 -- 172.21.15.73:0/3903239494 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6002ca80 con 0x7fce70150100 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.530+0000 7fce6d400640 1 -- 172.21.15.73:0/3903239494 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6002cbe0 con 0x7fce70150100 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.530+0000 7fce6d400640 1 -- 172.21.15.73:0/3903239494 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce600343f0 con 0x7fce70150100 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.530+0000 7fce74e00640 1 -- 172.21.15.73:0/3903239494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce70150100 msgr2=0x7fce700c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.530+0000 7fce74e00640 1 --2- 172.21.15.73:0/3903239494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce70150100 0x7fce700c6aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce700b11b0 tx=0x7fce6002bee0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.531+0000 7fce74e00640 1 -- 172.21.15.73:0/3903239494 shutdown_connections 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.531+0000 7fce74e00640 1 --2- 172.21.15.73:0/3903239494 >> v2:172.21.15.110:3300/0 conn(0x7fce700c6fe0 0x7fce70156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.531+0000 7fce74e00640 1 --2- 172.21.15.73:0/3903239494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce70150100 0x7fce700c6aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.531+0000 7fce74e00640 1 -- 172.21.15.73:0/3903239494 >> 172.21.15.73:0/3903239494 conn(0x7fce7006bb40 msgr2=0x7fce7006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.531+0000 7fce74e00640 1 -- 172.21.15.73:0/3903239494 shutdown_connections 2024-03-23T06:10:55.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.531+0000 7fce74e00640 1 -- 172.21.15.73:0/3903239494 wait complete. 2024-03-23T06:10:55.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.532+0000 7fce74e00640 1 Processor -- start 2024-03-23T06:10:55.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.533+0000 7fce74e00640 1 -- start start 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.533+0000 7fce74e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce700c7e10 0x7fce7013d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.533+0000 7fce74e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce70150100 0x7fce701558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.533+0000 7fce74e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce701e2f30 0x7fce7014c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.533+0000 7fce74e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce701e19a0 con 0x7fce701e2f30 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce74e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce701541a0 con 0x7fce700c7e10 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce74e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7014bea0 con 0x7fce70150100 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce700c7e10 0x7fce7013d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce700c7e10 0x7fce7013d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:58000/0 (socket says 172.21.15.73:58000) 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6de00640 1 -- 172.21.15.73:0/432573001 learned_addr learned my addr 172.21.15.73:0/432573001 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce65400640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce70150100 0x7fce701558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6e800640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce701e2f30 0x7fce7014c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6de00640 1 -- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce70150100 msgr2=0x7fce701558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6de00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce70150100 0x7fce701558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6de00640 1 -- 172.21.15.73:0/432573001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce701e2f30 msgr2=0x7fce7014c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6de00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce701e2f30 0x7fce7014c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.534+0000 7fce6de00640 1 -- 172.21.15.73:0/432573001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce60009b30 con 0x7fce700c7e10 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.535+0000 7fce6de00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce700c7e10 0x7fce7013d820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce60000f80 tx=0x7fce60004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.535+0000 7fce66a00640 1 -- 172.21.15.73:0/432573001 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60009510 con 0x7fce700c7e10 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.535+0000 7fce66a00640 1 -- 172.21.15.73:0/432573001 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6003e450 con 0x7fce700c7e10 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.535+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7013dd60 con 0x7fce700c7e10 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.535+0000 7fce66a00640 1 -- 172.21.15.73:0/432573001 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6003e800 con 0x7fce700c7e10 2024-03-23T06:10:55.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.535+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce701e04d0 con 0x7fce700c7e10 2024-03-23T06:10:55.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.536+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce700b0d50 con 0x7fce700c7e10 2024-03-23T06:10:55.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.537+0000 7fce66a00640 1 -- 172.21.15.73:0/432573001 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fce6002cd50 con 0x7fce700c7e10 2024-03-23T06:10:55.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.538+0000 7fce66a00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce4c06ac30 0x7fce4c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:55.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.538+0000 7fce66a00640 1 -- 172.21.15.73:0/432573001 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fce600ac0b0 con 0x7fce700c7e10 2024-03-23T06:10:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.538+0000 7fce65400640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce4c06ac30 0x7fce4c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:55.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.539+0000 7fce65400640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce4c06ac30 0x7fce4c06d0f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce701557a0 tx=0x7fce58009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.543+0000 7fce66a00640 1 -- 172.21.15.73:0/432573001 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fce600770e0 con 0x7fce700c7e10 2024-03-23T06:10:55.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.804+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fce7004e110 con 0x7fce700c7e10 2024-03-23T06:10:55.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.805+0000 7fce66a00640 1 -- 172.21.15.73:0/432573001 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fce6007a700 con 0x7fce700c7e10 2024-03-23T06:10:55.806 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":81,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:10:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce4c06ac30 msgr2=0x7fce4c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce4c06ac30 0x7fce4c06d0f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce701557a0 tx=0x7fce58009190 comp rx=0 tx=0).stop 2024-03-23T06:10:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce700c7e10 msgr2=0x7fce7013d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce700c7e10 0x7fce7013d820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce60000f80 tx=0x7fce60004a40 comp rx=0 tx=0).stop 2024-03-23T06:10:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 shutdown_connections 2024-03-23T06:10:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce701e2f30 0x7fce7014c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce4c06ac30 0x7fce4c06d0f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce70150100 0x7fce701558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 --2- 172.21.15.73:0/432573001 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce700c7e10 0x7fce7013d820 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 >> 172.21.15.73:0/432573001 conn(0x7fce7006bb40 msgr2=0x7fce7014dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 shutdown_connections 2024-03-23T06:10:55.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:55.808+0000 7fce74e00640 1 -- 172.21.15.73:0/432573001 wait complete. 2024-03-23T06:10:55.825 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:10:55.825 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:10:55.825 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:10:55.825 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:10:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.025+0000 7f7661000640 1 Processor -- start 2024-03-23T06:10:56.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.025+0000 7f7661000640 1 -- start start 2024-03-23T06:10:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7661000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f765c0c7c00 0x7f765c06f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7661000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f765c06fe80 0x7f765c0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7661000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765c0728d0 con 0x7f765c150500 2024-03-23T06:10:56.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7661000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c15a640 con 0x7f765c0c7c00 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7661000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f765c1598c0 con 0x7f765c06fe80 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7651400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f765c0c7c00 0x7f765c06f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7651400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f765c0c7c00 0x7f765c06f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50108/0 (socket says 172.21.15.73:50108) 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7651400640 1 -- 172.21.15.73:0/3988369643 learned_addr learned my addr 172.21.15.73:0/3988369643 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7659e00640 1 --1- 172.21.15.73:0/3988369643 >> v1:172.21.15.110:6789/0 conn(0x7f765c150500 0x7f765c071dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:53646/0 (socket says 172.21.15.73:53646) 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f765a800640 1 --2- 172.21.15.73:0/3988369643 >> v2:172.21.15.110:3300/0 conn(0x7f765c06fe80 0x7f765c0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7659400640 1 -- 172.21.15.73:0/3988369643 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920565622 0 0) 0x7f765c0728d0 con 0x7f765c150500 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.027+0000 7f7659400640 1 -- 172.21.15.73:0/3988369643 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7640003520 con 0x7f765c150500 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.028+0000 7f7651400640 1 -- 172.21.15.73:0/3988369643 >> v2:172.21.15.110:3300/0 conn(0x7f765c06fe80 msgr2=0x7f765c0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.028+0000 7f7651400640 1 --2- 172.21.15.73:0/3988369643 >> v2:172.21.15.110:3300/0 conn(0x7f765c06fe80 0x7f765c0c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.028+0000 7f7651400640 1 -- 172.21.15.73:0/3988369643 >> v1:172.21.15.110:6789/0 conn(0x7f765c150500 legacy=0x7f765c071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.028+0000 7f7651400640 1 -- 172.21.15.73:0/3988369643 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0725f0 con 0x7f765c0c7c00 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.029+0000 7f7651400640 1 --2- 172.21.15.73:0/3988369643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 0x7f765c06f940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f765c070310 tx=0x7f764402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95e16e75aee7476 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.029+0000 7f7659400640 1 -- 172.21.15.73:0/3988369643 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644030860 con 0x7f765c0c7c00 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.029+0000 7f7659400640 1 -- 172.21.15.73:0/3988369643 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440309c0 con 0x7f765c0c7c00 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.029+0000 7f7659400640 1 -- 172.21.15.73:0/3988369643 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644030d50 con 0x7f765c0c7c00 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.029+0000 7f7661000640 1 -- 172.21.15.73:0/3988369643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 msgr2=0x7f765c06f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.029+0000 7f7661000640 1 --2- 172.21.15.73:0/3988369643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 0x7f765c06f940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f765c070310 tx=0x7f764402b9a0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.030+0000 7f7661000640 1 -- 172.21.15.73:0/3988369643 shutdown_connections 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.030+0000 7f7661000640 1 --2- 172.21.15.73:0/3988369643 >> v2:172.21.15.110:3300/0 conn(0x7f765c06fe80 0x7f765c0c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.030+0000 7f7661000640 1 --2- 172.21.15.73:0/3988369643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 0x7f765c06f940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.030+0000 7f7661000640 1 -- 172.21.15.73:0/3988369643 >> 172.21.15.73:0/3988369643 conn(0x7f765c069cb0 msgr2=0x7f765c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.030+0000 7f7661000640 1 -- 172.21.15.73:0/3988369643 shutdown_connections 2024-03-23T06:10:56.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.030+0000 7f7661000640 1 -- 172.21.15.73:0/3988369643 wait complete. 2024-03-23T06:10:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.031+0000 7f7661000640 1 Processor -- start 2024-03-23T06:10:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.032+0000 7f7661000640 1 -- start start 2024-03-23T06:10:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.032+0000 7f7661000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f765c06fe80 0x7f765c147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.032+0000 7f7661000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 0x7f765c152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.032+0000 7f7661000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f765c150500 0x7f765c152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.032+0000 7f7661000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c14f740 con 0x7f765c0c7c00 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.032+0000 7f7661000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c1525c0 con 0x7f765c06fe80 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7661000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765c14f990 con 0x7f765c150500 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 0x7f765c152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 0x7f765c152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50116/0 (socket says 172.21.15.73:50116) 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 -- 172.21.15.73:0/1314059525 learned_addr learned my addr 172.21.15.73:0/1314059525 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7659e00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f765c06fe80 0x7f765c147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f765a800640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f765c150500 0x7f765c152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 -- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f765c150500 msgr2=0x7f765c152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f765c150500 0x7f765c152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 -- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f765c06fe80 msgr2=0x7f765c147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f765c06fe80 0x7f765c147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 -- 172.21.15.73:0/1314059525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76440094d0 con 0x7f765c0c7c00 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.033+0000 7f7651400640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 0x7f765c152a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f764402b9e0 tx=0x7f7644004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.034+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644039c90 con 0x7f765c0c7c00 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.034+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644039df0 con 0x7f765c0c7c00 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.034+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76440446c0 con 0x7f765c0c7c00 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.034+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c14fc70 con 0x7f765c0c7c00 2024-03-23T06:10:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.034+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c152250 con 0x7f765c0c7c00 2024-03-23T06:10:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.035+0000 7f7661000640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c14ef60 0x7f765c1f1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.035+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c073bf0 con 0x7f765c14ef60 2024-03-23T06:10:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.035+0000 7f7659e00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c14ef60 0x7f765c1f1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.036+0000 7f7659e00640 1 -- 172.21.15.73:0/1314059525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f765c15a120 con 0x7f765c14ef60 2024-03-23T06:10:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.036+0000 7f7659e00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c14ef60 0x7f765c1f1110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f764c0012e0 tx=0x7f764c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.036+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f764402f3b0 con 0x7f765c0c7c00 2024-03-23T06:10:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f7652a00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f763806ac30 0x7f763806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f764403e070 con 0x7f765c0c7c00 2024-03-23T06:10:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00f9b0 con 0x7f765c14ef60 2024-03-23T06:10:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f764c00fb10 con 0x7f765c14ef60 2024-03-23T06:10:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c14ef60 msgr2=0x7f765c1f1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f7652a00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c14ef60 0x7f765c1f1110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f764c0012e0 tx=0x7f764c007a90 comp rx=0 tx=0).stop 2024-03-23T06:10:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c14ef60 msgr2=0x7f765c1f1110 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:10:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f7652a00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c14ef60 0x7f765c1f1110 secure :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f764c0012e0 tx=0x7f764c007a90 comp rx=0 tx=0).stop 2024-03-23T06:10:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.037+0000 7f765a800640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f763806ac30 0x7f763806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.038+0000 7f765a800640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f763806ac30 0x7f763806d0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7654009aa0 tx=0x7f7654009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.044+0000 7f7661000640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c146370 0x7f765c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.044+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c146d90 con 0x7f765c146370 2024-03-23T06:10:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.044+0000 7f7659e00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c146370 0x7f765c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.045+0000 7f7659e00640 1 -- 172.21.15.73:0/1314059525 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f765c159e40 con 0x7f765c146370 2024-03-23T06:10:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.045+0000 7f7659e00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c146370 0x7f765c14d5b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f764c0012e0 tx=0x7f764c0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.045+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c024070 con 0x7f765c146370 2024-03-23T06:10:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.045+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4637 (secure 0 0 0) 0x7f764c01f2e0 con 0x7f765c146370 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.045+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c146370 msgr2=0x7f765c14d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.045+0000 7f7652a00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c146370 0x7f765c14d5b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f764c0012e0 tx=0x7f764c0014d0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7652a00640 1 -- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c146370 msgr2=0x7f765c14d5b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7652a00640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c146370 0x7f765c14d5b0 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f764c0012e0 tx=0x7f764c0014d0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:10:56.047 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 4, 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 81, 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.048 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.049 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:10:56.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.051 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.057 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:10:56.058 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f763806ac30 msgr2=0x7f763806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7661000640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f763806ac30 0x7f763806d0f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7654009aa0 tx=0x7f7654009190 comp rx=0 tx=0).stop 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 msgr2=0x7f765c152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7661000640 1 --2- 172.21.15.73:0/1314059525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f765c0c7c00 0x7f765c152a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f764402b9e0 tx=0x7f7644004730 comp rx=0 tx=0).stop 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f765a800640 1 -- 172.21.15.73:0/1314059525 reap_dead start 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f765a800640 1 -- 172.21.15.73:0/1314059525 reap_dead start 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 shutdown_connections 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 >> 172.21.15.73:0/1314059525 conn(0x7f765c069cb0 msgr2=0x7f765c06c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 shutdown_connections 2024-03-23T06:10:56.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.046+0000 7f7661000640 1 -- 172.21.15.73:0/1314059525 wait complete. 2024-03-23T06:10:56.062 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:10:56.062 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:10:56.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:10:56.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.263+0000 7f59cba00640 1 Processor -- start 2024-03-23T06:10:56.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.263+0000 7f59cba00640 1 -- start start 2024-03-23T06:10:56.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.264+0000 7f59cba00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59c406e370 0x7f59c4070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.264+0000 7f59cba00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 0x7f59c40c7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.264+0000 7f59cba00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c4070bf0 con 0x7f59c40c77d0 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59cba00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c4066000 con 0x7f59c406e370 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59cba00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4070e90 con 0x7f59c406e750 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c9000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59c406e370 0x7f59c4070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c9000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59c406e370 0x7f59c4070550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50138/0 (socket says 172.21.15.73:50138) 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c9000640 1 -- 172.21.15.73:0/2482510116 learned_addr learned my addr 172.21.15.73:0/2482510116 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c3e00640 1 --2- 172.21.15.73:0/2482510116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 0x7f59c40c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c9a00640 1 --1- 172.21.15.73:0/2482510116 >> v1:172.21.15.73:6789/0 conn(0x7f59c40c77d0 0x7f59c415ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52122/0 (socket says 172.21.15.73:52122) 2024-03-23T06:10:56.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c9000640 1 -- 172.21.15.73:0/2482510116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 msgr2=0x7f59c40c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:56.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c9000640 1 --2- 172.21.15.73:0/2482510116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 0x7f59c40c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c9000640 1 -- 172.21.15.73:0/2482510116 >> v1:172.21.15.73:6789/0 conn(0x7f59c40c77d0 legacy=0x7f59c415ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c9000640 1 -- 172.21.15.73:0/2482510116 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4071170 con 0x7f59c406e370 2024-03-23T06:10:56.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.265+0000 7f59c3e00640 1 --2- 172.21.15.73:0/2482510116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 0x7f59c40c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:10:56.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.266+0000 7f59c9000640 1 --2- 172.21.15.73:0/2482510116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c406e370 0x7f59c4070550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009870 tx=0x7f59b802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0ec57c1755f369 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59c3400640 1 -- 172.21.15.73:0/2482510116 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8030840 con 0x7f59c406e370 2024-03-23T06:10:56.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59c3400640 1 -- 172.21.15.73:0/2482510116 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b80309a0 con 0x7f59c406e370 2024-03-23T06:10:56.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59c3400640 1 -- 172.21.15.73:0/2482510116 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8030d30 con 0x7f59c406e370 2024-03-23T06:10:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59cba00640 1 -- 172.21.15.73:0/2482510116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c406e370 msgr2=0x7f59c4070550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59cba00640 1 --2- 172.21.15.73:0/2482510116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c406e370 0x7f59c4070550 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009870 tx=0x7f59b802b980 comp rx=0 tx=0).stop 2024-03-23T06:10:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59cba00640 1 -- 172.21.15.73:0/2482510116 shutdown_connections 2024-03-23T06:10:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59cba00640 1 --2- 172.21.15.73:0/2482510116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 0x7f59c40c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59cba00640 1 --2- 172.21.15.73:0/2482510116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c406e370 0x7f59c4070550 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59cba00640 1 -- 172.21.15.73:0/2482510116 >> 172.21.15.73:0/2482510116 conn(0x7f59c406d5e0 msgr2=0x7f59c406d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59cba00640 1 -- 172.21.15.73:0/2482510116 shutdown_connections 2024-03-23T06:10:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.267+0000 7f59cba00640 1 -- 172.21.15.73:0/2482510116 wait complete. 2024-03-23T06:10:56.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.269+0000 7f59cba00640 1 Processor -- start 2024-03-23T06:10:56.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.269+0000 7f59cba00640 1 -- start start 2024-03-23T06:10:56.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.270+0000 7f59cba00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c406e370 0x7f59c41f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.270+0000 7f59cba00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 0x7f59c41ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.270+0000 7f59cba00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c40c77d0 0x7f59c40c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.270+0000 7f59cba00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c414c700 con 0x7f59c40c77d0 2024-03-23T06:10:56.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.270+0000 7f59cba00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c414c9e0 con 0x7f59c406e370 2024-03-23T06:10:56.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.270+0000 7f59cba00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c41eeea0 con 0x7f59c406e750 2024-03-23T06:10:56.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.270+0000 7f59c9a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c40c77d0 0x7f59c40c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c40c77d0 0x7f59c40c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50142/0 (socket says 172.21.15.73:50142) 2024-03-23T06:10:56.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9a00640 1 -- 172.21.15.73:0/2474932659 learned_addr learned my addr 172.21.15.73:0/2474932659 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:56.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c406e370 0x7f59c41f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c3e00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 0x7f59c41ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9a00640 1 -- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 msgr2=0x7f59c41ef6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9a00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c406e750 0x7f59c41ef6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9a00640 1 -- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c406e370 msgr2=0x7f59c41f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9a00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c406e370 0x7f59c41f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9a00640 1 -- 172.21.15.73:0/2474932659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009400 con 0x7f59c40c77d0 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c9a00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c40c77d0 0x7f59c40c40d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00c730 tx=0x7f59bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.271+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc004d60 con 0x7f59c40c77d0 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.272+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00a640 con 0x7f59c40c77d0 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.272+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b80094d0 con 0x7f59c40c77d0 2024-03-23T06:10:56.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.272+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00a9d0 con 0x7f59c40c77d0 2024-03-23T06:10:56.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.272+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c40c73e0 con 0x7f59c40c77d0 2024-03-23T06:10:56.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.273+0000 7f59cba00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c41487f0 0x7f59c4148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.273+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4073b40 con 0x7f59c41487f0 2024-03-23T06:10:56.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.273+0000 7f59c9000640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c41487f0 0x7f59c4148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.273+0000 7f59c9000640 1 -- 172.21.15.73:0/2474932659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59c4071730 con 0x7f59c41487f0 2024-03-23T06:10:56.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.274+0000 7f59c9000640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c41487f0 0x7f59c4148bd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59c406b7f0 tx=0x7f59b80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.274+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f59bc00ad40 con 0x7f59c40c77d0 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.274+0000 7f59c0c00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f59a406ac30 0x7f59a406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f59bc088da0 con 0x7f59c40c77d0 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c3e00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f59a406ac30 0x7f59a406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8039c30 con 0x7f59c41487f0 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f59b8039d90 con 0x7f59c41487f0 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c41487f0 msgr2=0x7f59c4148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c0c00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c41487f0 0x7f59c4148bd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59c406b7f0 tx=0x7f59b80046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c41487f0 msgr2=0x7f59c4148bd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c0c00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c41487f0 0x7f59c4148bd0 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f59c406b7f0 tx=0x7f59b80046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.275+0000 7f59c3e00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f59a406ac30 0x7f59a406d0f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59c406b2c0 tx=0x7f59b0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.282+0000 7f59cba00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c4155f50 0x7f59c4156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.282+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c41ef010 con 0x7f59c4155f50 2024-03-23T06:10:56.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.282+0000 7f59c9000640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c4155f50 0x7f59c4156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.282+0000 7f59c9000640 1 -- 172.21.15.73:0/2474932659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f59c40c7cd0 con 0x7f59c4155f50 2024-03-23T06:10:56.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.283+0000 7f59c9000640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c4155f50 0x7f59c4156360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59b802b9c0 tx=0x7f59b8009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.283+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b804d680 con 0x7f59c4155f50 2024-03-23T06:10:56.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.283+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5118 (secure 0 0 0) 0x7f59b804d7e0 con 0x7f59c4155f50 2024-03-23T06:10:56.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.283+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c4155f50 msgr2=0x7f59c4156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.283+0000 7f59c0c00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c4155f50 0x7f59c4156360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59b802b9c0 tx=0x7f59b8009240 comp rx=0 tx=0).stop 2024-03-23T06:10:56.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.283+0000 7f59c0c00640 1 -- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c4155f50 msgr2=0x7f59c4156360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:10:56.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.283+0000 7f59c0c00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c4155f50 0x7f59c4156360 secure :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59b802b9c0 tx=0x7f59b8009240 comp rx=0 tx=0).stop 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 4, 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 81, 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:10:56.285 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:10:56.286 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:10:56.287 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.288 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:10:56.289 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.290 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.292 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.293 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.294 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.295 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.296 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:10:56.297 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:10:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f59a406ac30 msgr2=0x7f59a406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59cba00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f59a406ac30 0x7f59a406d0f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59c406b2c0 tx=0x7f59b0009190 comp rx=0 tx=0).stop 2024-03-23T06:10:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c40c77d0 msgr2=0x7f59c40c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59cba00640 1 --2- 172.21.15.73:0/2474932659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c40c77d0 0x7f59c40c40d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00c730 tx=0x7f59bc00cbf0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59c9a00640 1 -- 172.21.15.73:0/2474932659 reap_dead start 2024-03-23T06:10:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59c9a00640 1 -- 172.21.15.73:0/2474932659 reap_dead start 2024-03-23T06:10:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 shutdown_connections 2024-03-23T06:10:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 >> 172.21.15.73:0/2474932659 conn(0x7f59c406d5e0 msgr2=0x7f59c41507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 shutdown_connections 2024-03-23T06:10:56.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.284+0000 7f59cba00640 1 -- 172.21.15.73:0/2474932659 wait complete. 2024-03-23T06:10:56.302 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:10:56.302 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:10:56.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:10:56.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.496+0000 7f1c50a00640 1 Processor -- start 2024-03-23T06:10:56.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.496+0000 7f1c50a00640 1 -- start start 2024-03-23T06:10:56.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c50a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1c4c140510 0x7f1c4c071a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c50a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c071f90 0x7f1c4c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c50a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c4c06a9f0 0x7f1c4c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c50a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c1408f0 con 0x7f1c4c06a9f0 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c50a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4c158010 con 0x7f1c4c140510 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c50a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c157490 con 0x7f1c4c071f90 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c4c06a9f0 0x7f1c4c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4a800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1c4c140510 0x7f1c4c071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c071f90 0x7f1c4c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4a800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1c4c140510 0x7f1c4c071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:58076/0 (socket says 172.21.15.73:58076) 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4a800640 1 -- 172.21.15.73:0/2275830671 learned_addr learned my addr 172.21.15.73:0/2275830671 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c4c06a9f0 0x7f1c4c15ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50146/0 (socket says 172.21.15.73:50146) 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4b200640 1 -- 172.21.15.73:0/2275830671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c071f90 msgr2=0x7f1c4c06a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4b200640 1 --2- 172.21.15.73:0/2275830671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c071f90 0x7f1c4c06a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4b200640 1 -- 172.21.15.73:0/2275830671 >> v2:172.21.15.110:3300/0 conn(0x7f1c4c140510 msgr2=0x7f1c4c071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4b200640 1 --2- 172.21.15.73:0/2275830671 >> v2:172.21.15.110:3300/0 conn(0x7f1c4c140510 0x7f1c4c071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.499+0000 7f1c4b200640 1 -- 172.21.15.73:0/2275830671 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c157770 con 0x7f1c4c06a9f0 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.500+0000 7f1c4b200640 1 --2- 172.21.15.73:0/2275830671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c06a9f0 0x7f1c4c15ac50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c06e3f0 tx=0x7f1c4402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a43b1eb7ba49c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.500+0000 7f1c49e00640 1 -- 172.21.15.73:0/2275830671 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4402cc60 con 0x7f1c4c06a9f0 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.500+0000 7f1c49e00640 1 -- 172.21.15.73:0/2275830671 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4402cdc0 con 0x7f1c4c06a9f0 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.500+0000 7f1c49e00640 1 -- 172.21.15.73:0/2275830671 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44034660 con 0x7f1c4c06a9f0 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 -- 172.21.15.73:0/2275830671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c06a9f0 msgr2=0x7f1c4c15ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 --2- 172.21.15.73:0/2275830671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c06a9f0 0x7f1c4c15ac50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c06e3f0 tx=0x7f1c4402beb0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 -- 172.21.15.73:0/2275830671 shutdown_connections 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 --2- 172.21.15.73:0/2275830671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c06a9f0 0x7f1c4c15ac50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 --2- 172.21.15.73:0/2275830671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c071f90 0x7f1c4c06a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 --2- 172.21.15.73:0/2275830671 >> v2:172.21.15.110:3300/0 conn(0x7f1c4c140510 0x7f1c4c071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 -- 172.21.15.73:0/2275830671 >> 172.21.15.73:0/2275830671 conn(0x7f1c4c06d3f0 msgr2=0x7f1c4c06d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 -- 172.21.15.73:0/2275830671 shutdown_connections 2024-03-23T06:10:56.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.501+0000 7f1c50a00640 1 -- 172.21.15.73:0/2275830671 wait complete. 2024-03-23T06:10:56.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.503+0000 7f1c50a00640 1 Processor -- start 2024-03-23T06:10:56.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.503+0000 7f1c50a00640 1 -- start start 2024-03-23T06:10:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.504+0000 7f1c50a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c4c06a9f0 0x7f1c4c1524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.504+0000 7f1c50a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c071f90 0x7f1c4c0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c50a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c140510 0x7f1c4c0c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c50a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0c8bc0 con 0x7f1c4c071f90 2024-03-23T06:10:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c50a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c137c30 con 0x7f1c4c06a9f0 2024-03-23T06:10:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c50a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c154440 con 0x7f1c4c140510 2024-03-23T06:10:56.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c071f90 0x7f1c4c0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c4a800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c4c06a9f0 0x7f1c4c1524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c4b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c140510 0x7f1c4c0c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c071f90 0x7f1c4c0c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50156/0 (socket says 172.21.15.73:50156) 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c43e00640 1 -- 172.21.15.73:0/2433220107 learned_addr learned my addr 172.21.15.73:0/2433220107 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c43e00640 1 -- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c140510 msgr2=0x7f1c4c0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c43e00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c140510 0x7f1c4c0c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c43e00640 1 -- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c4c06a9f0 msgr2=0x7f1c4c1524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c43e00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c4c06a9f0 0x7f1c4c1524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.505+0000 7f1c43e00640 1 -- 172.21.15.73:0/2433220107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009a70 con 0x7f1c4c071f90 2024-03-23T06:10:56.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.506+0000 7f1c43e00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c071f90 0x7f1c4c0c5cb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400e870 tx=0x7f1c3400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.506+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400ee60 con 0x7f1c4c071f90 2024-03-23T06:10:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.506+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3400c940 con 0x7f1c4c071f90 2024-03-23T06:10:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.506+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400ccf0 con 0x7f1c4c071f90 2024-03-23T06:10:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.506+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c154720 con 0x7f1c4c071f90 2024-03-23T06:10:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.506+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c15a1b0 con 0x7f1c4c071f90 2024-03-23T06:10:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.507+0000 7f1c50a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c0c96f0 0x7f1c4c1efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.507+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c073aa0 con 0x7f1c4c0c96f0 2024-03-23T06:10:56.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.508+0000 7f1c4a800640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c0c96f0 0x7f1c4c1efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.508+0000 7f1c4a800640 1 -- 172.21.15.73:0/2433220107 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c4c159d50 con 0x7f1c4c0c96f0 2024-03-23T06:10:56.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.508+0000 7f1c4a800640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c0c96f0 0x7f1c4c1efd30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0118f0 tx=0x7f1c3c011db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.508+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00fb60 con 0x7f1c4c0c96f0 2024-03-23T06:10:56.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.508+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1c34013470 con 0x7f1c4c071f90 2024-03-23T06:10:56.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.509+0000 7f1c42a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c2806aca0 0x7f1c2806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.509+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1c34089a10 con 0x7f1c4c071f90 2024-03-23T06:10:56.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.510+0000 7f1c4b200640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c2806aca0 0x7f1c2806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.510+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f1c3c00fcc0 con 0x7f1c4c0c96f0 2024-03-23T06:10:56.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.510+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c0c96f0 msgr2=0x7f1c4c1efd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.510+0000 7f1c42a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c0c96f0 0x7f1c4c1efd30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0118f0 tx=0x7f1c3c011db0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.510+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c0c96f0 msgr2=0x7f1c4c1efd30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:10:56.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.510+0000 7f1c42a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c0c96f0 0x7f1c4c1efd30 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0118f0 tx=0x7f1c3c011db0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.510+0000 7f1c4b200640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c2806aca0 0x7f1c2806d160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c44036000 tx=0x7f1c44040040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.517+0000 7f1c50a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c1519f0 0x7f1c4c1f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.517+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c15a730 con 0x7f1c4c1519f0 2024-03-23T06:10:56.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.517+0000 7f1c4a800640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c1519f0 0x7f1c4c1f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.517+0000 7f1c4a800640 1 -- 172.21.15.73:0/2433220107 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1c4c157d30 con 0x7f1c4c1519f0 2024-03-23T06:10:56.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.518+0000 7f1c4a800640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c1519f0 0x7f1c4c1f0270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0118f0 tx=0x7f1c3c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.518+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c014640 con 0x7f1c4c1519f0 2024-03-23T06:10:56.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4805 (secure 0 0 0) 0x7f1c3c003e70 con 0x7f1c4c1519f0 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c1519f0 msgr2=0x7f1c4c1f0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c42a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c1519f0 0x7f1c4c1f0270 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0118f0 tx=0x7f1c3c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c42a00640 1 -- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c1519f0 msgr2=0x7f1c4c1f0270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c42a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c4c1519f0 0x7f1c4c1f0270 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0118f0 tx=0x7f1c3c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 4, 2024-03-23T06:10:56.520 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 82, 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.521 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.522 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:10:56.523 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:10:56.524 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.526 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:10:56.528 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:10:56.529 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.530 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:10:56.531 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:10:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:10:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:10:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:10:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:10:56.532 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:10:56.532 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c2806aca0 msgr2=0x7f1c2806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c50a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c2806aca0 0x7f1c2806d160 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c44036000 tx=0x7f1c44040040 comp rx=0 tx=0).stop 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c071f90 msgr2=0x7f1c4c0c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c50a00640 1 --2- 172.21.15.73:0/2433220107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c071f90 0x7f1c4c0c5cb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400e870 tx=0x7f1c3400ed30 comp rx=0 tx=0).stop 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c4b200640 1 -- 172.21.15.73:0/2433220107 reap_dead start 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c4b200640 1 -- 172.21.15.73:0/2433220107 reap_dead start 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 shutdown_connections 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 >> 172.21.15.73:0/2433220107 conn(0x7f1c4c06d3f0 msgr2=0x7f1c4c158470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 shutdown_connections 2024-03-23T06:10:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.519+0000 7f1c50a00640 1 -- 172.21.15.73:0/2433220107 wait complete. 2024-03-23T06:10:56.536 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:10:56.537 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T06:10:56.537 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T06:10:56.537 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T06:10:56.537 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T06:10:56.537 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T06:10:56.537 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:10:56.561 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T06:10:56.561 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:10:56.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:10:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.814+0000 7fec72a00640 1 Processor -- start 2024-03-23T06:10:56.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.815+0000 7fec72a00640 1 -- start start 2024-03-23T06:10:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec72a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec6c1513f0 0x7fec6c0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec72a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c0c5f50 con 0x7fec6c158b20 2024-03-23T06:10:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec72a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c157b60 con 0x7fec6c1586b0 2024-03-23T06:10:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec72a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6c0c0570 con 0x7fec6c1513f0 2024-03-23T06:10:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec6be00640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7fec6c1513f0 msgr2=0x7fec6c0c5a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:10:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec70a00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fec6c158b20 legacy=0x7fec6c071bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:10:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec6be00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec6c1513f0 0x7fec6c0c5a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:10:56.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec6b400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fec6c1586b0 0x7fec6c0bfe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:53648/0 (socket says 172.21.15.73:53648) 2024-03-23T06:10:56.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.816+0000 7fec6b400640 1 -- 172.21.15.73:0/3967220685 learned_addr learned my addr 172.21.15.73:0/3967220685 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696288486 0 0) 0x7fec6c157b60 con 0x7fec6c1586b0 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec4c003520 con 0x7fec6c1586b0 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 574784354 0 0) 0x7fec4c003520 con 0x7fec6c1586b0 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 >> v2:172.21.15.73:3300/0 conn(0x7fec6c1513f0 msgr2=0x7fec6c0c5a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 --2- 172.21.15.73:0/3967220685 >> v2:172.21.15.73:3300/0 conn(0x7fec6c1513f0 0x7fec6c0c5a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 >> v1:172.21.15.73:6789/0 conn(0x7fec6c158b20 legacy=0x7fec6c071bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c0c0830 con 0x7fec6c1586b0 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fec540019f0 con 0x7fec6c1586b0 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 >> v1:172.21.15.110:6789/0 conn(0x7fec6c1586b0 legacy=0x7fec6c0bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4c003970 0x7fec4c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0047c0 0x7fec4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c0051d0 0x7fec4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0c0570 con 0x7fec4c003970 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c00c0e0 con 0x7fec4c0051d0 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c00c2a0 con 0x7fec4c0047c0 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6be00640 1 -- 172.21.15.73:0/3967220685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4c003970 msgr2=0x7fec4c003d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6be00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4c003970 0x7fec4c003d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec6b400640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0047c0 0x7fec4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.817+0000 7fec70a00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c0051d0 0x7fec4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.818+0000 7fec70a00640 1 -- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0047c0 msgr2=0x7fec4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.818+0000 7fec70a00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0047c0 0x7fec4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.818+0000 7fec70a00640 1 -- 172.21.15.73:0/3967220685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4c003970 msgr2=0x7fec4c003d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.818+0000 7fec70a00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4c003970 0x7fec4c003d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.818+0000 7fec70a00640 1 -- 172.21.15.73:0/3967220685 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c003520 con 0x7fec4c0051d0 2024-03-23T06:10:56.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.819+0000 7fec70a00640 1 -- 172.21.15.73:0/3967220685 reap_dead start 2024-03-23T06:10:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.819+0000 7fec70a00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c0051d0 0x7fec4c00b980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec64009930 tx=0x7fec4c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad88dfe13457664 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.819+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64003b80 con 0x7fec4c0051d0 2024-03-23T06:10:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.819+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6402e070 con 0x7fec4c0051d0 2024-03-23T06:10:56.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.819+0000 7fec6aa00640 1 -- 172.21.15.73:0/3967220685 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64005070 con 0x7fec4c0051d0 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.820+0000 7fec72a00640 1 -- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c0051d0 msgr2=0x7fec4c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.820+0000 7fec72a00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c0051d0 0x7fec4c00b980 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec64009930 tx=0x7fec4c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.820+0000 7fec72a00640 1 -- 172.21.15.73:0/3967220685 shutdown_connections 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.820+0000 7fec72a00640 1 --2- 172.21.15.73:0/3967220685 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec4c0051d0 0x7fec4c00b980 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.820+0000 7fec72a00640 1 -- 172.21.15.73:0/3967220685 >> 172.21.15.73:0/3967220685 conn(0x7fec6c06bb40 msgr2=0x7fec6c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.820+0000 7fec72a00640 1 -- 172.21.15.73:0/3967220685 shutdown_connections 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.820+0000 7fec72a00640 1 -- 172.21.15.73:0/3967220685 wait complete. 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.822+0000 7fec72a00640 1 Processor -- start 2024-03-23T06:10:56.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.822+0000 7fec72a00640 1 -- start start 2024-03-23T06:10:56.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec72a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0051d0 0x7fec6c1f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec72a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c0c5a60 0x7fec6c14f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec72a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec6c14f730 0x7fec6c0c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec72a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0c6eb0 con 0x7fec6c0c5a60 2024-03-23T06:10:56.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec72a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c14ed60 con 0x7fec6c14f730 2024-03-23T06:10:56.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec72a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c1f2e60 con 0x7fec4c0051d0 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6b400640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c0c5a60 msgr2=0x7fec6c14f1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c0c5a60 0x7fec6c14f1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0051d0 0x7fec6c1f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0051d0 0x7fec6c1f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:57424/0 (socket says 172.21.15.73:57424) 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6be00640 1 -- 172.21.15.73:0/3380451925 learned_addr learned my addr 172.21.15.73:0/3380451925 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec70a00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec6c14f730 0x7fec6c0c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6be00640 1 -- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec6c14f730 msgr2=0x7fec6c0c3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6be00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec6c14f730 0x7fec6c0c3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6be00640 1 -- 172.21.15.73:0/3380451925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c0c5a60 msgr2=0x7fec6c14f1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6be00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c0c5a60 0x7fec6c14f1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.823+0000 7fec6be00640 1 -- 172.21.15.73:0/3380451925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c14fbb0 con 0x7fec4c0051d0 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.824+0000 7fec6be00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0051d0 0x7fec6c1f2920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00b570 tx=0x7fec5c00ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.824+0000 7fec63e00640 1 -- 172.21.15.73:0/3380451925 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c003e10 con 0x7fec4c0051d0 2024-03-23T06:10:56.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.824+0000 7fec63e00640 1 -- 172.21.15.73:0/3380451925 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c005070 con 0x7fec4c0051d0 2024-03-23T06:10:56.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.824+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c0c7510 con 0x7fec4c0051d0 2024-03-23T06:10:56.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.824+0000 7fec63e00640 1 -- 172.21.15.73:0/3380451925 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c005420 con 0x7fec4c0051d0 2024-03-23T06:10:56.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.824+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c0c7ab0 con 0x7fec4c0051d0 2024-03-23T06:10:56.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.825+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c0c1780 con 0x7fec4c0051d0 2024-03-23T06:10:56.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.826+0000 7fec63e00640 1 -- 172.21.15.73:0/3380451925 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fec5c005580 con 0x7fec4c0051d0 2024-03-23T06:10:56.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.827+0000 7fec63e00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806abb0 0x7fec4806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:10:56.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.827+0000 7fec63e00640 1 -- 172.21.15.73:0/3380451925 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fec5c089950 con 0x7fec4c0051d0 2024-03-23T06:10:56.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.827+0000 7fec6b400640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806abb0 0x7fec4806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:10:56.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.828+0000 7fec6b400640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806abb0 0x7fec4806d070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fec540013d0 tx=0x7fec54001360 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:10:56.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:56.830+0000 7fec63e00640 1 -- 172.21.15.73:0/3380451925 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fec5c0548f0 con 0x7fec4c0051d0 2024-03-23T06:10:57.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.098+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fec6c04e110 con 0x7fec4c0051d0 2024-03-23T06:10:57.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.100+0000 7fec63e00640 1 -- 172.21.15.73:0/3380451925 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7fec5c013620 con 0x7fec4c0051d0 2024-03-23T06:10:57.099 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":82,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:10:57.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806abb0 msgr2=0x7fec4806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806abb0 0x7fec4806d070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fec540013d0 tx=0x7fec54001360 comp rx=0 tx=0).stop 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0051d0 msgr2=0x7fec6c1f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0051d0 0x7fec6c1f2920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00b570 tx=0x7fec5c00ba30 comp rx=0 tx=0).stop 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 shutdown_connections 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec6c14f730 0x7fec6c0c3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec6c0c5a60 0x7fec6c14f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806abb0 0x7fec4806d070 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 --2- 172.21.15.73:0/3380451925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec4c0051d0 0x7fec6c1f2920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 >> 172.21.15.73:0/3380451925 conn(0x7fec6c06bb40 msgr2=0x7fec6c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 shutdown_connections 2024-03-23T06:10:57.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:10:57.102+0000 7fec72a00640 1 -- 172.21.15.73:0/3380451925 wait complete. 2024-03-23T06:11:00.122 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:00.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.339+0000 7f1b83400640 1 Processor -- start 2024-03-23T06:11:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.340+0000 7f1b83400640 1 -- start start 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.341+0000 7f1b83400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b7c14fbb0 0x7f1b7c06d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.341+0000 7f1b83400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b7c06f9b0 0x7f1b7c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.341+0000 7f1b83400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7c06fea0 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.341+0000 7f1b83400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c06e300 con 0x7f1b7c06f9b0 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.341+0000 7f1b83400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c0715d0 con 0x7f1b7c14fbb0 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.341+0000 7f1b73e00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f1b7c0c65a0 legacy=0x7f1b7c159350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.341+0000 7f1b81400640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f1b7c06f9b0 msgr2=0x7f1b7c06d5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.341+0000 7f1b81400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b7c06f9b0 0x7f1b7c06d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.342+0000 7f1b80a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b7c14fbb0 0x7f1b7c06d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.342+0000 7f1b80a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b7c14fbb0 0x7f1b7c06d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:42850/0 (socket says 172.21.15.73:42850) 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.342+0000 7f1b80a00640 1 -- 172.21.15.73:0/3397480911 learned_addr learned my addr 172.21.15.73:0/3397480911 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:00.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.342+0000 7f1b80a00640 1 -- 172.21.15.73:0/3397480911 >> v2:172.21.15.73:3300/0 conn(0x7f1b7c06f9b0 msgr2=0x7f1b7c06d5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.342+0000 7f1b80a00640 1 --2- 172.21.15.73:0/3397480911 >> v2:172.21.15.73:3300/0 conn(0x7f1b7c06f9b0 0x7f1b7c06d5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.342+0000 7f1b80a00640 1 -- 172.21.15.73:0/3397480911 >> v1:172.21.15.73:6789/0 conn(0x7f1b7c0c65a0 legacy=0x7f1b7c159350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.342+0000 7f1b80a00640 1 -- 172.21.15.73:0/3397480911 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c0718b0 con 0x7f1b7c14fbb0 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.343+0000 7f1b80a00640 1 --2- 172.21.15.73:0/3397480911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 0x7f1b7c06d090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0cbb10 tx=0x7f1b6402b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec44f9f79806310 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.343+0000 7f1b7be00640 1 -- 172.21.15.73:0/3397480911 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64031890 con 0x7f1b7c14fbb0 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.343+0000 7f1b7be00640 1 -- 172.21.15.73:0/3397480911 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b640319f0 con 0x7f1b7c14fbb0 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.343+0000 7f1b7be00640 1 -- 172.21.15.73:0/3397480911 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64031d80 con 0x7f1b7c14fbb0 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.344+0000 7f1b83400640 1 -- 172.21.15.73:0/3397480911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 msgr2=0x7f1b7c06d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.344+0000 7f1b83400640 1 --2- 172.21.15.73:0/3397480911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 0x7f1b7c06d090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0cbb10 tx=0x7f1b6402b930 comp rx=0 tx=0).stop 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.344+0000 7f1b83400640 1 -- 172.21.15.73:0/3397480911 shutdown_connections 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.344+0000 7f1b83400640 1 --2- 172.21.15.73:0/3397480911 >> v2:172.21.15.73:3300/0 conn(0x7f1b7c06f9b0 0x7f1b7c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.344+0000 7f1b83400640 1 --2- 172.21.15.73:0/3397480911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 0x7f1b7c06d090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.344+0000 7f1b83400640 1 -- 172.21.15.73:0/3397480911 >> 172.21.15.73:0/3397480911 conn(0x7f1b7c06bb40 msgr2=0x7f1b7c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:00.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.344+0000 7f1b83400640 1 -- 172.21.15.73:0/3397480911 shutdown_connections 2024-03-23T06:11:00.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.344+0000 7f1b83400640 1 -- 172.21.15.73:0/3397480911 wait complete. 2024-03-23T06:11:00.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.346+0000 7f1b83400640 1 Processor -- start 2024-03-23T06:11:00.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.346+0000 7f1b83400640 1 -- start start 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b83400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b7c06f9b0 0x7f1b7c155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b83400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c0c65a0 0x7f1b7c0c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b83400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 0x7f1b7c154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b83400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c1566b0 con 0x7f1b7c06f9b0 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b83400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c155c40 con 0x7f1b7c14fbb0 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b83400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0c8a00 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b80a00640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b7c06f9b0 msgr2=0x7f1b7c155700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b80a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b7c06f9b0 0x7f1b7c155700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b73e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c0c65a0 0x7f1b7c0c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b73e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c0c65a0 0x7f1b7c0c0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55794/0 (socket says 172.21.15.73:55794) 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b81400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 0x7f1b7c154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b73e00640 1 -- 172.21.15.73:0/1828747232 learned_addr learned my addr 172.21.15.73:0/1828747232 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b73e00640 1 -- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 msgr2=0x7f1b7c154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b73e00640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 0x7f1b7c154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b73e00640 1 -- 172.21.15.73:0/1828747232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b7c06f9b0 msgr2=0x7f1b7c155700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b73e00640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b7c06f9b0 0x7f1b7c155700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.347+0000 7f1b73e00640 1 -- 172.21.15.73:0/1828747232 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640094d0 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.348+0000 7f1b73e00640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c0c65a0 0x7f1b7c0c0a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00b580 tx=0x7f1b6c00ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.348+0000 7f1b79600640 1 -- 172.21.15.73:0/1828747232 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c003dc0 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.348+0000 7f1b79600640 1 -- 172.21.15.73:0/1828747232 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c005070 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.348+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c0cada0 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.348+0000 7f1b79600640 1 -- 172.21.15.73:0/1828747232 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c005420 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.348+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c1537a0 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.349+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c04e110 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.350+0000 7f1b79600640 1 -- 172.21.15.73:0/1828747232 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1b6c005580 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.351+0000 7f1b79600640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b5806abb0 0x7f1b5806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.351+0000 7f1b79600640 1 -- 172.21.15.73:0/1828747232 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1b6c089680 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.351+0000 7f1b80a00640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b5806abb0 0x7f1b5806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:00.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.352+0000 7f1b80a00640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b5806abb0 0x7f1b5806d070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1b64036000 tx=0x7f1b6403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.356+0000 7f1b79600640 1 -- 172.21.15.73:0/1828747232 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1b6c054450 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.618+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1b7c0c6d30 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.619+0000 7f1b79600640 1 -- 172.21.15.73:0/1828747232 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f1b6c05ce60 con 0x7f1b7c0c65a0 2024-03-23T06:11:00.619 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":86,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.621+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b5806abb0 msgr2=0x7f1b5806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.621+0000 7f1b83400640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b5806abb0 0x7f1b5806d070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1b64036000 tx=0x7f1b6403c040 comp rx=0 tx=0).stop 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.621+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c0c65a0 msgr2=0x7f1b7c0c0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.621+0000 7f1b83400640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c0c65a0 0x7f1b7c0c0a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00b580 tx=0x7f1b6c00ba40 comp rx=0 tx=0).stop 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.622+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 shutdown_connections 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.622+0000 7f1b83400640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b7c14fbb0 0x7f1b7c154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.622+0000 7f1b83400640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b5806abb0 0x7f1b5806d070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.622+0000 7f1b83400640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b7c0c65a0 0x7f1b7c0c0a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.622+0000 7f1b83400640 1 --2- 172.21.15.73:0/1828747232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b7c06f9b0 0x7f1b7c155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.622+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 >> 172.21.15.73:0/1828747232 conn(0x7f1b7c06bb40 msgr2=0x7f1b7c14be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:00.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.622+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 shutdown_connections 2024-03-23T06:11:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:00.622+0000 7f1b83400640 1 -- 172.21.15.73:0/1828747232 wait complete. 2024-03-23T06:11:03.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.831+0000 7ff80e800640 1 Processor -- start 2024-03-23T06:11:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.831+0000 7ff80e800640 1 -- start start 2024-03-23T06:11:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.832+0000 7ff80e800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff8080caed0 0x7ff8080cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.832+0000 7ff80e800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8080ca330 con 0x7ff8080ced20 2024-03-23T06:11:03.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.832+0000 7ff80e800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8080cbab0 con 0x7ff8080cf100 2024-03-23T06:11:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.832+0000 7ff80e800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8080cb8d0 con 0x7ff8080caed0 2024-03-23T06:11:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.832+0000 7ff80d400640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7ff8080ced20 legacy=0x7ff8080ca7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:11:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.833+0000 7ff80ca00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff8080cf100 0x7ff808153150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:40688/0 (socket says 172.21.15.73:40688) 2024-03-23T06:11:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.833+0000 7ff80ca00640 1 -- 172.21.15.73:0/598048022 learned_addr learned my addr 172.21.15.73:0/598048022 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.833+0000 7ff80de00640 1 --2- 172.21.15.73:0/598048022 >> v2:172.21.15.110:3300/0 conn(0x7ff8080caed0 0x7ff8080cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.833+0000 7ff80de00640 1 -- 172.21.15.73:0/598048022 >> v1:172.21.15.110:6789/0 conn(0x7ff8080cf100 legacy=0x7ff808153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.833+0000 7ff80de00640 1 -- 172.21.15.73:0/598048022 >> v1:172.21.15.73:6789/0 conn(0x7ff8080ced20 legacy=0x7ff8080ca7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:03.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.833+0000 7ff80de00640 1 -- 172.21.15.73:0/598048022 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8080cbd90 con 0x7ff8080caed0 2024-03-23T06:11:03.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.834+0000 7ff80de00640 1 --2- 172.21.15.73:0/598048022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080caed0 0x7ff8080cb390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff800009d90 tx=0x7ff80002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae211a94c62e6c3a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:03.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.835+0000 7ff807e00640 1 -- 172.21.15.73:0/598048022 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80002cd00 con 0x7ff8080caed0 2024-03-23T06:11:03.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.835+0000 7ff807e00640 1 -- 172.21.15.73:0/598048022 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80002ce60 con 0x7ff8080caed0 2024-03-23T06:11:03.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.835+0000 7ff807e00640 1 -- 172.21.15.73:0/598048022 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800034660 con 0x7ff8080caed0 2024-03-23T06:11:03.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.835+0000 7ff80e800640 1 -- 172.21.15.73:0/598048022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080caed0 msgr2=0x7ff8080cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:03.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.835+0000 7ff80e800640 1 --2- 172.21.15.73:0/598048022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080caed0 0x7ff8080cb390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff800009d90 tx=0x7ff80002bf50 comp rx=0 tx=0).stop 2024-03-23T06:11:03.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.836+0000 7ff80e800640 1 -- 172.21.15.73:0/598048022 shutdown_connections 2024-03-23T06:11:03.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.836+0000 7ff80e800640 1 --2- 172.21.15.73:0/598048022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080caed0 0x7ff8080cb390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:03.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.836+0000 7ff80e800640 1 -- 172.21.15.73:0/598048022 >> 172.21.15.73:0/598048022 conn(0x7ff8080713e0 msgr2=0x7ff8080717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:03.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.836+0000 7ff80e800640 1 -- 172.21.15.73:0/598048022 shutdown_connections 2024-03-23T06:11:03.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.836+0000 7ff80e800640 1 -- 172.21.15.73:0/598048022 wait complete. 2024-03-23T06:11:03.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.837+0000 7ff80e800640 1 Processor -- start 2024-03-23T06:11:03.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.837+0000 7ff80e800640 1 -- start start 2024-03-23T06:11:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.838+0000 7ff80e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8080caed0 0x7ff8081efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.838+0000 7ff80e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080ced20 0x7ff8080c19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.838+0000 7ff80e800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8080cf100 0x7ff8080c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.838+0000 7ff80e800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8080c2420 con 0x7ff8080caed0 2024-03-23T06:11:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.838+0000 7ff80e800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff808156610 con 0x7ff8080ced20 2024-03-23T06:11:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.838+0000 7ff80e800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff808154800 con 0x7ff8080cf100 2024-03-23T06:11:03.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.838+0000 7ff80d400640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8080caed0 msgr2=0x7ff8081efcd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.838+0000 7ff80d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8080caed0 0x7ff8081efcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8080cf100 0x7ff8080c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080ced20 0x7ff8080c19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8080cf100 0x7ff8080c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55808/0 (socket says 172.21.15.73:55808) 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80de00640 1 -- 172.21.15.73:0/3378820091 learned_addr learned my addr 172.21.15.73:0/3378820091 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80ca00640 1 -- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8080cf100 msgr2=0x7ff8080c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80ca00640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8080cf100 0x7ff8080c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80ca00640 1 -- 172.21.15.73:0/3378820091 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8080caed0 msgr2=0x7ff8081efcd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80ca00640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8080caed0 0x7ff8081efcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80ca00640 1 -- 172.21.15.73:0/3378820091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800009a70 con 0x7ff8080ced20 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.839+0000 7ff80de00640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8080cf100 0x7ff8080c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:03.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.840+0000 7ff80ca00640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080ced20 0x7ff8080c19a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c410 tx=0x7ff7f400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.840+0000 7ff805600640 1 -- 172.21.15.73:0/3378820091 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4005ce0 con 0x7ff8080ced20 2024-03-23T06:11:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.840+0000 7ff805600640 1 -- 172.21.15.73:0/3378820091 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f4005e40 con 0x7ff8080ced20 2024-03-23T06:11:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.840+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff808154ae0 con 0x7ff8080ced20 2024-03-23T06:11:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.840+0000 7ff805600640 1 -- 172.21.15.73:0/3378820091 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40072d0 con 0x7ff8080ced20 2024-03-23T06:11:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.840+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff808155e10 con 0x7ff8080ced20 2024-03-23T06:11:03.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.841+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80804e030 con 0x7ff8080ced20 2024-03-23T06:11:03.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.842+0000 7ff805600640 1 -- 172.21.15.73:0/3378820091 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff7f4007430 con 0x7ff8080ced20 2024-03-23T06:11:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.843+0000 7ff805600640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7e806abb0 0x7ff7e806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.843+0000 7ff805600640 1 -- 172.21.15.73:0/3378820091 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff7f4088be0 con 0x7ff8080ced20 2024-03-23T06:11:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.843+0000 7ff80d400640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7e806abb0 0x7ff7e806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:03.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.844+0000 7ff80d400640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7e806abb0 0x7ff7e806d070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006fd0 tx=0x7ff7fc006d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:03.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:03.848+0000 7ff805600640 1 -- 172.21.15.73:0/3378820091 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff7f4053950 con 0x7ff8080ced20 2024-03-23T06:11:04.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.134+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff8080c9c00 con 0x7ff8080ced20 2024-03-23T06:11:04.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.135+0000 7ff805600640 1 -- 172.21.15.73:0/3378820091 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7ff7f4017620 con 0x7ff8080ced20 2024-03-23T06:11:04.135 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":89,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:11:04.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7e806abb0 msgr2=0x7ff7e806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:04.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7e806abb0 0x7ff7e806d070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc006fd0 tx=0x7ff7fc006d80 comp rx=0 tx=0).stop 2024-03-23T06:11:04.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080ced20 msgr2=0x7ff8080c19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:04.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080ced20 0x7ff8080c19a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c410 tx=0x7ff7f400c8d0 comp rx=0 tx=0).stop 2024-03-23T06:11:04.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 shutdown_connections 2024-03-23T06:11:04.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7e806abb0 0x7ff7e806d070 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:04.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8080cf100 0x7ff8080c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:04.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8080ced20 0x7ff8080c19a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:04.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 --2- 172.21.15.73:0/3378820091 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8080caed0 0x7ff8081efcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:04.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 >> 172.21.15.73:0/3378820091 conn(0x7ff8080713e0 msgr2=0x7ff8080c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:04.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 shutdown_connections 2024-03-23T06:11:04.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:04.138+0000 7ff80e800640 1 -- 172.21.15.73:0/3378820091 wait complete. 2024-03-23T06:11:07.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.396+0000 7ff575e00640 1 Processor -- start 2024-03-23T06:11:07.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.396+0000 7ff575e00640 1 -- start start 2024-03-23T06:11:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff575e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:07.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff575e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff575e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57015a370 con 0x7ff5700ca7c0 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff575e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5700cb8d0 con 0x7ff5700ced20 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff575e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700ca330 con 0x7ff5700cf100 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff575400640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7ff5700ca7c0 legacy=0x7ff570153150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff574a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55824/0 (socket says 172.21.15.73:55824) 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 learned_addr learned my addr 172.21.15.73:0/3603627784 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff574a00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:07.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff574a00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:07.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.398+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff575400640 1 -- 172.21.15.73:0/3603627784 >> v1:172.21.15.73:6789/0 conn(0x7ff5700ca7c0 legacy=0x7ff570153150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:11:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:11:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff574a00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:11:07.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:07.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff574a00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:07.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:07.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:07.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:11:07.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:07.599+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.000+0000 7ff575400640 1 -- 172.21.15.73:0/3603627784 >> v1:172.21.15.73:6789/0 conn(0x7ff5700ca7c0 legacy=0x7ff570153150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.000+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.000+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.001+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.001+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.001+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.001+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.001+0000 7ff574a00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.001+0000 7ff574a00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.001+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:08.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.001+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:11:08.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.801+0000 7ff575400640 1 -- 172.21.15.73:0/3603627784 >> v1:172.21.15.73:6789/0 conn(0x7ff5700ca7c0 legacy=0x7ff570153150 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:11:08.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:08.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:08.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff574a00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:11:08.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:11:08.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff574a00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:08.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:08.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:08.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:08.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:11:08.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:08.802+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:11:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56e000640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 msgr2=0x7ff570159e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56e000640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5700cf100 0x7ff570159e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:10.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56e000640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 msgr2=0x7ff5700cb390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56e000640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.110:3300/0 conn(0x7ff5700ced20 0x7ff5700cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56e000640 1 -- 172.21.15.73:0/3603627784 >> v1:172.21.15.73:6789/0 conn(0x7ff5700ca7c0 legacy=0x7ff570153150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56e000640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 0x7ff550009880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56e000640 1 -- 172.21.15.73:0/3603627784 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5700cbab0 con 0x7ff5500036a0 2024-03-23T06:11:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56e000640 1 -- 172.21.15.73:0/3603627784 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5700cb8d0 con 0x7ff5500073c0 2024-03-23T06:11:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 msgr2=0x7ff550009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:10.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.398+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 0x7ff550009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.599+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 msgr2=0x7ff550009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:10.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:10.599+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 0x7ff550009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:11:11.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.000+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 msgr2=0x7ff550009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:11.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.000+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 0x7ff550009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:11:11.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.506+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210291910 0 0) 0x7ff5700cbab0 con 0x7ff5500036a0 2024-03-23T06:11:11.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.506+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff558003520 con 0x7ff5500036a0 2024-03-23T06:11:11.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3742992543 0 0) 0x7ff558003520 con 0x7ff5500036a0 2024-03-23T06:11:11.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 msgr2=0x7ff550009880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:11.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 --2- 172.21.15.73:0/3603627784 >> v2:172.21.15.73:3300/0 conn(0x7ff5500073c0 0x7ff550009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55000afa0 con 0x7ff5500036a0 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7ff56400d580 con 0x7ff5500036a0 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 >> v1:172.21.15.110:6789/0 conn(0x7ff5500036a0 legacy=0x7ff550005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff575400640 1 -- 172.21.15.73:0/3603627784 reap_dead start 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff558003970 0x7ff558003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5580052a0 0x7ff55800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5700cb8d0 con 0x7ff5580047c0 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800c1f0 con 0x7ff5580052a0 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.508+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55800c3b0 con 0x7ff558003970 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff574a00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff558003970 0x7ff558003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff56fe00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 msgr2=0x7ff558004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff575400640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5580052a0 0x7ff55800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:11.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:11.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff575400640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff558003970 msgr2=0x7ff558003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:11.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff575400640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff558003970 0x7ff558003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff575400640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 msgr2=0x7ff558004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:11.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff575400640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.509+0000 7ff575400640 1 -- 172.21.15.73:0/3603627784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558003520 con 0x7ff5580052a0 2024-03-23T06:11:11.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.512+0000 7ff575400640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5580052a0 0x7ff55800b980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff5700cea80 tx=0x7ff5580057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=549fbf7a352a6650 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:11.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.512+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56802cc40 con 0x7ff5580052a0 2024-03-23T06:11:11.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.512+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56802cda0 con 0x7ff5580052a0 2024-03-23T06:11:11.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.512+0000 7ff56f400640 1 -- 172.21.15.73:0/3603627784 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568034650 con 0x7ff5580052a0 2024-03-23T06:11:11.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.513+0000 7ff575e00640 1 -- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5580052a0 msgr2=0x7ff55800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:11.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.513+0000 7ff575e00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5580052a0 0x7ff55800b980 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff5700cea80 tx=0x7ff5580057f0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.514+0000 7ff575e00640 1 -- 172.21.15.73:0/3603627784 shutdown_connections 2024-03-23T06:11:11.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.514+0000 7ff575e00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5580052a0 0x7ff55800b980 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.514+0000 7ff575e00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 0x7ff558004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.514+0000 7ff575e00640 1 --2- 172.21.15.73:0/3603627784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff558003970 0x7ff558003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.514+0000 7ff575e00640 1 -- 172.21.15.73:0/3603627784 >> 172.21.15.73:0/3603627784 conn(0x7ff5700713e0 msgr2=0x7ff5700717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:11.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.514+0000 7ff575e00640 1 -- 172.21.15.73:0/3603627784 shutdown_connections 2024-03-23T06:11:11.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.514+0000 7ff575e00640 1 -- 172.21.15.73:0/3603627784 wait complete. 2024-03-23T06:11:11.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.517+0000 7ff575e00640 1 Processor -- start 2024-03-23T06:11:11.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.517+0000 7ff575e00640 1 -- start start 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.518+0000 7ff575e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff558003970 0x7ff5701f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff575e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 0x7ff5701ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff575e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5580052a0 0x7ff5701ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff575e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff570154730 con 0x7ff5580047c0 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff575e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5701f20b0 con 0x7ff558003970 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff575e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff570154980 con 0x7ff5580052a0 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff56fe00640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 msgr2=0x7ff5701ebdf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff56fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 0x7ff5701ebdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff574a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff558003970 0x7ff5701f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff574a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff558003970 0x7ff5701f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:34740/0 (socket says 172.21.15.73:34740) 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff574a00640 1 -- 172.21.15.73:0/3673503683 learned_addr learned my addr 172.21.15.73:0/3673503683 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff575400640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5580052a0 0x7ff5701ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:11.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff574a00640 1 -- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5580052a0 msgr2=0x7ff5701ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff574a00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5580052a0 0x7ff5701ec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff574a00640 1 -- 172.21.15.73:0/3673503683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 msgr2=0x7ff5701ebdf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff574a00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 0x7ff5701ebdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff574a00640 1 -- 172.21.15.73:0/3673503683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570154c60 con 0x7ff558003970 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.519+0000 7ff575400640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5580052a0 0x7ff5701ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.520+0000 7ff574a00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff558003970 0x7ff5701f15f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff5640169f0 tx=0x7ff564016eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.520+0000 7ff56cc00640 1 -- 172.21.15.73:0/3673503683 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564014990 con 0x7ff558003970 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.520+0000 7ff56cc00640 1 -- 172.21.15.73:0/3673503683 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56401b070 con 0x7ff558003970 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.520+0000 7ff56cc00640 1 -- 172.21.15.73:0/3673503683 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564014d50 con 0x7ff558003970 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.520+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff570154f40 con 0x7ff558003970 2024-03-23T06:11:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.520+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff570156770 con 0x7ff558003970 2024-03-23T06:11:11.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.521+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5700c9f80 con 0x7ff558003970 2024-03-23T06:11:11.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.522+0000 7ff56cc00640 1 -- 172.21.15.73:0/3673503683 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff56401d030 con 0x7ff558003970 2024-03-23T06:11:11.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.523+0000 7ff56cc00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff55006b300 0x7ff55006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:11.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.524+0000 7ff56cc00640 1 -- 172.21.15.73:0/3673503683 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff56408a530 con 0x7ff558003970 2024-03-23T06:11:11.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.524+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff55006b300 0x7ff55006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:11.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.524+0000 7ff56fe00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff55006b300 0x7ff55006d7c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5701514c0 tx=0x7ff55c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:11.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.528+0000 7ff56cc00640 1 -- 172.21.15.73:0/3673503683 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff564055300 con 0x7ff558003970 2024-03-23T06:11:11.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.802+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff57004e030 con 0x7ff558003970 2024-03-23T06:11:11.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.802+0000 7ff56cc00640 1 -- 172.21.15.73:0/3673503683 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7ff564058920 con 0x7ff558003970 2024-03-23T06:11:11.802 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":6,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:11:11.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff55006b300 msgr2=0x7ff55006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:11.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff55006b300 0x7ff55006d7c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff5701514c0 tx=0x7ff55c008040 comp rx=0 tx=0).stop 2024-03-23T06:11:11.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff558003970 msgr2=0x7ff5701f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:11.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff558003970 0x7ff5701f15f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff5640169f0 tx=0x7ff564016eb0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 shutdown_connections 2024-03-23T06:11:11.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff55006b300 0x7ff55006d7c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5580052a0 0x7ff5701ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5580047c0 0x7ff5701ebdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 --2- 172.21.15.73:0/3673503683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff558003970 0x7ff5701f15f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:11.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 >> 172.21.15.73:0/3673503683 conn(0x7ff5700713e0 msgr2=0x7ff5700cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:11.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 shutdown_connections 2024-03-23T06:11:11.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:11.805+0000 7ff575e00640 1 -- 172.21.15.73:0/3673503683 wait complete. 2024-03-23T06:11:11.824 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:11:11.824 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T06:11:11.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:11:12.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.023+0000 7f01f1e00640 1 Processor -- start 2024-03-23T06:11:12.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.023+0000 7f01f1e00640 1 -- start start 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.024+0000 7f01f1e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f01ec0b2970 0x7f01ec153040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01f1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0c9b70 0x7f01ec153580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01f1e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec06a960 con 0x7f01ec0c9790 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01f1e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec06adf0 con 0x7f01ec0b2970 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01f1e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1596d0 con 0x7f01ec0c9b70 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01ebe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f01ec0b2970 0x7f01ec153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01f1400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0c9b70 0x7f01ec153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01f0a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f01ec0c9790 0x7f01ec0b2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:37308/0 (socket says 172.21.15.73:37308) 2024-03-23T06:11:12.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01f0a00640 1 -- 172.21.15.73:0/2246327074 learned_addr learned my addr 172.21.15.73:0/2246327074 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:12.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01eb400640 1 -- 172.21.15.73:0/2246327074 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670103021 0 0) 0x7f01ec06a960 con 0x7f01ec0c9790 2024-03-23T06:11:12.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01eb400640 1 -- 172.21.15.73:0/2246327074 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d4003520 con 0x7f01ec0c9790 2024-03-23T06:11:12.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01ebe00640 1 -- 172.21.15.73:0/2246327074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0c9b70 msgr2=0x7f01ec153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:12.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01ebe00640 1 --2- 172.21.15.73:0/2246327074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0c9b70 0x7f01ec153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.025+0000 7f01ebe00640 1 -- 172.21.15.73:0/2246327074 >> v1:172.21.15.110:6789/0 conn(0x7f01ec0c9790 legacy=0x7f01ec0b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.026+0000 7f01ebe00640 1 -- 172.21.15.73:0/2246327074 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec15d820 con 0x7f01ec0b2970 2024-03-23T06:11:12.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.026+0000 7f01f1400640 1 --2- 172.21.15.73:0/2246327074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0c9b70 0x7f01ec153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:12.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.027+0000 7f01ebe00640 1 --2- 172.21.15.73:0/2246327074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0b2970 0x7f01ec153040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f01d80097d0 tx=0x7f01d802b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51655696629b6518 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.027+0000 7f01eb400640 1 -- 172.21.15.73:0/2246327074 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8031890 con 0x7f01ec0b2970 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.027+0000 7f01eb400640 1 -- 172.21.15.73:0/2246327074 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80319f0 con 0x7f01ec0b2970 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.027+0000 7f01eb400640 1 -- 172.21.15.73:0/2246327074 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8031d60 con 0x7f01ec0b2970 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.028+0000 7f01f1e00640 1 -- 172.21.15.73:0/2246327074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0b2970 msgr2=0x7f01ec153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.028+0000 7f01f1e00640 1 --2- 172.21.15.73:0/2246327074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0b2970 0x7f01ec153040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f01d80097d0 tx=0x7f01d802b930 comp rx=0 tx=0).stop 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.028+0000 7f01f1e00640 1 -- 172.21.15.73:0/2246327074 shutdown_connections 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.028+0000 7f01f1e00640 1 --2- 172.21.15.73:0/2246327074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0c9b70 0x7f01ec153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.028+0000 7f01f1e00640 1 --2- 172.21.15.73:0/2246327074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0b2970 0x7f01ec153040 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.028+0000 7f01f1e00640 1 -- 172.21.15.73:0/2246327074 >> 172.21.15.73:0/2246327074 conn(0x7f01ec071d40 msgr2=0x7f01ec06bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.028+0000 7f01f1e00640 1 -- 172.21.15.73:0/2246327074 shutdown_connections 2024-03-23T06:11:12.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.028+0000 7f01f1e00640 1 -- 172.21.15.73:0/2246327074 wait complete. 2024-03-23T06:11:12.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.031+0000 7f01f1e00640 1 Processor -- start 2024-03-23T06:11:12.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.031+0000 7f01f1e00640 1 -- start start 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.032+0000 7f01f1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0b2970 0x7f01ec15be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.032+0000 7f01f1e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01ec0c9790 0x7f01ec0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.032+0000 7f01f1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0c9b70 0x7f01ec1f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.032+0000 7f01f1e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec15a540 con 0x7f01ec0c9790 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.032+0000 7f01f1e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0cb390 con 0x7f01ec0c9b70 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.032+0000 7f01f1e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1ef500 con 0x7f01ec0b2970 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01ebe00640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01ec0c9790 msgr2=0x7f01ec0ca990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01ebe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01ec0c9790 0x7f01ec0ca990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:12.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f0a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0b2970 0x7f01ec15be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0c9b70 0x7f01ec1f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f0a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0b2970 0x7f01ec15be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49004/0 (socket says 172.21.15.73:49004) 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f0a00640 1 -- 172.21.15.73:0/1990119784 learned_addr learned my addr 172.21.15.73:0/1990119784 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f0a00640 1 -- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0c9b70 msgr2=0x7f01ec1f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f0a00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0c9b70 0x7f01ec1f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f0a00640 1 -- 172.21.15.73:0/1990119784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01ec0c9790 msgr2=0x7f01ec0ca990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f0a00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01ec0c9790 0x7f01ec0ca990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f0a00640 1 -- 172.21.15.73:0/1990119784 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009a70 con 0x7f01ec0b2970 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.033+0000 7f01f1400640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec0c9b70 0x7f01ec1f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.034+0000 7f01f0a00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0b2970 0x7f01ec15be60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c530 tx=0x7f01e000c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.034+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0005ce0 con 0x7f01ec0b2970 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.034+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e0005e40 con 0x7f01ec0b2970 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.034+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d8009400 con 0x7f01ec0b2970 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.034+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0007290 con 0x7f01ec0b2970 2024-03-23T06:11:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.034+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec1eec60 con 0x7f01ec0b2970 2024-03-23T06:11:12.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.035+0000 7f01f1e00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f26b0 0x7f01ec1eef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.035+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0c8eb0 con 0x7f01ec1f26b0 2024-03-23T06:11:12.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.035+0000 7f01ebe00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f26b0 0x7f01ec1eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.036+0000 7f01ebe00640 1 -- 172.21.15.73:0/1990119784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01ec06a310 con 0x7f01ec1f26b0 2024-03-23T06:11:12.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.036+0000 7f01ebe00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f26b0 0x7f01ec1eef40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c5050 tx=0x7f01d80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.036+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f01e00073f0 con 0x7f01ec0b2970 2024-03-23T06:11:12.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01e8c00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f01cc06abb0 0x7f01cc06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f01e0088cc0 con 0x7f01ec0b2970 2024-03-23T06:11:12.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d803cbf0 con 0x7f01ec1f26b0 2024-03-23T06:11:12.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f01d8006e10 con 0x7f01ec1f26b0 2024-03-23T06:11:12.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f26b0 msgr2=0x7f01ec1eef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01e8c00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f26b0 0x7f01ec1eef40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c5050 tx=0x7f01d80046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f26b0 msgr2=0x7f01ec1eef40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:12.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01e8c00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f26b0 0x7f01ec1eef40 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0c5050 tx=0x7f01d80046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.037+0000 7f01f1400640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f01cc06abb0 0x7f01cc06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.038+0000 7f01f1400640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f01cc06abb0 0x7f01cc06d070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0b21c0 tx=0x7f01e400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.044+0000 7f01f1e00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f1b00 0x7f01ec1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.044+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0723f0 con 0x7f01ec1f1b00 2024-03-23T06:11:12.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.044+0000 7f01ebe00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f1b00 0x7f01ec1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.045+0000 7f01ebe00640 1 -- 172.21.15.73:0/1990119784 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f01ec06a030 con 0x7f01ec1f1b00 2024-03-23T06:11:12.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.045+0000 7f01ebe00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f1b00 0x7f01ec1578a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000c00 tx=0x7f01d8009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.045+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8003b10 con 0x7f01ec1f1b00 2024-03-23T06:11:12.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.045+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7f01d8003c70 con 0x7f01ec1f1b00 2024-03-23T06:11:12.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.045+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f1b00 msgr2=0x7f01ec1578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.045+0000 7f01e8c00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f1b00 0x7f01ec1578a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000c00 tx=0x7f01d8009190 comp rx=0 tx=0).stop 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.045+0000 7f01e8c00640 1 -- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f1b00 msgr2=0x7f01ec1578a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.045+0000 7f01e8c00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01ec1f1b00 0x7f01ec1578a0 secure :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000c00 tx=0x7f01d8009190 comp rx=0 tx=0).stop 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 6, 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:11:12.046 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:12.047 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:12.048 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:12.049 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:12.050 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:12.051 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:12.052 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.053 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:12.054 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.055 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.056 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.057 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.058 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.059 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.059 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:11:12.059 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.059 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.059 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:11:12.059 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:11:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f01cc06abb0 msgr2=0x7f01cc06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1e00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f01cc06abb0 0x7f01cc06d070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0b21c0 tx=0x7f01e400b040 comp rx=0 tx=0).stop 2024-03-23T06:11:12.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0b2970 msgr2=0x7f01ec15be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1e00640 1 --2- 172.21.15.73:0/1990119784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01ec0b2970 0x7f01ec15be60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c530 tx=0x7f01e000c930 comp rx=0 tx=0).stop 2024-03-23T06:11:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1400640 1 -- 172.21.15.73:0/1990119784 reap_dead start 2024-03-23T06:11:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1400640 1 -- 172.21.15.73:0/1990119784 reap_dead start 2024-03-23T06:11:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 shutdown_connections 2024-03-23T06:11:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 >> 172.21.15.73:0/1990119784 conn(0x7f01ec071d40 msgr2=0x7f01ec158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 shutdown_connections 2024-03-23T06:11:12.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.046+0000 7f01f1e00640 1 -- 172.21.15.73:0/1990119784 wait complete. 2024-03-23T06:11:12.061 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:11:12.061 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T06:11:12.061 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:11:12.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.251+0000 7feaefc00640 1 Processor -- start 2024-03-23T06:11:12.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.251+0000 7feaefc00640 1 -- start start 2024-03-23T06:11:12.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feaefc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8159420 0x7feae80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feaefc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feae80ca940 0x7feae80cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feaefc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80c9c80 con 0x7feae8153760 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feaefc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae8159860 con 0x7feae80ca940 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feaefc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80cb310 con 0x7feae8159420 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feae7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8159420 0x7feae80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feaedc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feae80ca940 0x7feae80cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feae7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8159420 0x7feae80c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49012/0 (socket says 172.21.15.73:49012) 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feae7e00640 1 -- 172.21.15.73:0/666175336 learned_addr learned my addr 172.21.15.73:0/666175336 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.253+0000 7feaed200640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7feae8153760 0x7feae80cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:37318/0 (socket says 172.21.15.73:37318) 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.254+0000 7feae7e00640 1 -- 172.21.15.73:0/666175336 >> v2:172.21.15.110:3300/0 conn(0x7feae80ca940 msgr2=0x7feae80cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.254+0000 7feae7e00640 1 --2- 172.21.15.73:0/666175336 >> v2:172.21.15.110:3300/0 conn(0x7feae80ca940 0x7feae80cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.254+0000 7feae7e00640 1 -- 172.21.15.73:0/666175336 >> v1:172.21.15.110:6789/0 conn(0x7feae8153760 legacy=0x7feae80cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.254+0000 7feae7e00640 1 -- 172.21.15.73:0/666175336 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae806a2d0 con 0x7feae8159420 2024-03-23T06:11:12.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.254+0000 7feae7400640 1 -- 172.21.15.73:0/666175336 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152410470 0 0) 0x7feadc001110 con 0x7feae8153760 2024-03-23T06:11:12.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.255+0000 7feae7e00640 1 --2- 172.21.15.73:0/666175336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8159420 0x7feae80c9740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fead4009870 tx=0x7fead402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600bef715efbb46d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.255+0000 7feae7400640 1 -- 172.21.15.73:0/666175336 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4030840 con 0x7feae8159420 2024-03-23T06:11:12.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.255+0000 7feae7400640 1 -- 172.21.15.73:0/666175336 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead40309a0 con 0x7feae8159420 2024-03-23T06:11:12.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.255+0000 7feae7400640 1 -- 172.21.15.73:0/666175336 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4030d30 con 0x7feae8159420 2024-03-23T06:11:12.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.256+0000 7feaefc00640 1 -- 172.21.15.73:0/666175336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8159420 msgr2=0x7feae80c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.256+0000 7feaefc00640 1 --2- 172.21.15.73:0/666175336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8159420 0x7feae80c9740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fead4009870 tx=0x7fead402b980 comp rx=0 tx=0).stop 2024-03-23T06:11:12.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.256+0000 7feaefc00640 1 -- 172.21.15.73:0/666175336 shutdown_connections 2024-03-23T06:11:12.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.256+0000 7feaefc00640 1 --2- 172.21.15.73:0/666175336 >> v2:172.21.15.110:3300/0 conn(0x7feae80ca940 0x7feae80cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.256+0000 7feaefc00640 1 --2- 172.21.15.73:0/666175336 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8159420 0x7feae80c9740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.256+0000 7feaefc00640 1 -- 172.21.15.73:0/666175336 >> 172.21.15.73:0/666175336 conn(0x7feae806c310 msgr2=0x7feae80713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:12.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.256+0000 7feaefc00640 1 -- 172.21.15.73:0/666175336 shutdown_connections 2024-03-23T06:11:12.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.256+0000 7feaefc00640 1 -- 172.21.15.73:0/666175336 wait complete. 2024-03-23T06:11:12.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.258+0000 7feaefc00640 1 Processor -- start 2024-03-23T06:11:12.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.258+0000 7feaefc00640 1 -- start start 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaefc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae80ca940 0x7feae8147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaefc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feae8153760 0x7feae80c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaefc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feae8159420 0x7feae80ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaefc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c7d70 con 0x7feae8159420 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaefc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c6420 con 0x7feae8153760 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaefc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae81490e0 con 0x7feae80ca940 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaedc00640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feae8159420 msgr2=0x7feae80ce0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaedc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feae8159420 0x7feae80ce0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaed200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae80ca940 0x7feae8147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaed200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae80ca940 0x7feae8147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:49028/0 (socket says 172.21.15.73:49028) 2024-03-23T06:11:12.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feae7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feae8153760 0x7feae80c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaed200640 1 -- 172.21.15.73:0/2281883241 learned_addr learned my addr 172.21.15.73:0/2281883241 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaed200640 1 -- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feae8153760 msgr2=0x7feae80c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaed200640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feae8153760 0x7feae80c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaed200640 1 -- 172.21.15.73:0/2281883241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feae8159420 msgr2=0x7feae80ce0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaed200640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feae8159420 0x7feae80ce0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.259+0000 7feaed200640 1 -- 172.21.15.73:0/2281883241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40094d0 con 0x7feae80ca940 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.260+0000 7feaed200640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae80ca940 0x7feae8147190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c780 tx=0x7feadc00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.260+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0072d0 con 0x7feae80ca940 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.260+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc007450 con 0x7feae80ca940 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.260+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0047e0 con 0x7feae80ca940 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.260+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae80c6180 con 0x7feae80ca940 2024-03-23T06:11:12.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.260+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae80c7720 con 0x7feae80ca940 2024-03-23T06:11:12.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.261+0000 7feaefc00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8146b70 0x7feae8143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.261+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae8072510 con 0x7feae8146b70 2024-03-23T06:11:12.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.262+0000 7feae7e00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8146b70 0x7feae8143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.262+0000 7feae7e00640 1 -- 172.21.15.73:0/2281883241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feae806ab70 con 0x7feae8146b70 2024-03-23T06:11:12.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.262+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feadc004960 con 0x7feae80ca940 2024-03-23T06:11:12.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.262+0000 7feae7e00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8146b70 0x7feae8143150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feae80cfe30 tx=0x7fead4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feae4c00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feac806ac00 0x7feac806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7feadc088af0 con 0x7feae80ca940 2024-03-23T06:11:12.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead4049070 con 0x7feae8146b70 2024-03-23T06:11:12.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feaedc00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feac806ac00 0x7feac806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fead403f040 con 0x7feae8146b70 2024-03-23T06:11:12.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8146b70 msgr2=0x7feae8143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feae4c00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8146b70 0x7feae8143150 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feae80cfe30 tx=0x7fead4004730 comp rx=0 tx=0).stop 2024-03-23T06:11:12.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8146b70 msgr2=0x7feae8143150 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:12.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.263+0000 7feae4c00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8146b70 0x7feae8143150 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feae80cfe30 tx=0x7fead4004730 comp rx=0 tx=0).stop 2024-03-23T06:11:12.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.264+0000 7feaedc00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feac806ac00 0x7feac806d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feae80c8ea0 tx=0x7feae000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.270+0000 7feaefc00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8145b20 0x7feae8156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.270+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c7ee0 con 0x7feae8145b20 2024-03-23T06:11:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.270+0000 7feae7e00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8145b20 0x7feae8156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:12.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.271+0000 7feae7e00640 1 -- 172.21.15.73:0/2281883241 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7feae806a890 con 0x7feae8145b20 2024-03-23T06:11:12.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.271+0000 7feae7e00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8145b20 0x7feae8156f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fead4000c00 tx=0x7fead40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:12.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.271+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead403e050 con 0x7feae8145b20 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4793 (secure 0 0 0) 0x7fead4053070 con 0x7feae8145b20 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8145b20 msgr2=0x7feae8156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feae4c00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8145b20 0x7feae8156f30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fead4000c00 tx=0x7fead40046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feae4c00640 1 -- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8145b20 msgr2=0x7feae8156f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feae4c00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae8145b20 0x7feae8156f30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:11:12.272 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 6, 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:12.273 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:12.274 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:12.275 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:12.276 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:12.277 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:12.278 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.279 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.280 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:12.281 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.282 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:12.283 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:12.284 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:12.284 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-03-23T06:11:12.284 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:12.284 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:12.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:12.284 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:11:12.284 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feac806ac00 msgr2=0x7feac806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaefc00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feac806ac00 0x7feac806d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feae80c8ea0 tx=0x7feae000b040 comp rx=0 tx=0).stop 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae80ca940 msgr2=0x7feae8147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaefc00640 1 --2- 172.21.15.73:0/2281883241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feae80ca940 0x7feae8147190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c780 tx=0x7feadc00cc40 comp rx=0 tx=0).stop 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaedc00640 1 -- 172.21.15.73:0/2281883241 reap_dead start 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaedc00640 1 -- 172.21.15.73:0/2281883241 reap_dead start 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 shutdown_connections 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 >> 172.21.15.73:0/2281883241 conn(0x7feae806c310 msgr2=0x7feae80c3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 shutdown_connections 2024-03-23T06:11:12.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:12.272+0000 7feaefc00640 1 -- 172.21.15.73:0/2281883241 wait complete. 2024-03-23T06:11:12.292 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:11:12.293 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:11:25.418 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:11:25.424 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:11:32.293 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T06:11:32.293 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T06:11:32.293 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T06:11:32.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T06:11:32.299 INFO:tasks.ceph.mon.a:Started 2024-03-23T06:11:32.299 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:11:32.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:32.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.509+0000 7f143a600640 1 Processor -- start 2024-03-23T06:11:32.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.509+0000 7f143a600640 1 -- start start 2024-03-23T06:11:32.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.510+0000 7f143a600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14341536a0 0x7f14340ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:32.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.510+0000 7f143a600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340cab20 con 0x7f1434153a80 2024-03-23T06:11:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.510+0000 7f143a600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14341599a0 con 0x7f14341594f0 2024-03-23T06:11:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.510+0000 7f143a600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143415a520 con 0x7f14341536a0 2024-03-23T06:11:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.511+0000 7f1433400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14341536a0 0x7f14340ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.511+0000 7f1432a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1434153a80 0x7f14340cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45510/0 (socket says 172.21.15.73:45510) 2024-03-23T06:11:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.511+0000 7f1432a00640 1 -- 172.21.15.73:0/4145664324 learned_addr learned my addr 172.21.15.73:0/4145664324 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.511+0000 7f1433400640 1 -- 172.21.15.73:0/4145664324 >> v2:172.21.15.73:3300/0 conn(0x7f14341536a0 msgr2=0x7f14340ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:11:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.511+0000 7f1433400640 1 -- 172.21.15.73:0/4145664324 >> v2:172.21.15.73:3300/0 conn(0x7f14341536a0 msgr2=0x7f14340ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:32.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.511+0000 7f1433400640 1 --2- 172.21.15.73:0/4145664324 >> v2:172.21.15.73:3300/0 conn(0x7f14341536a0 0x7f14340ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1433400640 1 --2- 172.21.15.73:0/4145664324 >> v2:172.21.15.73:3300/0 conn(0x7f14341536a0 0x7f14340ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919781757 0 0) 0x7f14341599a0 con 0x7f14341594f0 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1418003520 con 0x7f14341594f0 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 436027125 0 0) 0x7f1418003520 con 0x7f14341594f0 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 >> v2:172.21.15.73:3300/0 conn(0x7f14341536a0 msgr2=0x7f14340ca5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 --2- 172.21.15.73:0/4145664324 >> v2:172.21.15.73:3300/0 conn(0x7f14341536a0 0x7f14340ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 >> v1:172.21.15.73:6789/0 conn(0x7f1434153a80 legacy=0x7f14340cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434159c80 con 0x7f14341594f0 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f142c0019f0 con 0x7f14341594f0 2024-03-23T06:11:32.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 >> v1:172.21.15.110:6789/0 conn(0x7f14341594f0 legacy=0x7f14340cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1418003970 0x7f1418003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14180047c0 0x7f1418004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1418005180 0x7f141800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143415a520 con 0x7f1418003970 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141800c0d0 con 0x7f1418005180 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141800c290 con 0x7f14180047c0 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1432a00640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14180047c0 0x7f1418004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.512+0000 7f1433e00640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1418005180 0x7f141800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.513+0000 7f1432a00640 1 -- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1418005180 msgr2=0x7f141800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.513+0000 7f1432a00640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1418005180 0x7f141800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.513+0000 7f1432a00640 1 -- 172.21.15.73:0/4145664324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1418003970 msgr2=0x7f1418003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.513+0000 7f1432a00640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1418003970 0x7f1418003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.513+0000 7f1432a00640 1 -- 172.21.15.73:0/4145664324 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434159c80 con 0x7f14180047c0 2024-03-23T06:11:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.513+0000 7f1433e00640 1 -- 172.21.15.73:0/4145664324 reap_dead start 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.514+0000 7f1432a00640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14180047c0 0x7f1418004c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1420001810 tx=0x7f14180057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af68b5e1c959fa72 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.514+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420004aa0 con 0x7f14180047c0 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.514+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142002e070 con 0x7f14180047c0 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.514+0000 7f1432000640 1 -- 172.21.15.73:0/4145664324 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420004e00 con 0x7f14180047c0 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.515+0000 7f143a600640 1 -- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14180047c0 msgr2=0x7f1418004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.515+0000 7f143a600640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14180047c0 0x7f1418004c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1420001810 tx=0x7f14180057f0 comp rx=0 tx=0).stop 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.515+0000 7f143a600640 1 -- 172.21.15.73:0/4145664324 shutdown_connections 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.515+0000 7f143a600640 1 --2- 172.21.15.73:0/4145664324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14180047c0 0x7f1418004c40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.515+0000 7f143a600640 1 -- 172.21.15.73:0/4145664324 >> 172.21.15.73:0/4145664324 conn(0x7f143406a060 msgr2=0x7f143406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.515+0000 7f143a600640 1 -- 172.21.15.73:0/4145664324 shutdown_connections 2024-03-23T06:11:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.515+0000 7f143a600640 1 -- 172.21.15.73:0/4145664324 wait complete. 2024-03-23T06:11:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.517+0000 7f143a600640 1 Processor -- start 2024-03-23T06:11:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.517+0000 7f143a600640 1 -- start start 2024-03-23T06:11:32.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.518+0000 7f143a600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.518+0000 7f143a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 0x7f14341eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.518+0000 7f143a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 0x7f1434149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.518+0000 7f143a600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143414ff10 con 0x7f14180047c0 2024-03-23T06:11:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.518+0000 7f143a600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341504d0 con 0x7f1434157560 2024-03-23T06:11:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.518+0000 7f143a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143415a6b0 con 0x7f14341ef2c0 2024-03-23T06:11:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.518+0000 7f1433400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.518+0000 7f1432a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 0x7f14341eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1432a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 0x7f14341eed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:44344/0 (socket says 172.21.15.73:44344) 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1432a00640 1 -- 172.21.15.73:0/485445833 learned_addr learned my addr 172.21.15.73:0/485445833 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433e00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 0x7f1434149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1432a00640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 msgr2=0x7f14341eed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1432a00640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 msgr2=0x7f14341eed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1432a00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 0x7f14341eed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1432a00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 0x7f14341eed80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433e00640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 msgr2=0x7f1434149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433e00640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 msgr2=0x7f1434149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433e00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 0x7f1434149a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433400640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 msgr2=0x7f14340ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433400640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 msgr2=0x7f14340ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433400640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433e00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 0x7f1434149a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.519+0000 7f1433400640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:32.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.720+0000 7f1433e00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 0x7f1434149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.720+0000 7f1432a00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 0x7f14341eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.720+0000 7f1433400640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.720+0000 7f1433400640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 msgr2=0x7f14340ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T06:11:32.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.720+0000 7f1433400640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 msgr2=0x7f14340ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:11:32.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.720+0000 7f1433400640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:32.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.721+0000 7f1433e00640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 msgr2=0x7f14341eed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:32.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.721+0000 7f1433e00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 0x7f14341eed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:32.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.721+0000 7f1433e00640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 msgr2=0x7f14340ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:32.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.721+0000 7f1433400640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:11:32.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.721+0000 7f1433e00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:32.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.721+0000 7f1433e00640 1 -- 172.21.15.73:0/485445833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434150960 con 0x7f14341ef2c0 2024-03-23T06:11:32.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.721+0000 7f1433e00640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 0x7f1434149a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14341598d0 tx=0x7f142c011620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:32.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.729+0000 7f142b400640 1 -- 172.21.15.73:0/485445833 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c01a070 con 0x7f14341ef2c0 2024-03-23T06:11:32.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.730+0000 7f142b400640 1 -- 172.21.15.73:0/485445833 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c011ba0 con 0x7f14341ef2c0 2024-03-23T06:11:32.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.730+0000 7f142b400640 1 -- 172.21.15.73:0/485445833 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c011d30 con 0x7f14341ef2c0 2024-03-23T06:11:32.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.730+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143415a950 con 0x7f14341ef2c0 2024-03-23T06:11:32.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.730+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1434150160 con 0x7f14341ef2c0 2024-03-23T06:11:32.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.732+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14340c9810 con 0x7f14341ef2c0 2024-03-23T06:11:32.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.733+0000 7f142b400640 1 -- 172.21.15.73:0/485445833 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f142c006b50 con 0x7f14341ef2c0 2024-03-23T06:11:32.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.734+0000 7f142b400640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f141406ac50 0x7f141406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:32.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.735+0000 7f142b400640 1 -- 172.21.15.73:0/485445833 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f142c089900 con 0x7f14341ef2c0 2024-03-23T06:11:32.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.736+0000 7f1433400640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f141406ac50 0x7f141406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:32.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.737+0000 7f1433400640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f141406ac50 0x7f141406d110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f14340cfd90 tx=0x7f1424008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:32.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:32.740+0000 7f142b400640 1 -- 172.21.15.73:0/485445833 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f142c054780 con 0x7f14341ef2c0 2024-03-23T06:11:33.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.038+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f143404e110 con 0x7f14341ef2c0 2024-03-23T06:11:33.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.038+0000 7f142b400640 1 -- 172.21.15.73:0/485445833 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f142c057da0 con 0x7f14341ef2c0 2024-03-23T06:11:33.038 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:11:33.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f141406ac50 msgr2=0x7f141406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f141406ac50 0x7f141406d110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f14340cfd90 tx=0x7f1424008040 comp rx=0 tx=0).stop 2024-03-23T06:11:33.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 msgr2=0x7f1434149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 0x7f1434149a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14341598d0 tx=0x7f142c011620 comp rx=0 tx=0).stop 2024-03-23T06:11:33.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 shutdown_connections 2024-03-23T06:11:33.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f141406ac50 0x7f141406d110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14341ef2c0 0x7f1434149a00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1434157560 0x7f14341eed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 --2- 172.21.15.73:0/485445833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f14180047c0 0x7f14340ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 >> 172.21.15.73:0/485445833 conn(0x7f143406a060 msgr2=0x7f1434158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:33.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 shutdown_connections 2024-03-23T06:11:33.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.042+0000 7f143a600640 1 -- 172.21.15.73:0/485445833 wait complete. 2024-03-23T06:11:33.060 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:11:33.060 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:11:33.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:11:33.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.245+0000 7f95b0800640 1 Processor -- start 2024-03-23T06:11:33.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.245+0000 7f95b0800640 1 -- start start 2024-03-23T06:11:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95b0800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a8159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95b0800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95a80ca940 0x7f95a80cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95b0800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a80cb310 con 0x7f95a80c9740 2024-03-23T06:11:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95b0800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a806a2d0 con 0x7f95a80ca940 2024-03-23T06:11:33.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95b0800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a806a5b0 con 0x7f95a8153760 2024-03-23T06:11:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95ad400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f95a80c9740 0x7f95a80cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45518/0 (socket says 172.21.15.73:45518) 2024-03-23T06:11:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95ad400640 1 -- 172.21.15.73:0/3477425769 learned_addr learned my addr 172.21.15.73:0/3477425769 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95ade00640 1 --2- 172.21.15.73:0/3477425769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a8159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.247+0000 7f95ae800640 1 --2- 172.21.15.73:0/3477425769 >> v2:172.21.15.110:3300/0 conn(0x7f95a80ca940 0x7f95a80cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.248+0000 7f95ade00640 1 -- 172.21.15.73:0/3477425769 >> v2:172.21.15.110:3300/0 conn(0x7f95a80ca940 msgr2=0x7f95a80cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.248+0000 7f95ade00640 1 --2- 172.21.15.73:0/3477425769 >> v2:172.21.15.110:3300/0 conn(0x7f95a80ca940 0x7f95a80cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.248+0000 7f95ade00640 1 -- 172.21.15.73:0/3477425769 >> v1:172.21.15.73:6789/0 conn(0x7f95a80c9740 legacy=0x7f95a80cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.248+0000 7f95ade00640 1 -- 172.21.15.73:0/3477425769 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a806a890 con 0x7f95a8153760 2024-03-23T06:11:33.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.250+0000 7f95ade00640 1 --2- 172.21.15.73:0/3477425769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a8159420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f959c0097d0 tx=0x7f959c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6516f7e6f9808db6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.250+0000 7f95aca00640 1 -- 172.21.15.73:0/3477425769 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c02d040 con 0x7f95a8153760 2024-03-23T06:11:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.250+0000 7f95aca00640 1 -- 172.21.15.73:0/3477425769 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c031810 con 0x7f95a8153760 2024-03-23T06:11:33.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.250+0000 7f95aca00640 1 -- 172.21.15.73:0/3477425769 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c031ba0 con 0x7f95a8153760 2024-03-23T06:11:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.251+0000 7f95b0800640 1 -- 172.21.15.73:0/3477425769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 msgr2=0x7f95a8159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.251+0000 7f95b0800640 1 --2- 172.21.15.73:0/3477425769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a8159420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f959c0097d0 tx=0x7f959c02b8b0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.251+0000 7f95b0800640 1 -- 172.21.15.73:0/3477425769 shutdown_connections 2024-03-23T06:11:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.251+0000 7f95b0800640 1 --2- 172.21.15.73:0/3477425769 >> v2:172.21.15.110:3300/0 conn(0x7f95a80ca940 0x7f95a80cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.251+0000 7f95b0800640 1 --2- 172.21.15.73:0/3477425769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a8159420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.251+0000 7f95b0800640 1 -- 172.21.15.73:0/3477425769 >> 172.21.15.73:0/3477425769 conn(0x7f95a806c310 msgr2=0x7f95a80713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.251+0000 7f95b0800640 1 -- 172.21.15.73:0/3477425769 shutdown_connections 2024-03-23T06:11:33.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.251+0000 7f95b0800640 1 -- 172.21.15.73:0/3477425769 wait complete. 2024-03-23T06:11:33.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.253+0000 7f95b0800640 1 Processor -- start 2024-03-23T06:11:33.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.253+0000 7f95b0800640 1 -- start start 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.254+0000 7f95b0800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80c9740 0x7f95a8145940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.254+0000 7f95b0800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95a80ca940 0x7f95a80ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.254+0000 7f95b0800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a80c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.254+0000 7f95b0800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8145e80 con 0x7f95a80c9740 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.254+0000 7f95b0800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8143d80 con 0x7f95a80ca940 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.254+0000 7f95b0800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8159620 con 0x7f95a8153760 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ade00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80c9740 0x7f95a8145940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ae800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a80c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ade00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80c9740 0x7f95a8145940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50582/0 (socket says 172.21.15.73:50582) 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ade00640 1 -- 172.21.15.73:0/3559918889 learned_addr learned my addr 172.21.15.73:0/3559918889 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:33.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ad400640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95a80ca940 0x7f95a80ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ae800640 1 -- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95a80ca940 msgr2=0x7f95a80ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ae800640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95a80ca940 0x7f95a80ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ae800640 1 -- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80c9740 msgr2=0x7f95a8145940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ae800640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a80c9740 0x7f95a8145940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.255+0000 7f95ae800640 1 -- 172.21.15.73:0/3559918889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c009400 con 0x7f95a8153760 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.256+0000 7f95ae800640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a80c62e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f95a400efc0 tx=0x7f95a400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.256+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4009c00 con 0x7f95a8153760 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.256+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a400f040 con 0x7f95a8153760 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.256+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40146c0 con 0x7f95a8153760 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.256+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a8144020 con 0x7f95a8153760 2024-03-23T06:11:33.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.257+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a81445e0 con 0x7f95a8153760 2024-03-23T06:11:33.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.258+0000 7f95b0800640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8144800 0x7f95a80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.258+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a80c6d60 con 0x7f95a8144800 2024-03-23T06:11:33.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.259+0000 7f95ade00640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8144800 0x7f95a80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.259+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f95a4014820 con 0x7f95a8153760 2024-03-23T06:11:33.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.259+0000 7f95ade00640 1 -- 172.21.15.73:0/3559918889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95a8153b40 con 0x7f95a8144800 2024-03-23T06:11:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.260+0000 7f95ade00640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8144800 0x7f95a80c6820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f959c034040 tx=0x7f959c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.260+0000 7f95a2000640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f958c06ac30 0x7f958c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.260+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f95a408a3b0 con 0x7f95a8153760 2024-03-23T06:11:33.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.261+0000 7f95ad400640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f958c06ac30 0x7f958c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.261+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c03ad00 con 0x7f95a8144800 2024-03-23T06:11:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.261+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f959c044400 con 0x7f95a8144800 2024-03-23T06:11:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.261+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8144800 msgr2=0x7f95a80c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.261+0000 7f95a2000640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8144800 0x7f95a80c6820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f959c034040 tx=0x7f959c004730 comp rx=0 tx=0).stop 2024-03-23T06:11:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.261+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8144800 msgr2=0x7f95a80c6820 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.261+0000 7f95a2000640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8144800 0x7f95a80c6820 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.261+0000 7f95ad400640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f958c06ac30 0x7f958c06d0f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f95a81499a0 tx=0x7f9598009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.274+0000 7f95b0800640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8157ec0 0x7f95a80b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.274+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a8072510 con 0x7f95a8157ec0 2024-03-23T06:11:33.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.275+0000 7f95ade00640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8157ec0 0x7f95a80b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.275+0000 7f95ade00640 1 -- 172.21.15.73:0/3559918889 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f95a806ae50 con 0x7f95a8157ec0 2024-03-23T06:11:33.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.276+0000 7f95ade00640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8157ec0 0x7f95a80b3170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f959c032000 tx=0x7f959c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.276+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c004480 con 0x7f95a8157ec0 2024-03-23T06:11:33.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.277+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f959c044940 con 0x7f95a8157ec0 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 10, 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.277 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.278 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.279 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:33.280 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:11:33.281 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.282 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.283 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.284 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.285 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.286 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:11:33.287 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:11:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.277+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8157ec0 msgr2=0x7f95a80b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.277+0000 7f95a2000640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8157ec0 0x7f95a80b3170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f959c032000 tx=0x7f959c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.277+0000 7f95a2000640 1 -- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8157ec0 msgr2=0x7f95a80b3170 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.277+0000 7f95a2000640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95a8157ec0 0x7f95a80b3170 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f959c032000 tx=0x7f959c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.277+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f958c06ac30 msgr2=0x7f958c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.277+0000 7f95b0800640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f958c06ac30 0x7f958c06d0f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f95a81499a0 tx=0x7f9598009040 comp rx=0 tx=0).stop 2024-03-23T06:11:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.278+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 msgr2=0x7f95a80c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.278+0000 7f95b0800640 1 --2- 172.21.15.73:0/3559918889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95a8153760 0x7f95a80c62e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f95a400efc0 tx=0x7f95a400c490 comp rx=0 tx=0).stop 2024-03-23T06:11:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.278+0000 7f95ae800640 1 -- 172.21.15.73:0/3559918889 reap_dead start 2024-03-23T06:11:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.278+0000 7f95ae800640 1 -- 172.21.15.73:0/3559918889 reap_dead start 2024-03-23T06:11:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.278+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 shutdown_connections 2024-03-23T06:11:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.278+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 >> 172.21.15.73:0/3559918889 conn(0x7f95a806c310 msgr2=0x7f95a8151ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.278+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 shutdown_connections 2024-03-23T06:11:33.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.278+0000 7f95b0800640 1 -- 172.21.15.73:0/3559918889 wait complete. 2024-03-23T06:11:33.299 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:11:33.299 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:11:33.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:11:33.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.483+0000 7f1427200640 1 Processor -- start 2024-03-23T06:11:33.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.483+0000 7f1427200640 1 -- start start 2024-03-23T06:11:33.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.485+0000 7f1427200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f14280c72e0 0x7f14280c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.485+0000 7f1427200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142815a400 con 0x7f1428153620 2024-03-23T06:11:33.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.485+0000 7f1427200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280c5d30 con 0x7f14280c5930 2024-03-23T06:11:33.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.485+0000 7f1427200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14280c5fc0 con 0x7f14280c72e0 2024-03-23T06:11:33.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.486+0000 7f1425e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1428153620 0x7f142815d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45534/0 (socket says 172.21.15.73:45534) 2024-03-23T06:11:33.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.486+0000 7f1425e00640 1 -- 172.21.15.73:0/2506375138 learned_addr learned my addr 172.21.15.73:0/2506375138 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:33.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1426800640 1 --2- 172.21.15.73:0/2506375138 >> v2:172.21.15.73:3300/0 conn(0x7f14280c72e0 0x7f14280c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644707560 0 0) 0x7f14280c5d30 con 0x7f14280c5930 2024-03-23T06:11:33.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f140c003520 con 0x7f14280c5930 2024-03-23T06:11:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1704153768 0 0) 0x7f140c003520 con 0x7f14280c5930 2024-03-23T06:11:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 >> v2:172.21.15.73:3300/0 conn(0x7f14280c72e0 msgr2=0x7f14280c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1424a00640 1 --2- 172.21.15.73:0/2506375138 >> v2:172.21.15.73:3300/0 conn(0x7f14280c72e0 0x7f14280c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 >> v1:172.21.15.73:6789/0 conn(0x7f1428153620 legacy=0x7f142815d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280bc380 con 0x7f14280c5930 2024-03-23T06:11:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.487+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f1414001650 con 0x7f14280c5930 2024-03-23T06:11:33.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 >> v1:172.21.15.110:6789/0 conn(0x7f14280c5930 legacy=0x7f1428159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1424a00640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f140c003970 0x7f140c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1424a00640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f140c0047c0 0x7f140c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1424a00640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c005180 0x7f140c014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280c5fc0 con 0x7f140c005180 2024-03-23T06:11:33.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0147e0 con 0x7f140c0047c0 2024-03-23T06:11:33.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0149a0 con 0x7f140c003970 2024-03-23T06:11:33.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1426800640 1 --2- 172.21.15.73:0/2506375138 >> v2:172.21.15.73:3300/0 conn(0x7f14280c72e0 0x7f14280c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1425e00640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f140c003970 0x7f140c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1425400640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f140c0047c0 0x7f140c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1425400640 1 -- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f140c003970 msgr2=0x7f140c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.488+0000 7f1425400640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f140c003970 0x7f140c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.489+0000 7f1425400640 1 -- 172.21.15.73:0/2506375138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c005180 msgr2=0x7f140c014190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.489+0000 7f1425400640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c005180 0x7f140c014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.489+0000 7f1425400640 1 -- 172.21.15.73:0/2506375138 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280bc380 con 0x7f140c0047c0 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.489+0000 7f1425e00640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f140c003970 0x7f140c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:33.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.489+0000 7f1426800640 1 -- 172.21.15.73:0/2506375138 reap_dead start 2024-03-23T06:11:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.490+0000 7f1425400640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f140c0047c0 0x7f140c004c40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1414007f90 tx=0x7f140c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cfc0326b676f231 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.490+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1414005270 con 0x7f140c0047c0 2024-03-23T06:11:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.490+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14140053d0 con 0x7f140c0047c0 2024-03-23T06:11:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.490+0000 7f1424a00640 1 -- 172.21.15.73:0/2506375138 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141402c990 con 0x7f140c0047c0 2024-03-23T06:11:33.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.491+0000 7f1427200640 1 -- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f140c0047c0 msgr2=0x7f140c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.491+0000 7f1427200640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f140c0047c0 0x7f140c004c40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1414007f90 tx=0x7f140c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.491+0000 7f1427200640 1 -- 172.21.15.73:0/2506375138 shutdown_connections 2024-03-23T06:11:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.491+0000 7f1427200640 1 --2- 172.21.15.73:0/2506375138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f140c0047c0 0x7f140c004c40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.491+0000 7f1427200640 1 -- 172.21.15.73:0/2506375138 >> 172.21.15.73:0/2506375138 conn(0x7f142806d3f0 msgr2=0x7f142806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.492+0000 7f1427200640 1 -- 172.21.15.73:0/2506375138 shutdown_connections 2024-03-23T06:11:33.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.492+0000 7f1427200640 1 -- 172.21.15.73:0/2506375138 wait complete. 2024-03-23T06:11:33.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.495+0000 7f1427200640 1 Processor -- start 2024-03-23T06:11:33.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.495+0000 7f1427200640 1 -- start start 2024-03-23T06:11:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.496+0000 7f1427200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c0047c0 0x7f1428072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.496+0000 7f1427200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14280c8710 0x7f14281e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.496+0000 7f1427200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281e00d0 0x7f14281e0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.496+0000 7f1427200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14281e0a90 con 0x7f140c0047c0 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.496+0000 7f1427200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1428072690 con 0x7f14281e00d0 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.496+0000 7f1427200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14280710b0 con 0x7f14280c8710 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c0047c0 0x7f1428072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c0047c0 0x7f1428072150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50628/0 (socket says 172.21.15.73:50628) 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425e00640 1 -- 172.21.15.73:0/2387220910 learned_addr learned my addr 172.21.15.73:0/2387220910 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425400640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14280c8710 0x7f14281e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1426800640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281e00d0 0x7f14281e0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425e00640 1 -- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14280c8710 msgr2=0x7f14281e1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425e00640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14280c8710 0x7f14281e1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425e00640 1 -- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281e00d0 msgr2=0x7f14281e0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425e00640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281e00d0 0x7f14281e0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425e00640 1 -- 172.21.15.73:0/2387220910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14281dfb40 con 0x7f140c0047c0 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.497+0000 7f1425400640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14280c8710 0x7f14281e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.498+0000 7f1425e00640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c0047c0 0x7f1428072150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1418004f50 tx=0x7f1418001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.498+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800f730 con 0x7f140c0047c0 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.498+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141800f890 con 0x7f140c0047c0 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.498+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800fc40 con 0x7f140c0047c0 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.498+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14281df560 con 0x7f140c0047c0 2024-03-23T06:11:33.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.498+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14281df7d0 con 0x7f140c0047c0 2024-03-23T06:11:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.500+0000 7f1427200640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281edaa0 0x7f14281ede80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.500+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1428073aa0 con 0x7f14281edaa0 2024-03-23T06:11:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.500+0000 7f1425400640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281edaa0 0x7f14281ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.501+0000 7f1425400640 1 -- 172.21.15.73:0/2387220910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14281594f0 con 0x7f14281edaa0 2024-03-23T06:11:33.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.501+0000 7f1425400640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281edaa0 0x7f14281ede80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1414001eb0 tx=0x7f1414001910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.501+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141403c070 con 0x7f14281edaa0 2024-03-23T06:11:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.502+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f141403d040 con 0x7f14281edaa0 2024-03-23T06:11:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.502+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281edaa0 msgr2=0x7f14281ede80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.502+0000 7f141e000640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281edaa0 0x7f14281ede80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1414001eb0 tx=0x7f1414001910 comp rx=0 tx=0).stop 2024-03-23T06:11:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.502+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281edaa0 msgr2=0x7f14281ede80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:33.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.502+0000 7f141e000640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281edaa0 0x7f14281ede80 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1414001eb0 tx=0x7f1414001910 comp rx=0 tx=0).stop 2024-03-23T06:11:33.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.502+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f141801d460 con 0x7f140c0047c0 2024-03-23T06:11:33.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.504+0000 7f141e000640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f140806a980 0x7f140806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.504+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1418089630 con 0x7f140c0047c0 2024-03-23T06:11:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.504+0000 7f1425400640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f140806a980 0x7f140806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.505+0000 7f1425400640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f140806a980 0x7f140806ce40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1428066920 tx=0x7f1414037000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.515+0000 7f1427200640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281ee3c0 0x7f1428141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.515+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280bc940 con 0x7f14281ee3c0 2024-03-23T06:11:33.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.515+0000 7f1426800640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281ee3c0 0x7f1428141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.516+0000 7f1426800640 1 -- 172.21.15.73:0/2387220910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f14281597d0 con 0x7f14281ee3c0 2024-03-23T06:11:33.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.516+0000 7f1426800640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281ee3c0 0x7f1428141c20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14280be720 tx=0x7f142000f500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.516+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420010040 con 0x7f14281ee3c0 2024-03-23T06:11:33.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.517+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5118 (secure 0 0 0) 0x7f1420016450 con 0x7f14281ee3c0 2024-03-23T06:11:33.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.517+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281ee3c0 msgr2=0x7f1428141c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.517+0000 7f141e000640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281ee3c0 0x7f1428141c20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14280be720 tx=0x7f142000f500 comp rx=0 tx=0).stop 2024-03-23T06:11:33.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.517+0000 7f141e000640 1 -- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281ee3c0 msgr2=0x7f1428141c20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:33.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.517+0000 7f141e000640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14281ee3c0 0x7f1428141c20 secure :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14280be720 tx=0x7f142000f500 comp rx=0 tx=0).stop 2024-03-23T06:11:33.517 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:11:33.517 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:33.517 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 10, 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.518 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.519 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:33.520 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.521 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.522 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.523 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.524 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.525 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.526 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.527 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.528 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.529 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.530 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:11:33.530 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:11:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f140806a980 msgr2=0x7f140806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1427200640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f140806a980 0x7f140806ce40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1428066920 tx=0x7f1414037000 comp rx=0 tx=0).stop 2024-03-23T06:11:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c0047c0 msgr2=0x7f1428072150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1427200640 1 --2- 172.21.15.73:0/2387220910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f140c0047c0 0x7f1428072150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1418004f50 tx=0x7f1418001a00 comp rx=0 tx=0).stop 2024-03-23T06:11:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1426800640 1 -- 172.21.15.73:0/2387220910 reap_dead start 2024-03-23T06:11:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 shutdown_connections 2024-03-23T06:11:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 >> 172.21.15.73:0/2387220910 conn(0x7f142806d3f0 msgr2=0x7f1428157c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 shutdown_connections 2024-03-23T06:11:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.518+0000 7f1427200640 1 -- 172.21.15.73:0/2387220910 wait complete. 2024-03-23T06:11:33.537 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:11:33.537 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:11:33.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:11:33.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.715+0000 7fc5eda00640 1 Processor -- start 2024-03-23T06:11:33.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.715+0000 7fc5eda00640 1 -- start start 2024-03-23T06:11:33.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.717+0000 7fc5eda00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc5e80c9790 0x7fc5e80b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.717+0000 7fc5eda00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5e80c9b70 0x7fc5e80b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.717+0000 7fc5eda00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8153040 0x7fc5e81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.717+0000 7fc5eda00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e806adf0 con 0x7fc5e80c9b70 2024-03-23T06:11:33.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.717+0000 7fc5eda00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e806a960 con 0x7fc5e80c9790 2024-03-23T06:11:33.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.717+0000 7fc5eda00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81596d0 con 0x7fc5e8153040 2024-03-23T06:11:33.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.717+0000 7fc5e7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc5e80c9790 0x7fc5e80b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5ed000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8153040 0x7fc5e81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.717+0000 7fc5e7400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc5e80c9b70 0x7fc5e80b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5ed000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8153040 0x7fc5e81534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:53372/0 (socket says 172.21.15.73:53372) 2024-03-23T06:11:33.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5e7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc5e80c9790 0x7fc5e80b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:44404/0 (socket says 172.21.15.73:44404) 2024-03-23T06:11:33.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5ed000640 1 -- 172.21.15.73:0/436155930 learned_addr learned my addr 172.21.15.73:0/436155930 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:33.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5ed000640 1 -- 172.21.15.73:0/436155930 >> v2:172.21.15.110:3300/0 conn(0x7fc5e80c9790 msgr2=0x7fc5e80b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:33.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5ed000640 1 --2- 172.21.15.73:0/436155930 >> v2:172.21.15.110:3300/0 conn(0x7fc5e80c9790 0x7fc5e80b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5ed000640 1 -- 172.21.15.73:0/436155930 >> v2:172.21.15.73:3300/0 conn(0x7fc5e80c9b70 msgr2=0x7fc5e80b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:33.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5ed000640 1 --2- 172.21.15.73:0/436155930 >> v2:172.21.15.73:3300/0 conn(0x7fc5e80c9b70 0x7fc5e80b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.718+0000 7fc5ed000640 1 -- 172.21.15.73:0/436155930 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e815d820 con 0x7fc5e8153040 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.719+0000 7fc5ed000640 1 --2- 172.21.15.73:0/436155930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8153040 0x7fc5e81534f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80c5050 tx=0x7fc5e002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52829f9db1711742 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.719+0000 7fc5e6a00640 1 -- 172.21.15.73:0/436155930 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e002cb00 con 0x7fc5e8153040 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5e6a00640 1 -- 172.21.15.73:0/436155930 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e002cc60 con 0x7fc5e8153040 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5e6a00640 1 -- 172.21.15.73:0/436155930 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e00343f0 con 0x7fc5e8153040 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5eda00640 1 -- 172.21.15.73:0/436155930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8153040 msgr2=0x7fc5e81534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5eda00640 1 --2- 172.21.15.73:0/436155930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8153040 0x7fc5e81534f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80c5050 tx=0x7fc5e002bf60 comp rx=0 tx=0).stop 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5eda00640 1 -- 172.21.15.73:0/436155930 shutdown_connections 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5eda00640 1 --2- 172.21.15.73:0/436155930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8153040 0x7fc5e81534f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5eda00640 1 --2- 172.21.15.73:0/436155930 >> v2:172.21.15.73:3300/0 conn(0x7fc5e80c9b70 0x7fc5e80b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5eda00640 1 --2- 172.21.15.73:0/436155930 >> v2:172.21.15.110:3300/0 conn(0x7fc5e80c9790 0x7fc5e80b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.720+0000 7fc5eda00640 1 -- 172.21.15.73:0/436155930 >> 172.21.15.73:0/436155930 conn(0x7fc5e8071d40 msgr2=0x7fc5e806bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:33.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.721+0000 7fc5eda00640 1 -- 172.21.15.73:0/436155930 shutdown_connections 2024-03-23T06:11:33.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.722+0000 7fc5eda00640 1 -- 172.21.15.73:0/436155930 wait complete. 2024-03-23T06:11:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.725+0000 7fc5eda00640 1 Processor -- start 2024-03-23T06:11:33.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.725+0000 7fc5eda00640 1 -- start start 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.726+0000 7fc5eda00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80c9790 0x7fc5e80cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.726+0000 7fc5eda00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e80c9b70 0x7fc5e81eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.726+0000 7fc5eda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5e8153040 0x7fc5e80b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.726+0000 7fc5eda00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80c9fb0 con 0x7fc5e80c9b70 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.726+0000 7fc5eda00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80cbf40 con 0x7fc5e8153040 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.726+0000 7fc5eda00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e81ef4e0 con 0x7fc5e80c9790 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80c9790 0x7fc5e80cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80c9790 0x7fc5e80cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:53374/0 (socket says 172.21.15.73:53374) 2024-03-23T06:11:33.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7e00640 1 -- 172.21.15.73:0/2559918987 learned_addr learned my addr 172.21.15.73:0/2559918987 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5ed000640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5e8153040 0x7fc5e80b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7400640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e80c9b70 0x7fc5e81eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7e00640 1 -- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5e8153040 msgr2=0x7fc5e80b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7e00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5e8153040 0x7fc5e80b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7e00640 1 -- 172.21.15.73:0/2559918987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e80c9b70 msgr2=0x7fc5e81eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7e00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc5e80c9b70 0x7fc5e81eefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.727+0000 7fc5e7e00640 1 -- 172.21.15.73:0/2559918987 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0009b30 con 0x7fc5e80c9790 2024-03-23T06:11:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.728+0000 7fc5e7e00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80c9790 0x7fc5e80cba00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800e8a0 tx=0x7fc5d800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.728+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80094f0 con 0x7fc5e80c9790 2024-03-23T06:11:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.728+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d800c940 con 0x7fc5e80c9790 2024-03-23T06:11:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.728+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d800ccf0 con 0x7fc5e80c9790 2024-03-23T06:11:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.728+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e80caac0 con 0x7fc5e80c9790 2024-03-23T06:11:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.728+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e80ca190 con 0x7fc5e80c9790 2024-03-23T06:11:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.729+0000 7fc5eda00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80ca3b0 0x7fc5e80cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.729+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e80723f0 con 0x7fc5e80ca3b0 2024-03-23T06:11:33.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.730+0000 7fc5e7400640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80ca3b0 0x7fc5e80cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.730+0000 7fc5e7400640 1 -- 172.21.15.73:0/2559918987 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5e806a310 con 0x7fc5e80ca3b0 2024-03-23T06:11:33.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.731+0000 7fc5e7400640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80ca3b0 0x7fc5e80cd910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5e81525c0 tx=0x7fc5d4011970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.731+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4015870 con 0x7fc5e80ca3b0 2024-03-23T06:11:33.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.731+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fc5d40159d0 con 0x7fc5e80ca3b0 2024-03-23T06:11:33.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.731+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80ca3b0 msgr2=0x7fc5e80cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.731+0000 7fc5dfe00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80ca3b0 0x7fc5e80cd910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5e81525c0 tx=0x7fc5d4011970 comp rx=0 tx=0).stop 2024-03-23T06:11:33.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.731+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80ca3b0 msgr2=0x7fc5e80cd910 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:33.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.731+0000 7fc5dfe00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80ca3b0 0x7fc5e80cd910 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc5e81525c0 tx=0x7fc5d4011970 comp rx=0 tx=0).stop 2024-03-23T06:11:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.732+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc5d8013470 con 0x7fc5e80c9790 2024-03-23T06:11:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.733+0000 7fc5dfe00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc5c806a980 0x7fc5c806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.733+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fc5d8089ae0 con 0x7fc5e80c9790 2024-03-23T06:11:33.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.734+0000 7fc5e7400640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc5c806a980 0x7fc5c806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.734+0000 7fc5e7400640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc5c806a980 0x7fc5c806ce40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8152660 tx=0x7fc5d4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.744+0000 7fc5eda00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8149370 0x7fc5e8149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.744+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e806a030 con 0x7fc5e8149370 2024-03-23T06:11:33.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.744+0000 7fc5ed000640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8149370 0x7fc5e8149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.745+0000 7fc5ed000640 1 -- 172.21.15.73:0/2559918987 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc5e806a5f0 con 0x7fc5e8149370 2024-03-23T06:11:33.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.745+0000 7fc5ed000640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8149370 0x7fc5e8149780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5e81593c0 tx=0x7fc5e0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.745+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e003f610 con 0x7fc5e8149370 2024-03-23T06:11:33.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.745+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4805 (secure 0 0 0) 0x7fc5e0009510 con 0x7fc5e8149370 2024-03-23T06:11:33.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8149370 msgr2=0x7fc5e8149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5dfe00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8149370 0x7fc5e8149780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5e81593c0 tx=0x7fc5e0004a40 comp rx=0 tx=0).stop 2024-03-23T06:11:33.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5dfe00640 1 -- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8149370 msgr2=0x7fc5e8149780 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5dfe00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e8149370 0x7fc5e8149780 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc5e81593c0 tx=0x7fc5e0004a40 comp rx=0 tx=0).stop 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 10, 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:11:33.746 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.747 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.748 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:11:33.749 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:33.750 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.752 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.753 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.755 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:11:33.756 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:11:33.757 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:11:33.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc5c806a980 msgr2=0x7fc5c806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5eda00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc5c806a980 0x7fc5c806ce40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8152660 tx=0x7fc5d4017000 comp rx=0 tx=0).stop 2024-03-23T06:11:33.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5ed000640 1 -- 172.21.15.73:0/2559918987 reap_dead start 2024-03-23T06:11:33.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80c9790 msgr2=0x7fc5e80cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.746+0000 7fc5eda00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80c9790 0x7fc5e80cba00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800e8a0 tx=0x7fc5d800ed60 comp rx=0 tx=0).stop 2024-03-23T06:11:33.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.747+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 shutdown_connections 2024-03-23T06:11:33.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.747+0000 7fc5eda00640 1 --2- 172.21.15.73:0/2559918987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5e80c9790 0x7fc5e80cba00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.747+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 >> 172.21.15.73:0/2559918987 conn(0x7fc5e8071d40 msgr2=0x7fc5e8158960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:33.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.747+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 shutdown_connections 2024-03-23T06:11:33.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.747+0000 7fc5eda00640 1 -- 172.21.15.73:0/2559918987 wait complete. 2024-03-23T06:11:33.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:11:33.762 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:11:33.762 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:11:33.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.931+0000 7f8062200640 1 Processor -- start 2024-03-23T06:11:33.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.932+0000 7f8062200640 1 -- start start 2024-03-23T06:11:33.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.933+0000 7f8062200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c1536a0 0x7f805c0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f8062200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c0cab20 con 0x7f805c1594f0 2024-03-23T06:11:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f8062200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805c1599a0 con 0x7f805c153a80 2024-03-23T06:11:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f8062200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c15a520 con 0x7f805c1536a0 2024-03-23T06:11:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f805b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c1536a0 0x7f805c0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f805b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c1536a0 0x7f805c0ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:53388/0 (socket says 172.21.15.73:53388) 2024-03-23T06:11:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f805b400640 1 -- 172.21.15.73:0/2967793664 learned_addr learned my addr 172.21.15.73:0/2967793664 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f805aa00640 1 --1- 172.21.15.73:0/2967793664 >> v1:172.21.15.110:6789/0 conn(0x7f805c153a80 0x7f805c0cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:60652/0 (socket says 172.21.15.73:60652) 2024-03-23T06:11:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f805b400640 1 -- 172.21.15.73:0/2967793664 >> v1:172.21.15.110:6789/0 conn(0x7f805c153a80 legacy=0x7f805c0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f805a000640 1 -- 172.21.15.73:0/2967793664 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476514712 0 0) 0x7f805c1599a0 con 0x7f805c153a80 2024-03-23T06:11:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f805b400640 1 -- 172.21.15.73:0/2967793664 >> v1:172.21.15.73:6789/0 conn(0x7f805c1594f0 legacy=0x7f805c0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:33.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.934+0000 7f805b400640 1 -- 172.21.15.73:0/2967793664 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805c159c80 con 0x7f805c1536a0 2024-03-23T06:11:33.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.936+0000 7f805b400640 1 --2- 172.21.15.73:0/2967793664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c1536a0 0x7f805c0ca5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f804c0098a0 tx=0x7f804c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f276b4fad4f08c66 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.936+0000 7f805a000640 1 -- 172.21.15.73:0/2967793664 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c030840 con 0x7f805c1536a0 2024-03-23T06:11:33.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.936+0000 7f805a000640 1 -- 172.21.15.73:0/2967793664 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c0309a0 con 0x7f805c1536a0 2024-03-23T06:11:33.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.936+0000 7f805a000640 1 -- 172.21.15.73:0/2967793664 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c030d30 con 0x7f805c1536a0 2024-03-23T06:11:33.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.937+0000 7f8062200640 1 -- 172.21.15.73:0/2967793664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c1536a0 msgr2=0x7f805c0ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.937+0000 7f8062200640 1 --2- 172.21.15.73:0/2967793664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c1536a0 0x7f805c0ca5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f804c0098a0 tx=0x7f804c02b980 comp rx=0 tx=0).stop 2024-03-23T06:11:33.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.937+0000 7f8062200640 1 -- 172.21.15.73:0/2967793664 shutdown_connections 2024-03-23T06:11:33.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.937+0000 7f8062200640 1 --2- 172.21.15.73:0/2967793664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c1536a0 0x7f805c0ca5e0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f804c0098a0 tx=0x7f804c02b980 comp rx=0 tx=0).stop 2024-03-23T06:11:33.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.937+0000 7f8062200640 1 -- 172.21.15.73:0/2967793664 >> 172.21.15.73:0/2967793664 conn(0x7f805c06a060 msgr2=0x7f805c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:33.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.937+0000 7f8062200640 1 -- 172.21.15.73:0/2967793664 shutdown_connections 2024-03-23T06:11:33.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.937+0000 7f8062200640 1 -- 172.21.15.73:0/2967793664 wait complete. 2024-03-23T06:11:33.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.940+0000 7f8062200640 1 Processor -- start 2024-03-23T06:11:33.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.940+0000 7f8062200640 1 -- start start 2024-03-23T06:11:33.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f8062200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c153a80 0x7f805c0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f8062200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805c1594f0 0x7f805c0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f8062200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c153e60 0x7f805c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f8062200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0ceba0 con 0x7f805c1594f0 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f8062200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805c0b1cb0 con 0x7f805c153e60 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f8062200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805c155620 con 0x7f805c153a80 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f805aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805c1594f0 0x7f805c0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f805be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c153e60 0x7f805c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f805aa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805c1594f0 0x7f805c0c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50642/0 (socket says 172.21.15.73:50642) 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f805aa00640 1 -- 172.21.15.73:0/3543896938 learned_addr learned my addr 172.21.15.73:0/3543896938 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f805be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c153e60 0x7f805c0b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:44432/0 (socket says 172.21.15.73:44432) 2024-03-23T06:11:33.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.942+0000 7f805b400640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c153a80 0x7f805c0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.943+0000 7f805b400640 1 -- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c153e60 msgr2=0x7f805c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.943+0000 7f805b400640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c153e60 0x7f805c0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.943+0000 7f805b400640 1 -- 172.21.15.73:0/3543896938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805c1594f0 msgr2=0x7f805c0c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:33.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.943+0000 7f805b400640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805c1594f0 0x7f805c0c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:33.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.943+0000 7f805b400640 1 -- 172.21.15.73:0/3543896938 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0094d0 con 0x7f805c153a80 2024-03-23T06:11:33.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.943+0000 7f805be00640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c153e60 0x7f805c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:33.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.943+0000 7f805b400640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c153a80 0x7f805c0ccc70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f804c033000 tx=0x7f804c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.943+0000 7f8053400640 1 -- 172.21.15.73:0/3543896938 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c0307b0 con 0x7f805c153a80 2024-03-23T06:11:33.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.944+0000 7f8053400640 1 -- 172.21.15.73:0/3543896938 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c043400 con 0x7f805c153a80 2024-03-23T06:11:33.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.944+0000 7f8053400640 1 -- 172.21.15.73:0/3543896938 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c0437b0 con 0x7f805c153a80 2024-03-23T06:11:33.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.944+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805c0b3b90 con 0x7f805c153a80 2024-03-23T06:11:33.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.944+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805c0b40f0 con 0x7f805c153a80 2024-03-23T06:11:33.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.946+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f805c1527e0 con 0x7f805c153a80 2024-03-23T06:11:33.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.947+0000 7f8053400640 1 -- 172.21.15.73:0/3543896938 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f804c043910 con 0x7f805c153a80 2024-03-23T06:11:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.948+0000 7f8053400640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803c06ac00 0x7f803c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:33.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.948+0000 7f8053400640 1 -- 172.21.15.73:0/3543896938 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f804c03e070 con 0x7f805c153a80 2024-03-23T06:11:33.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.948+0000 7f805aa00640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803c06ac00 0x7f803c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:33.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.949+0000 7f805aa00640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803c06ac00 0x7f803c06d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f805c157c00 tx=0x7f8048007e10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:33.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:33.952+0000 7f8053400640 1 -- 172.21.15.73:0/3543896938 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f804c077590 con 0x7f805c153a80 2024-03-23T06:11:34.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.357+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f805c15d9f0 con 0x7f805c153a80 2024-03-23T06:11:34.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.359+0000 7f8053400640 1 -- 172.21.15.73:0/3543896938 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f804c07abb0 con 0x7f805c153a80 2024-03-23T06:11:34.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803c06ac00 msgr2=0x7f803c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:34.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803c06ac00 0x7f803c06d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f805c157c00 tx=0x7f8048007e10 comp rx=0 tx=0).stop 2024-03-23T06:11:34.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c153a80 msgr2=0x7f805c0ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:34.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c153a80 0x7f805c0ccc70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f804c033000 tx=0x7f804c004730 comp rx=0 tx=0).stop 2024-03-23T06:11:34.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 shutdown_connections 2024-03-23T06:11:34.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f805c153e60 0x7f805c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:34.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805c1594f0 0x7f805c0c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:34.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f803c06ac00 0x7f803c06d0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:34.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 --2- 172.21.15.73:0/3543896938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f805c153a80 0x7f805c0ccc70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:34.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.362+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 >> 172.21.15.73:0/3543896938 conn(0x7f805c06a060 msgr2=0x7f805c158db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:34.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.363+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 shutdown_connections 2024-03-23T06:11:34.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:34.363+0000 7f8062200640 1 -- 172.21.15.73:0/3543896938 wait complete. 2024-03-23T06:11:34.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:11:44.386 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:11:44.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:44.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.590+0000 7fe3ff200640 1 Processor -- start 2024-03-23T06:11:44.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.590+0000 7fe3ff200640 1 -- start start 2024-03-23T06:11:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.591+0000 7fe3ff200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 0x7fe4000cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.591+0000 7fe3ff200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4000caed0 0x7fe400159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.591+0000 7fe3ff200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40015a370 con 0x7fe4000cf100 2024-03-23T06:11:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.591+0000 7fe3ff200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000cb8d0 con 0x7fe4000caed0 2024-03-23T06:11:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.591+0000 7fe3ff200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000ca330 con 0x7fe4000ced20 2024-03-23T06:11:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.591+0000 7fe3fe800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4000caed0 0x7fe400159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:44.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.591+0000 7fe3fe800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe4000caed0 0x7fe400159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35802/0 (socket says 172.21.15.73:35802) 2024-03-23T06:11:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.591+0000 7fe3fe800640 1 -- 172.21.15.73:0/1949865592 learned_addr learned my addr 172.21.15.73:0/1949865592 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.592+0000 7fe3fde00640 1 --2- 172.21.15.73:0/1949865592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 0x7fe4000cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.592+0000 7fe3fe800640 1 -- 172.21.15.73:0/1949865592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 msgr2=0x7fe4000cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.592+0000 7fe3fe800640 1 --2- 172.21.15.73:0/1949865592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 0x7fe4000cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.592+0000 7fe3fe800640 1 -- 172.21.15.73:0/1949865592 >> v1:172.21.15.110:6789/0 conn(0x7fe4000cf100 legacy=0x7fe4000ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:44.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.592+0000 7fe3fe800640 1 -- 172.21.15.73:0/1949865592 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4000cbab0 con 0x7fe4000caed0 2024-03-23T06:11:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.592+0000 7fe3fd400640 1 -- 172.21.15.73:0/1949865592 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499811112 0 0) 0x7fe3e8001110 con 0x7fe4000cf100 2024-03-23T06:11:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.593+0000 7fe3fe800640 1 --2- 172.21.15.73:0/1949865592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400159e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009e50 tx=0x7fe3f802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7af4d4dcd73631 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:44.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3fd400640 1 -- 172.21.15.73:0/1949865592 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f802cb90 con 0x7fe4000caed0 2024-03-23T06:11:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3fd400640 1 -- 172.21.15.73:0/1949865592 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f802ccf0 con 0x7fe4000caed0 2024-03-23T06:11:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3fd400640 1 -- 172.21.15.73:0/1949865592 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8034610 con 0x7fe4000caed0 2024-03-23T06:11:44.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3ff200640 1 -- 172.21.15.73:0/1949865592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 msgr2=0x7fe400159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3ff200640 1 --2- 172.21.15.73:0/1949865592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400159e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8009e50 tx=0x7fe3f802bff0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3ff200640 1 -- 172.21.15.73:0/1949865592 shutdown_connections 2024-03-23T06:11:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3ff200640 1 --2- 172.21.15.73:0/1949865592 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400159e30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3ff200640 1 --2- 172.21.15.73:0/1949865592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 0x7fe4000cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.594+0000 7fe3ff200640 1 -- 172.21.15.73:0/1949865592 >> 172.21.15.73:0/1949865592 conn(0x7fe4000713e0 msgr2=0x7fe4000717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.595+0000 7fe3ff200640 1 -- 172.21.15.73:0/1949865592 shutdown_connections 2024-03-23T06:11:44.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.595+0000 7fe3ff200640 1 -- 172.21.15.73:0/1949865592 wait complete. 2024-03-23T06:11:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.596+0000 7fe3ff200640 1 Processor -- start 2024-03-23T06:11:44.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.596+0000 7fe3ff200640 1 -- start start 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.597+0000 7fe3ff200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.597+0000 7fe3ff200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 0x7fe40014ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.597+0000 7fe3ff200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4000cf100 0x7fe4000c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.597+0000 7fe3ff200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4001f1ce0 con 0x7fe4000caed0 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.597+0000 7fe3ff200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4001f2cb0 con 0x7fe4000cf100 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.597+0000 7fe3ff200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4001372a0 con 0x7fe4000ced20 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35808/0 (socket says 172.21.15.73:35808) 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 -- 172.21.15.73:0/2526690979 learned_addr learned my addr 172.21.15.73:0/2526690979 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fe800640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4000cf100 0x7fe4000c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:44.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3f7e00640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 0x7fe40014ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:44.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 -- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 msgr2=0x7fe40014ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:44.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 0x7fe40014ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 -- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4000cf100 msgr2=0x7fe4000c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:44.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4000cf100 0x7fe4000c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 -- 172.21.15.73:0/2526690979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8009b30 con 0x7fe4000caed0 2024-03-23T06:11:44.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.598+0000 7fe3fde00640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400154bf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000e9e0 tx=0x7fe3f000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.599+0000 7fe3f6000640 1 -- 172.21.15.73:0/2526690979 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0009670 con 0x7fe4000caed0 2024-03-23T06:11:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.599+0000 7fe3f6000640 1 -- 172.21.15.73:0/2526690979 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000c970 con 0x7fe4000caed0 2024-03-23T06:11:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.599+0000 7fe3f6000640 1 -- 172.21.15.73:0/2526690979 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000cd20 con 0x7fe4000caed0 2024-03-23T06:11:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.599+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4001f2820 con 0x7fe4000caed0 2024-03-23T06:11:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.599+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4001553c0 con 0x7fe4000caed0 2024-03-23T06:11:44.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.600+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4000c9fa0 con 0x7fe4000caed0 2024-03-23T06:11:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.601+0000 7fe3f6000640 1 -- 172.21.15.73:0/2526690979 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe3f0013470 con 0x7fe4000caed0 2024-03-23T06:11:44.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.602+0000 7fe3f6000640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe3dc06ac00 0x7fe3dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.602+0000 7fe3f6000640 1 -- 172.21.15.73:0/2526690979 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe3f0089c70 con 0x7fe4000caed0 2024-03-23T06:11:44.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.602+0000 7fe3f7e00640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe3dc06ac00 0x7fe3dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:44.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.603+0000 7fe3f7e00640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe3dc06ac00 0x7fe3dc06d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe4001ec3a0 tx=0x7fe3e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:44.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.612+0000 7fe3f6000640 1 -- 172.21.15.73:0/2526690979 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe4000c9fa0 con 0x7fe4000caed0 2024-03-23T06:11:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.870+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe4000c9fa0 con 0x7fe4000caed0 2024-03-23T06:11:44.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.871+0000 7fe3f6000640 1 -- 172.21.15.73:0/2526690979 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fe4000c9fa0 con 0x7fe4000caed0 2024-03-23T06:11:44.870 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe3dc06ac00 msgr2=0x7fe3dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe3dc06ac00 0x7fe3dc06d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe4001ec3a0 tx=0x7fe3e8009040 comp rx=0 tx=0).stop 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 msgr2=0x7fe400154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400154bf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000e9e0 tx=0x7fe3f000eea0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 shutdown_connections 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4000cf100 0x7fe4000c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe3dc06ac00 0x7fe3dc06d0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4000ced20 0x7fe40014ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 --2- 172.21.15.73:0/2526690979 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4000caed0 0x7fe400154bf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 >> 172.21.15.73:0/2526690979 conn(0x7fe4000713e0 msgr2=0x7fe4000cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:44.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 shutdown_connections 2024-03-23T06:11:44.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:44.873+0000 7fe3ff200640 1 -- 172.21.15.73:0/2526690979 wait complete. 2024-03-23T06:11:44.890 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:11:44.891 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:11:44.891 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:11:44.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:11:45.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.087+0000 7faecd800640 1 Processor -- start 2024-03-23T06:11:45.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.087+0000 7faecd800640 1 -- start start 2024-03-23T06:11:45.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.088+0000 7faecd800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faec8153640 0x7faec80c6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.088+0000 7faecd800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec80cbde0 0x7faec8070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.088+0000 7faecd800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec815a600 con 0x7faec806b560 2024-03-23T06:11:45.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.088+0000 7faecd800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec815a080 con 0x7faec8153640 2024-03-23T06:11:45.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.088+0000 7faecd800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec815a320 con 0x7faec80cbde0 2024-03-23T06:11:45.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faec7400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7faec806b560 0x7faec8069cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55192/0 (socket says 172.21.15.73:55192) 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faec7400640 1 -- 172.21.15.73:0/1424611319 learned_addr learned my addr 172.21.15.73:0/1424611319 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faecce00640 1 --2- 172.21.15.73:0/1424611319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec80cbde0 0x7faec8070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faec7e00640 1 --2- 172.21.15.73:0/1424611319 >> v2:172.21.15.110:3300/0 conn(0x7faec8153640 0x7faec80c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faec6a00640 1 -- 172.21.15.73:0/1424611319 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351455394 0 0) 0x7faeb4001110 con 0x7faec806b560 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faec6a00640 1 -- 172.21.15.73:0/1424611319 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeac003520 con 0x7faec806b560 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faecce00640 1 -- 172.21.15.73:0/1424611319 >> v2:172.21.15.110:3300/0 conn(0x7faec8153640 msgr2=0x7faec80c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faecce00640 1 --2- 172.21.15.73:0/1424611319 >> v2:172.21.15.110:3300/0 conn(0x7faec8153640 0x7faec80c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faecce00640 1 -- 172.21.15.73:0/1424611319 >> v1:172.21.15.73:6789/0 conn(0x7faec806b560 legacy=0x7faec8069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faecce00640 1 -- 172.21.15.73:0/1424611319 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec80c5e60 con 0x7faec80cbde0 2024-03-23T06:11:45.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.089+0000 7faec7e00640 1 --2- 172.21.15.73:0/1424611319 >> v2:172.21.15.110:3300/0 conn(0x7faec8153640 0x7faec80c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:45.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.090+0000 7faecce00640 1 --2- 172.21.15.73:0/1424611319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec80cbde0 0x7faec8070010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faec0009d90 tx=0x7faec002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb25655adbd738c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faec6a00640 1 -- 172.21.15.73:0/1424611319 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec002cce0 con 0x7faec80cbde0 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faec6a00640 1 -- 172.21.15.73:0/1424611319 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec002ce40 con 0x7faec80cbde0 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faec6a00640 1 -- 172.21.15.73:0/1424611319 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0034660 con 0x7faec80cbde0 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faecd800640 1 -- 172.21.15.73:0/1424611319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec80cbde0 msgr2=0x7faec8070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faecd800640 1 --2- 172.21.15.73:0/1424611319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec80cbde0 0x7faec8070010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faec0009d90 tx=0x7faec002bf30 comp rx=0 tx=0).stop 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faecd800640 1 -- 172.21.15.73:0/1424611319 shutdown_connections 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faecd800640 1 --2- 172.21.15.73:0/1424611319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec80cbde0 0x7faec8070010 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faecd800640 1 --2- 172.21.15.73:0/1424611319 >> v2:172.21.15.110:3300/0 conn(0x7faec8153640 0x7faec80c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faecd800640 1 -- 172.21.15.73:0/1424611319 >> 172.21.15.73:0/1424611319 conn(0x7faec80cb2c0 msgr2=0x7faec80cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faecd800640 1 -- 172.21.15.73:0/1424611319 shutdown_connections 2024-03-23T06:11:45.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.091+0000 7faecd800640 1 -- 172.21.15.73:0/1424611319 wait complete. 2024-03-23T06:11:45.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.093+0000 7faecd800640 1 Processor -- start 2024-03-23T06:11:45.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.093+0000 7faecd800640 1 -- start start 2024-03-23T06:11:45.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faecd800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faec806b560 0x7faec81f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faecd800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec80cbde0 0x7faec814be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faecd800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec8153640 0x7faec814c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faecd800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec81f30e0 con 0x7faec80cbde0 2024-03-23T06:11:45.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faecd800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec814ba10 con 0x7faec806b560 2024-03-23T06:11:45.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faecd800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec8152260 con 0x7faec8153640 2024-03-23T06:11:45.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faec7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec80cbde0 0x7faec814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faec7400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec80cbde0 0x7faec814be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35812/0 (socket says 172.21.15.73:35812) 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faec7400640 1 -- 172.21.15.73:0/776543897 learned_addr learned my addr 172.21.15.73:0/776543897 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faecce00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec8153640 0x7faec814c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.094+0000 7faec7e00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faec806b560 0x7faec81f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faec7400640 1 -- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec8153640 msgr2=0x7faec814c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faec7400640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faec8153640 0x7faec814c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faec7400640 1 -- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faec806b560 msgr2=0x7faec81f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faec7400640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faec806b560 0x7faec81f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faec7400640 1 -- 172.21.15.73:0/776543897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8009400 con 0x7faec80cbde0 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faec7400640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec80cbde0 0x7faec814be30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c760 tx=0x7faeb400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4005ab0 con 0x7faec80cbde0 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4005c10 con 0x7faec80cbde0 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec0009a70 con 0x7faec80cbde0 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4001d30 con 0x7faec80cbde0 2024-03-23T06:11:45.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.095+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec81f2e00 con 0x7faec80cbde0 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.096+0000 7faecd800640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec8146d50 0x7faec8145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.096+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec8073a60 con 0x7faec8146d50 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.096+0000 7faec7e00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec8146d50 0x7faec8145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.097+0000 7faec7e00640 1 -- 172.21.15.73:0/776543897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faec8153a20 con 0x7faec8146d50 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.097+0000 7faec7e00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec8146d50 0x7faec8145ff0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faeb8011c00 tx=0x7faeb800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.097+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8011cf0 con 0x7faec8146d50 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.098+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7faeb8011e50 con 0x7faec8146d50 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.098+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec8146d50 msgr2=0x7faec8145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.098+0000 7faebfe00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec8146d50 0x7faec8145ff0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7faeb8011c00 tx=0x7faeb800f610 comp rx=0 tx=0).stop 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.098+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec8146d50 msgr2=0x7faec8145ff0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:45.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.098+0000 7faebfe00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec8146d50 0x7faec8145ff0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.098+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faeb4007070 con 0x7faec80cbde0 2024-03-23T06:11:45.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.099+0000 7faebfe00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faea806a910 0x7faea806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.099+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7faeb4088a70 con 0x7faec80cbde0 2024-03-23T06:11:45.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.100+0000 7faec7e00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faea806a910 0x7faea806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.100+0000 7faec7e00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faea806a910 0x7faea806cdd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faeb800fbb0 tx=0x7faeb8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.105+0000 7faecd800640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec81f2910 0x7faec8146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.105+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c6420 con 0x7faec81f2910 2024-03-23T06:11:45.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.105+0000 7faecce00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec81f2910 0x7faec8146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.106+0000 7faecce00640 1 -- 172.21.15.73:0/776543897 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7faec806a820 con 0x7faec81f2910 2024-03-23T06:11:45.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.106+0000 7faecce00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec81f2910 0x7faec8146530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faec806bf10 tx=0x7faec0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.106+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec003e640 con 0x7faec81f2910 2024-03-23T06:11:45.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7faec0042070 con 0x7faec81f2910 2024-03-23T06:11:45.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec81f2910 msgr2=0x7faec8146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faebfe00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec81f2910 0x7faec8146530 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faec806bf10 tx=0x7faec0004a40 comp rx=0 tx=0).stop 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faebfe00640 1 -- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec81f2910 msgr2=0x7faec8146530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faebfe00640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec81f2910 0x7faec8146530 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faec806bf10 tx=0x7faec0004a40 comp rx=0 tx=0).stop 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 10, 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:11:45.107 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 12, 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.108 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:11:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:11:45.110 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:45.111 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.112 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:11:45.113 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:45.114 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:11:45.115 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.116 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:11:45.117 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faea806a910 msgr2=0x7faea806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecd800640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faea806a910 0x7faea806cdd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faeb800fbb0 tx=0x7faeb8008030 comp rx=0 tx=0).stop 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec80cbde0 msgr2=0x7faec814be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecd800640 1 --2- 172.21.15.73:0/776543897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faec80cbde0 0x7faec814be30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c760 tx=0x7faeb400cc20 comp rx=0 tx=0).stop 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecce00640 1 -- 172.21.15.73:0/776543897 reap_dead start 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 shutdown_connections 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 >> 172.21.15.73:0/776543897 conn(0x7faec80cb2c0 msgr2=0x7faec80705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 shutdown_connections 2024-03-23T06:11:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.107+0000 7faecd800640 1 -- 172.21.15.73:0/776543897 wait complete. 2024-03-23T06:11:45.123 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:11:45.123 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:11:45.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:11:45.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.313+0000 7f6809800640 1 Processor -- start 2024-03-23T06:11:45.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.313+0000 7f6809800640 1 -- start start 2024-03-23T06:11:45.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6809800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f680406a7b0 0x7f6804159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6809800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040c75f0 con 0x7f6804069cb0 2024-03-23T06:11:45.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6809800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040c6720 con 0x7f6804153260 2024-03-23T06:11:45.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6809800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680415a2d0 con 0x7f680406a7b0 2024-03-23T06:11:45.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6808e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6804069cb0 0x7f6804163c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55204/0 (socket says 172.21.15.73:55204) 2024-03-23T06:11:45.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6803400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f680406a7b0 0x7f6804159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6808e00640 1 -- 172.21.15.73:0/1004221542 learned_addr learned my addr 172.21.15.73:0/1004221542 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:45.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6803400640 1 -- 172.21.15.73:0/1004221542 >> v1:172.21.15.110:6789/0 conn(0x7f6804153260 legacy=0x7f6804071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6802a00640 1 -- 172.21.15.73:0/1004221542 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244313378 0 0) 0x7f68040c75f0 con 0x7f6804069cb0 2024-03-23T06:11:45.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6803400640 1 -- 172.21.15.73:0/1004221542 >> v1:172.21.15.73:6789/0 conn(0x7f6804069cb0 legacy=0x7f6804163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.315+0000 7f6803400640 1 -- 172.21.15.73:0/1004221542 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040cc1e0 con 0x7f680406a7b0 2024-03-23T06:11:45.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6803400640 1 --2- 172.21.15.73:0/1004221542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f680406a7b0 0x7f6804159d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009750 tx=0x7f67f002b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c2730e69187866 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6802a00640 1 -- 172.21.15.73:0/1004221542 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0031710 con 0x7f680406a7b0 2024-03-23T06:11:45.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6802a00640 1 -- 172.21.15.73:0/1004221542 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f002f050 con 0x7f680406a7b0 2024-03-23T06:11:45.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6802a00640 1 -- 172.21.15.73:0/1004221542 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0031a90 con 0x7f680406a7b0 2024-03-23T06:11:45.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6809800640 1 -- 172.21.15.73:0/1004221542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f680406a7b0 msgr2=0x7f6804159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6809800640 1 --2- 172.21.15.73:0/1004221542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f680406a7b0 0x7f6804159d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009750 tx=0x7f67f002b7b0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6809800640 1 -- 172.21.15.73:0/1004221542 shutdown_connections 2024-03-23T06:11:45.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6809800640 1 --2- 172.21.15.73:0/1004221542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f680406a7b0 0x7f6804159d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.317+0000 7f6809800640 1 -- 172.21.15.73:0/1004221542 >> 172.21.15.73:0/1004221542 conn(0x7f680406adc0 msgr2=0x7f680406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:45.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.318+0000 7f6809800640 1 -- 172.21.15.73:0/1004221542 shutdown_connections 2024-03-23T06:11:45.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.318+0000 7f6809800640 1 -- 172.21.15.73:0/1004221542 wait complete. 2024-03-23T06:11:45.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.319+0000 7f6809800640 1 Processor -- start 2024-03-23T06:11:45.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.319+0000 7f6809800640 1 -- start start 2024-03-23T06:11:45.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6809800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6804069cb0 0x7f68040cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6809800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f680406a7b0 0x7f6804153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6809800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6804153260 0x7f68041f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6809800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804156700 con 0x7f6804069cb0 2024-03-23T06:11:45.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6809800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804155930 con 0x7f680406a7b0 2024-03-23T06:11:45.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6809800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6804155b80 con 0x7f6804153260 2024-03-23T06:11:45.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6803e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6804069cb0 0x7f68040cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6803e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6804069cb0 0x7f68040cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35842/0 (socket says 172.21.15.73:35842) 2024-03-23T06:11:45.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.320+0000 7f6803e00640 1 -- 172.21.15.73:0/2667281795 learned_addr learned my addr 172.21.15.73:0/2667281795 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:45.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6808e00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6804153260 0x7f68041f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6803400640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f680406a7b0 0x7f6804153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6803e00640 1 -- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6804153260 msgr2=0x7f68041f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6803e00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6804153260 0x7f68041f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6803e00640 1 -- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f680406a7b0 msgr2=0x7f6804153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6803e00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f680406a7b0 0x7f6804153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6803e00640 1 -- 172.21.15.73:0/2667281795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009400 con 0x7f6804069cb0 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6803e00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6804069cb0 0x7f68040cada0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c780 tx=0x7f67f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4005270 con 0x7f6804069cb0 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f40053f0 con 0x7f6804069cb0 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6804155e60 con 0x7f6804069cb0 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.321+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f400a880 con 0x7f6804069cb0 2024-03-23T06:11:45.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.322+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6804156420 con 0x7f6804069cb0 2024-03-23T06:11:45.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.323+0000 7f6809800640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6804154140 0x7f68041f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.323+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804073980 con 0x7f6804154140 2024-03-23T06:11:45.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.323+0000 7f6803400640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6804154140 0x7f68041f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.323+0000 7f6803400640 1 -- 172.21.15.73:0/2667281795 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6804070840 con 0x7f6804154140 2024-03-23T06:11:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.323+0000 7f6803400640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6804154140 0x7f68041f2580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f680406dd10 tx=0x7f67f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.324+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f0031710 con 0x7f6804154140 2024-03-23T06:11:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.324+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f67f0031870 con 0x7f6804154140 2024-03-23T06:11:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.324+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6804154140 msgr2=0x7f68041f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.324+0000 7f67fbe00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6804154140 0x7f68041f2580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f680406dd10 tx=0x7f67f00046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.324+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6804154140 msgr2=0x7f68041f2580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.324+0000 7f67fbe00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6804154140 0x7f68041f2580 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f680406dd10 tx=0x7f67f00046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.324+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f67f400a9e0 con 0x7f6804069cb0 2024-03-23T06:11:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.325+0000 7f67fbe00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f67e406a980 0x7f67e406ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.325+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f67f4089330 con 0x7f6804069cb0 2024-03-23T06:11:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.325+0000 7f6803400640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f67e406a980 0x7f67e406ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.326+0000 7f6803400640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f67e406a980 0x7f67e406ce40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68040c9470 tx=0x7f67f0042000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.331+0000 7f6809800640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040c4370 0x7f68041f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.331+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040cc7a0 con 0x7f68040c4370 2024-03-23T06:11:45.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.331+0000 7f6808e00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040c4370 0x7f68041f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.332+0000 7f6808e00640 1 -- 172.21.15.73:0/2667281795 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6804070b20 con 0x7f68040c4370 2024-03-23T06:11:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.332+0000 7f6808e00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040c4370 0x7f68041f1980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f67fc000f80 tx=0x7f67fc007a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.332+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc017070 con 0x7f68040c4370 2024-03-23T06:11:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.332+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5119 (secure 0 0 0) 0x7f67fc00f7a0 con 0x7f68040c4370 2024-03-23T06:11:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.332+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040c4370 msgr2=0x7f68041f1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.332+0000 7f67fbe00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040c4370 0x7f68041f1980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f67fc000f80 tx=0x7f67fc007a90 comp rx=0 tx=0).stop 2024-03-23T06:11:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f67fbe00640 1 -- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040c4370 msgr2=0x7f68041f1980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:45.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f67fbe00640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68040c4370 0x7f68041f1980 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 10, 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:11:45.333 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 12, 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.334 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.335 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:11:45.336 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:11:45.338 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.339 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:11:45.340 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.341 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.342 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.343 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.344 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:11:45.345 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f67e406a980 msgr2=0x7f67e406ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f67e406a980 0x7f67e406ce40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68040c9470 tx=0x7f67f0042000 comp rx=0 tx=0).stop 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6804069cb0 msgr2=0x7f68040cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6804069cb0 0x7f68040cada0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c780 tx=0x7f67f400cc40 comp rx=0 tx=0).stop 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6808e00640 1 -- 172.21.15.73:0/2667281795 reap_dead start 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 shutdown_connections 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 --2- 172.21.15.73:0/2667281795 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6804069cb0 0x7f68040cada0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 >> 172.21.15.73:0/2667281795 conn(0x7f680406adc0 msgr2=0x7f680406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:45.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 shutdown_connections 2024-03-23T06:11:45.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.333+0000 7f6809800640 1 -- 172.21.15.73:0/2667281795 wait complete. 2024-03-23T06:11:45.348 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:11:45.348 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:11:45.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:11:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.542+0000 7f303a000640 1 Processor -- start 2024-03-23T06:11:45.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.542+0000 7f303a000640 1 -- start start 2024-03-23T06:11:45.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f303a000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3034153760 0x7f3034159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f303a000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f303a000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303406a2d0 con 0x7f30340cbd10 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f303a000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303406a5b0 con 0x7f3034153760 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f303a000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303406a890 con 0x7f30340c9740 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f302aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f3033400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3034153760 0x7f3034159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f3033e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f30340cbd10 0x7f30340ca940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:54186/0 (socket says 172.21.15.73:54186) 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f302aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:43166/0 (socket says 172.21.15.73:43166) 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.544+0000 7f3033e00640 1 -- 172.21.15.73:0/3340415951 learned_addr learned my addr 172.21.15.73:0/3340415951 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.545+0000 7f302aa00640 1 -- 172.21.15.73:0/3340415951 >> v2:172.21.15.110:3300/0 conn(0x7f3034153760 msgr2=0x7f3034159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.545+0000 7f3032a00640 1 -- 172.21.15.73:0/3340415951 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497084208 0 0) 0x7f303406a2d0 con 0x7f30340cbd10 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.545+0000 7f302aa00640 1 --2- 172.21.15.73:0/3340415951 >> v2:172.21.15.110:3300/0 conn(0x7f3034153760 0x7f3034159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.545+0000 7f302aa00640 1 -- 172.21.15.73:0/3340415951 >> v1:172.21.15.110:6789/0 conn(0x7f30340cbd10 legacy=0x7f30340ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.545+0000 7f302aa00640 1 -- 172.21.15.73:0/3340415951 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303406ab70 con 0x7f30340c9740 2024-03-23T06:11:45.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.546+0000 7f302aa00640 1 --2- 172.21.15.73:0/3340415951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cb7d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30240097d0 tx=0x7f302402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e444f54147122 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.546+0000 7f3032a00640 1 -- 172.21.15.73:0/3340415951 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024031800 con 0x7f30340c9740 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.546+0000 7f3032a00640 1 -- 172.21.15.73:0/3340415951 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3024031960 con 0x7f30340c9740 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.546+0000 7f3032a00640 1 -- 172.21.15.73:0/3340415951 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024031cf0 con 0x7f30340c9740 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.547+0000 7f303a000640 1 -- 172.21.15.73:0/3340415951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 msgr2=0x7f30340cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.547+0000 7f303a000640 1 --2- 172.21.15.73:0/3340415951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cb7d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30240097d0 tx=0x7f302402b8a0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.547+0000 7f303a000640 1 -- 172.21.15.73:0/3340415951 shutdown_connections 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.547+0000 7f303a000640 1 --2- 172.21.15.73:0/3340415951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cb7d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.547+0000 7f303a000640 1 --2- 172.21.15.73:0/3340415951 >> v2:172.21.15.110:3300/0 conn(0x7f3034153760 0x7f3034159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.547+0000 7f303a000640 1 -- 172.21.15.73:0/3340415951 >> 172.21.15.73:0/3340415951 conn(0x7f303406c310 msgr2=0x7f30340713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.547+0000 7f303a000640 1 -- 172.21.15.73:0/3340415951 shutdown_connections 2024-03-23T06:11:45.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.547+0000 7f303a000640 1 -- 172.21.15.73:0/3340415951 wait complete. 2024-03-23T06:11:45.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.549+0000 7f303a000640 1 Processor -- start 2024-03-23T06:11:45.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.549+0000 7f303a000640 1 -- start start 2024-03-23T06:11:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f303a000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f303a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30340cbd10 0x7f3034157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f303a000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034153760 0x7f3034157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f303a000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034148070 con 0x7f3034153760 2024-03-23T06:11:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f303a000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034148350 con 0x7f30340cbd10 2024-03-23T06:11:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f303a000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30341e2970 con 0x7f30340c9740 2024-03-23T06:11:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034153760 0x7f3034157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034153760 0x7f3034157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35858/0 (socket says 172.21.15.73:35858) 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033e00640 1 -- 172.21.15.73:0/1308085508 learned_addr learned my addr 172.21.15.73:0/1308085508 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f302aa00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30340cbd10 0x7f3034157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033e00640 1 -- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 msgr2=0x7f30340cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033e00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033e00640 1 -- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30340cbd10 msgr2=0x7f3034157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033e00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30340cbd10 0x7f3034157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033e00640 1 -- 172.21.15.73:0/1308085508 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024009400 con 0x7f3034153760 2024-03-23T06:11:45.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.550+0000 7f3033400640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30340c9740 0x7f30340cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:45.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.551+0000 7f3033e00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034153760 0x7f3034157650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f302c00c7e0 tx=0x7f302c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.551+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00a640 con 0x7f3034153760 2024-03-23T06:11:45.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.551+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c00a7c0 con 0x7f3034153760 2024-03-23T06:11:45.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.551+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30341e2c50 con 0x7f3034153760 2024-03-23T06:11:45.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.551+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00ab70 con 0x7f3034153760 2024-03-23T06:11:45.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.551+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30340ce3a0 con 0x7f3034153760 2024-03-23T06:11:45.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.552+0000 7f303a000640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30341f2710 0x7f3034145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.552+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3034072510 con 0x7f30341f2710 2024-03-23T06:11:45.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.552+0000 7f3033400640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30341f2710 0x7f3034145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.553+0000 7f3033400640 1 -- 172.21.15.73:0/1308085508 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30340c9b80 con 0x7f30341f2710 2024-03-23T06:11:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.553+0000 7f3033400640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30341f2710 0x7f3034145530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f301c011c70 tx=0x7f301c00f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.553+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f302c00acd0 con 0x7f3034153760 2024-03-23T06:11:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302be00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f301006ac00 0x7f301006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f302c088fe0 con 0x7f3034153760 2024-03-23T06:11:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c004030 con 0x7f30341f2710 2024-03-23T06:11:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f301c004190 con 0x7f30341f2710 2024-03-23T06:11:45.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30341f2710 msgr2=0x7f3034145530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302be00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30341f2710 0x7f3034145530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f301c011c70 tx=0x7f301c00f610 comp rx=0 tx=0).stop 2024-03-23T06:11:45.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30341f2710 msgr2=0x7f3034145530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:45.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302be00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30341f2710 0x7f3034145530 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f301c011c70 tx=0x7f301c00f610 comp rx=0 tx=0).stop 2024-03-23T06:11:45.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.554+0000 7f302aa00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f301006ac00 0x7f301006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.555+0000 7f302aa00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f301006ac00 0x7f301006d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3024036000 tx=0x7f302403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.561+0000 7f303a000640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303414d2a0 0x7f3034145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.561+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30341e4480 con 0x7f303414d2a0 2024-03-23T06:11:45.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.562+0000 7f3033400640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303414d2a0 0x7f3034145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.562+0000 7f3033400640 1 -- 172.21.15.73:0/1308085508 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f30341e2ae0 con 0x7f303414d2a0 2024-03-23T06:11:45.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.562+0000 7f3033400640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303414d2a0 0x7f3034145a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f301c011c70 tx=0x7f301c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c01e860 con 0x7f303414d2a0 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7f301c024040 con 0x7f303414d2a0 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303414d2a0 msgr2=0x7f3034145a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f302be00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303414d2a0 0x7f3034145a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f301c011c70 tx=0x7f301c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f302be00640 1 -- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303414d2a0 msgr2=0x7f3034145a70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f302be00640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f303414d2a0 0x7f3034145a70 secure :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f301c011c70 tx=0x7f301c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:45.563 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 10, 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 12, 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.564 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.565 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:11:45.566 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:11:45.567 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.569 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:11:45.570 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:11:45.572 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.573 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:11:45.574 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:11:45.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:11:45.575 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:11:45.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:11:45.575 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:11:45.575 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:11:45.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f301006ac00 msgr2=0x7f301006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f303a000640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f301006ac00 0x7f301006d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3024036000 tx=0x7f302403c040 comp rx=0 tx=0).stop 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034153760 msgr2=0x7f3034157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f303a000640 1 --2- 172.21.15.73:0/1308085508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3034153760 0x7f3034157650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f302c00c7e0 tx=0x7f302c00cca0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f3033e00640 1 -- 172.21.15.73:0/1308085508 reap_dead start 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f3033e00640 1 -- 172.21.15.73:0/1308085508 reap_dead start 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 shutdown_connections 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.563+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 >> 172.21.15.73:0/1308085508 conn(0x7f303406c310 msgr2=0x7f3034150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.564+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 shutdown_connections 2024-03-23T06:11:45.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.564+0000 7f303a000640 1 -- 172.21.15.73:0/1308085508 wait complete. 2024-03-23T06:11:45.579 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:11:45.579 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T06:11:45.579 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T06:11:45.579 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T06:11:45.579 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T06:11:45.580 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T06:11:45.580 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:11:45.596 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T06:11:45.596 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:11:45.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.777+0000 7fb7a3a00640 1 Processor -- start 2024-03-23T06:11:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.777+0000 7fb7a3a00640 1 -- start start 2024-03-23T06:11:45.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.779+0000 7fb7a3a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.779+0000 7fb7a3a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79c160ec0 con 0x7fb79c1579b0 2024-03-23T06:11:45.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.779+0000 7fb7a3a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79c157d90 con 0x7fb79c0c66f0 2024-03-23T06:11:45.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.779+0000 7fb7a3a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c0c7370 con 0x7fb79c161bf0 2024-03-23T06:11:45.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.779+0000 7fb7a1a00640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7fb79c0c66f0 legacy=0x7fb79c0c5970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:11:45.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.779+0000 7fb7a1000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb79c1579b0 0x7fb79c0c0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55212/0 (socket says 172.21.15.73:55212) 2024-03-23T06:11:45.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.779+0000 7fb7a1000640 1 -- 172.21.15.73:0/3008438034 learned_addr learned my addr 172.21.15.73:0/3008438034 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:45.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.779+0000 7fb793e00640 1 --2- 172.21.15.73:0/3008438034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.780+0000 7fb79be00640 1 -- 172.21.15.73:0/3008438034 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078791573 0 0) 0x7fb79c160ec0 con 0x7fb79c1579b0 2024-03-23T06:11:45.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.780+0000 7fb79be00640 1 -- 172.21.15.73:0/3008438034 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb77c003520 con 0x7fb79c1579b0 2024-03-23T06:11:45.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.780+0000 7fb793e00640 1 -- 172.21.15.73:0/3008438034 >> v1:172.21.15.110:6789/0 conn(0x7fb79c0c66f0 legacy=0x7fb79c0c5970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:45.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.780+0000 7fb793e00640 1 -- 172.21.15.73:0/3008438034 >> v1:172.21.15.73:6789/0 conn(0x7fb79c1579b0 legacy=0x7fb79c0c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.780+0000 7fb793e00640 1 -- 172.21.15.73:0/3008438034 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c15e3f0 con 0x7fb79c161bf0 2024-03-23T06:11:45.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.781+0000 7fb793e00640 1 --2- 172.21.15.73:0/3008438034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c15d8d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0097d0 tx=0x7fb78c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d8f98be66ce50 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb79be00640 1 -- 172.21.15.73:0/3008438034 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c031770 con 0x7fb79c161bf0 2024-03-23T06:11:45.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb79be00640 1 -- 172.21.15.73:0/3008438034 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c0318d0 con 0x7fb79c161bf0 2024-03-23T06:11:45.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb79be00640 1 -- 172.21.15.73:0/3008438034 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c031c40 con 0x7fb79c161bf0 2024-03-23T06:11:45.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb7a3a00640 1 -- 172.21.15.73:0/3008438034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 msgr2=0x7fb79c15d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb7a3a00640 1 --2- 172.21.15.73:0/3008438034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c15d8d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0097d0 tx=0x7fb78c02b810 comp rx=0 tx=0).stop 2024-03-23T06:11:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb7a3a00640 1 -- 172.21.15.73:0/3008438034 shutdown_connections 2024-03-23T06:11:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb7a3a00640 1 --2- 172.21.15.73:0/3008438034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c15d8d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb7a3a00640 1 -- 172.21.15.73:0/3008438034 >> 172.21.15.73:0/3008438034 conn(0x7fb79c06bb40 msgr2=0x7fb79c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.782+0000 7fb7a3a00640 1 -- 172.21.15.73:0/3008438034 shutdown_connections 2024-03-23T06:11:45.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.783+0000 7fb7a3a00640 1 -- 172.21.15.73:0/3008438034 wait complete. 2024-03-23T06:11:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.784+0000 7fb7a3a00640 1 Processor -- start 2024-03-23T06:11:45.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.784+0000 7fb7a3a00640 1 -- start start 2024-03-23T06:11:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb7a3a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb79c0c66f0 0x7fb79c0c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb7a3a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb79c1579b0 0x7fb79c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb7a3a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb7a3a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c159530 con 0x7fb79c1579b0 2024-03-23T06:11:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb7a3a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c1540d0 con 0x7fb79c0c66f0 2024-03-23T06:11:45.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb7a3a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c154390 con 0x7fb79c161bf0 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb7a1000640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb79c0c66f0 msgr2=0x7fb79c0c1250 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb793e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb79c1579b0 0x7fb79c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.785+0000 7fb7a1000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb79c0c66f0 0x7fb79c0c1250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb793e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb79c1579b0 0x7fb79c153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35876/0 (socket says 172.21.15.73:35876) 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb793e00640 1 -- 172.21.15.73:0/1492769724 learned_addr learned my addr 172.21.15.73:0/1492769724 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb7a1a00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb793e00640 1 -- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 msgr2=0x7fb79c1582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb793e00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c1582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb793e00640 1 -- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb79c0c66f0 msgr2=0x7fb79c0c1250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb793e00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb79c0c66f0 0x7fb79c0c1250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb793e00640 1 -- 172.21.15.73:0/1492769724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c009400 con 0x7fb79c1579b0 2024-03-23T06:11:45.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb793e00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb79c1579b0 0x7fb79c153470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0097d0 tx=0x7fb78c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.786+0000 7fb799600640 1 -- 172.21.15.73:0/1492769724 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c004020 con 0x7fb79c1579b0 2024-03-23T06:11:45.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.787+0000 7fb799600640 1 -- 172.21.15.73:0/1492769724 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78c0041a0 con 0x7fb79c1579b0 2024-03-23T06:11:45.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.787+0000 7fb799600640 1 -- 172.21.15.73:0/1492769724 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78c003610 con 0x7fb79c1579b0 2024-03-23T06:11:45.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.787+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79c154670 con 0x7fb79c1579b0 2024-03-23T06:11:45.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.787+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79c154950 con 0x7fb79c1579b0 2024-03-23T06:11:45.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.788+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79c04e110 con 0x7fb79c1579b0 2024-03-23T06:11:45.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.789+0000 7fb799600640 1 -- 172.21.15.73:0/1492769724 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb78c003770 con 0x7fb79c1579b0 2024-03-23T06:11:45.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.790+0000 7fb799600640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb77806abb0 0x7fb77806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.790+0000 7fb799600640 1 -- 172.21.15.73:0/1492769724 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb78c0ab480 con 0x7fb79c1579b0 2024-03-23T06:11:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.790+0000 7fb7a1000640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb77806abb0 0x7fb77806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:45.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.791+0000 7fb7a1000640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb77806abb0 0x7fb77806d070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb784000c00 tx=0x7fb784007a10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:45.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:45.800+0000 7fb799600640 1 -- 172.21.15.73:0/1492769724 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb78c076380 con 0x7fb79c1579b0 2024-03-23T06:11:46.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.070+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb79c0c64d0 con 0x7fb79c1579b0 2024-03-23T06:11:46.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.070+0000 7fb799600640 1 -- 172.21.15.73:0/1492769724 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fb78c0799a0 con 0x7fb79c1579b0 2024-03-23T06:11:46.070 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb77806abb0 msgr2=0x7fb77806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb77806abb0 0x7fb77806d070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb784000c00 tx=0x7fb784007a10 comp rx=0 tx=0).stop 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb79c1579b0 msgr2=0x7fb79c153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb79c1579b0 0x7fb79c153470 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0097d0 tx=0x7fb78c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 shutdown_connections 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb77806abb0 0x7fb77806d070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb79c161bf0 0x7fb79c1582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb79c1579b0 0x7fb79c153470 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 --2- 172.21.15.73:0/1492769724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb79c0c66f0 0x7fb79c0c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 >> 172.21.15.73:0/1492769724 conn(0x7fb79c06bb40 msgr2=0x7fb79c15fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:46.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 shutdown_connections 2024-03-23T06:11:46.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:46.073+0000 7fb7a3a00640 1 -- 172.21.15.73:0/1492769724 wait complete. 2024-03-23T06:11:47.372 INFO:tasks.workunit.client.0.smithi073.stderr:Updating files: 64% (7756/12088) Updating files: 65% (7858/12088) Updating files: 66% (7979/12088) Updating files: 67% (8099/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '82316b04821a6c2c1d458a881920454bbadb8837'. 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-23T06:11:48.164 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-03-23T06:11:48.165 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 82316b04821 Merge branch 'wip-64881-reef' of https://github.com/sseshasa/ceph into wip-yuri11-testing-2024-03-21-1324-reef 2024-03-23T06:11:48.175 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-23T06:11:48.235 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-23T06:11:48.241 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-23T06:11:48.241 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-23T06:11:49.066 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-23T06:11:49.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:49.172 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-23T06:11:49.258 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-23T06:11:49.264 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-23T06:11:49.264 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-23T06:11:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.291+0000 7fd7e0600640 1 Processor -- start 2024-03-23T06:11:49.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.291+0000 7fd7e0600640 1 -- start start 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7e0600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 0x7fd7d8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7e0600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd7d8069cb0 0x7fd7d80701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7e0600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d8065a50 con 0x7fd7d81537f0 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7e0600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d806bfd0 con 0x7fd7d8069cb0 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7e0600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80c5d30 con 0x7fd7d8153410 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7dd200640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7fd7d81537f0 legacy=0x7fd7d80c6780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7de600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd7d8069cb0 0x7fd7d80701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7de600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd7d8069cb0 0x7fd7d80701d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35892/0 (socket says 172.21.15.73:35892) 2024-03-23T06:11:49.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7de600640 1 -- 172.21.15.73:0/2954189804 learned_addr learned my addr 172.21.15.73:0/2954189804 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:49.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7ddc00640 1 --2- 172.21.15.73:0/2954189804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 0x7fd7d8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:49.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7de600640 1 -- 172.21.15.73:0/2954189804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 msgr2=0x7fd7d8159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:49.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7de600640 1 --2- 172.21.15.73:0/2954189804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 0x7fd7d8159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7de600640 1 -- 172.21.15.73:0/2954189804 >> v1:172.21.15.110:6789/0 conn(0x7fd7d81537f0 legacy=0x7fd7d80c6780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:49.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.293+0000 7fd7de600640 1 -- 172.21.15.73:0/2954189804 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8065ca0 con 0x7fd7d8069cb0 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.294+0000 7fd7de600640 1 --2- 172.21.15.73:0/2954189804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d8069cb0 0x7fd7d80701d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009e50 tx=0x7fd7d002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e69c50f4aab59 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7d7e00640 1 -- 172.21.15.73:0/2954189804 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d002c9e0 con 0x7fd7d8069cb0 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7d7e00640 1 -- 172.21.15.73:0/2954189804 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d002cb40 con 0x7fd7d8069cb0 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7d7e00640 1 -- 172.21.15.73:0/2954189804 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00343f0 con 0x7fd7d8069cb0 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7e0600640 1 -- 172.21.15.73:0/2954189804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d8069cb0 msgr2=0x7fd7d80701d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2954189804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d8069cb0 0x7fd7d80701d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009e50 tx=0x7fd7d002be40 comp rx=0 tx=0).stop 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7e0600640 1 -- 172.21.15.73:0/2954189804 shutdown_connections 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2954189804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d8069cb0 0x7fd7d80701d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2954189804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 0x7fd7d8159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7e0600640 1 -- 172.21.15.73:0/2954189804 >> 172.21.15.73:0/2954189804 conn(0x7fd7d806dcc0 msgr2=0x7fd7d806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:49.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7e0600640 1 -- 172.21.15.73:0/2954189804 shutdown_connections 2024-03-23T06:11:49.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.295+0000 7fd7e0600640 1 -- 172.21.15.73:0/2954189804 wait complete. 2024-03-23T06:11:49.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.297+0000 7fd7e0600640 1 Processor -- start 2024-03-23T06:11:49.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.297+0000 7fd7e0600640 1 -- start start 2024-03-23T06:11:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7e0600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d8069cb0 0x7fd7d80c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7e0600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 0x7fd7d8149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7e0600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d81537f0 0x7fd7d81f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7e0600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d81efe40 con 0x7fd7d81537f0 2024-03-23T06:11:49.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7e0600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d814ab90 con 0x7fd7d8069cb0 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7e0600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d814ae50 con 0x7fd7d8153410 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7ddc00640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d8069cb0 msgr2=0x7fd7d80c4770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7ddc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d8069cb0 0x7fd7d80c4770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7de600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d81537f0 0x7fd7d81f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7dd200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 0x7fd7d8149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7de600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d81537f0 0x7fd7d81f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35902/0 (socket says 172.21.15.73:35902) 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.298+0000 7fd7de600640 1 -- 172.21.15.73:0/2931408638 learned_addr learned my addr 172.21.15.73:0/2931408638 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7de600640 1 -- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 msgr2=0x7fd7d8149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7de600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 0x7fd7d8149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7de600640 1 -- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d8069cb0 msgr2=0x7fd7d80c4770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7de600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d8069cb0 0x7fd7d80c4770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7de600640 1 -- 172.21.15.73:0/2931408638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d0009b30 con 0x7fd7d81537f0 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7de600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d81537f0 0x7fd7d81f1f40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009e50 tx=0x7fd7d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:49.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7d5600640 1 -- 172.21.15.73:0/2931408638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0009510 con 0x7fd7d81537f0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7d5600640 1 -- 172.21.15.73:0/2931408638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d003e450 con 0x7fd7d81537f0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d81501f0 con 0x7fd7d81537f0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.299+0000 7fd7d5600640 1 -- 172.21.15.73:0/2931408638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d003e800 con 0x7fd7d81537f0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.300+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d8148b10 con 0x7fd7d81537f0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.301+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d8150710 con 0x7fd7d81537f0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.301+0000 7fd7d5600640 1 -- 172.21.15.73:0/2931408638 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd7d003e960 con 0x7fd7d81537f0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.303+0000 7fd7d5600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7b806abb0 0x7fd7b806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.303+0000 7fd7d5600640 1 -- 172.21.15.73:0/2931408638 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd7d00ac300 con 0x7fd7d81537f0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.303+0000 7fd7ddc00640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7b806abb0 0x7fd7b806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:49.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.304+0000 7fd7ddc00640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7b806abb0 0x7fd7b806d070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0094a0 tx=0x7fd7cc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:49.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.307+0000 7fd7d5600640 1 -- 172.21.15.73:0/2931408638 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd7d8150710 con 0x7fd7d81537f0 2024-03-23T06:11:49.334 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-23T06:11:49.342 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:11:49.342 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-23T06:11:49.384 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-03-23T06:11:49.385 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-03-23T06:11:49.385 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=82316b04821a6c2c1d458a881920454bbadb8837 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-03-23T06:11:49.509 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into 'ffsb'... 2024-03-23T06:11:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.572+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd7d8148970 con 0x7fd7d81537f0 2024-03-23T06:11:49.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.572+0000 7fd7d5600640 1 -- 172.21.15.73:0/2931408638 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fd7d8148970 con 0x7fd7d81537f0 2024-03-23T06:11:49.572 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7b806abb0 msgr2=0x7fd7b806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7b806abb0 0x7fd7b806d070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0094a0 tx=0x7fd7cc009190 comp rx=0 tx=0).stop 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d81537f0 msgr2=0x7fd7d81f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d81537f0 0x7fd7d81f1f40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009e50 tx=0x7fd7d0004a40 comp rx=0 tx=0).stop 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 shutdown_connections 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7d81537f0 0x7fd7d81f1f40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7b806abb0 0x7fd7b806d070 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7d8153410 0x7fd7d8149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 --2- 172.21.15.73:0/2931408638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7d8069cb0 0x7fd7d80c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 >> 172.21.15.73:0/2931408638 conn(0x7fd7d806dcc0 msgr2=0x7fd7d80701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 shutdown_connections 2024-03-23T06:11:49.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:49.575+0000 7fd7e0600640 1 -- 172.21.15.73:0/2931408638 wait complete. 2024-03-23T06:11:52.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.804+0000 7f50c6400640 1 Processor -- start 2024-03-23T06:11:52.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.804+0000 7f50c6400640 1 -- start start 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50c6400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c01513f0 0x7f50c00c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50c6400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50c01586b0 0x7f50c00bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50c6400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c00c5f50 con 0x7f50c00c03a0 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50c6400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c0157b60 con 0x7f50c01586b0 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50c6400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00c0830 con 0x7f50c01513f0 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50bea00640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f50c01586b0 msgr2=0x7f50c00bfe60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50bea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50c01586b0 0x7f50c00bfe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50bf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c01513f0 0x7f50c00c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50bfe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f50c00c03a0 0x7f50c0071bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:40574/0 (socket says 172.21.15.73:40574) 2024-03-23T06:11:52.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.806+0000 7f50bfe00640 1 -- 172.21.15.73:0/469884718 learned_addr learned my addr 172.21.15.73:0/469884718 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:11:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.807+0000 7f50bf400640 1 -- 172.21.15.73:0/469884718 >> v2:172.21.15.110:3300/0 conn(0x7f50c01586b0 msgr2=0x7f50c00bfe60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.807+0000 7f50bf400640 1 --2- 172.21.15.73:0/469884718 >> v2:172.21.15.110:3300/0 conn(0x7f50c01586b0 0x7f50c00bfe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.807+0000 7f50bf400640 1 -- 172.21.15.73:0/469884718 >> v1:172.21.15.73:6789/0 conn(0x7f50c00c03a0 legacy=0x7f50c0071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:52.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.807+0000 7f50bf400640 1 -- 172.21.15.73:0/469884718 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00c0b10 con 0x7f50c01513f0 2024-03-23T06:11:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.808+0000 7f50bf400640 1 --2- 172.21.15.73:0/469884718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c01513f0 0x7f50c00c5a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50b00097a0 tx=0x7f50b002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=effdfd66581a7b70 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.808+0000 7f50be000640 1 -- 172.21.15.73:0/469884718 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0030610 con 0x7f50c01513f0 2024-03-23T06:11:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.808+0000 7f50be000640 1 -- 172.21.15.73:0/469884718 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0030770 con 0x7f50c01513f0 2024-03-23T06:11:52.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.808+0000 7f50be000640 1 -- 172.21.15.73:0/469884718 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0030b00 con 0x7f50c01513f0 2024-03-23T06:11:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.809+0000 7f50c6400640 1 -- 172.21.15.73:0/469884718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c01513f0 msgr2=0x7f50c00c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.809+0000 7f50c6400640 1 --2- 172.21.15.73:0/469884718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c01513f0 0x7f50c00c5a10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f50b00097a0 tx=0x7f50b002b960 comp rx=0 tx=0).stop 2024-03-23T06:11:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.809+0000 7f50c6400640 1 -- 172.21.15.73:0/469884718 shutdown_connections 2024-03-23T06:11:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.809+0000 7f50c6400640 1 --2- 172.21.15.73:0/469884718 >> v2:172.21.15.110:3300/0 conn(0x7f50c01586b0 0x7f50c00bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.809+0000 7f50c6400640 1 --2- 172.21.15.73:0/469884718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c01513f0 0x7f50c00c5a10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.809+0000 7f50c6400640 1 -- 172.21.15.73:0/469884718 >> 172.21.15.73:0/469884718 conn(0x7f50c006bb40 msgr2=0x7f50c006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.809+0000 7f50c6400640 1 -- 172.21.15.73:0/469884718 shutdown_connections 2024-03-23T06:11:52.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.809+0000 7f50c6400640 1 -- 172.21.15.73:0/469884718 wait complete. 2024-03-23T06:11:52.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.811+0000 7f50c6400640 1 Processor -- start 2024-03-23T06:11:52.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.811+0000 7f50c6400640 1 -- start start 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50c6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c01513f0 0x7f50c014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50c6400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c01586b0 0x7f50c014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50c6400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c014b470 0x7f50c014d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50c6400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00c7d20 con 0x7f50c01586b0 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50c6400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00c7f50 con 0x7f50c01513f0 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50c6400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00c8210 con 0x7f50c014b470 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bf400640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c01513f0 msgr2=0x7f50c014a050 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c01513f0 0x7f50c014a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c01586b0 0x7f50c014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:52.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c01586b0 0x7f50c014cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57354/0 (socket says 172.21.15.73:57354) 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bea00640 1 -- 172.21.15.73:0/1967187670 learned_addr learned my addr 172.21.15.73:0/1967187670 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bfe00640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c014b470 0x7f50c014d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bea00640 1 -- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c014b470 msgr2=0x7f50c014d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bea00640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c014b470 0x7f50c014d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bea00640 1 -- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c01513f0 msgr2=0x7f50c014a050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.812+0000 7f50bea00640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c01513f0 0x7f50c014a050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.813+0000 7f50bea00640 1 -- 172.21.15.73:0/1967187670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009400 con 0x7f50c01586b0 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.813+0000 7f50bea00640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c01586b0 0x7f50c014cc80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00b550 tx=0x7f50ac00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.813+0000 7f50b7400640 1 -- 172.21.15.73:0/1967187670 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac003dc0 con 0x7f50c01586b0 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.813+0000 7f50b7400640 1 -- 172.21.15.73:0/1967187670 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac005070 con 0x7f50c01586b0 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.813+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c014fb40 con 0x7f50c01586b0 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.813+0000 7f50b7400640 1 -- 172.21.15.73:0/1967187670 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac005420 con 0x7f50c01586b0 2024-03-23T06:11:52.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.813+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c0150100 con 0x7f50c01586b0 2024-03-23T06:11:52.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.814+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c0157fd0 con 0x7f50c01586b0 2024-03-23T06:11:52.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.815+0000 7f50b7400640 1 -- 172.21.15.73:0/1967187670 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f50ac005580 con 0x7f50c01586b0 2024-03-23T06:11:52.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.816+0000 7f50b7400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f50a006abb0 0x7f50a006d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:52.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.816+0000 7f50b7400640 1 -- 172.21.15.73:0/1967187670 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f50ac0896b0 con 0x7f50c01586b0 2024-03-23T06:11:52.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.816+0000 7f50bf400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f50a006abb0 0x7f50a006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:52.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.817+0000 7f50bf400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f50a006abb0 0x7f50a006d070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50b0036000 tx=0x7f50b0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:52.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:52.821+0000 7f50b7400640 1 -- 172.21.15.73:0/1967187670 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f50c0157fd0 con 0x7f50c01586b0 2024-03-23T06:11:53.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.089+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f50c0157fd0 con 0x7f50c01586b0 2024-03-23T06:11:53.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.090+0000 7f50b7400640 1 -- 172.21.15.73:0/1967187670 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f50ac013620 con 0x7f50c01586b0 2024-03-23T06:11:53.090 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f50a006abb0 msgr2=0x7f50a006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f50a006abb0 0x7f50a006d070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50b0036000 tx=0x7f50b0008030 comp rx=0 tx=0).stop 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c01586b0 msgr2=0x7f50c014cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c01586b0 0x7f50c014cc80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00b550 tx=0x7f50ac00ba10 comp rx=0 tx=0).stop 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 shutdown_connections 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f50a006abb0 0x7f50a006d070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c014b470 0x7f50c014d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50c01586b0 0x7f50c014cc80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 --2- 172.21.15.73:0/1967187670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c01513f0 0x7f50c014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 >> 172.21.15.73:0/1967187670 conn(0x7f50c006bb40 msgr2=0x7f50c0155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 shutdown_connections 2024-03-23T06:11:53.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:53.093+0000 7f50c6400640 1 -- 172.21.15.73:0/1967187670 wait complete. 2024-03-23T06:11:55.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:11:55.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:11:56.113 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:11:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.329+0000 7fb93d600640 1 Processor -- start 2024-03-23T06:11:56.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.329+0000 7fb93d600640 1 -- start start 2024-03-23T06:11:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.330+0000 7fb93d600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.330+0000 7fb93d600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.330+0000 7fb93d600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93806f9b0 con 0x7fb9380c7e10 2024-03-23T06:11:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.330+0000 7fb93d600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb938070250 con 0x7fb938150100 2024-03-23T06:11:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb93d600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380c0150 con 0x7fb9380c6fe0 2024-03-23T06:11:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb936a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:56.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb937400640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7fb9380c7e10 legacy=0x7fb938071d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:11:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb936a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57356/0 (socket says 172.21.15.73:57356) 2024-03-23T06:11:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 learned_addr learned my addr 172.21.15.73:0/1573862751 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:11:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:56.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:11:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:56.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.331+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb937400640 1 -- 172.21.15.73:0/1573862751 >> v1:172.21.15.110:6789/0 conn(0x7fb9380c7e10 legacy=0x7fb938071d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.532+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.533+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:11:56.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.533+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:11:56.690 INFO:tasks.workunit.client.0.smithi073.stderr:Updating files: 72% (43/59) Updating files: 74% (44/59) Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-03-23T06:11:56.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.933+0000 7fb937400640 1 -- 172.21.15.73:0/1573862751 >> v1:172.21.15.110:6789/0 conn(0x7fb9380c7e10 legacy=0x7fb938071d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:11:56.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.934+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.934+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.934+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.934+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.934+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.934+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.935+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.935+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.935+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:56.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:56.935+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:11:57.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.734+0000 7fb937400640 1 -- 172.21.15.73:0/1573862751 >> v1:172.21.15.110:6789/0 conn(0x7fb9380c7e10 legacy=0x7fb938071d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:11:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.736+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:57.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.736+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.736+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:11:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.736+0000 7fb936a00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.736+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.736+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:11:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.736+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:11:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.737+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:11:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.737+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:11:57.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:57.737+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:11:57.845 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-23T06:11:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb934c00640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 msgr2=0x7fb938156070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb934c00640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9380c6fe0 0x7fb938156070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb934c00640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 msgr2=0x7fb9380c6aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb934c00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.73:3300/0 conn(0x7fb938150100 0x7fb9380c6aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb934c00640 1 -- 172.21.15.73:0/1573862751 >> v1:172.21.15.110:6789/0 conn(0x7fb9380c7e10 legacy=0x7fb938071d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb934c00640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.110:3300/0 conn(0x7fb914007330 0x7fb9140097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb934c00640 1 -- 172.21.15.73:0/1573862751 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9380c03f0 con 0x7fb914003680 2024-03-23T06:11:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb934c00640 1 -- 172.21.15.73:0/1573862751 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb938070250 con 0x7fb914007330 2024-03-23T06:11:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.331+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.110:3300/0 conn(0x7fb914007330 msgr2=0x7fb9140097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:11:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.332+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.110:3300/0 conn(0x7fb914007330 0x7fb9140097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:59.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.533+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.110:3300/0 conn(0x7fb914007330 msgr2=0x7fb9140097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:11:59.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.533+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.110:3300/0 conn(0x7fb914007330 0x7fb9140097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:11:59.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.720+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352273975 0 0) 0x7fb9380c03f0 con 0x7fb914003680 2024-03-23T06:11:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.720+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb91c003520 con 0x7fb914003680 2024-03-23T06:11:59.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.721+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609919821 0 0) 0x7fb91c003520 con 0x7fb914003680 2024-03-23T06:11:59.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.721+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 >> v2:172.21.15.110:3300/0 conn(0x7fb914007330 msgr2=0x7fb9140097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:59.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.721+0000 7fb936000640 1 --2- 172.21.15.73:0/1573862751 >> v2:172.21.15.110:3300/0 conn(0x7fb914007330 0x7fb9140097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.721+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93806f9b0 con 0x7fb914003680 2024-03-23T06:11:59.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.721+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fb92800c570 con 0x7fb914003680 2024-03-23T06:11:59.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.721+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 >> v1:172.21.15.73:6789/0 conn(0x7fb914003680 legacy=0x7fb914005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:59.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb937400640 1 -- 172.21.15.73:0/1573862751 reap_dead start 2024-03-23T06:11:59.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb936000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 0x7fb91c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:59.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb936000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0047c0 0x7fb91c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:59.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb936000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0052a0 0x7fb91c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:59.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb938070250 con 0x7fb91c003970 2024-03-23T06:11:59.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c00c1f0 con 0x7fb91c0047c0 2024-03-23T06:11:59.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c00c3b0 con 0x7fb91c0052a0 2024-03-23T06:11:59.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb92e000640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0047c0 msgr2=0x7fb91c004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:11:59.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.722+0000 7fb92e000640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0047c0 0x7fb91c004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:59.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.723+0000 7fb937400640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0052a0 0x7fb91c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:59.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.723+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 0x7fb91c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:59.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.723+0000 7fb937400640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0047c0 msgr2=0x7fb91c004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:11:59.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.723+0000 7fb937400640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0047c0 0x7fb91c004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.723+0000 7fb937400640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 msgr2=0x7fb91c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:11:59.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.723+0000 7fb937400640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 0x7fb91c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.724+0000 7fb937400640 1 -- 172.21.15.73:0/1573862751 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c003520 con 0x7fb91c0052a0 2024-03-23T06:11:59.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.724+0000 7fb936a00640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 0x7fb91c003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:11:59.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.726+0000 7fb937400640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0052a0 0x7fb91c00b980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb914009e50 tx=0x7fb91c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=928dc232e75c9d9d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:59.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.731+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93002cc20 con 0x7fb91c0052a0 2024-03-23T06:11:59.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.731+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93002cd80 con 0x7fb91c0052a0 2024-03-23T06:11:59.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.731+0000 7fb936000640 1 -- 172.21.15.73:0/1573862751 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930034650 con 0x7fb91c0052a0 2024-03-23T06:11:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 -- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0052a0 msgr2=0x7fb91c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:59.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0052a0 0x7fb91c00b980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb914009e50 tx=0x7fb91c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 -- 172.21.15.73:0/1573862751 shutdown_connections 2024-03-23T06:11:59.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0052a0 0x7fb91c00b980 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0047c0 0x7fb91c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 --2- 172.21.15.73:0/1573862751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 0x7fb91c003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 -- 172.21.15.73:0/1573862751 >> 172.21.15.73:0/1573862751 conn(0x7fb93806bb40 msgr2=0x7fb93806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:11:59.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 -- 172.21.15.73:0/1573862751 shutdown_connections 2024-03-23T06:11:59.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.733+0000 7fb93d600640 1 -- 172.21.15.73:0/1573862751 wait complete. 2024-03-23T06:11:59.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.741+0000 7fb93d600640 1 Processor -- start 2024-03-23T06:11:59.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.742+0000 7fb93d600640 1 -- start start 2024-03-23T06:11:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.746+0000 7fb93d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 0x7fb9381ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:59.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.746+0000 7fb93d600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0047c0 0x7fb938152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.746+0000 7fb93d600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0052a0 0x7fb9380c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.746+0000 7fb93d600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380c1fe0 con 0x7fb91c003970 2024-03-23T06:11:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.746+0000 7fb93d600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9381efab0 con 0x7fb91c0052a0 2024-03-23T06:11:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.746+0000 7fb93d600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb938156b60 con 0x7fb91c0047c0 2024-03-23T06:11:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.747+0000 7fb937400640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0052a0 msgr2=0x7fb9380c3130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:11:59.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.747+0000 7fb92e000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0047c0 0x7fb938152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:59.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.747+0000 7fb92e000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0047c0 0x7fb938152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51186/0 (socket says 172.21.15.73:51186) 2024-03-23T06:11:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.747+0000 7fb92e000640 1 -- 172.21.15.73:0/2656968064 learned_addr learned my addr 172.21.15.73:0/2656968064 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:11:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.747+0000 7fb937400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0052a0 0x7fb9380c3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:11:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.748+0000 7fb92e000640 1 -- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0052a0 msgr2=0x7fb9380c3130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:11:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.748+0000 7fb92e000640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0052a0 0x7fb9380c3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.748+0000 7fb92e000640 1 -- 172.21.15.73:0/2656968064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 msgr2=0x7fb9381ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:11:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.748+0000 7fb92e000640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 0x7fb9381ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:11:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.748+0000 7fb92e000640 1 -- 172.21.15.73:0/2656968064 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938156e40 con 0x7fb91c0047c0 2024-03-23T06:11:59.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.748+0000 7fb92e000640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0047c0 0x7fb938152be0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9200135c0 tx=0x7fb920013a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:59.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.750+0000 7fb92f400640 1 -- 172.21.15.73:0/2656968064 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920015890 con 0x7fb91c0047c0 2024-03-23T06:11:59.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.751+0000 7fb92f400640 1 -- 172.21.15.73:0/2656968064 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb920015a10 con 0x7fb91c0047c0 2024-03-23T06:11:59.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.751+0000 7fb92f400640 1 -- 172.21.15.73:0/2656968064 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920015dc0 con 0x7fb91c0047c0 2024-03-23T06:11:59.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.751+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb938154fb0 con 0x7fb91c0047c0 2024-03-23T06:11:59.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.751+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb938155570 con 0x7fb91c0047c0 2024-03-23T06:11:59.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.752+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9380bff30 con 0x7fb91c0047c0 2024-03-23T06:11:59.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.753+0000 7fb92f400640 1 -- 172.21.15.73:0/2656968064 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb920016460 con 0x7fb91c0047c0 2024-03-23T06:11:59.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.754+0000 7fb92f400640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb91406b220 0x7fb91406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:11:59.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.754+0000 7fb92f400640 1 -- 172.21.15.73:0/2656968064 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb920089c10 con 0x7fb91c0047c0 2024-03-23T06:11:59.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.754+0000 7fb936a00640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb91406b220 0x7fb91406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:11:59.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.755+0000 7fb936a00640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb91406b220 0x7fb91406d6e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb928006e00 tx=0x7fb928006d90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:11:59.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:11:59.760+0000 7fb92f400640 1 -- 172.21.15.73:0/2656968064 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb920054af0 con 0x7fb91c0047c0 2024-03-23T06:12:00.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.039+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb9380c6560 con 0x7fb91c0047c0 2024-03-23T06:12:00.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.040+0000 7fb92f400640 1 -- 172.21.15.73:0/2656968064 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7fb920026020 con 0x7fb91c0047c0 2024-03-23T06:12:00.040 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":14,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb91406b220 msgr2=0x7fb91406d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb91406b220 0x7fb91406d6e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb928006e00 tx=0x7fb928006d90 comp rx=0 tx=0).stop 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0047c0 msgr2=0x7fb938152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0047c0 0x7fb938152be0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb9200135c0 tx=0x7fb920013a80 comp rx=0 tx=0).stop 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 shutdown_connections 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91c0052a0 0x7fb9380c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb91406b220 0x7fb91406d6e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb91c0047c0 0x7fb938152be0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 --2- 172.21.15.73:0/2656968064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb91c003970 0x7fb9381ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 >> 172.21.15.73:0/2656968064 conn(0x7fb93806bb40 msgr2=0x7fb938071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 shutdown_connections 2024-03-23T06:12:00.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.043+0000 7fb93d600640 1 -- 172.21.15.73:0/2656968064 wait complete. 2024-03-23T06:12:00.063 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:12:00.063 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T06:12:00.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:12:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.271+0000 7f19dfe00640 1 Processor -- start 2024-03-23T06:12:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.272+0000 7f19dfe00640 1 -- start start 2024-03-23T06:12:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dfe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19d8153760 0x7f19d8159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80c9740 0x7f19d80cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dfe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19d80cbd10 0x7f19d80ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dfe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d806a2d0 con 0x7f19d8153760 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dfe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d806a5b0 con 0x7f19d80cbd10 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dfe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d806a890 con 0x7f19d80c9740 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dd400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19d8153760 0x7f19d8159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dde00640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f19d80cbd10 msgr2=0x7f19d80ca940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dd400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19d8153760 0x7f19d8159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51304/0 (socket says 172.21.15.73:51304) 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dd400640 1 -- 172.21.15.73:0/839433895 learned_addr learned my addr 172.21.15.73:0/839433895 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.273+0000 7f19dde00640 1 --2- 172.21.15.73:0/839433895 >> v2:172.21.15.110:3300/0 conn(0x7f19d80cbd10 0x7f19d80ca940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.274+0000 7f19dca00640 1 --2- 172.21.15.73:0/839433895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80c9740 0x7f19d80cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.274+0000 7f19dd400640 1 -- 172.21.15.73:0/839433895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80c9740 msgr2=0x7f19d80cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.274+0000 7f19dd400640 1 --2- 172.21.15.73:0/839433895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80c9740 0x7f19d80cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.274+0000 7f19dd400640 1 -- 172.21.15.73:0/839433895 >> v2:172.21.15.110:3300/0 conn(0x7f19d80cbd10 msgr2=0x7f19d80ca940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:00.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.274+0000 7f19dd400640 1 --2- 172.21.15.73:0/839433895 >> v2:172.21.15.110:3300/0 conn(0x7f19d80cbd10 0x7f19d80ca940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.274+0000 7f19dd400640 1 -- 172.21.15.73:0/839433895 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d806ab70 con 0x7f19d8153760 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.275+0000 7f19dd400640 1 --2- 172.21.15.73:0/839433895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d8153760 0x7f19d8159420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009870 tx=0x7f19c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b23f6511f955da server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.275+0000 7f19d7e00640 1 -- 172.21.15.73:0/839433895 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8031870 con 0x7f19d8153760 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.275+0000 7f19d7e00640 1 -- 172.21.15.73:0/839433895 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c80319d0 con 0x7f19d8153760 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.275+0000 7f19d7e00640 1 -- 172.21.15.73:0/839433895 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8031d60 con 0x7f19d8153760 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 -- 172.21.15.73:0/839433895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d8153760 msgr2=0x7f19d8159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 --2- 172.21.15.73:0/839433895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d8153760 0x7f19d8159420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009870 tx=0x7f19c802b910 comp rx=0 tx=0).stop 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 -- 172.21.15.73:0/839433895 shutdown_connections 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 --2- 172.21.15.73:0/839433895 >> v2:172.21.15.110:3300/0 conn(0x7f19d80cbd10 0x7f19d80ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 --2- 172.21.15.73:0/839433895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80c9740 0x7f19d80cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 --2- 172.21.15.73:0/839433895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d8153760 0x7f19d8159420 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 -- 172.21.15.73:0/839433895 >> 172.21.15.73:0/839433895 conn(0x7f19d806c310 msgr2=0x7f19d80713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 -- 172.21.15.73:0/839433895 shutdown_connections 2024-03-23T06:12:00.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.276+0000 7f19dfe00640 1 -- 172.21.15.73:0/839433895 wait complete. 2024-03-23T06:12:00.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.278+0000 7f19dfe00640 1 Processor -- start 2024-03-23T06:12:00.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.278+0000 7f19dfe00640 1 -- start start 2024-03-23T06:12:00.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c9740 0x7f19d80c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80cbd10 0x7f19d81583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19d8153760 0x7f19d81f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dfe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d81f3430 con 0x7f19d80c9740 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dfe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8153f70 con 0x7f19d8153760 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dfe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80ce130 con 0x7f19d80cbd10 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c9740 0x7f19d80c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dde00640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19d8153760 msgr2=0x7f19d81f2ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dd400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c9740 0x7f19d80c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51316/0 (socket says 172.21.15.73:51316) 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dd400640 1 -- 172.21.15.73:0/1654734089 learned_addr learned my addr 172.21.15.73:0/1654734089 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dde00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19d8153760 0x7f19d81f2ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dca00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80cbd10 0x7f19d81583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dd400640 1 -- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80cbd10 msgr2=0x7f19d81583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dd400640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19d80cbd10 0x7f19d81583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dd400640 1 -- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19d8153760 msgr2=0x7f19d81f2ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dd400640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19d8153760 0x7f19d81f2ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.279+0000 7f19dd400640 1 -- 172.21.15.73:0/1654734089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80094d0 con 0x7f19d80c9740 2024-03-23T06:12:00.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.280+0000 7f19dd400640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c9740 0x7f19d80c7d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009870 tx=0x7f19c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.280+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c803ac60 con 0x7f19d80c9740 2024-03-23T06:12:00.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.280+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c803ade0 con 0x7f19d80c9740 2024-03-23T06:12:00.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.280+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c8044630 con 0x7f19d80c9740 2024-03-23T06:12:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.280+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d80c6fc0 con 0x7f19d80c9740 2024-03-23T06:12:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.280+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d80c7280 con 0x7f19d80c9740 2024-03-23T06:12:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.281+0000 7f19dfe00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c8da0 0x7f19d80c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.281+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8072510 con 0x7f19d80c8da0 2024-03-23T06:12:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.281+0000 7f19dca00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c8da0 0x7f19d80c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.282+0000 7f19dca00640 1 -- 172.21.15.73:0/1654734089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19d80c9b80 con 0x7f19d80c8da0 2024-03-23T06:12:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.282+0000 7f19dca00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c8da0 0x7f19d80c6350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19d80b42a0 tx=0x7f19c4010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.282+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f19c804d450 con 0x7f19d80c9740 2024-03-23T06:12:00.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.283+0000 7f19d5600640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f19b806abb0 0x7f19b806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.283+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f19c802d040 con 0x7f19d80c9740 2024-03-23T06:12:00.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.283+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4004240 con 0x7f19d80c8da0 2024-03-23T06:12:00.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.284+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f19c40043a0 con 0x7f19d80c8da0 2024-03-23T06:12:00.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.284+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c8da0 msgr2=0x7f19d80c6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.284+0000 7f19d5600640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c8da0 0x7f19d80c6350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19d80b42a0 tx=0x7f19c4010c10 comp rx=0 tx=0).stop 2024-03-23T06:12:00.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.284+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c8da0 msgr2=0x7f19d80c6350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:00.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.284+0000 7f19d5600640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c8da0 0x7f19d80c6350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.284+0000 7f19dde00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f19b806abb0 0x7f19b806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.284+0000 7f19dde00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f19b806abb0 0x7f19b806d070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19d0003cb0 tx=0x7f19d00091f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.290+0000 7f19dfe00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80cdbf0 0x7f19d80c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.290+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8153b40 con 0x7f19d80cdbf0 2024-03-23T06:12:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.291+0000 7f19dca00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80cdbf0 0x7f19d80c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.291+0000 7f19dca00640 1 -- 172.21.15.73:0/1654734089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f19d80720f0 con 0x7f19d80cdbf0 2024-03-23T06:12:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.291+0000 7f19dca00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80cdbf0 0x7f19d80c7470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19d81f00a0 tx=0x7f19c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4025070 con 0x7f19d80cdbf0 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4939 (secure 0 0 0) 0x7f19c4003d80 con 0x7f19d80cdbf0 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80cdbf0 msgr2=0x7f19d80c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19d5600640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80cdbf0 0x7f19d80c7470 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19d81f00a0 tx=0x7f19c40046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19d5600640 1 -- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80cdbf0 msgr2=0x7f19d80c7470 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19d5600640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80cdbf0 0x7f19d80c7470 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f19d81f00a0 tx=0x7f19c40046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:00.292 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 14, 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:00.293 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:00.294 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:12:00.295 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.296 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:00.299 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.300 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.301 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.302 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:12:00.303 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f19b806abb0 msgr2=0x7f19b806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19dfe00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f19b806abb0 0x7f19b806d070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19d0003cb0 tx=0x7f19d00091f0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c9740 msgr2=0x7f19d80c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19dfe00640 1 --2- 172.21.15.73:0/1654734089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19d80c9740 0x7f19d80c7d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009870 tx=0x7f19c80046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19dde00640 1 -- 172.21.15.73:0/1654734089 reap_dead start 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.292+0000 7f19dde00640 1 -- 172.21.15.73:0/1654734089 reap_dead start 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.293+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 shutdown_connections 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.293+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 >> 172.21.15.73:0/1654734089 conn(0x7f19d806c310 msgr2=0x7f19d8150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.293+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 shutdown_connections 2024-03-23T06:12:00.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.293+0000 7f19dfe00640 1 -- 172.21.15.73:0/1654734089 wait complete. 2024-03-23T06:12:00.308 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:12:00.309 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T06:12:00.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:12:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.504+0000 7fe297200640 1 Processor -- start 2024-03-23T06:12:00.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.504+0000 7fe297200640 1 -- start start 2024-03-23T06:12:00.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe297200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe290151480 0x7fe290157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe297200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c7e40 0x7fe290071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe297200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe290072090 0x7fe2900c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe297200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2901588d0 con 0x7fe290151480 2024-03-23T06:12:00.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe297200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29015b710 con 0x7fe290072090 2024-03-23T06:12:00.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe297200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29015ab90 con 0x7fe2900c7e40 2024-03-23T06:12:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe28fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe290151480 0x7fe290157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe295200640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7fe290072090 msgr2=0x7fe2900c5490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:12:00.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe295200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe290072090 0x7fe2900c5490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe28fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe290151480 0x7fe290157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51350/0 (socket says 172.21.15.73:51350) 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.506+0000 7fe28fe00640 1 -- 172.21.15.73:0/2823743002 learned_addr learned my addr 172.21.15.73:0/2823743002 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.507+0000 7fe28f400640 1 --2- 172.21.15.73:0/2823743002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c7e40 0x7fe290071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.507+0000 7fe28fe00640 1 -- 172.21.15.73:0/2823743002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c7e40 msgr2=0x7fe290071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.507+0000 7fe28fe00640 1 --2- 172.21.15.73:0/2823743002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c7e40 0x7fe290071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.507+0000 7fe28fe00640 1 -- 172.21.15.73:0/2823743002 >> v2:172.21.15.110:3300/0 conn(0x7fe290072090 msgr2=0x7fe2900c5490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.507+0000 7fe28fe00640 1 --2- 172.21.15.73:0/2823743002 >> v2:172.21.15.110:3300/0 conn(0x7fe290072090 0x7fe2900c5490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.507+0000 7fe28fe00640 1 -- 172.21.15.73:0/2823743002 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29015ae70 con 0x7fe290151480 2024-03-23T06:12:00.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.507+0000 7fe28f400640 1 --2- 172.21.15.73:0/2823743002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c7e40 0x7fe290071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:12:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.508+0000 7fe28fe00640 1 --2- 172.21.15.73:0/2823743002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 0x7fe290157e60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe29006cc80 tx=0x7fe28002b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb82b124b4ac036 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe28ea00640 1 -- 172.21.15.73:0/2823743002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280030880 con 0x7fe290151480 2024-03-23T06:12:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe28ea00640 1 -- 172.21.15.73:0/2823743002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2800309e0 con 0x7fe290151480 2024-03-23T06:12:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe28ea00640 1 -- 172.21.15.73:0/2823743002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280030d70 con 0x7fe290151480 2024-03-23T06:12:00.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe297200640 1 -- 172.21.15.73:0/2823743002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 msgr2=0x7fe290157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe297200640 1 --2- 172.21.15.73:0/2823743002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 0x7fe290157e60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe29006cc80 tx=0x7fe28002b9c0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe297200640 1 -- 172.21.15.73:0/2823743002 shutdown_connections 2024-03-23T06:12:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe297200640 1 --2- 172.21.15.73:0/2823743002 >> v2:172.21.15.110:3300/0 conn(0x7fe290072090 0x7fe2900c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe297200640 1 --2- 172.21.15.73:0/2823743002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c7e40 0x7fe290071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe297200640 1 --2- 172.21.15.73:0/2823743002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 0x7fe290157e60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.509+0000 7fe297200640 1 -- 172.21.15.73:0/2823743002 >> 172.21.15.73:0/2823743002 conn(0x7fe290069cb0 msgr2=0x7fe29006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.510+0000 7fe297200640 1 -- 172.21.15.73:0/2823743002 shutdown_connections 2024-03-23T06:12:00.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.510+0000 7fe297200640 1 -- 172.21.15.73:0/2823743002 wait complete. 2024-03-23T06:12:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.511+0000 7fe297200640 1 Processor -- start 2024-03-23T06:12:00.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.511+0000 7fe297200640 1 -- start start 2024-03-23T06:12:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.512+0000 7fe297200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe290072090 0x7fe29006fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.512+0000 7fe297200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2900c7e40 0x7fe29014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.512+0000 7fe297200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 0x7fe2900c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.512+0000 7fe297200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c96f0 con 0x7fe290151480 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.512+0000 7fe297200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900ca050 con 0x7fe2900c7e40 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.512+0000 7fe297200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900c8d90 con 0x7fe290072090 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe28f400640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2900c7e40 msgr2=0x7fe29014d3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe28f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2900c7e40 0x7fe29014d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 0x7fe2900c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 0x7fe2900c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51356/0 (socket says 172.21.15.73:51356) 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe28fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe290072090 0x7fe29006fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 -- 172.21.15.73:0/1048187901 learned_addr learned my addr 172.21.15.73:0/1048187901 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 -- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe290072090 msgr2=0x7fe29006fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe290072090 0x7fe29006fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 -- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2900c7e40 msgr2=0x7fe29014d3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2900c7e40 0x7fe29014d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 -- 172.21.15.73:0/1048187901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009400 con 0x7fe290151480 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe28fe00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe290072090 0x7fe29006fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.513+0000 7fe295200640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 0x7fe2900c9b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe28800b990 tx=0x7fe28800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.514+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800cb20 con 0x7fe290151480 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.514+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28800cc80 con 0x7fe290151480 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.514+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2800094d0 con 0x7fe290151480 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.514+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880156b0 con 0x7fe290151480 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.514+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2900c9030 con 0x7fe290151480 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.515+0000 7fe297200640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c9250 0x7fe290149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.515+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900ca3a0 con 0x7fe2900c9250 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.515+0000 7fe28fe00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c9250 0x7fe290149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.516+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe288012070 con 0x7fe290151480 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.516+0000 7fe28fe00640 1 -- 172.21.15.73:0/1048187901 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe29015b430 con 0x7fe2900c9250 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.516+0000 7fe28fe00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c9250 0x7fe290149090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe29006ab60 tx=0x7fe2800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe287e00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe27006abb0 0x7fe27006d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe2880896f0 con 0x7fe290151480 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe28f400640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe27006abb0 0x7fe27006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280044670 con 0x7fe2900c9250 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fe2800447d0 con 0x7fe2900c9250 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c9250 msgr2=0x7fe290149090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe287e00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c9250 0x7fe290149090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe29006ab60 tx=0x7fe2800046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c9250 msgr2=0x7fe290149090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.517+0000 7fe287e00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2900c9250 0x7fe290149090 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe29006ab60 tx=0x7fe2800046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:00.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.518+0000 7fe28f400640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe27006abb0 0x7fe27006d070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2900c0fa0 tx=0x7fe27c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.524+0000 7fe297200640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29006f940 0x7fe2901495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.524+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe290073bf0 con 0x7fe29006f940 2024-03-23T06:12:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.524+0000 7fe28fe00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29006f940 0x7fe2901495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:00.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.525+0000 7fe28fe00640 1 -- 172.21.15.73:0/1048187901 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe2900c82b0 con 0x7fe29006f940 2024-03-23T06:12:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.525+0000 7fe28fe00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29006f940 0x7fe2901495d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe28002ba00 tx=0x7fe280009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.525+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280003a20 con 0x7fe29006f940 2024-03-23T06:12:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.525+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7fe280003b80 con 0x7fe29006f940 2024-03-23T06:12:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.525+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29006f940 msgr2=0x7fe2901495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.525+0000 7fe287e00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29006f940 0x7fe2901495d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe28002ba00 tx=0x7fe280009240 comp rx=0 tx=0).stop 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.525+0000 7fe287e00640 1 -- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29006f940 msgr2=0x7fe2901495d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.525+0000 7fe287e00640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe29006f940 0x7fe2901495d0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe28002ba00 tx=0x7fe280009240 comp rx=0 tx=0).stop 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 14, 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:12:00.526 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:00.527 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.528 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:12:00.529 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.530 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:12:00.531 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.532 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:00.533 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:00.534 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:12:00.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.536 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:00.537 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:00.538 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:00.538 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:00.538 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:00.538 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:12:00.538 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe27006abb0 msgr2=0x7fe27006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe297200640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe27006abb0 0x7fe27006d070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe2900c0fa0 tx=0x7fe27c009190 comp rx=0 tx=0).stop 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 msgr2=0x7fe2900c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe297200640 1 --2- 172.21.15.73:0/1048187901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe290151480 0x7fe2900c9b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe28800b990 tx=0x7fe28800be50 comp rx=0 tx=0).stop 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe295200640 1 -- 172.21.15.73:0/1048187901 reap_dead start 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe295200640 1 -- 172.21.15.73:0/1048187901 reap_dead start 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 shutdown_connections 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 >> 172.21.15.73:0/1048187901 conn(0x7fe290069cb0 msgr2=0x7fe290158cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 shutdown_connections 2024-03-23T06:12:00.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:00.526+0000 7fe297200640 1 -- 172.21.15.73:0/1048187901 wait complete. 2024-03-23T06:12:00.543 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:12:00.543 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:12:00.891 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether build environment is sane... yes 2024-03-23T06:12:00.916 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-03-23T06:12:00.917 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gawk... gawk 2024-03-23T06:12:00.949 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether make sets $(MAKE)... yes 2024-03-23T06:12:01.022 INFO:tasks.workunit.client.0.smithi073.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-03-23T06:12:01.022 INFO:tasks.workunit.client.0.smithi073.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-03-23T06:12:01.037 INFO:tasks.workunit.client.0.smithi073.stdout:checking for style of include used by make... GNU 2024-03-23T06:12:01.042 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... gcc 2024-03-23T06:12:01.154 INFO:tasks.workunit.client.0.smithi073.stdout:checking for C compiler default output file name... a.out 2024-03-23T06:12:01.161 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether the C compiler works... yes 2024-03-23T06:12:01.166 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are cross compiling... no 2024-03-23T06:12:01.241 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of executables... 2024-03-23T06:12:01.319 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of object files... o 2024-03-23T06:12:01.392 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... yes 2024-03-23T06:12:01.635 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... yes 2024-03-23T06:12:01.786 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-23T06:12:01.956 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... gcc3 2024-03-23T06:12:02.117 INFO:tasks.workunit.client.0.smithi073.stdout:checking how to run the C preprocessor... gcc -E 2024-03-23T06:12:02.233 INFO:tasks.workunit.client.0.smithi073.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-03-23T06:12:02.238 INFO:tasks.workunit.client.0.smithi073.stdout:checking for egrep... /usr/bin/grep -E 2024-03-23T06:12:02.269 INFO:tasks.workunit.client.0.smithi073.stdout:checking for AIX... no 2024-03-23T06:12:02.288 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... (cached) gcc 2024-03-23T06:12:02.315 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-23T06:12:02.318 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-23T06:12:02.318 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-23T06:12:02.318 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... (cached) gcc3 2024-03-23T06:12:02.435 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lm... yes 2024-03-23T06:12:03.406 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lpthread... yes 2024-03-23T06:12:03.735 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... yes 2024-03-23T06:12:03.890 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-03-23T06:12:03.992 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/types.h... yes 2024-03-23T06:12:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/stat.h... yes 2024-03-23T06:12:04.219 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdlib.h... yes 2024-03-23T06:12:04.332 INFO:tasks.workunit.client.0.smithi073.stdout:checking for string.h... yes 2024-03-23T06:12:04.451 INFO:tasks.workunit.client.0.smithi073.stdout:checking for memory.h... yes 2024-03-23T06:12:04.561 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strings.h... yes 2024-03-23T06:12:04.676 INFO:tasks.workunit.client.0.smithi073.stdout:checking for inttypes.h... yes 2024-03-23T06:12:04.784 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... yes 2024-03-23T06:12:04.897 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... yes 2024-03-23T06:12:05.025 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h usability... yes 2024-03-23T06:12:05.075 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h presence... yes 2024-03-23T06:12:05.076 INFO:tasks.workunit.client.0.smithi073.stdout:checking for pthread.h... yes 2024-03-23T06:12:05.188 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h usability... yes 2024-03-23T06:12:05.233 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h presence... yes 2024-03-23T06:12:05.235 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fcntl.h... yes 2024-03-23T06:12:05.343 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h usability... yes 2024-03-23T06:12:05.395 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h presence... yes 2024-03-23T06:12:05.397 INFO:tasks.workunit.client.0.smithi073.stdout:checking for limits.h... yes 2024-03-23T06:12:05.432 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... (cached) yes 2024-03-23T06:12:05.972 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h usability... yes 2024-03-23T06:12:06.026 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h presence... yes 2024-03-23T06:12:06.028 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/time.h... yes 2024-03-23T06:12:06.062 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... (cached) yes 2024-03-23T06:12:06.173 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h usability... yes 2024-03-23T06:12:06.226 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h presence... yes 2024-03-23T06:12:06.228 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/vfs.h... yes 2024-03-23T06:12:06.334 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h usability... no 2024-03-23T06:12:06.652 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h presence... no 2024-03-23T06:12:06.654 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/limits.h... no 2024-03-23T06:12:06.744 INFO:tasks.workunit.client.0.smithi073.stdout:checking for an ANSI C-conforming const... yes 2024-03-23T06:12:06.808 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-03-23T06:12:06.811 INFO:tasks.workunit.client.0.smithi073.stdout:checking for function prototypes... yes 2024-03-23T06:12:06.870 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether setvbuf arguments are reversed... no 2024-03-23T06:12:07.332 INFO:tasks.workunit.client.0.smithi073.stdout:checking for system... yes 2024-03-23T06:12:07.471 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gettimeofday... yes 2024-03-23T06:12:07.605 INFO:tasks.workunit.client.0.smithi073.stdout:checking for mkdir... yes 2024-03-23T06:12:07.744 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strerror... yes 2024-03-23T06:12:08.141 INFO:tasks.workunit.client.0.smithi073.stdout:checking for open64... yes 2024-03-23T06:12:08.287 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stat64... yes 2024-03-23T06:12:08.421 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fseeko64... yes 2024-03-23T06:12:08.562 INFO:tasks.workunit.client.0.smithi073.stdout:checking for lrand48_r... yes 2024-03-23T06:12:08.695 INFO:tasks.workunit.client.0.smithi073.stdout:checking for srand48_r... yes 2024-03-23T06:12:08.749 INFO:tasks.workunit.client.0.smithi073.stdout:configure: creating ./config.status 2024-03-23T06:12:09.033 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating Makefile 2024-03-23T06:12:09.076 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-03-23T06:12:09.121 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing depfiles commands 2024-03-23T06:12:09.233 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing default commands 2024-03-23T06:12:09.331 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-03-23T06:12:09.338 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-03-23T06:12:09.341 INFO:tasks.workunit.client.0.smithi073.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-03-23T06:12:09.341 INFO:tasks.workunit.client.0.smithi073.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-03-23T06:12:09.341 INFO:tasks.workunit.client.0.smithi073.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-03-23T06:12:09.341 INFO:tasks.workunit.client.0.smithi073.stderr: any GNU archive site. 2024-03-23T06:12:09.351 INFO:tasks.workunit.client.0.smithi073.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-03-23T06:12:09.355 INFO:tasks.workunit.client.0.smithi073.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-03-23T06:12:09.358 INFO:tasks.workunit.client.0.smithi073.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-03-23T06:12:09.358 INFO:tasks.workunit.client.0.smithi073.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-03-23T06:12:09.358 INFO:tasks.workunit.client.0.smithi073.stderr: You might want to install the `Automake' and `Perl' packages. 2024-03-23T06:12:09.358 INFO:tasks.workunit.client.0.smithi073.stderr: Grab them from any GNU archive site. 2024-03-23T06:12:10.404 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-03-23T06:12:10.946 INFO:tasks.workunit.client.0.smithi073.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-03-23T06:12:10.947 INFO:tasks.workunit.client.0.smithi073.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-03-23T06:12:10.947 INFO:tasks.workunit.client.0.smithi073.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-03-23T06:12:10.947 INFO:tasks.workunit.client.0.smithi073.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-03-23T06:12:11.161 INFO:tasks.workunit.client.0.smithi073.stdout:/bin/sh ./config.status --recheck 2024-03-23T06:12:11.706 INFO:tasks.workunit.client.0.smithi073.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-03-23T06:12:11.956 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-23T06:12:12.972 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether build environment is sane... yes 2024-03-23T06:12:12.990 INFO:tasks.workunit.client.0.smithi073.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-03-23T06:12:12.991 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gawk... gawk 2024-03-23T06:12:13.025 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether make sets $(MAKE)... yes 2024-03-23T06:12:13.123 INFO:tasks.workunit.client.0.smithi073.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-03-23T06:12:13.123 INFO:tasks.workunit.client.0.smithi073.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-03-23T06:12:13.142 INFO:tasks.workunit.client.0.smithi073.stdout:checking for style of include used by make... GNU 2024-03-23T06:12:13.147 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... gcc 2024-03-23T06:12:13.304 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether the C compiler works... yes 2024-03-23T06:12:13.304 INFO:tasks.workunit.client.0.smithi073.stdout:checking for C compiler default output file name... a.out 2024-03-23T06:12:13.383 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of executables... 2024-03-23T06:12:13.463 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are cross compiling... no 2024-03-23T06:12:14.227 INFO:tasks.workunit.client.0.smithi073.stdout:checking for suffix of object files... o 2024-03-23T06:12:14.291 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... yes 2024-03-23T06:12:14.349 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... yes 2024-03-23T06:12:14.428 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-23T06:12:14.595 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... gcc3 2024-03-23T06:12:14.682 INFO:tasks.workunit.client.0.smithi073.stdout:checking how to run the C preprocessor... gcc -E 2024-03-23T06:12:14.786 INFO:tasks.workunit.client.0.smithi073.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-03-23T06:12:14.792 INFO:tasks.workunit.client.0.smithi073.stdout:checking for egrep... /usr/bin/grep -E 2024-03-23T06:12:15.309 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... yes 2024-03-23T06:12:15.386 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/types.h... yes 2024-03-23T06:12:17.239 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/stat.h... yes 2024-03-23T06:12:17.324 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdlib.h... yes 2024-03-23T06:12:17.407 INFO:tasks.workunit.client.0.smithi073.stdout:checking for string.h... yes 2024-03-23T06:12:17.492 INFO:tasks.workunit.client.0.smithi073.stdout:checking for memory.h... yes 2024-03-23T06:12:17.578 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strings.h... yes 2024-03-23T06:12:17.657 INFO:tasks.workunit.client.0.smithi073.stdout:checking for inttypes.h... yes 2024-03-23T06:12:17.741 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... yes 2024-03-23T06:12:18.461 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... yes 2024-03-23T06:12:18.549 INFO:tasks.workunit.client.0.smithi073.stdout:checking minix/config.h usability... no 2024-03-23T06:12:18.600 INFO:tasks.workunit.client.0.smithi073.stdout:checking minix/config.h presence... no 2024-03-23T06:12:18.600 INFO:tasks.workunit.client.0.smithi073.stdout:checking for minix/config.h... no 2024-03-23T06:12:18.672 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-03-23T06:12:18.673 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc... (cached) gcc 2024-03-23T06:12:18.743 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-23T06:12:18.743 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-23T06:12:18.743 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-23T06:12:18.743 INFO:tasks.workunit.client.0.smithi073.stdout:checking dependency style of gcc... (cached) gcc3 2024-03-23T06:12:18.829 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lm... yes 2024-03-23T06:12:18.919 INFO:tasks.workunit.client.0.smithi073.stdout:checking for main in -lpthread... yes 2024-03-23T06:12:18.924 INFO:tasks.workunit.client.0.smithi073.stdout:checking for ANSI C header files... (cached) yes 2024-03-23T06:12:18.996 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-03-23T06:12:19.098 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h usability... yes 2024-03-23T06:12:19.132 INFO:tasks.workunit.client.0.smithi073.stdout:checking pthread.h presence... yes 2024-03-23T06:12:19.132 INFO:tasks.workunit.client.0.smithi073.stdout:checking for pthread.h... yes 2024-03-23T06:12:19.226 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h usability... yes 2024-03-23T06:12:19.260 INFO:tasks.workunit.client.0.smithi073.stdout:checking fcntl.h presence... yes 2024-03-23T06:12:19.260 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fcntl.h... yes 2024-03-23T06:12:19.372 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h usability... yes 2024-03-23T06:12:19.405 INFO:tasks.workunit.client.0.smithi073.stdout:checking limits.h presence... yes 2024-03-23T06:12:19.405 INFO:tasks.workunit.client.0.smithi073.stdout:checking for limits.h... yes 2024-03-23T06:12:19.431 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stdint.h... (cached) yes 2024-03-23T06:12:19.509 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h usability... yes 2024-03-23T06:12:19.810 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/time.h presence... yes 2024-03-23T06:12:19.810 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/time.h... yes 2024-03-23T06:12:19.840 INFO:tasks.workunit.client.0.smithi073.stdout:checking for unistd.h... (cached) yes 2024-03-23T06:12:19.924 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h usability... yes 2024-03-23T06:12:19.956 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/vfs.h presence... yes 2024-03-23T06:12:19.956 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/vfs.h... yes 2024-03-23T06:12:20.055 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h usability... no 2024-03-23T06:12:20.106 INFO:tasks.workunit.client.0.smithi073.stdout:checking sys/limits.h presence... no 2024-03-23T06:12:20.106 INFO:tasks.workunit.client.0.smithi073.stdout:checking for sys/limits.h... no 2024-03-23T06:12:20.162 INFO:tasks.workunit.client.0.smithi073.stdout:checking for an ANSI C-conforming const... yes 2024-03-23T06:12:20.219 INFO:tasks.workunit.client.0.smithi073.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-03-23T06:12:20.332 INFO:tasks.workunit.client.0.smithi073.stdout:checking for system... yes 2024-03-23T06:12:20.445 INFO:tasks.workunit.client.0.smithi073.stdout:checking for gettimeofday... yes 2024-03-23T06:12:20.544 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T06:12:20.544 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T06:12:20.544 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T06:12:20.544 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T06:12:20.547 INFO:tasks.ceph.mon.b:Started 2024-03-23T06:12:20.547 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:12:20.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:12:20.558 INFO:tasks.workunit.client.0.smithi073.stdout:checking for mkdir... yes 2024-03-23T06:12:20.658 INFO:tasks.workunit.client.0.smithi073.stdout:checking for strerror... yes 2024-03-23T06:12:20.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.730+0000 7f954c200640 1 Processor -- start 2024-03-23T06:12:20.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.731+0000 7f954c200640 1 -- start start 2024-03-23T06:12:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954c200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954c200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954c200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f954415a520 con 0x7f95441536a0 2024-03-23T06:12:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954c200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95440cab20 con 0x7f9544153a80 2024-03-23T06:12:20.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95441599a0 con 0x7f95441594f0 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9549800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9549800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47436/0 (socket says 172.21.15.73:47436) 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 learned_addr learned my addr 172.21.15.73:0/2171313276 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:20.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:20.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.732+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:20.758 INFO:tasks.workunit.client.0.smithi073.stdout:checking for open64... yes 2024-03-23T06:12:20.862 INFO:tasks.workunit.client.0.smithi073.stdout:checking for stat64... yes 2024-03-23T06:12:20.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:20.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.933+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.934+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.934+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.934+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:20.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:20.934+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:12:20.975 INFO:tasks.workunit.client.0.smithi073.stdout:checking for fseeko64... yes 2024-03-23T06:12:21.092 INFO:tasks.workunit.client.0.smithi073.stdout:checking for lrand48_r... yes 2024-03-23T06:12:21.208 INFO:tasks.workunit.client.0.smithi073.stdout:checking for srand48_r... yes 2024-03-23T06:12:21.257 INFO:tasks.workunit.client.0.smithi073.stdout:configure: creating ./config.status 2024-03-23T06:12:21.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.335+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:21.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.336+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.337+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:12:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.337+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.337+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.337+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:12:21.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.337+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:21.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.337+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:12:21.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.338+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:21.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.338+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:21.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.338+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:12:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.343+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:12:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.343+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.343+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:21.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:21.343+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:12:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.138+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.139+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:12:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.139+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.139+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:22.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.139+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:12:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.139+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.140+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:12:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.140+0000 7f9549800640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.140+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:22.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.140+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:12:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.144+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.144+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:12:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.144+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.144+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:22.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:22.145+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:12:22.343 INFO:tasks.workunit.client.0.smithi073.stdout: /bin/sh ./config.status 2024-03-23T06:12:22.463 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating Makefile 2024-03-23T06:12:22.489 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-03-23T06:12:22.533 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing depfiles commands 2024-03-23T06:12:22.570 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: executing default commands 2024-03-23T06:12:23.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:23.732+0000 7f9542a00640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95440cc3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:23.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:23.732+0000 7f9542a00640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95440cc3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:23.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:23.732+0000 7f9542a00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 msgr2=0x7f95440cbe90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:23.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:23.732+0000 7f9542a00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.110:3300/0 conn(0x7f9544153a80 0x7f95440cbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:23.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:23.732+0000 7f9542a00640 1 -- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 msgr2=0x7f95440ca5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:23.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:23.732+0000 7f9542a00640 1 --2- 172.21.15.73:0/2171313276 >> v2:172.21.15.73:3300/0 conn(0x7f95441536a0 0x7f95440ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:23.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:23.732+0000 7f9542a00640 1 -- 172.21.15.73:0/2171313276 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9544159c80 con 0x7f952c007330 2024-03-23T06:12:23.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:23.732+0000 7f9542a00640 1 -- 172.21.15.73:0/2171313276 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c00c060 con 0x7f952c0036c0 2024-03-23T06:12:25.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:12:25.675 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.670+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611274003 0 0) 0x7f9544159c80 con 0x7f952c007330 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.670+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9524003520 con 0x7f952c007330 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.671+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3017032296 0 0) 0x7f9524003520 con 0x7f952c007330 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.671+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 >> v1:172.21.15.110:6789/0 conn(0x7f952c0036c0 legacy=0x7f952c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.671+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c00d260 con 0x7f952c007330 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.671+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f953000d580 con 0x7f952c007330 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.671+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 >> v1:172.21.15.73:6789/0 conn(0x7f952c007330 legacy=0x7f952c0097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.671+0000 7f954a200640 1 -- 172.21.15.73:0/2171313276 reap_dead start 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.671+0000 7f9543e00640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524003a40 0x7f9524003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.672+0000 7f9543e00640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.672+0000 7f9543e00640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524004f00 0x7f952400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:25.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.672+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9524005690 con 0x7f9524004f00 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.672+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952400bef0 con 0x7f9524003a40 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.672+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952400c0b0 con 0x7f95441594f0 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.672+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.672+0000 7f9549800640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524003a40 0x7f9524003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.673+0000 7f954a200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524004f00 0x7f952400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.673+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524003a40 msgr2=0x7f9524003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.673+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524003a40 0x7f9524003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.673+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524004f00 msgr2=0x7f952400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.673+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524004f00 0x7f952400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.673+0000 7f9548e00640 1 -- 172.21.15.73:0/2171313276 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9524003520 con 0x7f95441594f0 2024-03-23T06:12:25.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.676+0000 7f9548e00640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95240047c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9530006fd0 tx=0x7f95240057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8514422855b7eb9c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:25.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.689+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953002d5b0 con 0x7f95441594f0 2024-03-23T06:12:25.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.689+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9530031070 con 0x7f95441594f0 2024-03-23T06:12:25.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.689+0000 7f9543e00640 1 -- 172.21.15.73:0/2171313276 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953002d950 con 0x7f95441594f0 2024-03-23T06:12:25.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.690+0000 7f954c200640 1 -- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f95240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:25.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.690+0000 7f954c200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95240047c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9530006fd0 tx=0x7f95240057f0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.690+0000 7f954c200640 1 -- 172.21.15.73:0/2171313276 shutdown_connections 2024-03-23T06:12:25.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.690+0000 7f954c200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524004f00 0x7f952400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.690+0000 7f954c200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f95240047c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.690+0000 7f954c200640 1 --2- 172.21.15.73:0/2171313276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524003a40 0x7f9524003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.690+0000 7f954c200640 1 -- 172.21.15.73:0/2171313276 >> 172.21.15.73:0/2171313276 conn(0x7f954406a060 msgr2=0x7f954406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:25.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.691+0000 7f954c200640 1 -- 172.21.15.73:0/2171313276 shutdown_connections 2024-03-23T06:12:25.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.691+0000 7f954c200640 1 -- 172.21.15.73:0/2171313276 wait complete. 2024-03-23T06:12:25.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.695+0000 7f954c200640 1 Processor -- start 2024-03-23T06:12:25.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.696+0000 7f954c200640 1 -- start start 2024-03-23T06:12:25.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.697+0000 7f954c200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524003a40 0x7f954414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:25.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.697+0000 7f954c200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 0x7f9544145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:25.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.697+0000 7f954c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f9544147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:25.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954c200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95440b38f0 con 0x7f9524003a40 2024-03-23T06:12:25.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954c200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95441f27f0 con 0x7f9524004f00 2024-03-23T06:12:25.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95441f2d50 con 0x7f95441594f0 2024-03-23T06:12:25.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f9548e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 0x7f9544145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:25.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f9544147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:25.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f9548e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 0x7f9544145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37002/0 (socket says 172.21.15.73:37002) 2024-03-23T06:12:25.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f9548e00640 1 -- 172.21.15.73:0/877564805 learned_addr learned my addr 172.21.15.73:0/877564805 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:25.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f9544147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:40212/0 (socket says 172.21.15.73:40212) 2024-03-23T06:12:25.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f9549800640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524003a40 0x7f954414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:25.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f9548e00640 1 -- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 msgr2=0x7f9544145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T06:12:25.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f9548e00640 1 -- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 msgr2=0x7f9544145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:12:25.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f9548e00640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 0x7f9544145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:25.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954a200640 1 -- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f9544147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T06:12:25.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954a200640 1 -- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f9544147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:12:25.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f9548e00640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 0x7f9544145ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:25.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954a200640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f9544147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:25.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.698+0000 7f954a200640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f9544147790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:25.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.699+0000 7f9549800640 1 -- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 msgr2=0x7f9544147790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.699+0000 7f9549800640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f9544147790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.699+0000 7f9549800640 1 -- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 msgr2=0x7f9544145ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.699+0000 7f9549800640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 0x7f9544145ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.699+0000 7f9549800640 1 -- 172.21.15.73:0/877564805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440b4300 con 0x7f9524003a40 2024-03-23T06:12:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.699+0000 7f9549800640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524003a40 0x7f954414e990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9538003d10 tx=0x7f95380129c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:25.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.700+0000 7f9541600640 1 -- 172.21.15.73:0/877564805 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538018920 con 0x7f9524003a40 2024-03-23T06:12:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.700+0000 7f9541600640 1 -- 172.21.15.73:0/877564805 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953800c040 con 0x7f9524003a40 2024-03-23T06:12:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.700+0000 7f9541600640 1 -- 172.21.15.73:0/877564805 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538018cc0 con 0x7f9524003a40 2024-03-23T06:12:25.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.700+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95441f2a70 con 0x7f9524003a40 2024-03-23T06:12:25.704 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-03-23T06:12:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.700+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95440b4020 con 0x7f9524003a40 2024-03-23T06:12:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.702+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95441592d0 con 0x7f9524003a40 2024-03-23T06:12:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.702+0000 7f9541600640 1 -- 172.21.15.73:0/877564805 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f953801e070 con 0x7f9524003a40 2024-03-23T06:12:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.704+0000 7f9541600640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f952c06b9e0 0x7f952c06dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.704+0000 7f9541600640 1 -- 172.21.15.73:0/877564805 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f953808a540 con 0x7f9524003a40 2024-03-23T06:12:25.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.704+0000 7f9548e00640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f952c06b9e0 0x7f952c06dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:25.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.705+0000 7f9548e00640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f952c06b9e0 0x7f952c06dea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9530006e30 tx=0x7f9530033000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:25.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.709+0000 7f9541600640 1 -- 172.21.15.73:0/877564805 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9538055320 con 0x7f9524003a40 2024-03-23T06:12:25.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.983+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f95440b1680 con 0x7f9524003a40 2024-03-23T06:12:25.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.984+0000 7f9541600640 1 -- 172.21.15.73:0/877564805 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f9538058940 con 0x7f9524003a40 2024-03-23T06:12:25.984 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":18,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:12:25.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f952c06b9e0 msgr2=0x7f952c06dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:25.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f952c06b9e0 0x7f952c06dea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9530006e30 tx=0x7f9530033000 comp rx=0 tx=0).stop 2024-03-23T06:12:25.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524003a40 msgr2=0x7f954414e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524003a40 0x7f954414e990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9538003d10 tx=0x7f95380129c0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 shutdown_connections 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f952c06b9e0 0x7f952c06dea0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95441594f0 0x7f9544147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9524004f00 0x7f9544145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 --2- 172.21.15.73:0/877564805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9524003a40 0x7f954414e990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.987+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 >> 172.21.15.73:0/877564805 conn(0x7f954406a060 msgr2=0x7f9544157710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.988+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 shutdown_connections 2024-03-23T06:12:25.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:25.988+0000 7f954c200640 1 -- 172.21.15.73:0/877564805 wait complete. 2024-03-23T06:12:26.277 INFO:tasks.workunit.client.0.smithi073.stdout:rm -f stamp-h1 2024-03-23T06:12:26.281 INFO:tasks.workunit.client.0.smithi073.stdout:touch config.h.in 2024-03-23T06:12:26.285 INFO:tasks.workunit.client.0.smithi073.stdout:cd . && /bin/sh ./config.status config.h 2024-03-23T06:12:26.383 INFO:tasks.workunit.client.0.smithi073.stdout:config.status: creating config.h 2024-03-23T06:12:27.294 INFO:tasks.workunit.client.0.smithi073.stdout:make all-am 2024-03-23T06:12:27.305 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-03-23T06:12:27.305 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-03-23T06:12:27.876 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-03-23T06:12:27.883 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-03-23T06:12:28.026 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-03-23T06:12:28.032 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-03-23T06:12:28.160 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-03-23T06:12:28.166 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-03-23T06:12:28.296 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-03-23T06:12:28.302 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-03-23T06:12:28.472 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-03-23T06:12:28.478 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-03-23T06:12:28.564 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-03-23T06:12:28.569 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-03-23T06:12:28.636 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-03-23T06:12:28.643 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-03-23T06:12:28.715 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-03-23T06:12:28.721 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-03-23T06:12:28.980 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-03-23T06:12:28.986 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-03-23T06:12:29.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:12:29.174 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-03-23T06:12:29.179 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-03-23T06:12:29.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.194+0000 7f7f34800640 1 Processor -- start 2024-03-23T06:12:29.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.194+0000 7f7f34800640 1 -- start start 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f34800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 0x7f7f2c0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f34800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c1594f0 0x7f7f2c0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f34800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c1599a0 con 0x7f7f2c1536a0 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f34800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c15a520 con 0x7f7f2c153a80 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f34800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c159c80 con 0x7f7f2c1594f0 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f31e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7f2c1536a0 0x7f7f2c0ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54700/0 (socket says 172.21.15.73:54700) 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f31e00640 1 -- 172.21.15.73:0/345709113 learned_addr learned my addr 172.21.15.73:0/345709113 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f31400640 1 --2- 172.21.15.73:0/345709113 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 0x7f7f2c0cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f32800640 1 --2- 172.21.15.73:0/345709113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c1594f0 0x7f7f2c0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f31400640 1 -- 172.21.15.73:0/345709113 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 msgr2=0x7f7f2c0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f31400640 1 -- 172.21.15.73:0/345709113 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 msgr2=0x7f7f2c0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f31400640 1 --2- 172.21.15.73:0/345709113 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 0x7f7f2c0cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.196+0000 7f7f31400640 1 --2- 172.21.15.73:0/345709113 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 0x7f7f2c0cbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:29.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.197+0000 7f7f30a00640 1 -- 172.21.15.73:0/345709113 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627638548 0 0) 0x7f7f2c1599a0 con 0x7f7f2c1536a0 2024-03-23T06:12:29.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.197+0000 7f7f30a00640 1 -- 172.21.15.73:0/345709113 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f14003520 con 0x7f7f2c1536a0 2024-03-23T06:12:29.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.197+0000 7f7f32800640 1 -- 172.21.15.73:0/345709113 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 msgr2=0x7f7f2c0cbe90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:29.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.197+0000 7f7f32800640 1 --2- 172.21.15.73:0/345709113 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 0x7f7f2c0cbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.197+0000 7f7f32800640 1 -- 172.21.15.73:0/345709113 >> v1:172.21.15.73:6789/0 conn(0x7f7f2c1536a0 legacy=0x7f7f2c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.197+0000 7f7f32800640 1 -- 172.21.15.73:0/345709113 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c159f60 con 0x7f7f2c1594f0 2024-03-23T06:12:29.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.199+0000 7f7f32800640 1 --2- 172.21.15.73:0/345709113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c1594f0 0x7f7f2c0cc3d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009d90 tx=0x7f7f2802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d0c04020b868e06 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.199+0000 7f7f30a00640 1 -- 172.21.15.73:0/345709113 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2802cc50 con 0x7f7f2c1594f0 2024-03-23T06:12:29.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.199+0000 7f7f30a00640 1 -- 172.21.15.73:0/345709113 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2802cdb0 con 0x7f7f2c1594f0 2024-03-23T06:12:29.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.199+0000 7f7f30a00640 1 -- 172.21.15.73:0/345709113 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28034660 con 0x7f7f2c1594f0 2024-03-23T06:12:29.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.200+0000 7f7f34800640 1 -- 172.21.15.73:0/345709113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c1594f0 msgr2=0x7f7f2c0cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.200+0000 7f7f34800640 1 --2- 172.21.15.73:0/345709113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c1594f0 0x7f7f2c0cc3d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009d90 tx=0x7f7f2802bea0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.200+0000 7f7f34800640 1 -- 172.21.15.73:0/345709113 shutdown_connections 2024-03-23T06:12:29.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.200+0000 7f7f34800640 1 --2- 172.21.15.73:0/345709113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c1594f0 0x7f7f2c0cc3d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.200+0000 7f7f34800640 1 --2- 172.21.15.73:0/345709113 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c153a80 0x7f7f2c0cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.200+0000 7f7f34800640 1 -- 172.21.15.73:0/345709113 >> 172.21.15.73:0/345709113 conn(0x7f7f2c06a060 msgr2=0x7f7f2c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:29.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.200+0000 7f7f34800640 1 -- 172.21.15.73:0/345709113 shutdown_connections 2024-03-23T06:12:29.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.200+0000 7f7f34800640 1 -- 172.21.15.73:0/345709113 wait complete. 2024-03-23T06:12:29.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.202+0000 7f7f34800640 1 Processor -- start 2024-03-23T06:12:29.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.202+0000 7f7f34800640 1 -- start start 2024-03-23T06:12:29.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.203+0000 7f7f34800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 0x7f7f2c1493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.203+0000 7f7f34800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c153a80 0x7f7f2c1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.203+0000 7f7f34800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f2c1594f0 0x7f7f2c1f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.203+0000 7f7f34800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0b4130 con 0x7f7f2c1594f0 2024-03-23T06:12:29.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.203+0000 7f7f34800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c147af0 con 0x7f7f2c1536a0 2024-03-23T06:12:29.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.203+0000 7f7f34800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0b35b0 con 0x7f7f2c153a80 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f32800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f2c1594f0 0x7f7f2c1f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f32800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f2c1594f0 0x7f7f2c1f2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47490/0 (socket says 172.21.15.73:47490) 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f31400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c153a80 0x7f7f2c1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f32800640 1 -- 172.21.15.73:0/1962104816 learned_addr learned my addr 172.21.15.73:0/1962104816 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f31e00640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 0x7f7f2c1493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f31e00640 1 -- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 msgr2=0x7f7f2c1493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f31e00640 1 -- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 msgr2=0x7f7f2c1493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f31e00640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 0x7f7f2c1493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f31e00640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 0x7f7f2c1493f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f32800640 1 -- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c153a80 msgr2=0x7f7f2c1f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f32800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c153a80 0x7f7f2c1f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f32800640 1 -- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 msgr2=0x7f7f2c1493f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f32800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 0x7f7f2c1493f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f32800640 1 -- 172.21.15.73:0/1962104816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f28009a70 con 0x7f7f2c1594f0 2024-03-23T06:12:29.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.204+0000 7f7f31400640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c153a80 0x7f7f2c1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:12:29.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.205+0000 7f7f32800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f2c1594f0 0x7f7f2c1f2d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009d90 tx=0x7f7f28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.205+0000 7f7f26000640 1 -- 172.21.15.73:0/1962104816 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28040650 con 0x7f7f2c1594f0 2024-03-23T06:12:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.205+0000 7f7f26000640 1 -- 172.21.15.73:0/1962104816 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f280407b0 con 0x7f7f2c1594f0 2024-03-23T06:12:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.205+0000 7f7f26000640 1 -- 172.21.15.73:0/1962104816 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28040b60 con 0x7f7f2c1594f0 2024-03-23T06:12:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.205+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c0b3890 con 0x7f7f2c1594f0 2024-03-23T06:12:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.205+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c0b3e50 con 0x7f7f2c1594f0 2024-03-23T06:12:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.206+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c1f2520 con 0x7f7f2c1594f0 2024-03-23T06:12:29.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.207+0000 7f7f26000640 1 -- 172.21.15.73:0/1962104816 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7f28040cc0 con 0x7f7f2c1594f0 2024-03-23T06:12:29.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.208+0000 7f7f26000640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f1006ac30 0x7f7f1006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.208+0000 7f7f26000640 1 -- 172.21.15.73:0/1962104816 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f7f280ac290 con 0x7f7f2c1594f0 2024-03-23T06:12:29.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.208+0000 7f7f31e00640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f1006ac30 0x7f7f1006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.209+0000 7f7f31e00640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f1006ac30 0x7f7f1006d0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7f200011e0 tx=0x7f7f20009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.212+0000 7f7f26000640 1 -- 172.21.15.73:0/1962104816 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7f28077210 con 0x7f7f2c1594f0 2024-03-23T06:12:29.377 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-03-23T06:12:29.382 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-03-23T06:12:29.482 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-03-23T06:12:29.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.486+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7f2c0b1550 con 0x7f7f2c1594f0 2024-03-23T06:12:29.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.487+0000 7f7f26000640 1 -- 172.21.15.73:0/1962104816 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f7f28009450 con 0x7f7f2c1594f0 2024-03-23T06:12:29.486 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:12:29.489 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-03-23T06:12:29.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f1006ac30 msgr2=0x7f7f1006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f1006ac30 0x7f7f1006d0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7f200011e0 tx=0x7f7f20009040 comp rx=0 tx=0).stop 2024-03-23T06:12:29.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f2c1594f0 msgr2=0x7f7f2c1f2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f2c1594f0 0x7f7f2c1f2d00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009d90 tx=0x7f7f28004a40 comp rx=0 tx=0).stop 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 shutdown_connections 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f2c1594f0 0x7f7f2c1f2d00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7f1006ac30 0x7f7f1006d0f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f2c153a80 0x7f7f2c1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 --2- 172.21.15.73:0/1962104816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c1536a0 0x7f7f2c1493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 >> 172.21.15.73:0/1962104816 conn(0x7f7f2c06a060 msgr2=0x7f7f2c158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 shutdown_connections 2024-03-23T06:12:29.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.489+0000 7f7f34800640 1 -- 172.21.15.73:0/1962104816 wait complete. 2024-03-23T06:12:29.508 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:12:29.508 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:12:29.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:12:29.596 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-03-23T06:12:29.602 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-03-23T06:12:29.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.708+0000 7f0146a00640 1 Processor -- start 2024-03-23T06:12:29.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.708+0000 7f0146a00640 1 -- start start 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f0146a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140153760 0x7f0140159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f0146a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 0x7f01400cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f0146a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014006a2d0 con 0x7f01400cbd10 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f0146a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014006a5b0 con 0x7f01400c9740 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f0146a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014006a890 con 0x7f0140153760 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f013fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140153760 0x7f0140159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f013fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140153760 0x7f0140159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:40238/0 (socket says 172.21.15.73:40238) 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f013fe00640 1 -- 172.21.15.73:0/1832592131 learned_addr learned my addr 172.21.15.73:0/1832592131 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f0144a00640 1 --1- 172.21.15.73:0/1832592131 >> v1:172.21.15.73:6789/0 conn(0x7f01400cbd10 0x7f01400ca940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54716/0 (socket says 172.21.15.73:54716) 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.710+0000 7f0137e00640 1 --2- 172.21.15.73:0/1832592131 >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 0x7f01400cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.711+0000 7f0137e00640 1 -- 172.21.15.73:0/1832592131 >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 msgr2=0x7f01400cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.711+0000 7f0137e00640 1 -- 172.21.15.73:0/1832592131 >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 msgr2=0x7f01400cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.711+0000 7f0137e00640 1 --2- 172.21.15.73:0/1832592131 >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 0x7f01400cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:29.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.711+0000 7f013fe00640 1 -- 172.21.15.73:0/1832592131 >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 msgr2=0x7f01400cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:29.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.711+0000 7f0137e00640 1 --2- 172.21.15.73:0/1832592131 >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 0x7f01400cb7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:29.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.711+0000 7f013fe00640 1 --2- 172.21.15.73:0/1832592131 >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 0x7f01400cb7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.711+0000 7f013fe00640 1 -- 172.21.15.73:0/1832592131 >> v1:172.21.15.73:6789/0 conn(0x7f01400cbd10 legacy=0x7f01400ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.711+0000 7f013fe00640 1 -- 172.21.15.73:0/1832592131 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014006ab70 con 0x7f0140153760 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.712+0000 7f013fe00640 1 --2- 172.21.15.73:0/1832592131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140153760 0x7f0140159420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01300098a0 tx=0x7f013002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776c220b5aaf7c91 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.712+0000 7f013f400640 1 -- 172.21.15.73:0/1832592131 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130030840 con 0x7f0140153760 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.712+0000 7f013f400640 1 -- 172.21.15.73:0/1832592131 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300309a0 con 0x7f0140153760 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.712+0000 7f013f400640 1 -- 172.21.15.73:0/1832592131 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130030d30 con 0x7f0140153760 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.713+0000 7f0146a00640 1 -- 172.21.15.73:0/1832592131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140153760 msgr2=0x7f0140159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.713+0000 7f0146a00640 1 --2- 172.21.15.73:0/1832592131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140153760 0x7f0140159420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01300098a0 tx=0x7f013002b980 comp rx=0 tx=0).stop 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.713+0000 7f0146a00640 1 -- 172.21.15.73:0/1832592131 shutdown_connections 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.713+0000 7f0146a00640 1 --2- 172.21.15.73:0/1832592131 >> v2:172.21.15.110:3300/0 conn(0x7f01400c9740 0x7f01400cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.713+0000 7f0146a00640 1 --2- 172.21.15.73:0/1832592131 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140153760 0x7f0140159420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.713+0000 7f0146a00640 1 -- 172.21.15.73:0/1832592131 >> 172.21.15.73:0/1832592131 conn(0x7f014006c310 msgr2=0x7f01400713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:29.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.713+0000 7f0146a00640 1 -- 172.21.15.73:0/1832592131 shutdown_connections 2024-03-23T06:12:29.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.713+0000 7f0146a00640 1 -- 172.21.15.73:0/1832592131 wait complete. 2024-03-23T06:12:29.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.715+0000 7f0146a00640 1 Processor -- start 2024-03-23T06:12:29.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.715+0000 7f0146a00640 1 -- start start 2024-03-23T06:12:29.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f0146a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400c9740 0x7f01401ef980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f0146a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01400cbd10 0x7f01400ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f0146a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140153760 0x7f0140157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f0146a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140159270 con 0x7f01400c9740 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f0146a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01401efec0 con 0x7f0140153760 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f0146a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140145a80 con 0x7f01400cbd10 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f013fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400c9740 0x7f01401ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f013fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400c9740 0x7f01401ef980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47496/0 (socket says 172.21.15.73:47496) 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f013fe00640 1 -- 172.21.15.73:0/86509927 learned_addr learned my addr 172.21.15.73:0/86509927 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f0137e00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01400cbd10 0x7f01400ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.716+0000 7f0144a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140153760 0x7f0140157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f0144a00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140153760 msgr2=0x7f0140157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f0144a00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140153760 msgr2=0x7f0140157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f0144a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140153760 0x7f0140157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f0144a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140153760 0x7f0140157080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f013fe00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01400cbd10 msgr2=0x7f01400ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f013fe00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01400cbd10 0x7f01400ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f013fe00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140153760 msgr2=0x7f0140157080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f013fe00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140153760 0x7f0140157080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f013fe00640 1 -- 172.21.15.73:0/86509927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300094d0 con 0x7f01400c9740 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f013fe00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400c9740 0x7f01401ef980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f013002b9c0 tx=0x7f01300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013003e070 con 0x7f01400c9740 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.717+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130039a10 con 0x7f01400c9740 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.718+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130039de0 con 0x7f01400c9740 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.718+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140145f10 con 0x7f01400c9740 2024-03-23T06:12:29.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.718+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0140145150 con 0x7f01400c9740 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.719+0000 7f0146a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01401575c0 0x7f01401452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.719+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140072510 con 0x7f01401575c0 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.719+0000 7f0137e00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01401575c0 0x7f01401452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.720+0000 7f0137e00640 1 -- 172.21.15.73:0/86509927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01400c9b80 con 0x7f01401575c0 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.720+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f01300423f0 con 0x7f01400c9740 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.720+0000 7f0137e00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01401575c0 0x7f01401452e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0140150bc0 tx=0x7f0128010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f013cc00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f011c06ac00 0x7f011c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f01300ab480 con 0x7f01400c9740 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f0144a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f011c06ac00 0x7f011c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128010ed0 con 0x7f01401575c0 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f012800ea00 con 0x7f01401575c0 2024-03-23T06:12:29.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01401575c0 msgr2=0x7f01401452e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f013cc00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01401575c0 0x7f01401452e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0140150bc0 tx=0x7f0128010c80 comp rx=0 tx=0).stop 2024-03-23T06:12:29.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01401575c0 msgr2=0x7f01401452e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:29.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.721+0000 7f013cc00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01401575c0 0x7f01401452e0 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0140150bc0 tx=0x7f0128010c80 comp rx=0 tx=0).stop 2024-03-23T06:12:29.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.722+0000 7f0144a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f011c06ac00 0x7f011c06d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0138007fd0 tx=0x7f0138007f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.728+0000 7f0146a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0140159400 0x7f0140142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.728+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140153b40 con 0x7f0140159400 2024-03-23T06:12:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.728+0000 7f0137e00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0140159400 0x7f0140142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.729+0000 7f0137e00640 1 -- 172.21.15.73:0/86509927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f01400720f0 con 0x7f0140159400 2024-03-23T06:12:29.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.729+0000 7f0137e00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0140159400 0x7f0140142620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0128017000 tx=0x7f01280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.729+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012801dea0 con 0x7f0140159400 2024-03-23T06:12:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4950 (secure 0 0 0) 0x7f0128023040 con 0x7f0140159400 2024-03-23T06:12:29.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0140159400 msgr2=0x7f0140142620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f013cc00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0140159400 0x7f0140142620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0128017000 tx=0x7f01280046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f013cc00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0140159400 msgr2=0x7f0140142620 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f013cc00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0140159400 0x7f0140142620 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0128017000 tx=0x7f01280046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 20, 2024-03-23T06:12:29.730 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 3, 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:29.731 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:29.732 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:12:29.733 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:29.734 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:29.735 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:29.736 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:12:29.737 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.738 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.739 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:29.740 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:29.741 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:29.742 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:29.742 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:29.742 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:29.742 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:29.742 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:12:29.742 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f011c06ac00 msgr2=0x7f011c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0146a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f011c06ac00 0x7f011c06d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0138007fd0 tx=0x7f0138007f60 comp rx=0 tx=0).stop 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400c9740 msgr2=0x7f01401ef980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0146a00640 1 --2- 172.21.15.73:0/86509927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400c9740 0x7f01401ef980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f013002b9c0 tx=0x7f01300046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0144a00640 1 -- 172.21.15.73:0/86509927 reap_dead start 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0144a00640 1 -- 172.21.15.73:0/86509927 reap_dead start 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 shutdown_connections 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 >> 172.21.15.73:0/86509927 conn(0x7f014006c310 msgr2=0x7f0140150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 shutdown_connections 2024-03-23T06:12:29.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.730+0000 7f0146a00640 1 -- 172.21.15.73:0/86509927 wait complete. 2024-03-23T06:12:29.748 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:12:29.749 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:12:29.749 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:12:29.749 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-03-23T06:12:29.755 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-03-23T06:12:29.801 INFO:tasks.workunit.client.0.smithi073.stderr:In file included from parser.h:22, 2024-03-23T06:12:29.801 INFO:tasks.workunit.client.0.smithi073.stderr: from parser.c:25: 2024-03-23T06:12:29.801 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘init_filesys’: 2024-03-23T06:12:29.802 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T06:12:29.802 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T06:12:29.802 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T06:12:29.803 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-03-23T06:12:29.804 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-03-23T06:12:29.805 INFO:tasks.workunit.client.0.smithi073.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-03-23T06:12:29.806 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘init_tg_stats’: 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-03-23T06:12:29.807 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: 971 | list_for_each_entry(tmp_list, 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-03-23T06:12:29.808 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: 971 | list_for_each_entry(tmp_list, 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-03-23T06:12:29.809 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr: 980 | list_for_each_entry(tmp_list, 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr: | ^ 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-03-23T06:12:29.810 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~ 2024-03-23T06:12:29.811 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-03-23T06:12:29.811 INFO:tasks.workunit.client.0.smithi073.stderr: 36 | container_of(ptr, type, member) 2024-03-23T06:12:29.811 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~ 2024-03-23T06:12:29.812 INFO:tasks.workunit.client.0.smithi073.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-03-23T06:12:29.812 INFO:tasks.workunit.client.0.smithi073.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-03-23T06:12:29.812 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~ 2024-03-23T06:12:29.812 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-03-23T06:12:29.812 INFO:tasks.workunit.client.0.smithi073.stderr: 980 | list_for_each_entry(tmp_list, 2024-03-23T06:12:29.812 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.858 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘get_optstr’: 2024-03-23T06:12:29.859 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-03-23T06:12:29.859 INFO:tasks.workunit.client.0.smithi073.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-03-23T06:12:29.859 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.859 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:200:14: note: source object declared here 2024-03-23T06:12:29.859 INFO:tasks.workunit.client.0.smithi073.stderr: 200 | char temp[BUFSIZE]; 2024-03-23T06:12:29.859 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~ 2024-03-23T06:12:29.866 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c: In function ‘size64_convert’: 2024-03-23T06:12:29.866 INFO:tasks.workunit.client.0.smithi073.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-03-23T06:12:29.866 INFO:tasks.workunit.client.0.smithi073.stderr: 119 | memcpy(unit, "\0", 3); 2024-03-23T06:12:29.866 INFO:tasks.workunit.client.0.smithi073.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-03-23T06:12:29.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.942+0000 7f526e200640 1 Processor -- start 2024-03-23T06:12:29.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.942+0000 7f526e200640 1 -- start start 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f526e200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680cb130 0x7f52681592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f526e200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 0x7f52680c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f526e200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526815a1f0 con 0x7f52680c5050 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f526e200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680c5430 con 0x7f52680b4780 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f526e200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5268159950 con 0x7f52680cb130 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f526ce00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f52680c5050 0x7f5268069cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41238/0 (socket says 172.21.15.73:41238) 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f526ce00640 1 -- 172.21.15.73:0/1934694170 learned_addr learned my addr 172.21.15.73:0/1934694170 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f526d800640 1 --2- 172.21.15.73:0/1934694170 >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 0x7f52680c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.943+0000 7f5267e00640 1 --2- 172.21.15.73:0/1934694170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680cb130 0x7f52681592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f526d800640 1 -- 172.21.15.73:0/1934694170 >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 msgr2=0x7f52680c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f526d800640 1 -- 172.21.15.73:0/1934694170 >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 msgr2=0x7f52680c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f526d800640 1 --2- 172.21.15.73:0/1934694170 >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 0x7f52680c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f526d800640 1 --2- 172.21.15.73:0/1934694170 >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 0x7f52680c9e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f5267400640 1 -- 172.21.15.73:0/1934694170 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420983238 0 0) 0x7f526815a1f0 con 0x7f52680c5050 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f5267400640 1 -- 172.21.15.73:0/1934694170 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5250003520 con 0x7f52680c5050 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f5267e00640 1 -- 172.21.15.73:0/1934694170 >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 msgr2=0x7f52680c9e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f5267e00640 1 --2- 172.21.15.73:0/1934694170 >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 0x7f52680c9e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f5267e00640 1 -- 172.21.15.73:0/1934694170 >> v1:172.21.15.73:6789/0 conn(0x7f52680c5050 legacy=0x7f5268069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.944+0000 7f5267e00640 1 -- 172.21.15.73:0/1934694170 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268159c30 con 0x7f52680cb130 2024-03-23T06:12:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.945+0000 7f5267e00640 1 --2- 172.21.15.73:0/1934694170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680cb130 0x7f52681592a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52540097a0 tx=0x7f525402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f730a4895845bbf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.945+0000 7f5267400640 1 -- 172.21.15.73:0/1934694170 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525402e070 con 0x7f52680cb130 2024-03-23T06:12:29.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f5267400640 1 -- 172.21.15.73:0/1934694170 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52540315a0 con 0x7f52680cb130 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f5267400640 1 -- 172.21.15.73:0/1934694170 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254031930 con 0x7f52680cb130 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f526e200640 1 -- 172.21.15.73:0/1934694170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680cb130 msgr2=0x7f52681592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f526e200640 1 --2- 172.21.15.73:0/1934694170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680cb130 0x7f52681592a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f52540097a0 tx=0x7f525402b840 comp rx=0 tx=0).stop 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f526e200640 1 -- 172.21.15.73:0/1934694170 shutdown_connections 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f526e200640 1 --2- 172.21.15.73:0/1934694170 >> v2:172.21.15.110:3300/0 conn(0x7f52680b4780 0x7f52680c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f526e200640 1 --2- 172.21.15.73:0/1934694170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680cb130 0x7f52681592a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f526e200640 1 -- 172.21.15.73:0/1934694170 >> 172.21.15.73:0/1934694170 conn(0x7f52680ceb80 msgr2=0x7f52680cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f526e200640 1 -- 172.21.15.73:0/1934694170 shutdown_connections 2024-03-23T06:12:29.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.946+0000 7f526e200640 1 -- 172.21.15.73:0/1934694170 wait complete. 2024-03-23T06:12:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.949+0000 7f526e200640 1 Processor -- start 2024-03-23T06:12:29.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.949+0000 7f526e200640 1 -- start start 2024-03-23T06:12:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526e200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680b4780 0x7f5268151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526e200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680c5050 0x7f52681f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680cb130 0x7f52680cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526e200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c20e0 con 0x7f52680c5050 2024-03-23T06:12:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526e200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52681f2e20 con 0x7f52680cb130 2024-03-23T06:12:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526e200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5268151b80 con 0x7f52680b4780 2024-03-23T06:12:29.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526ce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680b4780 0x7f5268151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526ce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680b4780 0x7f5268151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:36584/0 (socket says 172.21.15.73:36584) 2024-03-23T06:12:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526ce00640 1 -- 172.21.15.73:0/725038916 learned_addr learned my addr 172.21.15.73:0/725038916 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526d800640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680cb130 0x7f52680cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680c5050 0x7f52681f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526d800640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680cb130 msgr2=0x7f52680cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-23T06:12:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526d800640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680cb130 msgr2=0x7f52680cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:12:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526d800640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680cb130 0x7f52680cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:29.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.950+0000 7f526d800640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680cb130 0x7f52680cda90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f526ce00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680cb130 msgr2=0x7f52680cda90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f526ce00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680cb130 0x7f52680cda90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f526ce00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680c5050 msgr2=0x7f52681f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f526ce00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52680c5050 0x7f52681f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f526ce00640 1 -- 172.21.15.73:0/725038916 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5254009400 con 0x7f52680b4780 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f526ce00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680b4780 0x7f5268151640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c530 tx=0x7f525c00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c005ce0 con 0x7f52680b4780 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c005e40 con 0x7f52680b4780 2024-03-23T06:12:29.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52681f2b40 con 0x7f52680b4780 2024-03-23T06:12:29.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.951+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c0072b0 con 0x7f52680b4780 2024-03-23T06:12:29.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.952+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5268158700 con 0x7f52680b4780 2024-03-23T06:12:29.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.953+0000 7f526e200640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.953+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680723f0 con 0x7f52681f26c0 2024-03-23T06:12:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.954+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.954+0000 7f5267e00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 msgr2=0x7f52680cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-03-23T06:12:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.954+0000 7f5267e00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 msgr2=0x7f52680cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:12:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.954+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.954+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:29.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.954+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f525c007410 con 0x7f52680b4780 2024-03-23T06:12:29.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.956+0000 7f5264c00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f524806ac00 0x7f524806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:29.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.956+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f525c088cf0 con 0x7f52680b4780 2024-03-23T06:12:29.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.956+0000 7f526d800640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f524806ac00 0x7f524806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:29.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:29.957+0000 7f526d800640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f524806ac00 0x7f524806d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5260009610 tx=0x7f526000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:30.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.155+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:30.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.155+0000 7f5267e00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 msgr2=0x7f52680cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-03-23T06:12:30.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.155+0000 7f5267e00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 msgr2=0x7f52680cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:12:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.155+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:30.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.155+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:12:30.225 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-03-23T06:12:30.231 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-03-23T06:12:30.324 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-03-23T06:12:30.329 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-03-23T06:12:30.458 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-03-23T06:12:30.463 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-03-23T06:12:30.521 INFO:tasks.workunit.client.0.smithi073.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-03-23T06:12:30.528 INFO:tasks.workunit.client.0.smithi073.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-03-23T06:12:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.556+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.556+0000 7f5267e00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 msgr2=0x7f52680cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-03-23T06:12:30.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.557+0000 7f5267e00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 msgr2=0x7f52680cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:12:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.557+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:30.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:30.557+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:12:30.591 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-03-23T06:12:30.599 INFO:tasks.workunit.client.0.smithi073.stdout:FFSB version 6.0-RC2 started 2024-03-23T06:12:30.599 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:12:30.607 INFO:tasks.workunit.client.0.smithi073.stdout:benchmark time = 300 2024-03-23T06:12:30.607 INFO:tasks.workunit.client.0.smithi073.stdout:ThreadGroup 0 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout:================ 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: num_threads = 32 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: read_random = off 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: read_size = 0 (0B) 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: read_blocksize = 0 (0B) 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: read_skip = off 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: read_skipsize = 0 (0B) 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: write_random = on 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: write_size = 5242880 (5MB) 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: fsync_file = 0 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: write_blocksize = 4096 (4KB) 2024-03-23T06:12:30.608 INFO:tasks.workunit.client.0.smithi073.stdout: wait time = 0 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: op weights 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: read = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: readall = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: write = 1 (100.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: create = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: append = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: delete = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: metaop = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: createdir = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: stat = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: writeall = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: writeall_fsync = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: open_close = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: write_fsync = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: create_fsync = 0 (0.00%) 2024-03-23T06:12:30.609 INFO:tasks.workunit.client.0.smithi073.stdout: append_fsync = 0 (0.00%) 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout:FileSystem . 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout:========== 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: num_dirs = 0 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: starting files = 128 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: min file size = 104857600 (100MB) 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: max file size = 104857600 (100MB) 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: directio = off 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: alignedio = on 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: bufferedio = off 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: aging is off 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: current utilization = 0.04% 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:12:30.610 INFO:tasks.workunit.client.0.smithi073.stdout:checking existing fs: . 2024-03-23T06:12:30.611 INFO:tasks.workunit.client.0.smithi073.stdout:recreating new fileset 2024-03-23T06:12:30.611 INFO:tasks.workunit.client.0.smithi073.stderr:opendir: No such file or directory 2024-03-23T06:12:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.358+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.359+0000 7f5267e00640 1 -- 172.21.15.73:0/725038916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52680c9910 con 0x7f52681f26c0 2024-03-23T06:12:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.360+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5268072380 tx=0x7f52540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.360+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254045480 con 0x7f52681f26c0 2024-03-23T06:12:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.361+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f52540455e0 con 0x7f52681f26c0 2024-03-23T06:12:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.361+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 msgr2=0x7f52680cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.361+0000 7f5264c00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5268072380 tx=0x7f52540046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.361+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 msgr2=0x7f52680cdfd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.361+0000 7f5264c00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52681f26c0 0x7f52680cdfd0 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5268072380 tx=0x7f52540046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.374+0000 7f526e200640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680ce510 0x7f5268145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.374+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680c9630 con 0x7f52680ce510 2024-03-23T06:12:31.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.375+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680ce510 0x7f5268145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.375+0000 7f5267e00640 1 -- 172.21.15.73:0/725038916 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f526806a3c0 con 0x7f52680ce510 2024-03-23T06:12:31.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.376+0000 7f5267e00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680ce510 0x7f5268145b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52540097a0 tx=0x7f5254031000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.376+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254003610 con 0x7f52680ce510 2024-03-23T06:12:31.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f5254054070 con 0x7f52680ce510 2024-03-23T06:12:31.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680ce510 msgr2=0x7f5268145b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f5264c00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680ce510 0x7f5268145b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52540097a0 tx=0x7f5254031000 comp rx=0 tx=0).stop 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f5264c00640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680ce510 msgr2=0x7f5268145b40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f5264c00640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52680ce510 0x7f5268145b40 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f52540097a0 tx=0x7f5254031000 comp rx=0 tx=0).stop 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 20, 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:12:31.377 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 5, 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:31.378 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:31.379 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:12:31.380 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:12:31.381 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.382 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:12:31.383 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:12:31.385 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.386 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:12:31.387 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:12:31.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f524806ac00 msgr2=0x7f524806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f526e200640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f524806ac00 0x7f524806d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5260009610 tx=0x7f526000b040 comp rx=0 tx=0).stop 2024-03-23T06:12:31.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680b4780 msgr2=0x7f5268151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.377+0000 7f526e200640 1 --2- 172.21.15.73:0/725038916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52680b4780 0x7f5268151640 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c530 tx=0x7f525c00c9f0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.378+0000 7f526d800640 1 -- 172.21.15.73:0/725038916 reap_dead start 2024-03-23T06:12:31.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.378+0000 7f526d800640 1 -- 172.21.15.73:0/725038916 reap_dead start 2024-03-23T06:12:31.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.378+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 shutdown_connections 2024-03-23T06:12:31.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.378+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 >> 172.21.15.73:0/725038916 conn(0x7f52680ceb80 msgr2=0x7f52681e5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:31.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.378+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 shutdown_connections 2024-03-23T06:12:31.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.378+0000 7f526e200640 1 -- 172.21.15.73:0/725038916 wait complete. 2024-03-23T06:12:31.397 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:12:31.428 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:12:31.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:12:31.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.670+0000 7f1eab000640 1 Processor -- start 2024-03-23T06:12:31.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.671+0000 7f1eab000640 1 -- start start 2024-03-23T06:12:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.673+0000 7f1eab000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ea406a7d0 0x7f1ea414f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.673+0000 7f1eab000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ea40c9350 0x7f1ea40ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.673+0000 7f1eab000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea40ca090 con 0x7f1ea40caea0 2024-03-23T06:12:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.673+0000 7f1eab000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea4155e90 con 0x7f1ea40c9350 2024-03-23T06:12:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.673+0000 7f1eab000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea40cb2a0 con 0x7f1ea406a7d0 2024-03-23T06:12:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.673+0000 7f1ea3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ea406a7d0 0x7f1ea414f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.674+0000 7f1ea3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ea406a7d0 0x7f1ea414f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:34166/0 (socket says 172.21.15.73:34166) 2024-03-23T06:12:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.674+0000 7f1ea3e00640 1 -- 172.21.15.73:0/4103299714 learned_addr learned my addr 172.21.15.73:0/4103299714 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.674+0000 7f1ea3400640 1 --2- 172.21.15.73:0/4103299714 >> v2:172.21.15.73:3300/0 conn(0x7f1ea40c9350 0x7f1ea40ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.675+0000 7f1ea3e00640 1 -- 172.21.15.73:0/4103299714 >> v2:172.21.15.73:3300/0 conn(0x7f1ea40c9350 msgr2=0x7f1ea40ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.675+0000 7f1ea3e00640 1 --2- 172.21.15.73:0/4103299714 >> v2:172.21.15.73:3300/0 conn(0x7f1ea40c9350 0x7f1ea40ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.675+0000 7f1ea3e00640 1 -- 172.21.15.73:0/4103299714 >> v1:172.21.15.73:6789/0 conn(0x7f1ea40caea0 legacy=0x7f1ea4158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.676+0000 7f1ea3e00640 1 -- 172.21.15.73:0/4103299714 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40ca2c0 con 0x7f1ea406a7d0 2024-03-23T06:12:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.676+0000 7f1ea2a00640 1 -- 172.21.15.73:0/4103299714 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008497704 0 0) 0x7f1ea40ca090 con 0x7f1ea40caea0 2024-03-23T06:12:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.677+0000 7f1ea3e00640 1 --2- 172.21.15.73:0/4103299714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ea406a7d0 0x7f1ea414f8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40c92e0 tx=0x7f1e9c02c030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893e8591aa6e68e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.677+0000 7f1ea3400640 1 --2- 172.21.15.73:0/4103299714 >> v2:172.21.15.73:3300/0 conn(0x7f1ea40c9350 0x7f1ea40ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:12:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.677+0000 7f1ea2a00640 1 -- 172.21.15.73:0/4103299714 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c02cbd0 con 0x7f1ea406a7d0 2024-03-23T06:12:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.677+0000 7f1ea2a00640 1 -- 172.21.15.73:0/4103299714 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c02cd30 con 0x7f1ea406a7d0 2024-03-23T06:12:31.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.677+0000 7f1ea2a00640 1 -- 172.21.15.73:0/4103299714 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c02cea0 con 0x7f1ea406a7d0 2024-03-23T06:12:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.678+0000 7f1eab000640 1 -- 172.21.15.73:0/4103299714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ea406a7d0 msgr2=0x7f1ea414f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.678+0000 7f1eab000640 1 --2- 172.21.15.73:0/4103299714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ea406a7d0 0x7f1ea414f8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40c92e0 tx=0x7f1e9c02c030 comp rx=0 tx=0).stop 2024-03-23T06:12:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.678+0000 7f1eab000640 1 -- 172.21.15.73:0/4103299714 shutdown_connections 2024-03-23T06:12:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.678+0000 7f1eab000640 1 --2- 172.21.15.73:0/4103299714 >> v2:172.21.15.73:3300/0 conn(0x7f1ea40c9350 0x7f1ea40ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.678+0000 7f1eab000640 1 --2- 172.21.15.73:0/4103299714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ea406a7d0 0x7f1ea414f8b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.678+0000 7f1eab000640 1 -- 172.21.15.73:0/4103299714 >> 172.21.15.73:0/4103299714 conn(0x7f1ea4069cb0 msgr2=0x7f1ea406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.679+0000 7f1eab000640 1 -- 172.21.15.73:0/4103299714 shutdown_connections 2024-03-23T06:12:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.679+0000 7f1eab000640 1 -- 172.21.15.73:0/4103299714 wait complete. 2024-03-23T06:12:31.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.681+0000 7f1eab000640 1 Processor -- start 2024-03-23T06:12:31.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.681+0000 7f1eab000640 1 -- start start 2024-03-23T06:12:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1eab000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea406a7d0 0x7f1ea41f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1eab000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ea40c9350 0x7f1ea41f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1eab000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea40caea0 0x7f1ea413e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1eab000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40aabe0 con 0x7f1ea40caea0 2024-03-23T06:12:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1eab000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40ad5a0 con 0x7f1ea40c9350 2024-03-23T06:12:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1eab000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40a9760 con 0x7f1ea406a7d0 2024-03-23T06:12:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1ea3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea406a7d0 0x7f1ea41f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1ea3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea406a7d0 0x7f1ea41f2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:36600/0 (socket says 172.21.15.73:36600) 2024-03-23T06:12:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1ea3e00640 1 -- 172.21.15.73:0/794724729 learned_addr learned my addr 172.21.15.73:0/794724729 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1ea9000640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea40caea0 0x7f1ea413e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.682+0000 7f1ea3400640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ea40c9350 0x7f1ea41f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3e00640 1 -- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ea40c9350 msgr2=0x7f1ea41f0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3e00640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ea40c9350 0x7f1ea41f0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3e00640 1 -- 172.21.15.73:0/794724729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea40caea0 msgr2=0x7f1ea413e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3e00640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea40caea0 0x7f1ea413e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3e00640 1 -- 172.21.15.73:0/794724729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e94009400 con 0x7f1ea406a7d0 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3e00640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea406a7d0 0x7f1ea41f2350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c036040 tx=0x7f1e9c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c02cea0 con 0x7f1ea406a7d0 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c009510 con 0x7f1ea406a7d0 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c03e690 con 0x7f1ea406a7d0 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c009b30 con 0x7f1ea406a7d0 2024-03-23T06:12:31.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea41f2ef0 con 0x7f1ea406a7d0 2024-03-23T06:12:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1eab000640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea41f0590 0x7f1ea4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea4073bf0 con 0x7f1ea41f0590 2024-03-23T06:12:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1e9c03e7f0 con 0x7f1ea406a7d0 2024-03-23T06:12:31.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3400640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea41f0590 0x7f1ea4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3400640 1 -- 172.21.15.73:0/794724729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ea4155b20 con 0x7f1ea41f0590 2024-03-23T06:12:31.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.683+0000 7f1ea3400640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea41f0590 0x7f1ea4152f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ea41545c0 tx=0x7f1e9400f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1e9be00640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e8406ac00 0x7f1e8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1e9c0ac1b0 con 0x7f1ea406a7d0 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1ea9000640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e8406ac00 0x7f1e8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94011c90 con 0x7f1ea41f0590 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f1e94011df0 con 0x7f1ea41f0590 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea41f0590 msgr2=0x7f1ea4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1e9be00640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea41f0590 0x7f1ea4152f20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1ea41545c0 tx=0x7f1e9400f610 comp rx=0 tx=0).stop 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea41f0590 msgr2=0x7f1ea4152f20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:31.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1e9be00640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea41f0590 0x7f1ea4152f20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.688+0000 7f1ea9000640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e8406ac00 0x7f1e8406d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e90000f60 tx=0x7f1e90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.697+0000 7f1eab000640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea40aa590 0x7f1ea40ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.697+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea40aad50 con 0x7f1ea40aa590 2024-03-23T06:12:31.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.698+0000 7f1ea3400640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea40aa590 0x7f1ea40ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.698+0000 7f1ea3400640 1 -- 172.21.15.73:0/794724729 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1ea4155840 con 0x7f1ea40aa590 2024-03-23T06:12:31.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.699+0000 7f1ea3400640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea40aa590 0x7f1ea40ab050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40c0c40 tx=0x7f1e940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.699+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9401e860 con 0x7f1ea40aa590 2024-03-23T06:12:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.699+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f1e940133a0 con 0x7f1ea40aa590 2024-03-23T06:12:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.699+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea40aa590 msgr2=0x7f1ea40ab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.699+0000 7f1e9be00640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea40aa590 0x7f1ea40ab050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40c0c40 tx=0x7f1e940046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.699+0000 7f1e9be00640 1 -- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea40aa590 msgr2=0x7f1ea40ab050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:31.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.699+0000 7f1e9be00640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea40aa590 0x7f1ea40ab050 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.699 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 20, 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 5, 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:31.700 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:31.701 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:12:31.702 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:31.703 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:31.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:31.705 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.706 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:31.707 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.708 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.709 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:12:31.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:31.711 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:12:31.711 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e8406ac00 msgr2=0x7f1e8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1eab000640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e8406ac00 0x7f1e8406d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e90000f60 tx=0x7f1e90009040 comp rx=0 tx=0).stop 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea406a7d0 msgr2=0x7f1ea41f2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1eab000640 1 --2- 172.21.15.73:0/794724729 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ea406a7d0 0x7f1ea41f2350 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c036040 tx=0x7f1e9c004a40 comp rx=0 tx=0).stop 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1ea9000640 1 -- 172.21.15.73:0/794724729 reap_dead start 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1ea9000640 1 -- 172.21.15.73:0/794724729 reap_dead start 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 shutdown_connections 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 >> 172.21.15.73:0/794724729 conn(0x7f1ea4069cb0 msgr2=0x7f1ea40bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 shutdown_connections 2024-03-23T06:12:31.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.700+0000 7f1eab000640 1 -- 172.21.15.73:0/794724729 wait complete. 2024-03-23T06:12:31.715 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:12:31.715 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:12:31.715 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:12:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.910+0000 7f13f1c00640 1 Processor -- start 2024-03-23T06:12:31.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.911+0000 7f13f1c00640 1 -- start start 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13f1c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13f1c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13ec1594f0 0x7f13ec0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13f1c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ec0cab20 con 0x7f13ec153a80 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13f1c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ec15a520 con 0x7f13ec1594f0 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13f1c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec1599a0 con 0x7f13ec1536a0 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13eb400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f13ec1594f0 0x7f13ec0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec0ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:36616/0 (socket says 172.21.15.73:36616) 2024-03-23T06:12:31.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.912+0000 7f13eaa00640 1 -- 172.21.15.73:0/627750567 learned_addr learned my addr 172.21.15.73:0/627750567 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:31.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.913+0000 7f13eaa00640 1 -- 172.21.15.73:0/627750567 >> v2:172.21.15.73:3300/0 conn(0x7f13ec1594f0 msgr2=0x7f13ec0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:31.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.913+0000 7f13eaa00640 1 --2- 172.21.15.73:0/627750567 >> v2:172.21.15.73:3300/0 conn(0x7f13ec1594f0 0x7f13ec0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.913+0000 7f13eaa00640 1 -- 172.21.15.73:0/627750567 >> v1:172.21.15.73:6789/0 conn(0x7f13ec153a80 legacy=0x7f13ec0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.913+0000 7f13eaa00640 1 -- 172.21.15.73:0/627750567 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec159c80 con 0x7f13ec1536a0 2024-03-23T06:12:31.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.914+0000 7f13eaa00640 1 --2- 172.21.15.73:0/627750567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec0ca5e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009870 tx=0x7f13dc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79a07ab2c72ed5bf server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.914+0000 7f13e9600640 1 -- 172.21.15.73:0/627750567 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc030840 con 0x7f13ec1536a0 2024-03-23T06:12:31.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.914+0000 7f13e9600640 1 -- 172.21.15.73:0/627750567 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13dc0309a0 con 0x7f13ec1536a0 2024-03-23T06:12:31.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13e9600640 1 -- 172.21.15.73:0/627750567 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13dc030d30 con 0x7f13ec1536a0 2024-03-23T06:12:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13f1c00640 1 -- 172.21.15.73:0/627750567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 msgr2=0x7f13ec0ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13f1c00640 1 --2- 172.21.15.73:0/627750567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec0ca5e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009870 tx=0x7f13dc02b980 comp rx=0 tx=0).stop 2024-03-23T06:12:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13f1c00640 1 -- 172.21.15.73:0/627750567 shutdown_connections 2024-03-23T06:12:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13f1c00640 1 --2- 172.21.15.73:0/627750567 >> v2:172.21.15.73:3300/0 conn(0x7f13ec1594f0 0x7f13ec0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13f1c00640 1 --2- 172.21.15.73:0/627750567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec0ca5e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13f1c00640 1 -- 172.21.15.73:0/627750567 >> 172.21.15.73:0/627750567 conn(0x7f13ec06a060 msgr2=0x7f13ec06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:31.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13f1c00640 1 -- 172.21.15.73:0/627750567 shutdown_connections 2024-03-23T06:12:31.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.915+0000 7f13f1c00640 1 -- 172.21.15.73:0/627750567 wait complete. 2024-03-23T06:12:31.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.917+0000 7f13f1c00640 1 Processor -- start 2024-03-23T06:12:31.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.917+0000 7f13f1c00640 1 -- start start 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13f1c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec1e2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13f1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13ec153a80 0x7f13ec147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13f1c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec1594f0 0x7f13ec148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13f1c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec0b4380 con 0x7f13ec1594f0 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13f1c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec0b40c0 con 0x7f13ec153a80 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13f1c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ec149910 con 0x7f13ec1536a0 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec1e2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13eaa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec1e2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:36628/0 (socket says 172.21.15.73:36628) 2024-03-23T06:12:31.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13eaa00640 1 -- 172.21.15.73:0/1889993005 learned_addr learned my addr 172.21.15.73:0/1889993005 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13ea000640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13ec153a80 0x7f13ec147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.918+0000 7f13eb400640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec1594f0 0x7f13ec148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13ea000640 1 -- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 msgr2=0x7f13ec1e2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13ea000640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec1e2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13ea000640 1 -- 172.21.15.73:0/1889993005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec1594f0 msgr2=0x7f13ec148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13ea000640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec1594f0 0x7f13ec148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13ea000640 1 -- 172.21.15.73:0/1889993005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0094d0 con 0x7f13ec153a80 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13eaa00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec1e2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13ea000640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13ec153a80 0x7f13ec147b30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13d800c390 tx=0x7f13d800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13e2a00640 1 -- 172.21.15.73:0/1889993005 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d80052d0 con 0x7f13ec153a80 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13e2a00640 1 -- 172.21.15.73:0/1889993005 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d8005430 con 0x7f13ec153a80 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13e2a00640 1 -- 172.21.15.73:0/1889993005 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8003830 con 0x7f13ec153a80 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ec0cd820 con 0x7f13ec153a80 2024-03-23T06:12:31.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.919+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ec0cdde0 con 0x7f13ec153a80 2024-03-23T06:12:31.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.921+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec0c9810 con 0x7f13ec153a80 2024-03-23T06:12:31.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.921+0000 7f13e2a00640 1 -- 172.21.15.73:0/1889993005 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f13d8003990 con 0x7f13ec153a80 2024-03-23T06:12:31.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.922+0000 7f13e2a00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f13cc06ac30 0x7f13cc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:31.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.922+0000 7f13e2a00640 1 -- 172.21.15.73:0/1889993005 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f13d8088bc0 con 0x7f13ec153a80 2024-03-23T06:12:31.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.922+0000 7f13eaa00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f13cc06ac30 0x7f13cc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:31.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.923+0000 7f13eaa00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f13cc06ac30 0x7f13cc06d0f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009870 tx=0x7f13dc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:31.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:31.927+0000 7f13e2a00640 1 -- 172.21.15.73:0/1889993005 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f13d8053a40 con 0x7f13ec153a80 2024-03-23T06:12:32.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.196+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f13ec04e110 con 0x7f13ec153a80 2024-03-23T06:12:32.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.199+0000 7f13e2a00640 1 -- 172.21.15.73:0/1889993005 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f13d8017080 con 0x7f13ec153a80 2024-03-23T06:12:32.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.201+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f13cc06ac30 msgr2=0x7f13cc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.201+0000 7f13f1c00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f13cc06ac30 0x7f13cc06d0f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009870 tx=0x7f13dc008030 comp rx=0 tx=0).stop 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.201+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13ec153a80 msgr2=0x7f13ec147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13ec153a80 0x7f13ec147b30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13d800c390 tx=0x7f13d800c850 comp rx=0 tx=0).stop 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 shutdown_connections 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13ec1594f0 0x7f13ec148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13ec153a80 0x7f13ec147b30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f13cc06ac30 0x7f13cc06d0f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 --2- 172.21.15.73:0/1889993005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13ec1536a0 0x7f13ec1e2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 >> 172.21.15.73:0/1889993005 conn(0x7f13ec06a060 msgr2=0x7f13ec1574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 shutdown_connections 2024-03-23T06:12:32.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:32.202+0000 7f13f1c00640 1 -- 172.21.15.73:0/1889993005 wait complete. 2024-03-23T06:12:32.218 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:12:42.219 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:12:42.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:12:42.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.565+0000 7f9169a00640 1 Processor -- start 2024-03-23T06:12:42.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.565+0000 7f9169a00640 1 -- start start 2024-03-23T06:12:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.568+0000 7f9169a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f916415c4f0 0x7f916406fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.568+0000 7f9169a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164070110 0x7f91640ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9169a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91641505b0 con 0x7f916406b9d0 2024-03-23T06:12:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9169a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916415a990 con 0x7f916415c4f0 2024-03-23T06:12:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9169a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91641597b0 con 0x7f9164070110 2024-03-23T06:12:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9163e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f916415c4f0 0x7f916406fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:42.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9163400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164070110 0x7f91640ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9169000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f916406b9d0 0x7f916415ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:59064/0 (socket says 172.21.15.73:59064) 2024-03-23T06:12:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9169000640 1 -- 172.21.15.73:0/3418331882 learned_addr learned my addr 172.21.15.73:0/3418331882 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:12:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9163400640 1 -- 172.21.15.73:0/3418331882 >> v2:172.21.15.73:3300/0 conn(0x7f916415c4f0 msgr2=0x7f916406fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9163400640 1 --2- 172.21.15.73:0/3418331882 >> v2:172.21.15.73:3300/0 conn(0x7f916415c4f0 0x7f916406fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9163400640 1 -- 172.21.15.73:0/3418331882 >> v1:172.21.15.110:6789/0 conn(0x7f916406b9d0 legacy=0x7f916415ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9163400640 1 -- 172.21.15.73:0/3418331882 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164159a70 con 0x7f9164070110 2024-03-23T06:12:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.569+0000 7f9163e00640 1 --2- 172.21.15.73:0/3418331882 >> v2:172.21.15.73:3300/0 conn(0x7f916415c4f0 0x7f916406fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:12:42.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.571+0000 7f9163400640 1 --2- 172.21.15.73:0/3418331882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164070110 0x7f91640ccd20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91500097a0 tx=0x7f915002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f641fd44f3b52c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:42.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.571+0000 7f9162a00640 1 -- 172.21.15.73:0/3418331882 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150030710 con 0x7f9164070110 2024-03-23T06:12:42.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.571+0000 7f9162a00640 1 -- 172.21.15.73:0/3418331882 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915002e050 con 0x7f9164070110 2024-03-23T06:12:42.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.571+0000 7f9162a00640 1 -- 172.21.15.73:0/3418331882 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150030a90 con 0x7f9164070110 2024-03-23T06:12:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.572+0000 7f9169a00640 1 -- 172.21.15.73:0/3418331882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164070110 msgr2=0x7f91640ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.572+0000 7f9169a00640 1 --2- 172.21.15.73:0/3418331882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164070110 0x7f91640ccd20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91500097a0 tx=0x7f915002b790 comp rx=0 tx=0).stop 2024-03-23T06:12:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.572+0000 7f9169a00640 1 -- 172.21.15.73:0/3418331882 shutdown_connections 2024-03-23T06:12:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.572+0000 7f9169a00640 1 --2- 172.21.15.73:0/3418331882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164070110 0x7f91640ccd20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:42.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.572+0000 7f9169a00640 1 --2- 172.21.15.73:0/3418331882 >> v2:172.21.15.73:3300/0 conn(0x7f916415c4f0 0x7f916406fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.572+0000 7f9169a00640 1 -- 172.21.15.73:0/3418331882 >> 172.21.15.73:0/3418331882 conn(0x7f916406a660 msgr2=0x7f91640719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.573+0000 7f9169a00640 1 -- 172.21.15.73:0/3418331882 shutdown_connections 2024-03-23T06:12:42.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.573+0000 7f9169a00640 1 -- 172.21.15.73:0/3418331882 wait complete. 2024-03-23T06:12:42.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.575+0000 7f9169a00640 1 Processor -- start 2024-03-23T06:12:42.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.575+0000 7f9169a00640 1 -- start start 2024-03-23T06:12:42.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9169a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916406b9d0 0x7f91640c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:42.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9169a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164070110 0x7f9164150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:42.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9169a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f916415c4f0 0x7f91640c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:42.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9169a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640c51f0 con 0x7f916406b9d0 2024-03-23T06:12:42.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9169a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640c5a50 con 0x7f9164070110 2024-03-23T06:12:42.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9169a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9164155fa0 con 0x7f916415c4f0 2024-03-23T06:12:42.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9169000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f916415c4f0 0x7f91640c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:42.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9163400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164070110 0x7f9164150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:42.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9163400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164070110 0x7f9164150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33232/0 (socket says 172.21.15.73:33232) 2024-03-23T06:12:42.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.577+0000 7f9169000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f916415c4f0 0x7f91640c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60338/0 (socket says 172.21.15.73:60338) 2024-03-23T06:12:42.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.578+0000 7f9163400640 1 -- 172.21.15.73:0/3247233821 learned_addr learned my addr 172.21.15.73:0/3247233821 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:42.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.578+0000 7f9163e00640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916406b9d0 0x7f91640c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.578+0000 7f9163400640 1 -- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f916415c4f0 msgr2=0x7f91640c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.578+0000 7f9163400640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f916415c4f0 0x7f91640c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.578+0000 7f9163400640 1 -- 172.21.15.73:0/3247233821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916406b9d0 msgr2=0x7f91640c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.578+0000 7f9163400640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916406b9d0 0x7f91640c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.579+0000 7f9163400640 1 -- 172.21.15.73:0/3247233821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9150009400 con 0x7f9164070110 2024-03-23T06:12:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.579+0000 7f9163e00640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916406b9d0 0x7f91640c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:12:42.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.579+0000 7f9163400640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164070110 0x7f9164150870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9150035040 tx=0x7f91500046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:42.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.579+0000 7f915be00640 1 -- 172.21.15.73:0/3247233821 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915003b8d0 con 0x7f9164070110 2024-03-23T06:12:42.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.579+0000 7f915be00640 1 -- 172.21.15.73:0/3247233821 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915003ba50 con 0x7f9164070110 2024-03-23T06:12:42.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.579+0000 7f9169a00640 1 -- 172.21.15.73:0/3247233821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9164156240 con 0x7f9164070110 2024-03-23T06:12:42.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.579+0000 7f915be00640 1 -- 172.21.15.73:0/3247233821 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915003be00 con 0x7f9164070110 2024-03-23T06:12:42.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.579+0000 7f9169a00640 1 -- 172.21.15.73:0/3247233821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91640c56e0 con 0x7f9164070110 2024-03-23T06:12:42.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.581+0000 7f9159600640 1 -- 172.21.15.73:0/3247233821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916406c4b0 con 0x7f9164070110 2024-03-23T06:12:42.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.582+0000 7f915be00640 1 -- 172.21.15.73:0/3247233821 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9150039040 con 0x7f9164070110 2024-03-23T06:12:42.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.583+0000 7f915be00640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f914406ac00 0x7f914406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:42.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.583+0000 7f915be00640 1 -- 172.21.15.73:0/3247233821 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f91500aaa90 con 0x7f9164070110 2024-03-23T06:12:42.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.584+0000 7f9163e00640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f914406ac00 0x7f914406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:42.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.584+0000 7f9163e00640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f914406ac00 0x7f914406d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9154006e80 tx=0x7f9154008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:42.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:42.593+0000 7f915be00640 1 -- 172.21.15.73:0/3247233821 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f91500759a0 con 0x7f9164070110 2024-03-23T06:12:43.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.133+0000 7f9159600640 1 -- 172.21.15.73:0/3247233821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f91640cdc60 con 0x7f9164070110 2024-03-23T06:12:43.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.142+0000 7f915be00640 1 -- 172.21.15.73:0/3247233821 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f915004a620 con 0x7f9164070110 2024-03-23T06:12:43.145 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:12:43.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.153+0000 7f9159600640 1 -- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f914406ac00 msgr2=0x7f914406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.155+0000 7f9159600640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f914406ac00 0x7f914406d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9154006e80 tx=0x7f9154008040 comp rx=0 tx=0).stop 2024-03-23T06:12:43.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.155+0000 7f9159600640 1 -- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164070110 msgr2=0x7f9164150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.156+0000 7f9159600640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164070110 0x7f9164150870 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9150035040 tx=0x7f91500046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.157+0000 7f9159600640 1 -- 172.21.15.73:0/3247233821 shutdown_connections 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.157+0000 7f9159600640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f914406ac00 0x7f914406d0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.157+0000 7f9159600640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f916415c4f0 0x7f91640c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.157+0000 7f9159600640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164070110 0x7f9164150870 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9150035040 tx=0x7f91500046c0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.157+0000 7f9159600640 1 --2- 172.21.15.73:0/3247233821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f916406b9d0 0x7f91640c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.157+0000 7f9159600640 1 -- 172.21.15.73:0/3247233821 >> 172.21.15.73:0/3247233821 conn(0x7f916406a660 msgr2=0x7f9164157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.163+0000 7f9159600640 1 -- 172.21.15.73:0/3247233821 shutdown_connections 2024-03-23T06:12:43.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.163+0000 7f9159600640 1 -- 172.21.15.73:0/3247233821 wait complete. 2024-03-23T06:12:43.205 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:12:43.205 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:12:43.205 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:12:43.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:12:43.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.537+0000 7fe1dd800640 1 Processor -- start 2024-03-23T06:12:43.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.538+0000 7fe1dd800640 1 -- start start 2024-03-23T06:12:43.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.539+0000 7fe1dd800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9790 0x7fe1d80b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.539+0000 7fe1dd800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d806a960 con 0x7fe1d8153750 2024-03-23T06:12:43.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.539+0000 7fe1dd800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d81596d0 con 0x7fe1d80c9b70 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.539+0000 7fe1dd800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d806adf0 con 0x7fe1d80c9790 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.539+0000 7fe1d7400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe1d80c9b70 0x7fe1d8153040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:59078/0 (socket says 172.21.15.73:59078) 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.539+0000 7fe1d7400640 1 -- 172.21.15.73:0/3581644209 learned_addr learned my addr 172.21.15.73:0/3581644209 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.539+0000 7fe1d7e00640 1 --2- 172.21.15.73:0/3581644209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9790 0x7fe1d80b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.540+0000 7fe1d6a00640 1 -- 172.21.15.73:0/3581644209 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208345133 0 0) 0x7fe1d81596d0 con 0x7fe1d80c9b70 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.540+0000 7fe1d6a00640 1 -- 172.21.15.73:0/3581644209 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1bc003520 con 0x7fe1d80c9b70 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.540+0000 7fe1d7e00640 1 -- 172.21.15.73:0/3581644209 >> v1:172.21.15.110:6789/0 conn(0x7fe1d80c9b70 legacy=0x7fe1d8153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.540+0000 7fe1d7e00640 1 -- 172.21.15.73:0/3581644209 >> v1:172.21.15.73:6789/0 conn(0x7fe1d8153750 legacy=0x7fe1d815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.540+0000 7fe1d7e00640 1 -- 172.21.15.73:0/3581644209 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d815d820 con 0x7fe1d80c9790 2024-03-23T06:12:43.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.541+0000 7fe1d7e00640 1 --2- 172.21.15.73:0/3581644209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9790 0x7fe1d80b2260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009dc0 tx=0x7fe1d002bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15ebf6ac15adfa7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:43.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.542+0000 7fe1d6a00640 1 -- 172.21.15.73:0/3581644209 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d002cd50 con 0x7fe1d80c9790 2024-03-23T06:12:43.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.542+0000 7fe1d6a00640 1 -- 172.21.15.73:0/3581644209 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d0034440 con 0x7fe1d80c9790 2024-03-23T06:12:43.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.542+0000 7fe1d6a00640 1 -- 172.21.15.73:0/3581644209 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00347d0 con 0x7fe1d80c9790 2024-03-23T06:12:43.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.543+0000 7fe1dd800640 1 -- 172.21.15.73:0/3581644209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9790 msgr2=0x7fe1d80b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.543+0000 7fe1dd800640 1 --2- 172.21.15.73:0/3581644209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9790 0x7fe1d80b2260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009dc0 tx=0x7fe1d002bfa0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.543+0000 7fe1dd800640 1 -- 172.21.15.73:0/3581644209 shutdown_connections 2024-03-23T06:12:43.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.543+0000 7fe1dd800640 1 --2- 172.21.15.73:0/3581644209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9790 0x7fe1d80b2260 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.543+0000 7fe1dd800640 1 -- 172.21.15.73:0/3581644209 >> 172.21.15.73:0/3581644209 conn(0x7fe1d8071d40 msgr2=0x7fe1d806bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:43.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.548+0000 7fe1dd800640 1 -- 172.21.15.73:0/3581644209 shutdown_connections 2024-03-23T06:12:43.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.548+0000 7fe1dd800640 1 -- 172.21.15.73:0/3581644209 wait complete. 2024-03-23T06:12:43.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.552+0000 7fe1dd800640 1 Processor -- start 2024-03-23T06:12:43.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.552+0000 7fe1dd800640 1 -- start start 2024-03-23T06:12:43.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.555+0000 7fe1dd800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d80c9790 0x7fe1d815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.555+0000 7fe1dd800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9b70 0x7fe1d815b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.555+0000 7fe1d7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d80c9790 0x7fe1d815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.555+0000 7fe1d7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d80c9790 0x7fe1d815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33240/0 (socket says 172.21.15.73:33240) 2024-03-23T06:12:43.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.555+0000 7fe1d7e00640 1 -- 172.21.15.73:0/2566973307 learned_addr learned my addr 172.21.15.73:0/2566973307 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:43.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.556+0000 7fe1d7400640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9b70 0x7fe1d815b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.556+0000 7fe1dd800640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d8153750 0x7fe1d80ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.557+0000 7fe1dce00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d8153750 0x7fe1d80ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.557+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d815b970 con 0x7fe1d8153750 2024-03-23T06:12:43.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.557+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8157270 con 0x7fe1d80c9790 2024-03-23T06:12:43.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.557+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80ccfe0 con 0x7fe1d80c9b70 2024-03-23T06:12:43.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.559+0000 7fe1d7400640 1 -- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d80c9790 msgr2=0x7fe1d815be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.559+0000 7fe1d7400640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1d80c9790 0x7fe1d815be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.559+0000 7fe1d7400640 1 -- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d8153750 msgr2=0x7fe1d80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.559+0000 7fe1d7400640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d8153750 0x7fe1d80ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.559+0000 7fe1d7400640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0009a70 con 0x7fe1d80c9b70 2024-03-23T06:12:43.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.560+0000 7fe1d7400640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9b70 0x7fe1d815b430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c430 tx=0x7fe1c400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:43.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.560+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4005ce0 con 0x7fe1d80c9b70 2024-03-23T06:12:43.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.560+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4005e40 con 0x7fe1d80c9b70 2024-03-23T06:12:43.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.560+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4007310 con 0x7fe1d80c9b70 2024-03-23T06:12:43.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.560+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d80c5ea0 con 0x7fe1d80c9b70 2024-03-23T06:12:43.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.561+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d815afa0 con 0x7fe1d80c9b70 2024-03-23T06:12:43.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.565+0000 7fe1dd800640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce200 0x7fe1d8150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.565+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80723f0 con 0x7fe1d80ce200 2024-03-23T06:12:43.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.571+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe1c4007470 con 0x7fe1d80c9b70 2024-03-23T06:12:43.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.572+0000 7fe1cfe00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1b806acd0 0x7fe1b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.572+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe1c4088b50 con 0x7fe1d80c9b70 2024-03-23T06:12:43.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.573+0000 7fe1dce00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1b806acd0 0x7fe1b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.575+0000 7fe1dce00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1b806acd0 0x7fe1b806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8000f60 tx=0x7fe1c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:43.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.581+0000 7fe1d7e00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce200 0x7fe1d8150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.583+0000 7fe1d7e00640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1d806a310 con 0x7fe1d80ce200 2024-03-23T06:12:43.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.584+0000 7fe1d7e00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce200 0x7fe1d8150aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0000f80 tx=0x7fe1d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:43.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.584+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0049610 con 0x7fe1d80ce200 2024-03-23T06:12:43.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.584+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fe1d00497b0 con 0x7fe1d80ce200 2024-03-23T06:12:43.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.584+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce200 msgr2=0x7fe1d8150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.584+0000 7fe1cfe00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce200 0x7fe1d8150aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0000f80 tx=0x7fe1d0004a40 comp rx=0 tx=0).stop 2024-03-23T06:12:43.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.585+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce200 msgr2=0x7fe1d8150aa0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:43.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.585+0000 7fe1cfe00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce200 0x7fe1d8150aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.596+0000 7fe1dd800640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce5e0 0x7fe1d815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.596+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d806a030 con 0x7fe1d80ce5e0 2024-03-23T06:12:43.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.596+0000 7fe1d7e00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce5e0 0x7fe1d815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.597+0000 7fe1d7e00640 1 -- 172.21.15.73:0/2566973307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe1d806a5f0 con 0x7fe1d80ce5e0 2024-03-23T06:12:43.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.597+0000 7fe1d7e00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce5e0 0x7fe1d815a670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0045000 tx=0x7fe1d0031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:43.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.598+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0004240 con 0x7fe1d80ce5e0 2024-03-23T06:12:43.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.598+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4951 (secure 0 0 0) 0x7fe1d00043a0 con 0x7fe1d80ce5e0 2024-03-23T06:12:43.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.598+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce5e0 msgr2=0x7fe1d815a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.598+0000 7fe1cfe00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce5e0 0x7fe1d815a670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0045000 tx=0x7fe1d0031000 comp rx=0 tx=0).stop 2024-03-23T06:12:43.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.598+0000 7fe1cfe00640 1 -- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce5e0 msgr2=0x7fe1d815a670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:43.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.598+0000 7fe1cfe00640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe1d80ce5e0 0x7fe1d815a670 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.598 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 20, 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 17, 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:12:43.599 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:12:43.600 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:12:43.601 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:43.602 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:43.603 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:12:43.604 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.605 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:43.606 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:43.607 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:43.609 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:43.610 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:43.610 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:43.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:43.610 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:43.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:43.610 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:12:43.610 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1b806acd0 msgr2=0x7fe1b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dd800640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe1b806acd0 0x7fe1b806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8000f60 tx=0x7fe1c8009040 comp rx=0 tx=0).stop 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9b70 msgr2=0x7fe1d815b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dd800640 1 --2- 172.21.15.73:0/2566973307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1d80c9b70 0x7fe1d815b430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400c430 tx=0x7fe1c400c8f0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dce00640 1 -- 172.21.15.73:0/2566973307 reap_dead start 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dce00640 1 -- 172.21.15.73:0/2566973307 reap_dead start 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 shutdown_connections 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 >> 172.21.15.73:0/2566973307 conn(0x7fe1d8071d40 msgr2=0x7fe1d8158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 shutdown_connections 2024-03-23T06:12:43.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.599+0000 7fe1dd800640 1 -- 172.21.15.73:0/2566973307 wait complete. 2024-03-23T06:12:43.620 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:12:43.620 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:12:43.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:12:43.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.957+0000 7fbc5a600640 1 Processor -- start 2024-03-23T06:12:43.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.957+0000 7fbc5a600640 1 -- start start 2024-03-23T06:12:43.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.960+0000 7fbc5a600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc5414fd70 0x7fbc540ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.960+0000 7fbc5a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5406f940 0x7fbc54156060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc52a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbc540c6310 0x7fbc540714f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:59094/0 (socket says 172.21.15.73:59094) 2024-03-23T06:12:43.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc53400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc5414fd70 0x7fbc540ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc53400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc5414fd70 0x7fbc540ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:34500/0 (socket says 172.21.15.73:34500) 2024-03-23T06:12:43.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc52a00640 1 -- 172.21.15.73:0/434632734 learned_addr learned my addr 172.21.15.73:0/434632734 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:12:43.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc53e00640 1 --2- 172.21.15.73:0/434632734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5406f940 0x7fbc54156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc5a600640 1 -- 172.21.15.73:0/434632734 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc540c5490 con 0x7fbc540c6310 2024-03-23T06:12:43.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc5a600640 1 -- 172.21.15.73:0/434632734 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5406fdd0 con 0x7fbc5414fd70 2024-03-23T06:12:43.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc5a600640 1 -- 172.21.15.73:0/434632734 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc540c56e0 con 0x7fbc5406f940 2024-03-23T06:12:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc53400640 1 -- 172.21.15.73:0/434632734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5406f940 msgr2=0x7fbc54156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc53400640 1 --2- 172.21.15.73:0/434632734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5406f940 0x7fbc54156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc53400640 1 -- 172.21.15.73:0/434632734 >> v1:172.21.15.110:6789/0 conn(0x7fbc540c6310 legacy=0x7fbc540714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.962+0000 7fbc53400640 1 -- 172.21.15.73:0/434632734 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540c59c0 con 0x7fbc5414fd70 2024-03-23T06:12:43.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.968+0000 7fbc53e00640 1 --2- 172.21.15.73:0/434632734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5406f940 0x7fbc54156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:12:43.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.971+0000 7fbc53400640 1 --2- 172.21.15.73:0/434632734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5414fd70 0x7fbc540ca4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00aea0 tx=0x7fbc4c02ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d55cb09e1eda68 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.975+0000 7fbc52000640 1 -- 172.21.15.73:0/434632734 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c02d9a0 con 0x7fbc5414fd70 2024-03-23T06:12:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.975+0000 7fbc52000640 1 -- 172.21.15.73:0/434632734 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4c02db00 con 0x7fbc5414fd70 2024-03-23T06:12:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.975+0000 7fbc52000640 1 -- 172.21.15.73:0/434632734 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c02de90 con 0x7fbc5414fd70 2024-03-23T06:12:43.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.982+0000 7fbc5a600640 1 -- 172.21.15.73:0/434632734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5414fd70 msgr2=0x7fbc540ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.982+0000 7fbc5a600640 1 --2- 172.21.15.73:0/434632734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5414fd70 0x7fbc540ca4f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00aea0 tx=0x7fbc4c02ce80 comp rx=0 tx=0).stop 2024-03-23T06:12:43.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.982+0000 7fbc5a600640 1 -- 172.21.15.73:0/434632734 shutdown_connections 2024-03-23T06:12:43.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.982+0000 7fbc5a600640 1 --2- 172.21.15.73:0/434632734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5406f940 0x7fbc54156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.982+0000 7fbc5a600640 1 --2- 172.21.15.73:0/434632734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc5414fd70 0x7fbc540ca4f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.982+0000 7fbc5a600640 1 -- 172.21.15.73:0/434632734 >> 172.21.15.73:0/434632734 conn(0x7fbc54069cb0 msgr2=0x7fbc5406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:43.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.983+0000 7fbc5a600640 1 -- 172.21.15.73:0/434632734 shutdown_connections 2024-03-23T06:12:43.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.983+0000 7fbc5a600640 1 -- 172.21.15.73:0/434632734 wait complete. 2024-03-23T06:12:43.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.986+0000 7fbc5a600640 1 Processor -- start 2024-03-23T06:12:43.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.986+0000 7fbc5a600640 1 -- start start 2024-03-23T06:12:43.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.988+0000 7fbc5a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc5406f940 0x7fbc5414e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.989+0000 7fbc5a600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc540c6310 0x7fbc540c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.989+0000 7fbc5a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5414fd70 0x7fbc540c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:43.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.990+0000 7fbc5a600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc541fcb20 con 0x7fbc540c6310 2024-03-23T06:12:43.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.990+0000 7fbc5a600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc541fbcc0 con 0x7fbc5406f940 2024-03-23T06:12:43.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.990+0000 7fbc5a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc541fbfa0 con 0x7fbc5414fd70 2024-03-23T06:12:43.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.990+0000 7fbc53400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc5406f940 0x7fbc5414e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.990+0000 7fbc53e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5414fd70 0x7fbc540c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.990+0000 7fbc53e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5414fd70 0x7fbc540c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60386/0 (socket says 172.21.15.73:60386) 2024-03-23T06:12:43.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.990+0000 7fbc53e00640 1 -- 172.21.15.73:0/3123568556 learned_addr learned my addr 172.21.15.73:0/3123568556 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.991+0000 7fbc53e00640 1 -- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc5406f940 msgr2=0x7fbc5414e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.991+0000 7fbc53e00640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc5406f940 0x7fbc5414e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.991+0000 7fbc53e00640 1 -- 172.21.15.73:0/3123568556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc540c6310 msgr2=0x7fbc540c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:43.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.991+0000 7fbc52a00640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc540c6310 0x7fbc540c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:43.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.991+0000 7fbc53e00640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc540c6310 0x7fbc540c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:43.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.991+0000 7fbc53e00640 1 -- 172.21.15.73:0/3123568556 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40009400 con 0x7fbc5414fd70 2024-03-23T06:12:43.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.992+0000 7fbc53e00640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5414fd70 0x7fbc540c33d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000e930 tx=0x7fbc4000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:43.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.992+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40009700 con 0x7fbc5414fd70 2024-03-23T06:12:43.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.992+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4000ca00 con 0x7fbc5414fd70 2024-03-23T06:12:43.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.993+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000cd90 con 0x7fbc5414fd70 2024-03-23T06:12:43.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.993+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c00ab80 con 0x7fbc5414fd70 2024-03-23T06:12:43.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.993+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc541fc560 con 0x7fbc5414fd70 2024-03-23T06:12:43.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:43.998+0000 7fbc52a00640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc540c6310 0x7fbc540c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:12:44.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.000+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbc40013470 con 0x7fbc5414fd70 2024-03-23T06:12:44.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.001+0000 7fbc5a600640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc541fc720 0x7fbc5412bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:44.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.001+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc54073bf0 con 0x7fbc541fc720 2024-03-23T06:12:44.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.003+0000 7fbc4b400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc3406acd0 0x7fbc3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:44.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.004+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fbc40089270 con 0x7fbc5414fd70 2024-03-23T06:12:44.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.009+0000 7fbc53400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc541fc720 0x7fbc5412bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:44.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.010+0000 7fbc52a00640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc3406acd0 0x7fbc3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:44.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.013+0000 7fbc52a00640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc3406acd0 0x7fbc3406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbc540c7ec0 tx=0x7fbc44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:44.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.014+0000 7fbc53400640 1 -- 172.21.15.73:0/3123568556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc54155ad0 con 0x7fbc541fc720 2024-03-23T06:12:44.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.015+0000 7fbc53400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc541fc720 0x7fbc5412bea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbc5406ac90 tx=0x7fbc4c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:44.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.016+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c00a560 con 0x7fbc541fc720 2024-03-23T06:12:44.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.016+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fbc4c041680 con 0x7fbc541fc720 2024-03-23T06:12:44.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.016+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc541fc720 msgr2=0x7fbc5412bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:44.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.016+0000 7fbc4b400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc541fc720 0x7fbc5412bea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbc5406ac90 tx=0x7fbc4c004a40 comp rx=0 tx=0).stop 2024-03-23T06:12:44.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.016+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc541fc720 msgr2=0x7fbc5412bea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:44.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.016+0000 7fbc4b400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc541fc720 0x7fbc5412bea0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:44.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.038+0000 7fbc5a600640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc54149820 0x7fbc541ff120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:44.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:44.038+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc540c5f80 con 0x7fbc54149820 2024-03-23T06:12:45.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.062+0000 7fbc53400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc54149820 0x7fbc541ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.064+0000 7fbc53400640 1 -- 172.21.15.73:0/3123568556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbc54150150 con 0x7fbc54149820 2024-03-23T06:12:45.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.064+0000 7fbc53400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc54149820 0x7fbc541ff120 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000f80 tx=0x7fbc4c00a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.065+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c04f070 con 0x7fbc54149820 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.065+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4636 (secure 0 0 0) 0x7fbc4c004390 con 0x7fbc54149820 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.065+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc54149820 msgr2=0x7fbc541ff120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.065+0000 7fbc4b400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc54149820 0x7fbc541ff120 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000f80 tx=0x7fbc4c00a000 comp rx=0 tx=0).stop 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.065+0000 7fbc4b400640 1 -- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc54149820 msgr2=0x7fbc541ff120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.065+0000 7fbc4b400640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc54149820 0x7fbc541ff120 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c000f80 tx=0x7fbc4c00a000 comp rx=0 tx=0).stop 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:12:45.065 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 20, 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 18, 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:45.066 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:45.067 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:45.068 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:45.069 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:45.070 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.071 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:12:45.074 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.075 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.076 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.077 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:12:45.077 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.067+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc3406acd0 msgr2=0x7fbc3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.067+0000 7fbc5a600640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc3406acd0 0x7fbc3406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbc540c7ec0 tx=0x7fbc44009040 comp rx=0 tx=0).stop 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.067+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5414fd70 msgr2=0x7fbc540c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.067+0000 7fbc5a600640 1 --2- 172.21.15.73:0/3123568556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc5414fd70 0x7fbc540c33d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000e930 tx=0x7fbc4000edf0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.068+0000 7fbc53e00640 1 -- 172.21.15.73:0/3123568556 reap_dead start 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.068+0000 7fbc53e00640 1 -- 172.21.15.73:0/3123568556 reap_dead start 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.068+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 shutdown_connections 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.068+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 >> 172.21.15.73:0/3123568556 conn(0x7fbc54069cb0 msgr2=0x7fbc54155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.069+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 shutdown_connections 2024-03-23T06:12:45.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.069+0000 7fbc5a600640 1 -- 172.21.15.73:0/3123568556 wait complete. 2024-03-23T06:12:45.104 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:12:45.104 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:12:45.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:12:45.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.357+0000 7f7a3b200640 1 Processor -- start 2024-03-23T06:12:45.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.357+0000 7f7a3b200640 1 -- start start 2024-03-23T06:12:45.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.358+0000 7f7a3b200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7a34153760 0x7f7a34159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.358+0000 7f7a3b200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a340c9740 0x7f7a340cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.358+0000 7f7a3b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a340ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.358+0000 7f7a3b200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3406a2d0 con 0x7f7a34153760 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.358+0000 7f7a3b200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3406a5b0 con 0x7f7a340c9740 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.358+0000 7f7a3b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3406a890 con 0x7f7a340cbd10 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.358+0000 7f7a39200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a340ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.359+0000 7f7a39200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a340ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60396/0 (socket says 172.21.15.73:60396) 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.359+0000 7f7a39200640 1 -- 172.21.15.73:0/1546550395 learned_addr learned my addr 172.21.15.73:0/1546550395 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.359+0000 7f7a33400640 1 --2- 172.21.15.73:0/1546550395 >> v2:172.21.15.110:3300/0 conn(0x7f7a340c9740 0x7f7a340cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.359+0000 7f7a39200640 1 -- 172.21.15.73:0/1546550395 >> v2:172.21.15.110:3300/0 conn(0x7f7a340c9740 msgr2=0x7f7a340cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.359+0000 7f7a39200640 1 --2- 172.21.15.73:0/1546550395 >> v2:172.21.15.110:3300/0 conn(0x7f7a340c9740 0x7f7a340cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.359+0000 7f7a39200640 1 -- 172.21.15.73:0/1546550395 >> v2:172.21.15.73:3300/0 conn(0x7f7a34153760 msgr2=0x7f7a34159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:45.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.359+0000 7f7a39200640 1 --2- 172.21.15.73:0/1546550395 >> v2:172.21.15.73:3300/0 conn(0x7f7a34153760 0x7f7a34159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.359+0000 7f7a39200640 1 -- 172.21.15.73:0/1546550395 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3406ab70 con 0x7f7a340cbd10 2024-03-23T06:12:45.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.361+0000 7f7a39200640 1 --2- 172.21.15.73:0/1546550395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a340ca940 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7a340c5640 tx=0x7f7a2c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=547e3b8404f31d6c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.361+0000 7f7a32a00640 1 -- 172.21.15.73:0/1546550395 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c02ca80 con 0x7f7a340cbd10 2024-03-23T06:12:45.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.361+0000 7f7a32a00640 1 -- 172.21.15.73:0/1546550395 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c02cbe0 con 0x7f7a340cbd10 2024-03-23T06:12:45.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.361+0000 7f7a32a00640 1 -- 172.21.15.73:0/1546550395 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0343f0 con 0x7f7a340cbd10 2024-03-23T06:12:45.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 -- 172.21.15.73:0/1546550395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 msgr2=0x7f7a340ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 --2- 172.21.15.73:0/1546550395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a340ca940 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7a340c5640 tx=0x7f7a2c02bee0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 -- 172.21.15.73:0/1546550395 shutdown_connections 2024-03-23T06:12:45.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 --2- 172.21.15.73:0/1546550395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a340ca940 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 --2- 172.21.15.73:0/1546550395 >> v2:172.21.15.110:3300/0 conn(0x7f7a340c9740 0x7f7a340cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 --2- 172.21.15.73:0/1546550395 >> v2:172.21.15.73:3300/0 conn(0x7f7a34153760 0x7f7a34159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 -- 172.21.15.73:0/1546550395 >> 172.21.15.73:0/1546550395 conn(0x7f7a3406c310 msgr2=0x7f7a340713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:45.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 -- 172.21.15.73:0/1546550395 shutdown_connections 2024-03-23T06:12:45.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.362+0000 7f7a3b200640 1 -- 172.21.15.73:0/1546550395 wait complete. 2024-03-23T06:12:45.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.364+0000 7f7a3b200640 1 Processor -- start 2024-03-23T06:12:45.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.364+0000 7f7a3b200640 1 -- start start 2024-03-23T06:12:45.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.365+0000 7f7a3b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a340c9740 0x7f7a34155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.365+0000 7f7a3b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a34155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.365+0000 7f7a3b200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a34153760 0x7f7a34157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.365+0000 7f7a3b200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34155540 con 0x7f7a34153760 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.365+0000 7f7a3b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3414d3c0 con 0x7f7a340c9740 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.365+0000 7f7a3b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340c8d10 con 0x7f7a340cbd10 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.366+0000 7f7a33e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a340c9740 0x7f7a34155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.366+0000 7f7a33400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a34155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.366+0000 7f7a33400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a34155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60402/0 (socket says 172.21.15.73:60402) 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.366+0000 7f7a33400640 1 -- 172.21.15.73:0/2562318139 learned_addr learned my addr 172.21.15.73:0/2562318139 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.366+0000 7f7a39200640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a34153760 0x7f7a34157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.366+0000 7f7a33400640 1 -- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a340c9740 msgr2=0x7f7a34155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.366+0000 7f7a33e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a340c9740 0x7f7a34155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33298/0 (socket says 172.21.15.73:33298) 2024-03-23T06:12:45.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a33400640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a340c9740 0x7f7a34155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a33400640 1 -- 172.21.15.73:0/2562318139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a34153760 msgr2=0x7f7a34157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a33400640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a34153760 0x7f7a34157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a33400640 1 -- 172.21.15.73:0/2562318139 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c009b30 con 0x7f7a340cbd10 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a39200640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a34153760 0x7f7a34157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a33e00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a340c9740 0x7f7a34155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a33400640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a34155b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d5f0 tx=0x7f7a2400dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240125f0 con 0x7f7a340cbd10 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a24012750 con 0x7f7a340cbd10 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24012b00 con 0x7f7a340cbd10 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.367+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a341565b0 con 0x7f7a340cbd10 2024-03-23T06:12:45.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.368+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a34154350 con 0x7f7a340cbd10 2024-03-23T06:12:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.369+0000 7f7a3b200640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a34157bc0 0x7f7a341f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.369+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34072510 con 0x7f7a34157bc0 2024-03-23T06:12:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.369+0000 7f7a33e00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a34157bc0 0x7f7a341f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.370+0000 7f7a33e00640 1 -- 172.21.15.73:0/2562318139 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a340c9b80 con 0x7f7a34157bc0 2024-03-23T06:12:45.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.370+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7a24012c60 con 0x7f7a340cbd10 2024-03-23T06:12:45.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.370+0000 7f7a33e00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a34157bc0 0x7f7a341f6f10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c720 tx=0x7f7a2000cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.371+0000 7f7a2be00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7a1406ac00 0x7f7a1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.371+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f7a24089b80 con 0x7f7a340cbd10 2024-03-23T06:12:45.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.371+0000 7f7a39200640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7a1406ac00 0x7f7a1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.372+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20007890 con 0x7f7a34157bc0 2024-03-23T06:12:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.372+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f7a200079f0 con 0x7f7a34157bc0 2024-03-23T06:12:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.372+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a34157bc0 msgr2=0x7f7a341f6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.372+0000 7f7a2be00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a34157bc0 0x7f7a341f6f10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c720 tx=0x7f7a2000cbe0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.372+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a34157bc0 msgr2=0x7f7a341f6f10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.372+0000 7f7a2be00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a34157bc0 0x7f7a341f6f10 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000c720 tx=0x7f7a2000cbe0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.372+0000 7f7a39200640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7a1406ac00 0x7f7a1406d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c035000 tx=0x7f7a2c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.384+0000 7f7a3b200640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a341560c0 0x7f7a341f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.384+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34153b40 con 0x7f7a341560c0 2024-03-23T06:12:45.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.386+0000 7f7a33e00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a341560c0 0x7f7a341f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.386+0000 7f7a33e00640 1 -- 172.21.15.73:0/2562318139 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7a340720f0 con 0x7f7a341560c0 2024-03-23T06:12:45.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.388+0000 7f7a33e00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a341560c0 0x7f7a341f7450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a20017000 tx=0x7f7a200047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.389+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20028070 con 0x7f7a341560c0 2024-03-23T06:12:45.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.389+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f7a20020040 con 0x7f7a341560c0 2024-03-23T06:12:45.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.389+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a341560c0 msgr2=0x7f7a341f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.389+0000 7f7a2be00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a341560c0 0x7f7a341f7450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a20017000 tx=0x7f7a200047d0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.389+0000 7f7a2be00640 1 -- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a341560c0 msgr2=0x7f7a341f7450 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:12:45.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.389+0000 7f7a2be00640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a341560c0 0x7f7a341f7450 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a20017000 tx=0x7f7a200047d0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.390 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:12:45.390 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:45.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 20, 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 19, 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:45.391 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:12:45.393 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:12:45.394 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:12:45.396 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:12:45.397 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.398 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:12:45.400 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:12:45.401 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:12:45.402 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:12:45.402 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:12:45.402 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:12:45.402 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:12:45.402 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:12:45.402 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.390+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7a1406ac00 msgr2=0x7f7a1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.390+0000 7f7a3b200640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7a1406ac00 0x7f7a1406d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c035000 tx=0x7f7a2c030000 comp rx=0 tx=0).stop 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.390+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 msgr2=0x7f7a34155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.390+0000 7f7a3b200640 1 --2- 172.21.15.73:0/2562318139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a340cbd10 0x7f7a34155b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a2400d5f0 tx=0x7f7a2400dab0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.391+0000 7f7a39200640 1 -- 172.21.15.73:0/2562318139 reap_dead start 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.391+0000 7f7a39200640 1 -- 172.21.15.73:0/2562318139 reap_dead start 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.391+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 shutdown_connections 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.391+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 >> 172.21.15.73:0/2562318139 conn(0x7f7a3406c310 msgr2=0x7f7a340ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.391+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 shutdown_connections 2024-03-23T06:12:45.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.391+0000 7f7a3b200640 1 -- 172.21.15.73:0/2562318139 wait complete. 2024-03-23T06:12:45.416 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:12:45.416 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T06:12:45.416 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T06:12:45.417 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T06:12:45.417 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T06:12:45.417 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T06:12:45.417 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:12:45.452 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T06:12:45.453 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:12:45.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:12:45.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.827+0000 7fba5da00640 1 Processor -- start 2024-03-23T06:12:45.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.827+0000 7fba5da00640 1 -- start start 2024-03-23T06:12:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.830+0000 7fba56a00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fba58157c20 legacy=0x7fba5806baa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:12:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.830+0000 7fba5da00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815e3a0 0x7fba58169230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.830+0000 7fba5da00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba581619d0 con 0x7fba58157c20 2024-03-23T06:12:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.830+0000 7fba5da00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba580ca710 con 0x7fba580b1680 2024-03-23T06:12:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.830+0000 7fba5da00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba58160e90 con 0x7fba5815e3a0 2024-03-23T06:12:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.831+0000 7fba56000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fba580b1680 0x7fba580cbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:59110/0 (socket says 172.21.15.73:59110) 2024-03-23T06:12:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.831+0000 7fba56000640 1 -- 172.21.15.73:0/3701925710 learned_addr learned my addr 172.21.15.73:0/3701925710 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:12:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.831+0000 7fba57400640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815e3a0 0x7fba58169230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.832+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964535874 0 0) 0x7fba580ca710 con 0x7fba580b1680 2024-03-23T06:12:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.832+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3c003520 con 0x7fba580b1680 2024-03-23T06:12:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.833+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084017948 0 0) 0x7fba3c003520 con 0x7fba580b1680 2024-03-23T06:12:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.833+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815e3a0 msgr2=0x7fba58169230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.833+0000 7fba55600640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815e3a0 0x7fba58169230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.833+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 >> v1:172.21.15.73:6789/0 conn(0x7fba58157c20 legacy=0x7fba5806baa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.833+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba581610a0 con 0x7fba580b1680 2024-03-23T06:12:45.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.833+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fba44001650 con 0x7fba580b1680 2024-03-23T06:12:45.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.833+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 >> v1:172.21.15.110:6789/0 conn(0x7fba580b1680 legacy=0x7fba580cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.833+0000 7fba55600640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.834+0000 7fba55600640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba3c0047c0 0x7fba3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.834+0000 7fba55600640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815e3a0 0x7fba3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.834+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58160e90 con 0x7fba3c0047c0 2024-03-23T06:12:45.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.834+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c00ba60 con 0x7fba3c003990 2024-03-23T06:12:45.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.834+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3c00bc20 con 0x7fba5815e3a0 2024-03-23T06:12:45.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.834+0000 7fba56a00640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.835+0000 7fba56000640 1 -- 172.21.15.73:0/3701925710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba3c0047c0 msgr2=0x7fba3c004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:12:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.835+0000 7fba56000640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba3c0047c0 0x7fba3c004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.835+0000 7fba57400640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815e3a0 0x7fba3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.835+0000 7fba56a00640 1 -- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815e3a0 msgr2=0x7fba3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.835+0000 7fba56a00640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815e3a0 0x7fba3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.835+0000 7fba56a00640 1 -- 172.21.15.73:0/3701925710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba3c0047c0 msgr2=0x7fba3c004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.835+0000 7fba56a00640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba3c0047c0 0x7fba3c004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.835+0000 7fba56a00640 1 -- 172.21.15.73:0/3701925710 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba581619d0 con 0x7fba3c003990 2024-03-23T06:12:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.837+0000 7fba56a00640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba3c003dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba48003980 tx=0x7fba3c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7c924caedfc4392 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.838+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48003bb0 con 0x7fba3c003990 2024-03-23T06:12:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.838+0000 7fba55600640 1 -- 172.21.15.73:0/3701925710 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4802e070 con 0x7fba3c003990 2024-03-23T06:12:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.840+0000 7fba5da00640 1 -- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 msgr2=0x7fba3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.840+0000 7fba5da00640 1 --2- 172.21.15.73:0/3701925710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba3c003dd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba48003980 tx=0x7fba3c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.840+0000 7fba57400640 1 -- 172.21.15.73:0/3701925710 reap_dead start 2024-03-23T06:12:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.841+0000 7fba5da00640 1 -- 172.21.15.73:0/3701925710 shutdown_connections 2024-03-23T06:12:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.841+0000 7fba5da00640 1 -- 172.21.15.73:0/3701925710 >> 172.21.15.73:0/3701925710 conn(0x7fba5806a060 msgr2=0x7fba5806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.841+0000 7fba5da00640 1 -- 172.21.15.73:0/3701925710 shutdown_connections 2024-03-23T06:12:45.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.841+0000 7fba5da00640 1 -- 172.21.15.73:0/3701925710 wait complete. 2024-03-23T06:12:45.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.844+0000 7fba5da00640 1 Processor -- start 2024-03-23T06:12:45.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.844+0000 7fba5da00640 1 -- start start 2024-03-23T06:12:45.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.846+0000 7fba5da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba581e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.850+0000 7fba56a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba581e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.850+0000 7fba56a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba581e9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33334/0 (socket says 172.21.15.73:33334) 2024-03-23T06:12:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.851+0000 7fba56a00640 1 -- 172.21.15.73:0/3821153539 learned_addr learned my addr 172.21.15.73:0/3821153539 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.851+0000 7fba5da00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba581e9200 0x7fba580c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.851+0000 7fba56000640 1 -- 172.21.15.73:0/3821153539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba581e9200 msgr2=0x7fba580c6320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:12:45.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.852+0000 7fba56000640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba581e9200 0x7fba580c6320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:45.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.852+0000 7fba5da00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815f290 0x7fba581f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.852+0000 7fba5da00640 1 -- 172.21.15.73:0/3821153539 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba580c6bc0 con 0x7fba581e9200 2024-03-23T06:12:45.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.852+0000 7fba5da00640 1 -- 172.21.15.73:0/3821153539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba581f4ba0 con 0x7fba3c003990 2024-03-23T06:12:45.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.852+0000 7fba5da00640 1 -- 172.21.15.73:0/3821153539 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba581e8eb0 con 0x7fba5815f290 2024-03-23T06:12:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.858+0000 7fba57400640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815f290 0x7fba581f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.859+0000 7fba56a00640 1 -- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815f290 msgr2=0x7fba581f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.859+0000 7fba56a00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815f290 0x7fba581f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.859+0000 7fba56a00640 1 -- 172.21.15.73:0/3821153539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba581e9200 msgr2=0x7fba580c6320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.859+0000 7fba56a00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba581e9200 0x7fba580c6320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:45.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.859+0000 7fba56a00640 1 -- 172.21.15.73:0/3821153539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba581e88f0 con 0x7fba3c003990 2024-03-23T06:12:45.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.860+0000 7fba57400640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815f290 0x7fba581f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:12:45.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.861+0000 7fba56a00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba581e9600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fba48003fd0 tx=0x7fba48005a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.863+0000 7fba4ea00640 1 -- 172.21.15.73:0/3821153539 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48005410 con 0x7fba3c003990 2024-03-23T06:12:45.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.864+0000 7fba4ea00640 1 -- 172.21.15.73:0/3821153539 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba48005570 con 0x7fba3c003990 2024-03-23T06:12:45.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.864+0000 7fba5da00640 1 -- 172.21.15.73:0/3821153539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba581e8bd0 con 0x7fba3c003990 2024-03-23T06:12:45.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.864+0000 7fba4ea00640 1 -- 172.21.15.73:0/3821153539 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba48033430 con 0x7fba3c003990 2024-03-23T06:12:45.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.865+0000 7fba5da00640 1 -- 172.21.15.73:0/3821153539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba580cfc50 con 0x7fba3c003990 2024-03-23T06:12:45.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.869+0000 7fba43e00640 1 -- 172.21.15.73:0/3821153539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba580b2440 con 0x7fba3c003990 2024-03-23T06:12:45.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.875+0000 7fba4ea00640 1 -- 172.21.15.73:0/3821153539 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fba48030030 con 0x7fba3c003990 2024-03-23T06:12:45.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.876+0000 7fba4ea00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fba3806ac00 0x7fba3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:45.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.877+0000 7fba4ea00640 1 -- 172.21.15.73:0/3821153539 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fba480aa3a0 con 0x7fba3c003990 2024-03-23T06:12:45.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.878+0000 7fba56000640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fba3806ac00 0x7fba3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:45.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.880+0000 7fba56000640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fba3806ac00 0x7fba3806d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba5815d9f0 tx=0x7fba44001600 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:45.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:45.890+0000 7fba4ea00640 1 -- 172.21.15.73:0/3821153539 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fba48075380 con 0x7fba3c003990 2024-03-23T06:12:46.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.401+0000 7fba43e00640 1 -- 172.21.15.73:0/3821153539 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fba58155320 con 0x7fba3c003990 2024-03-23T06:12:46.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.402+0000 7fba4ea00640 1 -- 172.21.15.73:0/3821153539 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fba480789a0 con 0x7fba3c003990 2024-03-23T06:12:46.411 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:12:46.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 -- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fba3806ac00 msgr2=0x7fba3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fba3806ac00 0x7fba3806d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba5815d9f0 tx=0x7fba44001600 comp rx=0 tx=0).stop 2024-03-23T06:12:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 -- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 msgr2=0x7fba581e9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:46.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba581e9600 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fba48003fd0 tx=0x7fba48005a10 comp rx=0 tx=0).stop 2024-03-23T06:12:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 -- 172.21.15.73:0/3821153539 shutdown_connections 2024-03-23T06:12:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fba3806ac00 0x7fba3806d0c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba5815f290 0x7fba581f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba581e9200 0x7fba580c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 --2- 172.21.15.73:0/3821153539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba3c003990 0x7fba581e9600 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:46.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 -- 172.21.15.73:0/3821153539 >> 172.21.15.73:0/3821153539 conn(0x7fba5806a060 msgr2=0x7fba58154070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:46.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 -- 172.21.15.73:0/3821153539 shutdown_connections 2024-03-23T06:12:46.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:46.410+0000 7fba43e00640 1 -- 172.21.15.73:0/3821153539 wait complete. 2024-03-23T06:12:49.457 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:12:49.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.656+0000 7f2dcd000640 1 Processor -- start 2024-03-23T06:12:49.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.656+0000 7f2dcd000640 1 -- start start 2024-03-23T06:12:49.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dcd000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2dc80cf100 0x7f2dc80cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:49.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dcd000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80caed0 0x7f2dc8159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dcd000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc815a370 con 0x7f2dc80ced20 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dcd000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc80cb8d0 con 0x7f2dc80cf100 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dcd000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80ca330 con 0x7f2dc80caed0 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dc6a00640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f2dc80cf100 msgr2=0x7f2dc80cb390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dc6a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2dc80cf100 0x7f2dc80cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dc7400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2dc80ced20 0x7f2dc80ca7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:59116/0 (socket says 172.21.15.73:59116) 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dc7400640 1 -- 172.21.15.73:0/681713007 learned_addr learned my addr 172.21.15.73:0/681713007 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.657+0000 7f2dc7e00640 1 --2- 172.21.15.73:0/681713007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80caed0 0x7f2dc8159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:49.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.658+0000 7f2dc7e00640 1 -- 172.21.15.73:0/681713007 >> v2:172.21.15.73:3300/0 conn(0x7f2dc80cf100 msgr2=0x7f2dc80cb390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.658+0000 7f2dc7e00640 1 --2- 172.21.15.73:0/681713007 >> v2:172.21.15.73:3300/0 conn(0x7f2dc80cf100 0x7f2dc80cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.658+0000 7f2dc7e00640 1 -- 172.21.15.73:0/681713007 >> v1:172.21.15.110:6789/0 conn(0x7f2dc80ced20 legacy=0x7f2dc80ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:49.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.658+0000 7f2dc7e00640 1 -- 172.21.15.73:0/681713007 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80cbab0 con 0x7f2dc80caed0 2024-03-23T06:12:49.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.660+0000 7f2dc7e00640 1 --2- 172.21.15.73:0/681713007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80caed0 0x7f2dc8159e30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009d90 tx=0x7f2dc002bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af6c8f3d42cb8e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:49.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.660+0000 7f2dc6000640 1 -- 172.21.15.73:0/681713007 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc002cd00 con 0x7f2dc80caed0 2024-03-23T06:12:49.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.660+0000 7f2dc6000640 1 -- 172.21.15.73:0/681713007 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc002ce60 con 0x7f2dc80caed0 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.660+0000 7f2dc6000640 1 -- 172.21.15.73:0/681713007 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0034660 con 0x7f2dc80caed0 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.660+0000 7f2dcd000640 1 -- 172.21.15.73:0/681713007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80caed0 msgr2=0x7f2dc8159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.660+0000 7f2dcd000640 1 --2- 172.21.15.73:0/681713007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80caed0 0x7f2dc8159e30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009d90 tx=0x7f2dc002bf50 comp rx=0 tx=0).stop 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.661+0000 7f2dcd000640 1 -- 172.21.15.73:0/681713007 shutdown_connections 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.661+0000 7f2dcd000640 1 --2- 172.21.15.73:0/681713007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80caed0 0x7f2dc8159e30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.661+0000 7f2dcd000640 1 --2- 172.21.15.73:0/681713007 >> v2:172.21.15.73:3300/0 conn(0x7f2dc80cf100 0x7f2dc80cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.661+0000 7f2dcd000640 1 -- 172.21.15.73:0/681713007 >> 172.21.15.73:0/681713007 conn(0x7f2dc80713e0 msgr2=0x7f2dc80717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.661+0000 7f2dcd000640 1 -- 172.21.15.73:0/681713007 shutdown_connections 2024-03-23T06:12:49.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.661+0000 7f2dcd000640 1 -- 172.21.15.73:0/681713007 wait complete. 2024-03-23T06:12:49.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.662+0000 7f2dcd000640 1 Processor -- start 2024-03-23T06:12:49.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.662+0000 7f2dcd000640 1 -- start start 2024-03-23T06:12:49.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dcd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc80caed0 0x7f2dc815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:49.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dcd000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc80ced20 0x7f2dc81f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:49.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dcd000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80cf100 0x7f2dc81f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:49.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dcd000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80c57f0 con 0x7f2dc80ced20 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dcd000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc8156b90 con 0x7f2dc80caed0 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dcd000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc8154f70 con 0x7f2dc80cf100 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dc6a00640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc80ced20 msgr2=0x7f2dc81f1c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dc6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc80ced20 0x7f2dc81f1c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dc7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc80caed0 0x7f2dc815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dc7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80cf100 0x7f2dc81f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dc7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80cf100 0x7f2dc81f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60484/0 (socket says 172.21.15.73:60484) 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.663+0000 7f2dc7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc80caed0 0x7f2dc815cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33348/0 (socket says 172.21.15.73:33348) 2024-03-23T06:12:49.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dc7400640 1 -- 172.21.15.73:0/3694327789 learned_addr learned my addr 172.21.15.73:0/3694327789 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dc7400640 1 -- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80cf100 msgr2=0x7f2dc81f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dc7400640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80cf100 0x7f2dc81f2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dc7400640 1 -- 172.21.15.73:0/3694327789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc80ced20 msgr2=0x7f2dc81f1c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dc7400640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc80ced20 0x7f2dc81f1c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dc7400640 1 -- 172.21.15.73:0/3694327789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0009a70 con 0x7f2dc80caed0 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dc7e00640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80cf100 0x7f2dc81f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dc7400640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc80caed0 0x7f2dc815cb60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c4d0 tx=0x7f2db800c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dbf400640 1 -- 172.21.15.73:0/3694327789 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8005ce0 con 0x7f2dc80caed0 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dbf400640 1 -- 172.21.15.73:0/3694327789 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db8005e40 con 0x7f2dc80caed0 2024-03-23T06:12:49.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dbf400640 1 -- 172.21.15.73:0/3694327789 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8007270 con 0x7f2dc80caed0 2024-03-23T06:12:49.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.664+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc80c4e90 con 0x7f2dc80caed0 2024-03-23T06:12:49.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.665+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc80c5130 con 0x7f2dc80caed0 2024-03-23T06:12:49.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.666+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc804e030 con 0x7f2dc80caed0 2024-03-23T06:12:49.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.666+0000 7f2dbf400640 1 -- 172.21.15.73:0/3694327789 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2db80073d0 con 0x7f2dc80caed0 2024-03-23T06:12:49.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.667+0000 7f2dbf400640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2da806abb0 0x7f2da806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:49.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.667+0000 7f2dbf400640 1 -- 172.21.15.73:0/3694327789 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f2db8088ab0 con 0x7f2dc80caed0 2024-03-23T06:12:49.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.668+0000 7f2dc6a00640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2da806abb0 0x7f2da806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:49.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.668+0000 7f2dc6a00640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2da806abb0 0x7f2da806d070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2db4006fd0 tx=0x7f2db4006d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:49.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.672+0000 7f2dbf400640 1 -- 172.21.15.73:0/3694327789 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2db80538b0 con 0x7f2dc80caed0 2024-03-23T06:12:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.938+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2dc815a370 con 0x7f2dc80caed0 2024-03-23T06:12:49.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.938+0000 7f2dbf400640 1 -- 172.21.15.73:0/3694327789 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f2db8017620 con 0x7f2dc80caed0 2024-03-23T06:12:49.938 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2da806abb0 msgr2=0x7f2da806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2da806abb0 0x7f2da806d070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2db4006fd0 tx=0x7f2db4006d80 comp rx=0 tx=0).stop 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc80caed0 msgr2=0x7f2dc815cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc80caed0 0x7f2dc815cb60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c4d0 tx=0x7f2db800c990 comp rx=0 tx=0).stop 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 shutdown_connections 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2da806abb0 0x7f2da806d070 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc80cf100 0x7f2dc81f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2dc80ced20 0x7f2dc81f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 --2- 172.21.15.73:0/3694327789 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc80caed0 0x7f2dc815cb60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 >> 172.21.15.73:0/3694327789 conn(0x7f2dc80713e0 msgr2=0x7f2dc81512d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 shutdown_connections 2024-03-23T06:12:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:49.941+0000 7f2dcd000640 1 -- 172.21.15.73:0/3694327789 wait complete. 2024-03-23T06:12:52.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:12:53.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.237+0000 7ff7df800640 1 Processor -- start 2024-03-23T06:12:53.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.237+0000 7ff7df800640 1 -- start start 2024-03-23T06:12:53.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.238+0000 7ff7df800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff7d8071d20 0x7ff7d80721d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:53.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.238+0000 7ff7df800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d806f9b0 con 0x7ff7d8150100 2024-03-23T06:12:53.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.238+0000 7ff7df800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d8070250 con 0x7ff7d80c7e10 2024-03-23T06:12:53.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.238+0000 7ff7df800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d80c0150 con 0x7ff7d8071d20 2024-03-23T06:12:53.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.238+0000 7ff7dce00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7ff7d8150100 legacy=0x7ff7d80c6aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:12:53.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.238+0000 7ff7d7e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff7d80c7e10 0x7ff7d8156070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:37650/0 (socket says 172.21.15.73:37650) 2024-03-23T06:12:53.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.238+0000 7ff7d7e00640 1 -- 172.21.15.73:0/3330320547 learned_addr learned my addr 172.21.15.73:0/3330320547 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:12:53.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.238+0000 7ff7dd800640 1 --2- 172.21.15.73:0/3330320547 >> v2:172.21.15.110:3300/0 conn(0x7ff7d8071d20 0x7ff7d80721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:53.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.239+0000 7ff7dd800640 1 -- 172.21.15.73:0/3330320547 >> v1:172.21.15.110:6789/0 conn(0x7ff7d80c7e10 legacy=0x7ff7d8156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:53.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.239+0000 7ff7dd800640 1 -- 172.21.15.73:0/3330320547 >> v1:172.21.15.73:6789/0 conn(0x7ff7d8150100 legacy=0x7ff7d80c6aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:53.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.239+0000 7ff7dd800640 1 -- 172.21.15.73:0/3330320547 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80c71b0 con 0x7ff7d8071d20 2024-03-23T06:12:53.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.240+0000 7ff7dd800640 1 --2- 172.21.15.73:0/3330320547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d80721d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009d90 tx=0x7ff7d002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3280bb5af9167068 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:53.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.240+0000 7ff7d7400640 1 -- 172.21.15.73:0/3330320547 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d002cbd0 con 0x7ff7d8071d20 2024-03-23T06:12:53.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.240+0000 7ff7d7400640 1 -- 172.21.15.73:0/3330320547 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d002cd30 con 0x7ff7d8071d20 2024-03-23T06:12:53.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.240+0000 7ff7d7400640 1 -- 172.21.15.73:0/3330320547 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d002cea0 con 0x7ff7d8071d20 2024-03-23T06:12:53.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.241+0000 7ff7df800640 1 -- 172.21.15.73:0/3330320547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 msgr2=0x7ff7d80721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:53.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.241+0000 7ff7df800640 1 --2- 172.21.15.73:0/3330320547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d80721d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009d90 tx=0x7ff7d002be20 comp rx=0 tx=0).stop 2024-03-23T06:12:53.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.242+0000 7ff7df800640 1 -- 172.21.15.73:0/3330320547 shutdown_connections 2024-03-23T06:12:53.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.242+0000 7ff7df800640 1 --2- 172.21.15.73:0/3330320547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d80721d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:53.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.242+0000 7ff7df800640 1 -- 172.21.15.73:0/3330320547 >> 172.21.15.73:0/3330320547 conn(0x7ff7d806bb40 msgr2=0x7ff7d806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:53.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.242+0000 7ff7df800640 1 -- 172.21.15.73:0/3330320547 shutdown_connections 2024-03-23T06:12:53.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.243+0000 7ff7df800640 1 -- 172.21.15.73:0/3330320547 wait complete. 2024-03-23T06:12:53.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.245+0000 7ff7df800640 1 Processor -- start 2024-03-23T06:12:53.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.245+0000 7ff7df800640 1 -- start start 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.246+0000 7ff7df800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d813c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.246+0000 7ff7df800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7d80c7e10 0x7ff7d8139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.246+0000 7ff7df800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d8150100 0x7ff7d81398b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.246+0000 7ff7df800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8134030 con 0x7ff7d8150100 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.246+0000 7ff7df800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8137180 con 0x7ff7d8071d20 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.246+0000 7ff7df800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8137420 con 0x7ff7d80c7e10 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.246+0000 7ff7dd800640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d8150100 msgr2=0x7ff7d81398b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.246+0000 7ff7dd800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d8150100 0x7ff7d81398b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:53.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7dce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d813c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7dce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d813c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:59558/0 (socket says 172.21.15.73:59558) 2024-03-23T06:12:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7dce00640 1 -- 172.21.15.73:0/1421329945 learned_addr learned my addr 172.21.15.73:0/1421329945 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7d7e00640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7d80c7e10 0x7ff7d8139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7dce00640 1 -- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7d80c7e10 msgr2=0x7ff7d8139370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7dce00640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7d80c7e10 0x7ff7d8139370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7dce00640 1 -- 172.21.15.73:0/1421329945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d8150100 msgr2=0x7ff7d81398b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7dce00640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d8150100 0x7ff7d81398b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:53.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.247+0000 7ff7dce00640 1 -- 172.21.15.73:0/1421329945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d0009a70 con 0x7ff7d8071d20 2024-03-23T06:12:53.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.248+0000 7ff7dce00640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d813c080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00b550 tx=0x7ff7cc00ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:53.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.248+0000 7ff7d4c00640 1 -- 172.21.15.73:0/1421329945 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc003dc0 con 0x7ff7d8071d20 2024-03-23T06:12:53.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.248+0000 7ff7d4c00640 1 -- 172.21.15.73:0/1421329945 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc005070 con 0x7ff7d8071d20 2024-03-23T06:12:53.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.248+0000 7ff7d4c00640 1 -- 172.21.15.73:0/1421329945 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc005420 con 0x7ff7d8071d20 2024-03-23T06:12:53.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.248+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d8137700 con 0x7ff7d8071d20 2024-03-23T06:12:53.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.249+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d81342a0 con 0x7ff7d8071d20 2024-03-23T06:12:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.250+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d804e110 con 0x7ff7d8071d20 2024-03-23T06:12:53.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.251+0000 7ff7d4c00640 1 -- 172.21.15.73:0/1421329945 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff7cc005580 con 0x7ff7d8071d20 2024-03-23T06:12:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.252+0000 7ff7d4c00640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7b806abb0 0x7ff7b806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:53.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.252+0000 7ff7d4c00640 1 -- 172.21.15.73:0/1421329945 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff7cc089670 con 0x7ff7d8071d20 2024-03-23T06:12:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.252+0000 7ff7d7e00640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7b806abb0 0x7ff7b806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:53.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.253+0000 7ff7d7e00640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7b806abb0 0x7ff7b806d070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8153bb0 tx=0x7ff7c4007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:53.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.256+0000 7ff7d4c00640 1 -- 172.21.15.73:0/1421329945 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff7cc054440 con 0x7ff7d8071d20 2024-03-23T06:12:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.641+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff7d80bff30 con 0x7ff7d8071d20 2024-03-23T06:12:53.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.641+0000 7ff7d4c00640 1 -- 172.21.15.73:0/1421329945 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7ff7cc057a60 con 0x7ff7d8071d20 2024-03-23T06:12:53.641 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":20,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:12:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7b806abb0 msgr2=0x7ff7b806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7b806abb0 0x7ff7b806d070 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8153bb0 tx=0x7ff7c4007e80 comp rx=0 tx=0).stop 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 msgr2=0x7ff7d813c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d813c080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00b550 tx=0x7ff7cc00ba10 comp rx=0 tx=0).stop 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 shutdown_connections 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7d8150100 0x7ff7d81398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff7b806abb0 0x7ff7b806d070 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7d80c7e10 0x7ff7d8139370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 --2- 172.21.15.73:0/1421329945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7d8071d20 0x7ff7d813c080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 >> 172.21.15.73:0/1421329945 conn(0x7ff7d806bb40 msgr2=0x7ff7d806d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.643+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 shutdown_connections 2024-03-23T06:12:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:53.644+0000 7ff7df800640 1 -- 172.21.15.73:0/1421329945 wait complete. 2024-03-23T06:12:55.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:12:56.001 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:12:56.660 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:12:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.894+0000 7f5342600640 1 Processor -- start 2024-03-23T06:12:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.894+0000 7f5342600640 1 -- start start 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f5342600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f5342600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f5342600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533c150600 con 0x7f533c150220 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f5342600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c06d1f0 con 0x7f533c15d740 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f5342600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c159440 con 0x7f533c06f9b0 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533b400640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f533c150220 legacy=0x7f533c06e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:59564/0 (socket says 172.21.15.73:59564) 2024-03-23T06:12:56.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 learned_addr learned my addr 172.21.15.73:0/2523412819 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:12:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:12:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:56.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:56.896+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533b400640 1 -- 172.21.15.73:0/2523412819 >> v1:172.21.15.73:6789/0 conn(0x7f533c150220 legacy=0x7f533c06e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:12:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:12:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:12:57.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:12:57.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:57.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:57.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.096+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:12:57.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533b400640 1 -- 172.21.15.73:0/2523412819 >> v1:172.21.15.73:6789/0 conn(0x7f533c150220 legacy=0x7f533c06e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.497+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:57.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:57.498+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:12:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.299+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.299+0000 7f533b400640 1 -- 172.21.15.73:0/2523412819 >> v1:172.21.15.73:6789/0 conn(0x7f533c150220 legacy=0x7f533c06e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:12:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.299+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:58.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.300+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:12:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.300+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.300+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.300+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:12:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.300+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:12:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.300+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:12:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.300+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:12:58.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:58.300+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f5338c00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f533c06d680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f5338c00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f533c06d680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f5338c00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 msgr2=0x7f533c06f470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f5338c00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.110:3300/0 conn(0x7f533c15d740 0x7f533c06f470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f5338c00640 1 -- 172.21.15.73:0/2523412819 >> v1:172.21.15.73:6789/0 conn(0x7f533c150220 legacy=0x7f533c06e6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f5338c00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.73:3300/0 conn(0x7f531c0073e0 0x7f531c009880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:59.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f5338c00640 1 -- 172.21.15.73:0/2523412819 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533c1596e0 con 0x7f531c0036c0 2024-03-23T06:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f5338c00640 1 -- 172.21.15.73:0/2523412819 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c06d1f0 con 0x7f531c0073e0 2024-03-23T06:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.73:3300/0 conn(0x7f531c0073e0 msgr2=0x7f531c009880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:12:59.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.895+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.73:3300/0 conn(0x7f531c0073e0 0x7f531c009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963379756 0 0) 0x7f533c1596e0 con 0x7f531c0036c0 2024-03-23T06:12:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5320003520 con 0x7f531c0036c0 2024-03-23T06:12:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3962104345 0 0) 0x7f5320003520 con 0x7f531c0036c0 2024-03-23T06:12:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 >> v2:172.21.15.73:3300/0 conn(0x7f531c0073e0 msgr2=0x7f531c009880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 --2- 172.21.15.73:0/2523412819 >> v2:172.21.15.73:3300/0 conn(0x7f531c0073e0 0x7f531c009880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c150600 con 0x7f531c0036c0 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f53340046c0 con 0x7f531c0036c0 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 >> v1:172.21.15.110:6789/0 conn(0x7f531c0036c0 legacy=0x7f531c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f5320003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5320004060 0x7f53200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004d50 0x7f53200051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c06d1f0 con 0x7f5320004060 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532000bc40 con 0x7f5320004d50 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532000be00 con 0x7f533c06f9b0 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.896+0000 7f533aa00640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5320004060 msgr2=0x7f53200047c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533aa00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5320004060 0x7f53200047c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533be00640 1 -- 172.21.15.73:0/2523412819 reap_dead start 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533b400640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f5320003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533be00640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004d50 0x7f53200051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:59.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533b400640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004d50 msgr2=0x7f53200051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533b400640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004d50 0x7f53200051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533b400640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5320004060 msgr2=0x7f53200047c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533b400640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5320004060 0x7f53200047c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.897+0000 7f533b400640 1 -- 172.21.15.73:0/2523412819 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5320003520 con 0x7f533c06f9b0 2024-03-23T06:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.898+0000 7f533b400640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f5320003970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f533400c5d0 tx=0x7f53200057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8bad3c800635a7d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:59.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.898+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340048e0 con 0x7f533c06f9b0 2024-03-23T06:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.899+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5334004a60 con 0x7f533c06f9b0 2024-03-23T06:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.899+0000 7f533a000640 1 -- 172.21.15.73:0/2523412819 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5334004e50 con 0x7f533c06f9b0 2024-03-23T06:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.899+0000 7f5342600640 1 -- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 msgr2=0x7f5320003970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.900+0000 7f5342600640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f5320003970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f533400c5d0 tx=0x7f53200057f0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.901+0000 7f5342600640 1 -- 172.21.15.73:0/2523412819 shutdown_connections 2024-03-23T06:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.901+0000 7f5342600640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5320004060 0x7f53200047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.901+0000 7f5342600640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f533c06f9b0 0x7f5320003970 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.901+0000 7f5342600640 1 --2- 172.21.15.73:0/2523412819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004d50 0x7f53200051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.901+0000 7f5342600640 1 -- 172.21.15.73:0/2523412819 >> 172.21.15.73:0/2523412819 conn(0x7f533c0cced0 msgr2=0x7f533c0cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.901+0000 7f5342600640 1 -- 172.21.15.73:0/2523412819 shutdown_connections 2024-03-23T06:12:59.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.901+0000 7f5342600640 1 -- 172.21.15.73:0/2523412819 wait complete. 2024-03-23T06:12:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.903+0000 7f5342600640 1 Processor -- start 2024-03-23T06:12:59.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.903+0000 7f5342600640 1 -- start start 2024-03-23T06:12:59.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.904+0000 7f5342600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004060 0x7f533c14ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:59.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.904+0000 7f5342600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5320004d50 0x7f533c154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:59.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.904+0000 7f5342600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c06f9b0 0x7f533c155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.904+0000 7f5342600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c157580 con 0x7f533c06f9b0 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.904+0000 7f5342600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c149b90 con 0x7f5320004060 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.904+0000 7f5342600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c154940 con 0x7f5320004d50 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533be00640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c06f9b0 msgr2=0x7f533c155260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c06f9b0 0x7f533c155260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004060 0x7f533c14ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004060 0x7f533c14ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:39240/0 (socket says 172.21.15.73:39240) 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533b400640 1 -- 172.21.15.73:0/1760750882 learned_addr learned my addr 172.21.15.73:0/1760750882 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:12:59.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533aa00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5320004d50 0x7f533c154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533b400640 1 -- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5320004d50 msgr2=0x7f533c154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533b400640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5320004d50 0x7f533c154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533b400640 1 -- 172.21.15.73:0/1760750882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c06f9b0 msgr2=0x7f533c155260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533b400640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c06f9b0 0x7f533c155260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.905+0000 7f533b400640 1 -- 172.21.15.73:0/1760750882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c1ee990 con 0x7f5320004060 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.906+0000 7f533b400640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004060 0x7f533c14ddf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f533400c5d0 tx=0x7f5334006900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.906+0000 7f5333400640 1 -- 172.21.15.73:0/1760750882 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340048d0 con 0x7f5320004060 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.906+0000 7f5333400640 1 -- 172.21.15.73:0/1760750882 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53340060d0 con 0x7f5320004060 2024-03-23T06:12:59.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.906+0000 7f5333400640 1 -- 172.21.15.73:0/1760750882 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53340064a0 con 0x7f5320004060 2024-03-23T06:12:59.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.907+0000 7f5342600640 1 -- 172.21.15.73:0/1760750882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c1eeec0 con 0x7f5320004060 2024-03-23T06:12:59.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.907+0000 7f5342600640 1 -- 172.21.15.73:0/1760750882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c158200 con 0x7f5320004060 2024-03-23T06:12:59.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.908+0000 7f5330c00640 1 -- 172.21.15.73:0/1760750882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5310005250 con 0x7f5320004060 2024-03-23T06:12:59.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.909+0000 7f5333400640 1 -- 172.21.15.73:0/1760750882 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5334032050 con 0x7f5320004060 2024-03-23T06:12:59.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.910+0000 7f5333400640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f531c06b610 0x7f531c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:12:59.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.910+0000 7f5333400640 1 -- 172.21.15.73:0/1760750882 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f53340aaaf0 con 0x7f5320004060 2024-03-23T06:12:59.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.910+0000 7f533aa00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f531c06b610 0x7f531c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:12:59.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.910+0000 7f533aa00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f531c06b610 0x7f531c06dad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f533c1ebb40 tx=0x7f532c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:12:59.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:12:59.914+0000 7f5333400640 1 -- 172.21.15.73:0/1760750882 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f5334075aa0 con 0x7f5320004060 2024-03-23T06:13:00.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.362+0000 7f5330c00640 1 -- 172.21.15.73:0/1760750882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5310005500 con 0x7f5320004060 2024-03-23T06:13:00.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.362+0000 7f5333400640 1 -- 172.21.15.73:0/1760750882 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f5334046080 con 0x7f5320004060 2024-03-23T06:13:00.363 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":22,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:13:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.366+0000 7f5330c00640 1 -- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f531c06b610 msgr2=0x7f531c06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.366+0000 7f5330c00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f531c06b610 0x7f531c06dad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f533c1ebb40 tx=0x7f532c008040 comp rx=0 tx=0).stop 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.366+0000 7f5330c00640 1 -- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004060 msgr2=0x7f533c14ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.366+0000 7f5330c00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004060 0x7f533c14ddf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f533400c5d0 tx=0x7f5334006900 comp rx=0 tx=0).stop 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.367+0000 7f5330c00640 1 -- 172.21.15.73:0/1760750882 shutdown_connections 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.367+0000 7f5330c00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f533c06f9b0 0x7f533c155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.367+0000 7f5330c00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f531c06b610 0x7f531c06dad0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.367+0000 7f5330c00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5320004d50 0x7f533c154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.367+0000 7f5330c00640 1 --2- 172.21.15.73:0/1760750882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5320004060 0x7f533c14ddf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.367+0000 7f5330c00640 1 -- 172.21.15.73:0/1760750882 >> 172.21.15.73:0/1760750882 conn(0x7f533c0cced0 msgr2=0x7f533c0c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.367+0000 7f5330c00640 1 -- 172.21.15.73:0/1760750882 shutdown_connections 2024-03-23T06:13:00.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.367+0000 7f5330c00640 1 -- 172.21.15.73:0/1760750882 wait complete. 2024-03-23T06:13:00.388 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:13:00.388 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T06:13:00.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:13:00.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.576+0000 7f5da7000640 1 Processor -- start 2024-03-23T06:13:00.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.576+0000 7f5da7000640 1 -- start start 2024-03-23T06:13:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da7000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da0140510 0x7f5da0071a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da7000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5da015ac50 0x7f5da015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da7000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da01408f0 con 0x7f5da0071f90 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da7000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da015b600 con 0x7f5da015ac50 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da7000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0158010 con 0x7f5da0140510 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da5200640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f5da0071f90 legacy=0x7f5da006a4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da6600640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f5da015ac50 msgr2=0x7f5da015b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da6600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5da015ac50 0x7f5da015b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da5c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da0140510 0x7f5da0071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da5c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da0140510 0x7f5da0071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:57354/0 (socket says 172.21.15.73:57354) 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.577+0000 7f5da5c00640 1 -- 172.21.15.73:0/1295155688 learned_addr learned my addr 172.21.15.73:0/1295155688 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.578+0000 7f5da5c00640 1 -- 172.21.15.73:0/1295155688 >> v2:172.21.15.73:3300/0 conn(0x7f5da015ac50 msgr2=0x7f5da015b0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.578+0000 7f5da5c00640 1 --2- 172.21.15.73:0/1295155688 >> v2:172.21.15.73:3300/0 conn(0x7f5da015ac50 0x7f5da015b0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.578+0000 7f5da5c00640 1 -- 172.21.15.73:0/1295155688 >> v1:172.21.15.73:6789/0 conn(0x7f5da0071f90 legacy=0x7f5da006a4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.578+0000 7f5da5c00640 1 -- 172.21.15.73:0/1295155688 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da0157490 con 0x7f5da0140510 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.579+0000 7f5da5c00640 1 --2- 172.21.15.73:0/1295155688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da0140510 0x7f5da0071a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009e50 tx=0x7f5d9802bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edafc884a86f89be server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.579+0000 7f5d9fe00640 1 -- 172.21.15.73:0/1295155688 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9802cb20 con 0x7f5da0140510 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.579+0000 7f5d9fe00640 1 -- 172.21.15.73:0/1295155688 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9802cc80 con 0x7f5da0140510 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.579+0000 7f5d9fe00640 1 -- 172.21.15.73:0/1295155688 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d980343f0 con 0x7f5da0140510 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.580+0000 7f5da7000640 1 -- 172.21.15.73:0/1295155688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da0140510 msgr2=0x7f5da0071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.580+0000 7f5da7000640 1 --2- 172.21.15.73:0/1295155688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da0140510 0x7f5da0071a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009e50 tx=0x7f5d9802bf80 comp rx=0 tx=0).stop 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.580+0000 7f5da7000640 1 -- 172.21.15.73:0/1295155688 shutdown_connections 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.580+0000 7f5da7000640 1 --2- 172.21.15.73:0/1295155688 >> v2:172.21.15.73:3300/0 conn(0x7f5da015ac50 0x7f5da015b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.580+0000 7f5da7000640 1 --2- 172.21.15.73:0/1295155688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da0140510 0x7f5da0071a50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.580+0000 7f5da7000640 1 -- 172.21.15.73:0/1295155688 >> 172.21.15.73:0/1295155688 conn(0x7f5da006d3f0 msgr2=0x7f5da006d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.580+0000 7f5da7000640 1 -- 172.21.15.73:0/1295155688 shutdown_connections 2024-03-23T06:13:00.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.580+0000 7f5da7000640 1 -- 172.21.15.73:0/1295155688 wait complete. 2024-03-23T06:13:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.582+0000 7f5da7000640 1 Processor -- start 2024-03-23T06:13:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.583+0000 7f5da7000640 1 -- start start 2024-03-23T06:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.584+0000 7f5da7000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da0071f90 0x7f5da00cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.584+0000 7f5da7000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5da0140510 0x7f5da01537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.584+0000 7f5da7000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da015ac50 0x7f5da0152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da7000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da01eb410 con 0x7f5da0140510 2024-03-23T06:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da7000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0151b90 con 0x7f5da0071f90 2024-03-23T06:13:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da7000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da0151e70 con 0x7f5da015ac50 2024-03-23T06:13:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da5200640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5da0140510 msgr2=0x7f5da01537f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:13:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da5c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da0071f90 0x7f5da00cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da5200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5da0140510 0x7f5da01537f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da5c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da0071f90 0x7f5da00cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:39248/0 (socket says 172.21.15.73:39248) 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da5c00640 1 -- 172.21.15.73:0/2937578770 learned_addr learned my addr 172.21.15.73:0/2937578770 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.585+0000 7f5da6600640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da015ac50 0x7f5da0152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5da5c00640 1 -- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da015ac50 msgr2=0x7f5da0152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5da5c00640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da015ac50 0x7f5da0152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5da5c00640 1 -- 172.21.15.73:0/2937578770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5da0140510 msgr2=0x7f5da01537f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5da5c00640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5da0140510 0x7f5da01537f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5da5c00640 1 -- 172.21.15.73:0/2937578770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98009b30 con 0x7f5da0071f90 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5da5c00640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da0071f90 0x7f5da00cafb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009e50 tx=0x7f5d98004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98009510 con 0x7f5da0071f90 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9803e450 con 0x7f5da0071f90 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.586+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9803e800 con 0x7f5da0071f90 2024-03-23T06:13:00.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.587+0000 7f5da7000640 1 -- 172.21.15.73:0/2937578770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da0152150 con 0x7f5da0071f90 2024-03-23T06:13:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.587+0000 7f5da7000640 1 -- 172.21.15.73:0/2937578770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da01eb110 con 0x7f5da0071f90 2024-03-23T06:13:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.588+0000 7f5d92a00640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74002a30 0x7f5d74004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.588+0000 7f5d92a00640 1 -- 172.21.15.73:0/2937578770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d74007e80 con 0x7f5d74002a30 2024-03-23T06:13:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.588+0000 7f5da5200640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74002a30 0x7f5d74004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.589+0000 7f5da5200640 1 -- 172.21.15.73:0/2937578770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d74008040 con 0x7f5d74002a30 2024-03-23T06:13:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.589+0000 7f5da5200640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74002a30 0x7f5d74004ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5da0155ab0 tx=0x7f5d9400b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.590+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94003e10 con 0x7f5d74002a30 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.590+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5d94005070 con 0x7f5d74002a30 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.590+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74002a30 msgr2=0x7f5d74004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.590+0000 7f5d9d600640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74002a30 0x7f5d74004ef0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5da0155ab0 tx=0x7f5d9400b8c0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.590+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74002a30 msgr2=0x7f5d74004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.590+0000 7f5d9d600640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74002a30 0x7f5d74004ef0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.590+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5d9803e960 con 0x7f5da0071f90 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.592+0000 7f5d9d600640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5d8006a910 0x7f5d8006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.592+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5d980ac4a0 con 0x7f5da0071f90 2024-03-23T06:13:00.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.592+0000 7f5da5200640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5d8006a910 0x7f5d8006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.593+0000 7f5da5200640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5d8006a910 0x7f5d8006cdd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5da0155ab0 tx=0x7f5d94008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.600+0000 7f5d92a00640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74006f10 0x7f5d74007360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.600+0000 7f5d92a00640 1 -- 172.21.15.73:0/2937578770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d740078d0 con 0x7f5d74006f10 2024-03-23T06:13:00.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.601+0000 7f5da6600640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74006f10 0x7f5d74007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.602+0000 7f5da6600640 1 -- 172.21.15.73:0/2937578770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5d74007a90 con 0x7f5d74006f10 2024-03-23T06:13:00.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.602+0000 7f5da6600640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74006f10 0x7f5d74007360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c010a60 tx=0x7f5d8c010f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.603+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c00eb30 con 0x7f5d74006f10 2024-03-23T06:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.603+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4939 (secure 0 0 0) 0x7f5d8c00ec90 con 0x7f5d74006f10 2024-03-23T06:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.603+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74006f10 msgr2=0x7f5d74007360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.603+0000 7f5d9d600640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74006f10 0x7f5d74007360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c010a60 tx=0x7f5d8c010f20 comp rx=0 tx=0).stop 2024-03-23T06:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.603+0000 7f5d9d600640 1 -- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74006f10 msgr2=0x7f5d74007360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:00.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.603+0000 7f5d9d600640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d74006f10 0x7f5d74007360 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c010a60 tx=0x7f5d8c010f20 comp rx=0 tx=0).stop 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 22, 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.605 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:00.606 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:13:00.608 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.609 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.610 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:00.611 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.612 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.614 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:00.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 3 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:13:00.616 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:13:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5d92a00640 1 -- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5d8006a910 msgr2=0x7f5d8006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5d92a00640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5d8006a910 0x7f5d8006cdd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5da0155ab0 tx=0x7f5d94008030 comp rx=0 tx=0).stop 2024-03-23T06:13:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5d92a00640 1 -- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da0071f90 msgr2=0x7f5da00cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5d92a00640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da0071f90 0x7f5da00cafb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009e50 tx=0x7f5d98004a40 comp rx=0 tx=0).stop 2024-03-23T06:13:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5da6600640 1 -- 172.21.15.73:0/2937578770 reap_dead start 2024-03-23T06:13:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5d92a00640 1 -- 172.21.15.73:0/2937578770 shutdown_connections 2024-03-23T06:13:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5d92a00640 1 --2- 172.21.15.73:0/2937578770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da0071f90 0x7f5da00cafb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5d92a00640 1 -- 172.21.15.73:0/2937578770 >> 172.21.15.73:0/2937578770 conn(0x7f5da006d3f0 msgr2=0x7f5da013dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:00.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.604+0000 7f5d92a00640 1 -- 172.21.15.73:0/2937578770 shutdown_connections 2024-03-23T06:13:00.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.605+0000 7f5d92a00640 1 -- 172.21.15.73:0/2937578770 wait complete. 2024-03-23T06:13:00.624 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:13:00.624 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T06:13:00.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:13:00.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.818+0000 7f555ec00640 1 Processor -- start 2024-03-23T06:13:00.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.819+0000 7f555ec00640 1 -- start start 2024-03-23T06:13:00.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f555ec00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5558071f60 0x7f555806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f555ec00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f555815caa0 0x7f555815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f555ec00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55580c3c60 con 0x7f5558153780 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f555ec00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55580b1ef0 con 0x7f5558071f60 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f555ec00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55580cac80 con 0x7f555815caa0 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f5557400640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f5558071f60 msgr2=0x7f555806abd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f5557400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5558071f60 0x7f555806abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f5557e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5558153780 0x7f55580ca570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:53094/0 (socket says 172.21.15.73:53094) 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f5557e00640 1 -- 172.21.15.73:0/3986842549 learned_addr learned my addr 172.21.15.73:0/3986842549 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.820+0000 7f555cc00640 1 --2- 172.21.15.73:0/3986842549 >> v2:172.21.15.110:3300/0 conn(0x7f555815caa0 0x7f555815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.821+0000 7f5556a00640 1 -- 172.21.15.73:0/3986842549 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427792536 0 0) 0x7f55580c3c60 con 0x7f5558153780 2024-03-23T06:13:00.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.821+0000 7f5556a00640 1 -- 172.21.15.73:0/3986842549 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f553c003520 con 0x7f5558153780 2024-03-23T06:13:00.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.821+0000 7f555cc00640 1 -- 172.21.15.73:0/3986842549 >> v2:172.21.15.73:3300/0 conn(0x7f5558071f60 msgr2=0x7f555806abd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:00.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.821+0000 7f555cc00640 1 --2- 172.21.15.73:0/3986842549 >> v2:172.21.15.73:3300/0 conn(0x7f5558071f60 0x7f555806abd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.821+0000 7f555cc00640 1 -- 172.21.15.73:0/3986842549 >> v1:172.21.15.110:6789/0 conn(0x7f5558153780 legacy=0x7f55580ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.821+0000 7f555cc00640 1 -- 172.21.15.73:0/3986842549 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55580c3eb0 con 0x7f555815caa0 2024-03-23T06:13:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.822+0000 7f555cc00640 1 --2- 172.21.15.73:0/3986842549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f555815caa0 0x7f555815cef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f55580b1870 tx=0x7f555002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c66529691d7836f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.822+0000 7f5556a00640 1 -- 172.21.15.73:0/3986842549 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555002cc90 con 0x7f555815caa0 2024-03-23T06:13:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.822+0000 7f5556a00640 1 -- 172.21.15.73:0/3986842549 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555002cdf0 con 0x7f555815caa0 2024-03-23T06:13:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.822+0000 7f5556a00640 1 -- 172.21.15.73:0/3986842549 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550034660 con 0x7f555815caa0 2024-03-23T06:13:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.823+0000 7f555ec00640 1 -- 172.21.15.73:0/3986842549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f555815caa0 msgr2=0x7f555815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.823+0000 7f555ec00640 1 --2- 172.21.15.73:0/3986842549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f555815caa0 0x7f555815cef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f55580b1870 tx=0x7f555002bee0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.823+0000 7f555ec00640 1 -- 172.21.15.73:0/3986842549 shutdown_connections 2024-03-23T06:13:00.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.823+0000 7f555ec00640 1 --2- 172.21.15.73:0/3986842549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f555815caa0 0x7f555815cef0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.823+0000 7f555ec00640 1 --2- 172.21.15.73:0/3986842549 >> v2:172.21.15.73:3300/0 conn(0x7f5558071f60 0x7f555806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.823+0000 7f555ec00640 1 -- 172.21.15.73:0/3986842549 >> 172.21.15.73:0/3986842549 conn(0x7f555806c3b0 msgr2=0x7f55580713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:00.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.823+0000 7f555ec00640 1 -- 172.21.15.73:0/3986842549 shutdown_connections 2024-03-23T06:13:00.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.823+0000 7f555ec00640 1 -- 172.21.15.73:0/3986842549 wait complete. 2024-03-23T06:13:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.825+0000 7f555ec00640 1 Processor -- start 2024-03-23T06:13:00.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.826+0000 7f555ec00640 1 -- start start 2024-03-23T06:13:00.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f555ec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558071f60 0x7f55581efc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f555ec00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5558153780 0x7f55580b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f555ec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f555815caa0 0x7f555815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f555ec00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555815a960 con 0x7f5558153780 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f555ec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55581f01d0 con 0x7f555815caa0 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f555ec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555815c2c0 con 0x7f5558071f60 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f5557400640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5558153780 msgr2=0x7f55580b3540 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f5557400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5558153780 0x7f55580b3540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f5557e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558071f60 0x7f55581efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f5557e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558071f60 0x7f55581efc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:57368/0 (socket says 172.21.15.73:57368) 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f5557e00640 1 -- 172.21.15.73:0/1097786298 learned_addr learned my addr 172.21.15.73:0/1097786298 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.827+0000 7f555cc00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f555815caa0 0x7f555815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f5557e00640 1 -- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f555815caa0 msgr2=0x7f555815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f5557e00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f555815caa0 0x7f555815ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f5557e00640 1 -- 172.21.15.73:0/1097786298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5558153780 msgr2=0x7f55580b3540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:13:00.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f5557e00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5558153780 0x7f55580b3540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f5557e00640 1 -- 172.21.15.73:0/1097786298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5550009a70 con 0x7f5558071f60 2024-03-23T06:13:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f5557e00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558071f60 0x7f55581efc90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f554800c500 tx=0x7f554800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548005ce0 con 0x7f5558071f60 2024-03-23T06:13:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548005e40 con 0x7f5558071f60 2024-03-23T06:13:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555815c840 con 0x7f5558071f60 2024-03-23T06:13:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.828+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548007330 con 0x7f5558071f60 2024-03-23T06:13:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.829+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555815a580 con 0x7f5558071f60 2024-03-23T06:13:00.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.830+0000 7f555ec00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55580c6310 0x7f55581444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.830+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5558072510 con 0x7f55580c6310 2024-03-23T06:13:00.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.830+0000 7f5557400640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55580c6310 0x7f55581444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.830+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5548007490 con 0x7f5558071f60 2024-03-23T06:13:00.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.831+0000 7f5557400640 1 -- 172.21.15.73:0/1097786298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55580c4750 con 0x7f55580c6310 2024-03-23T06:13:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.831+0000 7f5557400640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55580c6310 0x7f55581444d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f555814d710 tx=0x7f554400b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.831+0000 7f554fe00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f553806abb0 0x7f553806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.831+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5548088c60 con 0x7f5558071f60 2024-03-23T06:13:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.832+0000 7f555cc00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f553806abb0 0x7f553806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.832+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544003e10 con 0x7f55580c6310 2024-03-23T06:13:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.832+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5544005070 con 0x7f55580c6310 2024-03-23T06:13:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.832+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55580c6310 msgr2=0x7f55581444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.832+0000 7f554fe00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55580c6310 0x7f55581444d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f555814d710 tx=0x7f554400b8c0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.832+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55580c6310 msgr2=0x7f55581444d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.832+0000 7f554fe00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55580c6310 0x7f55581444d0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f555814d710 tx=0x7f554400b8c0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.832+0000 7f555cc00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f553806abb0 0x7f553806d070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5550036000 tx=0x7f5550030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.845+0000 7f555ec00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f555815ba10 0x7f5558144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:00.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.845+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55580c4470 con 0x7f555815ba10 2024-03-23T06:13:00.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.845+0000 7f5557400640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f555815ba10 0x7f5558144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.846+0000 7f5557400640 1 -- 172.21.15.73:0/1097786298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f55580c4a30 con 0x7f555815ba10 2024-03-23T06:13:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.846+0000 7f5557400640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f555815ba10 0x7f5558144a10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5544006fd0 tx=0x7f5544005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.846+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5544020070 con 0x7f555815ba10 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7f5544010400 con 0x7f555815ba10 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f555815ba10 msgr2=0x7f5558144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f554fe00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f555815ba10 0x7f5558144a10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5544006fd0 tx=0x7f5544005a20 comp rx=0 tx=0).stop 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f554fe00640 1 -- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f555815ba10 msgr2=0x7f5558144a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f554fe00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f555815ba10 0x7f5558144a10 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5544006fd0 tx=0x7f5544005a20 comp rx=0 tx=0).stop 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:13:00.848 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 22, 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:00.849 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:00.850 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:13:00.851 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:00.852 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:00.853 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:00.854 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.855 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:00.856 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:00.857 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.858 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.859 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:13:00.860 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f553806abb0 msgr2=0x7f553806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555ec00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f553806abb0 0x7f553806d070 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5550036000 tx=0x7f5550030000 comp rx=0 tx=0).stop 2024-03-23T06:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558071f60 msgr2=0x7f55581efc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555ec00640 1 --2- 172.21.15.73:0/1097786298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558071f60 0x7f55581efc90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f554800c500 tx=0x7f554800c9c0 comp rx=0 tx=0).stop 2024-03-23T06:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555cc00640 1 -- 172.21.15.73:0/1097786298 reap_dead start 2024-03-23T06:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555cc00640 1 -- 172.21.15.73:0/1097786298 reap_dead start 2024-03-23T06:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 shutdown_connections 2024-03-23T06:13:00.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 >> 172.21.15.73:0/1097786298 conn(0x7f555806c3b0 msgr2=0x7f555814d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 shutdown_connections 2024-03-23T06:13:00.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:00.847+0000 7f555ec00640 1 -- 172.21.15.73:0/1097786298 wait complete. 2024-03-23T06:13:00.869 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:13:00.869 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:13:20.869 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T06:13:20.870 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T06:13:20.870 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T06:13:20.870 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T06:13:20.877 INFO:tasks.ceph.mon.a:Started 2024-03-23T06:13:20.878 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:13:20.878 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:13:21.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.222+0000 7f9929a00640 1 Processor -- start 2024-03-23T06:13:21.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.222+0000 7f9929a00640 1 -- start start 2024-03-23T06:13:21.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.224+0000 7f9929a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f99241536a0 0x7f99240ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.224+0000 7f9929a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9924153a80 0x7f99240cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f9929a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99240cab20 con 0x7f99241594f0 2024-03-23T06:13:21.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f9929a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992415a520 con 0x7f99241536a0 2024-03-23T06:13:21.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f9929a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99241599a0 con 0x7f9924153a80 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f991be00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9924153a80 0x7f99240cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f9923400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f99241594f0 0x7f99240cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:35574/0 (socket says 172.21.15.73:35574) 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f991be00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9924153a80 0x7f99240cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:60080/0 (socket says 172.21.15.73:60080) 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f9923400640 1 -- 172.21.15.73:0/1051571076 learned_addr learned my addr 172.21.15.73:0/1051571076 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487609924 0 0) 0x7f99240cab20 con 0x7f99241594f0 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.225+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9908003520 con 0x7f99241594f0 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1350913984 0 0) 0x7f9908003520 con 0x7f99241594f0 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 >> v2:172.21.15.110:3300/0 conn(0x7f9924153a80 msgr2=0x7f99240cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 --2- 172.21.15.73:0/1051571076 >> v2:172.21.15.110:3300/0 conn(0x7f9924153a80 0x7f99240cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 >> v2:172.21.15.73:3300/0 conn(0x7f99241536a0 msgr2=0x7f99240ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 --2- 172.21.15.73:0/1051571076 >> v2:172.21.15.73:3300/0 conn(0x7f99241536a0 0x7f99240ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924159c80 con 0x7f99241594f0 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f991c0019f0 con 0x7f99241594f0 2024-03-23T06:13:21.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 >> v1:172.21.15.110:6789/0 conn(0x7f99241594f0 legacy=0x7f99240cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:21.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9908003970 0x7f9908003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99080047c0 0x7f9908004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9908014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992415a520 con 0x7f99080047c0 2024-03-23T06:13:21.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99241599a0 con 0x7f9908005180 2024-03-23T06:13:21.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99080148e0 con 0x7f9908003970 2024-03-23T06:13:21.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.226+0000 7f9923400640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9908014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:21.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.227+0000 7f9923400640 1 -- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9908003970 msgr2=0x7f9908003d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:21.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.227+0000 7f9923400640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9908003970 0x7f9908003d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:21.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.227+0000 7f9923400640 1 -- 172.21.15.73:0/1051571076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99080047c0 msgr2=0x7f9908004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:21.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.227+0000 7f9923400640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99080047c0 0x7f9908004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:21.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.227+0000 7f9923400640 1 -- 172.21.15.73:0/1051571076 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908003520 con 0x7f9908005180 2024-03-23T06:13:21.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.228+0000 7f9923400640 1 -- 172.21.15.73:0/1051571076 reap_dead start 2024-03-23T06:13:21.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.229+0000 7f9923400640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9908014190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f991c005a60 tx=0x7f99080057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d023c52878613f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:21.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.229+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c02d780 con 0x7f9908005180 2024-03-23T06:13:21.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.229+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c02d8e0 con 0x7f9908005180 2024-03-23T06:13:21.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.229+0000 7f9922000640 1 -- 172.21.15.73:0/1051571076 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c02dc90 con 0x7f9908005180 2024-03-23T06:13:21.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.230+0000 7f9929a00640 1 -- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 msgr2=0x7f9908014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:21.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.230+0000 7f9929a00640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9908014190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f991c005a60 tx=0x7f99080057f0 comp rx=0 tx=0).stop 2024-03-23T06:13:21.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.231+0000 7f9929a00640 1 -- 172.21.15.73:0/1051571076 shutdown_connections 2024-03-23T06:13:21.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.231+0000 7f9929a00640 1 --2- 172.21.15.73:0/1051571076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9908014190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:21.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.231+0000 7f9929a00640 1 -- 172.21.15.73:0/1051571076 >> 172.21.15.73:0/1051571076 conn(0x7f992406a060 msgr2=0x7f992406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:21.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.232+0000 7f9929a00640 1 -- 172.21.15.73:0/1051571076 shutdown_connections 2024-03-23T06:13:21.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.232+0000 7f9929a00640 1 -- 172.21.15.73:0/1051571076 wait complete. 2024-03-23T06:13:21.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.234+0000 7f9929a00640 1 Processor -- start 2024-03-23T06:13:21.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.235+0000 7f9929a00640 1 -- start start 2024-03-23T06:13:21.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.236+0000 7f9929a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9924148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.236+0000 7f9929a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f992414e830 0x7f9924156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.236+0000 7f9929a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99240cbd90 0x7f99240cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.236+0000 7f9929a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99241ee480 con 0x7f992414e830 2024-03-23T06:13:21.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.236+0000 7f9929a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99241463e0 con 0x7f9908005180 2024-03-23T06:13:21.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.236+0000 7f9929a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99241ed890 con 0x7f99240cbd90 2024-03-23T06:13:21.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.237+0000 7f9922a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9924148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:21.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.237+0000 7f9922a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9924148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:60092/0 (socket says 172.21.15.73:60092) 2024-03-23T06:13:21.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.237+0000 7f9922a00640 1 -- 172.21.15.73:0/864835735 learned_addr learned my addr 172.21.15.73:0/864835735 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:21.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.237+0000 7f9923400640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99240cbd90 0x7f99240cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:21.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.238+0000 7f991be00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f992414e830 0x7f9924156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:21.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.238+0000 7f9923400640 1 -- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 msgr2=0x7f9924148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:21.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.238+0000 7f9923400640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9924148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:21.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.238+0000 7f9923400640 1 -- 172.21.15.73:0/864835735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f992414e830 msgr2=0x7f9924156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:21.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.238+0000 7f9923400640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f992414e830 0x7f9924156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:21.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.238+0000 7f9923400640 1 -- 172.21.15.73:0/864835735 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9924154210 con 0x7f99240cbd90 2024-03-23T06:13:21.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.239+0000 7f9923400640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99240cbd90 0x7f99240cc210 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9924072510 tx=0x7f991c004d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:21.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.242+0000 7f991aa00640 1 -- 172.21.15.73:0/864835735 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c03d070 con 0x7f99240cbd90 2024-03-23T06:13:21.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.242+0000 7f991aa00640 1 -- 172.21.15.73:0/864835735 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c001940 con 0x7f99240cbd90 2024-03-23T06:13:21.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.242+0000 7f991aa00640 1 -- 172.21.15.73:0/864835735 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c02dc50 con 0x7f99240cbd90 2024-03-23T06:13:21.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.243+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99241edae0 con 0x7f99240cbd90 2024-03-23T06:13:21.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.243+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99241ee0a0 con 0x7f99240cbd90 2024-03-23T06:13:21.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.247+0000 7f991aa00640 1 -- 172.21.15.73:0/864835735 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f991c040070 con 0x7f99240cbd90 2024-03-23T06:13:21.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.249+0000 7f991aa00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f990006acd0 0x7f990006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:21.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.249+0000 7f991aa00640 1 -- 172.21.15.73:0/864835735 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f991c0aa920 con 0x7f99240cbd90 2024-03-23T06:13:21.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.249+0000 7f9922a00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f990006acd0 0x7f990006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:21.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.250+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99240c9810 con 0x7f99240cbd90 2024-03-23T06:13:21.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.250+0000 7f9922a00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f990006acd0 0x7f990006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9914009ac0 tx=0x7f99140091c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:21.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.257+0000 7f991aa00640 1 -- 172.21.15.73:0/864835735 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f991c0758b0 con 0x7f99240cbd90 2024-03-23T06:13:21.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:21.872+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f992404e110 con 0x7f99240cbd90 2024-03-23T06:13:22.770 INFO:tasks.workunit.client.0.smithi073.stdout:fs setup took 52 secs 2024-03-23T06:13:26.111 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:13:26.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:13:32.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.443+0000 7f991aa00640 1 -- 172.21.15.73:0/864835735 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f991c047030 con 0x7f99240cbd90 2024-03-23T06:13:32.447 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":32,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:13:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.448+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f990006acd0 msgr2=0x7f990006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:32.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.448+0000 7f9929a00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f990006acd0 0x7f990006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9914009ac0 tx=0x7f99140091c0 comp rx=0 tx=0).stop 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.448+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99240cbd90 msgr2=0x7f99240cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.448+0000 7f9929a00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99240cbd90 0x7f99240cc210 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9924072510 tx=0x7f991c004d00 comp rx=0 tx=0).stop 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.449+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 shutdown_connections 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.449+0000 7f9929a00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f990006acd0 0x7f990006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.449+0000 7f9929a00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99240cbd90 0x7f99240cc210 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.449+0000 7f9929a00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f992414e830 0x7f9924156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.449+0000 7f9929a00640 1 --2- 172.21.15.73:0/864835735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9908005180 0x7f9924148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.449+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 >> 172.21.15.73:0/864835735 conn(0x7f992406a060 msgr2=0x7f9924158860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.452+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 shutdown_connections 2024-03-23T06:13:32.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:32.452+0000 7f9929a00640 1 -- 172.21.15.73:0/864835735 wait complete. 2024-03-23T06:13:35.491 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:13:35.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.714+0000 7f6aed800640 1 Processor -- start 2024-03-23T06:13:35.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.714+0000 7f6aed800640 1 -- start start 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.716+0000 7f6aed800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.716+0000 7f6aed800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.716+0000 7f6aed800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae8150820 con 0x7f6ae80c6920 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6aed800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80c3840 con 0x7f6ae8150440 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6aed800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae8156210 con 0x7f6ae815a350 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41672/0 (socket says 172.21.15.73:41672) 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 learned_addr learned my addr 172.21.15.73:0/2201507499 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:35.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:35.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:35.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:13:35.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:35.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:35.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:35.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.717+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:35.792 INFO:tasks.workunit.client.0.smithi073.stdout:Syncing()...13 sec 2024-03-23T06:13:35.794 INFO:tasks.workunit.client.0.smithi073.stdout:Starting Actual Benchmark At: Sat Mar 23 06:13:35 2024 2024-03-23T06:13:35.794 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:13:35.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.918+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:35.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:35.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:13:35.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:35.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:35.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:13:35.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:35.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:35.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:35.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:35.919+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:13:36.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.320+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:36.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.320+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:36.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.320+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:36.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.320+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:36.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.321+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:13:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.324+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.324+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.324+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.324+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:36.324+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:13:37.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.122+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:37.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.122+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:37.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.122+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:37.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.122+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:37.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.122+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:13:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.134+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.136+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:37.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.136+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.136+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:37.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:37.137+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:13:38.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.717+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 msgr2=0x7f6ae80c88d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:38.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.717+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae815a350 0x7f6ae80c88d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:38.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.717+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 msgr2=0x7f6ae80c8390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:38.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.717+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ae8150440 0x7f6ae80c8390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:38.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.717+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 >> v1:172.21.15.73:6789/0 conn(0x7f6ae80c6920 legacy=0x7f6ae80c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:38.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.717+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:38.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.717+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae81564f0 con 0x7f6ac8007af0 2024-03-23T06:13:38.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.717+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80c3840 con 0x7f6ac800b830 2024-03-23T06:13:38.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.718+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:38.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.719+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:38.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.719+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:38.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.719+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:38.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.719+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.923+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:38.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.923+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.924+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.924+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:38.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:38.924+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:13:39.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:39.326+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:39.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:39.327+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:39.327+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:39.327+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:39.327+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:13:40.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:40.128+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:40.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:40.129+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:40.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:40.129+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:40.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:40.129+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:40.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:40.129+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:13:41.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.717+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:41.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.717+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800b830 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:41.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.717+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 >> v1:172.21.15.110:6789/0 conn(0x7f6ac8007af0 legacy=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:41.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.718+0000 7f6aece00640 1 -- 172.21.15.73:0/2201507499 reap_dead start 2024-03-23T06:13:41.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.718+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:41.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.719+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:41.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.719+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac80035b0 con 0x7f6ac800e880 2024-03-23T06:13:41.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.719+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80c3840 con 0x7f6ac800e470 2024-03-23T06:13:41.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.719+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae8156210 con 0x7f6ac8007af0 2024-03-23T06:13:41.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.719+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:41.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.720+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:41.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.720+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:13:41.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.720+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:41.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.720+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:41.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.720+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:41.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.722+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:41.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.722+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:41.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.722+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:41.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.722+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:41.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.922+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:41.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.923+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:41.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.923+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:41.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.923+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:41.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.923+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:13:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.924+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.925+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:13:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.925+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:41.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.925+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:41.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:41.925+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:13:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.324+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.325+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.325+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.325+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.325+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:13:42.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.326+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.328+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.328+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.328+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:42.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:42.328+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:13:43.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.128+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:43.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.129+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:43.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.129+0000 7f6ae7400640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:43.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.129+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:43.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.129+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:13:43.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.130+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.130+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.130+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.130+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:43.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:43.130+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:13:44.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 msgr2=0x7f6ac8009f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.110:3300/0 conn(0x7f6ac8007af0 0x7f6ac8009f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 msgr2=0x7f6ac800dcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> v2:172.21.15.73:3300/0 conn(0x7f6ac800e470 0x7f6ac800dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 >> v1:172.21.15.73:6789/0 conn(0x7f6ac800e880 legacy=0x7f6ac800a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae5600640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac800ee70 con 0x7f6ac800b250 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae5600640 1 -- 172.21.15.73:0/2201507499 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80c3840 con 0x7f6ac800adb0 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.721+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.722+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:44.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.722+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.722+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:44.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.722+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:13:44.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.923+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:44.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.923+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:44.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.923+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:44.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.923+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:44.923+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:13:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:45.324+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:45.325+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:45.325+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:45.325+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:45.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:45.325+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:13:46.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.126+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:46.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.126+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:13:46.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.126+0000 7f6ae7e00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:13:46.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.126+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:13:46.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.126+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.628+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384985913 0 0) 0x7f6ac800ee70 con 0x7f6ac800b250 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.628+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6acc003520 con 0x7f6ac800b250 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.628+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3237610157 0 0) 0x7f6acc003520 con 0x7f6ac800b250 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.628+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 msgr2=0x7f6ac80068c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.628+0000 7f6ae6a00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ac800adb0 0x7f6ac80068c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac801dc40 con 0x7f6ac800b250 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f6ad40167f0 con 0x7f6ac800b250 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 >> v1:172.21.15.110:6789/0 conn(0x7f6ac800b250 legacy=0x7f6ac8006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6aece00640 1 -- 172.21.15.73:0/2201507499 reap_dead start 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc003970 0x7f6acc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:46.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0047c0 0x7f6acc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:46.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0051d0 0x7f6acc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:46.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc003970 0x7f6acc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:46.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80c3840 con 0x7f6acc0047c0 2024-03-23T06:13:46.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc00c100 con 0x7f6acc0051d0 2024-03-23T06:13:46.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.629+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc00c2c0 con 0x7f6acc003970 2024-03-23T06:13:46.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.630+0000 7f6ae7400640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0047c0 0x7f6acc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:46.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.630+0000 7f6aece00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0051d0 0x7f6acc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:46.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.631+0000 7f6aece00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc003970 msgr2=0x7f6acc003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:13:46.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.631+0000 7f6aece00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc003970 0x7f6acc003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.631+0000 7f6aece00640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0047c0 msgr2=0x7f6acc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:13:46.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.631+0000 7f6aece00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0047c0 0x7f6acc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.631+0000 7f6aece00640 1 -- 172.21.15.73:0/2201507499 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac801dc40 con 0x7f6acc0051d0 2024-03-23T06:13:46.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.632+0000 7f6aece00640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0051d0 0x7f6acc00b980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8153d10 tx=0x7f6acc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b285bb3389763bb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:46.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.633+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0005d40 con 0x7f6acc0051d0 2024-03-23T06:13:46.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.633+0000 7f6ae6a00640 1 -- 172.21.15.73:0/2201507499 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae002e070 con 0x7f6acc0051d0 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.634+0000 7f6aed800640 1 -- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0051d0 msgr2=0x7f6acc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.634+0000 7f6aed800640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0051d0 0x7f6acc00b980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8153d10 tx=0x7f6acc0057f0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.638+0000 7f6aed800640 1 -- 172.21.15.73:0/2201507499 shutdown_connections 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.638+0000 7f6aed800640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0051d0 0x7f6acc00b980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.638+0000 7f6aed800640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc0047c0 0x7f6acc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.638+0000 7f6aed800640 1 --2- 172.21.15.73:0/2201507499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc003970 0x7f6acc003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.638+0000 7f6aed800640 1 -- 172.21.15.73:0/2201507499 >> 172.21.15.73:0/2201507499 conn(0x7f6ae806bed0 msgr2=0x7f6ae806c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.638+0000 7f6aed800640 1 -- 172.21.15.73:0/2201507499 shutdown_connections 2024-03-23T06:13:46.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.638+0000 7f6aed800640 1 -- 172.21.15.73:0/2201507499 wait complete. 2024-03-23T06:13:46.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.641+0000 7f6aed800640 1 Processor -- start 2024-03-23T06:13:46.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.642+0000 7f6aed800640 1 -- start start 2024-03-23T06:13:46.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.645+0000 7f6aed800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc003970 0x7f6ae81ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:46.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.646+0000 7f6aed800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0047c0 0x7f6ae814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:46.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.646+0000 7f6aed800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0051d0 0x7f6ae81588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:46.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.647+0000 7f6aed800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae814ff80 con 0x7f6acc003970 2024-03-23T06:13:46.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.647+0000 7f6aed800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae814cc20 con 0x7f6acc0047c0 2024-03-23T06:13:46.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.647+0000 7f6aed800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81561f0 con 0x7f6acc0051d0 2024-03-23T06:13:46.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.647+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0047c0 0x7f6ae814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:46.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.647+0000 7f6aece00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0051d0 0x7f6ae81588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:46.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.647+0000 7f6aece00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0051d0 0x7f6ae81588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:46990/0 (socket says 172.21.15.73:46990) 2024-03-23T06:13:46.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.647+0000 7f6aece00640 1 -- 172.21.15.73:0/1685813852 learned_addr learned my addr 172.21.15.73:0/1685813852 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:46.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.648+0000 7f6aece00640 1 -- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0047c0 msgr2=0x7f6ae814a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:46.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.648+0000 7f6aece00640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0047c0 0x7f6ae814a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.648+0000 7f6aece00640 1 -- 172.21.15.73:0/1685813852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc003970 msgr2=0x7f6ae81ee450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:46.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.648+0000 7f6aece00640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc003970 0x7f6ae81ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:46.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.649+0000 7f6aece00640 1 -- 172.21.15.73:0/1685813852 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8155c30 con 0x7f6acc0051d0 2024-03-23T06:13:46.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.649+0000 7f6ae7400640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0047c0 0x7f6ae814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:13:46.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.649+0000 7f6aece00640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0051d0 0x7f6ae81588c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80c6290 tx=0x7f6ae00014d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.652+0000 7f6adfe00640 1 -- 172.21.15.73:0/1685813852 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0041070 con 0x7f6acc0051d0 2024-03-23T06:13:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.652+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8155f10 con 0x7f6acc0051d0 2024-03-23T06:13:46.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.652+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae81edc50 con 0x7f6acc0051d0 2024-03-23T06:13:46.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.652+0000 7f6adfe00640 1 -- 172.21.15.73:0/1685813852 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0039040 con 0x7f6acc0051d0 2024-03-23T06:13:46.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.652+0000 7f6adfe00640 1 -- 172.21.15.73:0/1685813852 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0038050 con 0x7f6acc0051d0 2024-03-23T06:13:46.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.658+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac0005250 con 0x7f6acc0051d0 2024-03-23T06:13:46.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.668+0000 7f6adfe00640 1 -- 172.21.15.73:0/1685813852 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6ae0030030 con 0x7f6acc0051d0 2024-03-23T06:13:46.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.671+0000 7f6adfe00640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ac80752e0 0x7f6ac80777a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:46.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.671+0000 7f6adfe00640 1 -- 172.21.15.73:0/1685813852 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f6ae00a9c10 con 0x7f6acc0051d0 2024-03-23T06:13:46.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.672+0000 7f6adfe00640 1 -- 172.21.15.73:0/1685813852 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6ae00749d0 con 0x7f6acc0051d0 2024-03-23T06:13:46.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.674+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ac80752e0 0x7f6ac80777a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:46.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:46.676+0000 7f6ae7e00640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ac80752e0 0x7f6ac80777a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8006e80 tx=0x7f6ad8000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:47.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.253+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6ac00057d0 con 0x7f6acc0051d0 2024-03-23T06:13:47.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.254+0000 7f6adfe00640 1 -- 172.21.15.73:0/1685813852 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f6ae0077ff0 con 0x7f6acc0051d0 2024-03-23T06:13:47.254 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:13:47.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.259+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ac80752e0 msgr2=0x7f6ac80777a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.259+0000 7f6aed800640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ac80752e0 0x7f6ac80777a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8006e80 tx=0x7f6ad8000bc0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.260+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0051d0 msgr2=0x7f6ae81588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.260+0000 7f6aed800640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0051d0 0x7f6ae81588c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ae80c6290 tx=0x7f6ae00014d0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.260+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 shutdown_connections 2024-03-23T06:13:47.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.260+0000 7f6aed800640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6ac80752e0 0x7f6ac80777a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.260+0000 7f6aed800640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6acc0051d0 0x7f6ae81588c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.260+0000 7f6aed800640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6acc0047c0 0x7f6ae814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.261+0000 7f6aed800640 1 --2- 172.21.15.73:0/1685813852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6acc003970 0x7f6ae81ee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.261+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 >> 172.21.15.73:0/1685813852 conn(0x7f6ae806bed0 msgr2=0x7f6ae80c4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:47.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.261+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 shutdown_connections 2024-03-23T06:13:47.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.261+0000 7f6aed800640 1 -- 172.21.15.73:0/1685813852 wait complete. 2024-03-23T06:13:47.297 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:13:47.297 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:13:47.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:13:47.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.708+0000 7fec6ec00640 1 Processor -- start 2024-03-23T06:13:47.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.709+0000 7fec6ec00640 1 -- start start 2024-03-23T06:13:47.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.712+0000 7fec6ec00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec681579d0 0x7fec680cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:47.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.713+0000 7fec6ec00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6815e320 con 0x7fec680caae0 2024-03-23T06:13:47.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.713+0000 7fec6ec00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec680cb0d0 con 0x7fec680ca690 2024-03-23T06:13:47.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.713+0000 7fec6ec00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec680cb3b0 con 0x7fec681579d0 2024-03-23T06:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.714+0000 7fec6ce00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fec680ca690 0x7fec68160d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:56768/0 (socket says 172.21.15.73:56768) 2024-03-23T06:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.714+0000 7fec6ce00640 1 -- 172.21.15.73:0/4235429982 learned_addr learned my addr 172.21.15.73:0/4235429982 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:13:47.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.714+0000 7fec6d800640 1 --2- 172.21.15.73:0/4235429982 >> v2:172.21.15.73:3300/0 conn(0x7fec681579d0 0x7fec680cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.716+0000 7fec6d800640 1 -- 172.21.15.73:0/4235429982 >> v1:172.21.15.110:6789/0 conn(0x7fec680ca690 legacy=0x7fec68160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.716+0000 7fec67e00640 1 -- 172.21.15.73:0/4235429982 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876112781 0 0) 0x7fec680cb0d0 con 0x7fec680ca690 2024-03-23T06:13:47.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.716+0000 7fec6d800640 1 -- 172.21.15.73:0/4235429982 >> v1:172.21.15.73:6789/0 conn(0x7fec680caae0 legacy=0x7fec680cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.717+0000 7fec6d800640 1 -- 172.21.15.73:0/4235429982 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6815d9f0 con 0x7fec681579d0 2024-03-23T06:13:47.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.719+0000 7fec6d800640 1 --2- 172.21.15.73:0/4235429982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec681579d0 0x7fec680cbfb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fec540097a0 tx=0x7fec5402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c05702981f95f8b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:47.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.722+0000 7fec67e00640 1 -- 172.21.15.73:0/4235429982 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5402f050 con 0x7fec681579d0 2024-03-23T06:13:47.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.724+0000 7fec67e00640 1 -- 172.21.15.73:0/4235429982 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54031700 con 0x7fec681579d0 2024-03-23T06:13:47.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.724+0000 7fec67e00640 1 -- 172.21.15.73:0/4235429982 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54031a90 con 0x7fec681579d0 2024-03-23T06:13:47.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.726+0000 7fec6ec00640 1 -- 172.21.15.73:0/4235429982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec681579d0 msgr2=0x7fec680cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.726+0000 7fec6ec00640 1 --2- 172.21.15.73:0/4235429982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec681579d0 0x7fec680cbfb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fec540097a0 tx=0x7fec5402b820 comp rx=0 tx=0).stop 2024-03-23T06:13:47.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.727+0000 7fec6ec00640 1 -- 172.21.15.73:0/4235429982 shutdown_connections 2024-03-23T06:13:47.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.727+0000 7fec6ec00640 1 --2- 172.21.15.73:0/4235429982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec681579d0 0x7fec680cbfb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.727+0000 7fec6ec00640 1 -- 172.21.15.73:0/4235429982 >> 172.21.15.73:0/4235429982 conn(0x7fec68069cb0 msgr2=0x7fec6806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:47.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.729+0000 7fec6ec00640 1 -- 172.21.15.73:0/4235429982 shutdown_connections 2024-03-23T06:13:47.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.729+0000 7fec6ec00640 1 -- 172.21.15.73:0/4235429982 wait complete. 2024-03-23T06:13:47.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.733+0000 7fec6ec00640 1 Processor -- start 2024-03-23T06:13:47.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.733+0000 7fec6ec00640 1 -- start start 2024-03-23T06:13:47.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.735+0000 7fec6ec00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680ca690 0x7fec680d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:47.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.735+0000 7fec6ec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec680caae0 0x7fec6813fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:47.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.735+0000 7fec6ec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec681579d0 0x7fec680d3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:47.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.737+0000 7fec6e200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec681579d0 0x7fec680d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:47.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.738+0000 7fec6e200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec681579d0 0x7fec680d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:47002/0 (socket says 172.21.15.73:47002) 2024-03-23T06:13:47.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.738+0000 7fec6e200640 1 -- 172.21.15.73:0/1937833416 learned_addr learned my addr 172.21.15.73:0/1937833416 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:47.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.738+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec681f72a0 con 0x7fec680ca690 2024-03-23T06:13:47.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.738+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec680d1da0 con 0x7fec680caae0 2024-03-23T06:13:47.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.738+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec681f6620 con 0x7fec681579d0 2024-03-23T06:13:47.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.739+0000 7fec6ce00640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec680caae0 0x7fec6813fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:47.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.739+0000 7fec6e200640 1 -- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec680caae0 msgr2=0x7fec6813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.739+0000 7fec6e200640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec680caae0 0x7fec6813fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.739+0000 7fec6d800640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680ca690 0x7fec680d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:47.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.739+0000 7fec6e200640 1 -- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680ca690 msgr2=0x7fec680d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.740+0000 7fec6e200640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec680ca690 0x7fec680d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.740+0000 7fec6e200640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54009400 con 0x7fec681579d0 2024-03-23T06:13:47.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.741+0000 7fec6ce00640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec680caae0 0x7fec6813fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:13:47.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.742+0000 7fec6e200640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec681579d0 0x7fec680d3380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec6000caf0 tx=0x7fec600020e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:47.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.742+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60003da0 con 0x7fec681579d0 2024-03-23T06:13:47.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.742+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6000a760 con 0x7fec681579d0 2024-03-23T06:13:47.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.742+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec681615e0 con 0x7fec681579d0 2024-03-23T06:13:47.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.743+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec681f6be0 con 0x7fec681579d0 2024-03-23T06:13:47.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.743+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60003da0 con 0x7fec681579d0 2024-03-23T06:13:47.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.756+0000 7fec6ec00640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44002a30 0x7fec44004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:47.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.756+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44007e80 con 0x7fec44002a30 2024-03-23T06:13:47.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.756+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fec6000a8d0 con 0x7fec681579d0 2024-03-23T06:13:47.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.758+0000 7fec6d800640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44002a30 0x7fec44004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:47.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.764+0000 7fec6d800640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec44008040 con 0x7fec44002a30 2024-03-23T06:13:47.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.764+0000 7fec65600640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806ac60 0x7fec4806d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.765+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fec60089270 con 0x7fec681579d0 2024-03-23T06:13:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.765+0000 7fec6ce00640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806ac60 0x7fec4806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:47.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.766+0000 7fec6d800640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44002a30 0x7fec44004ef0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec680d0f90 tx=0x7fec540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:47.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.767+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54033a30 con 0x7fec44002a30 2024-03-23T06:13:47.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.767+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fec54033b90 con 0x7fec44002a30 2024-03-23T06:13:47.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.767+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44002a30 msgr2=0x7fec44004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.767+0000 7fec65600640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44002a30 0x7fec44004ef0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec680d0f90 tx=0x7fec540046c0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.767+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44002a30 msgr2=0x7fec44004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:47.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.767+0000 7fec65600640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44002a30 0x7fec44004ef0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fec680d0f90 tx=0x7fec540046c0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.771+0000 7fec6ce00640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806ac60 0x7fec4806d120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec681f0bb0 tx=0x7fec5c007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:47.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.779+0000 7fec6ec00640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44006f60 0x7fec440073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:47.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.780+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44007940 con 0x7fec44006f60 2024-03-23T06:13:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.780+0000 7fec6d800640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44006f60 0x7fec440073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:47.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.781+0000 7fec6d800640 1 -- 172.21.15.73:0/1937833416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fec44007b00 con 0x7fec44006f60 2024-03-23T06:13:47.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.782+0000 7fec6d800640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44006f60 0x7fec440073d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fec5402b860 tx=0x7fec54031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:47.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.783+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5404c040 con 0x7fec44006f60 2024-03-23T06:13:47.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.784+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7fec540523f0 con 0x7fec44006f60 2024-03-23T06:13:47.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.784+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44006f60 msgr2=0x7fec440073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.784+0000 7fec65600640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44006f60 0x7fec440073d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fec5402b860 tx=0x7fec54031000 comp rx=0 tx=0).stop 2024-03-23T06:13:47.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.784+0000 7fec65600640 1 -- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44006f60 msgr2=0x7fec440073d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:47.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.784+0000 7fec65600640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec44006f60 0x7fec440073d0 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fec5402b860 tx=0x7fec54031000 comp rx=0 tx=0).stop 2024-03-23T06:13:47.784 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 44, 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:47.785 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:47.786 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:13:47.787 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:47.788 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:47.789 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.790 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:47.792 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:47.793 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:47.794 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:47.795 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:47.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:47.795 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:47.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:47.795 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:13:47.795 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.789+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806ac60 msgr2=0x7fec4806d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.789+0000 7fec6ec00640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fec4806ac60 0x7fec4806d120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec681f0bb0 tx=0x7fec5c007de0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.789+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec681579d0 msgr2=0x7fec680d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.789+0000 7fec6ec00640 1 --2- 172.21.15.73:0/1937833416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec681579d0 0x7fec680d3380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fec6000caf0 tx=0x7fec600020e0 comp rx=0 tx=0).stop 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.789+0000 7fec6e200640 1 -- 172.21.15.73:0/1937833416 reap_dead start 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.789+0000 7fec6e200640 1 -- 172.21.15.73:0/1937833416 reap_dead start 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.789+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 shutdown_connections 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.789+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 >> 172.21.15.73:0/1937833416 conn(0x7fec68069cb0 msgr2=0x7fec68156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.790+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 shutdown_connections 2024-03-23T06:13:47.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:47.790+0000 7fec6ec00640 1 -- 172.21.15.73:0/1937833416 wait complete. 2024-03-23T06:13:47.836 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:13:47.836 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:13:47.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:13:48.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.174+0000 7f7fe5800640 1 Processor -- start 2024-03-23T06:13:48.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.174+0000 7f7fe5800640 1 -- start start 2024-03-23T06:13:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.177+0000 7f7fe5800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7fe01537b0 0x7f7fe00cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.177+0000 7f7fe5800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00b1c40 0x7f7fe0163e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.177+0000 7f7fe5800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe00b2460 con 0x7f7fe00ca7d0 2024-03-23T06:13:48.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.177+0000 7f7fe5800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe00ca140 con 0x7f7fe01537b0 2024-03-23T06:13:48.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.177+0000 7f7fe5800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe015a4b0 con 0x7f7fe00b1c40 2024-03-23T06:13:48.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.178+0000 7f7fdf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00b1c40 0x7f7fe0163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.178+0000 7f7fde000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7fe01537b0 0x7f7fe00cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.178+0000 7f7fdf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00b1c40 0x7f7fe0163e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:47012/0 (socket says 172.21.15.73:47012) 2024-03-23T06:13:48.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.178+0000 7f7fdf400640 1 -- 172.21.15.73:0/923396367 learned_addr learned my addr 172.21.15.73:0/923396367 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:48.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.178+0000 7f7fdea00640 1 --1- 172.21.15.73:0/923396367 >> v1:172.21.15.73:6789/0 conn(0x7f7fe00ca7d0 0x7f7fe006a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59348/0 (socket says 172.21.15.73:59348) 2024-03-23T06:13:48.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.178+0000 7f7fdf400640 1 -- 172.21.15.73:0/923396367 >> v2:172.21.15.73:3300/0 conn(0x7f7fe01537b0 msgr2=0x7f7fe00cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:13:48.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.179+0000 7f7fdf400640 1 --2- 172.21.15.73:0/923396367 >> v2:172.21.15.73:3300/0 conn(0x7f7fe01537b0 0x7f7fe00cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.179+0000 7f7fdf400640 1 -- 172.21.15.73:0/923396367 >> v1:172.21.15.73:6789/0 conn(0x7f7fe00ca7d0 legacy=0x7f7fe006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.179+0000 7f7fdf400640 1 -- 172.21.15.73:0/923396367 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe00c9e60 con 0x7f7fe00b1c40 2024-03-23T06:13:48.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.179+0000 7f7fde000640 1 --2- 172.21.15.73:0/923396367 >> v2:172.21.15.73:3300/0 conn(0x7f7fe01537b0 0x7f7fe00cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:13:48.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.183+0000 7f7fdf400640 1 --2- 172.21.15.73:0/923396367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00b1c40 0x7f7fe0163e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009870 tx=0x7f7fd002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=765f90cd1eba83ec server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.185+0000 7f7fdd600640 1 -- 172.21.15.73:0/923396367 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031640 con 0x7f7fe00b1c40 2024-03-23T06:13:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.185+0000 7f7fdd600640 1 -- 172.21.15.73:0/923396367 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd00317a0 con 0x7f7fe00b1c40 2024-03-23T06:13:48.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.185+0000 7f7fdd600640 1 -- 172.21.15.73:0/923396367 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031b30 con 0x7f7fe00b1c40 2024-03-23T06:13:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.186+0000 7f7fe5800640 1 -- 172.21.15.73:0/923396367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00b1c40 msgr2=0x7f7fe0163e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.186+0000 7f7fe5800640 1 --2- 172.21.15.73:0/923396367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00b1c40 0x7f7fe0163e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009870 tx=0x7f7fd002b8f0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.191+0000 7f7fe5800640 1 -- 172.21.15.73:0/923396367 shutdown_connections 2024-03-23T06:13:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.191+0000 7f7fe5800640 1 --2- 172.21.15.73:0/923396367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00b1c40 0x7f7fe0163e60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.191+0000 7f7fe5800640 1 --2- 172.21.15.73:0/923396367 >> v2:172.21.15.73:3300/0 conn(0x7f7fe01537b0 0x7f7fe00cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.191+0000 7f7fe5800640 1 -- 172.21.15.73:0/923396367 >> 172.21.15.73:0/923396367 conn(0x7f7fe0071800 msgr2=0x7f7fe0071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.191+0000 7f7fe5800640 1 -- 172.21.15.73:0/923396367 shutdown_connections 2024-03-23T06:13:48.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.191+0000 7f7fe5800640 1 -- 172.21.15.73:0/923396367 wait complete. 2024-03-23T06:13:48.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.196+0000 7f7fe5800640 1 Processor -- start 2024-03-23T06:13:48.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.197+0000 7f7fe5800640 1 -- start start 2024-03-23T06:13:48.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.198+0000 7f7fe5800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe00b1c40 0x7f7fe00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fe5800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fe00ca7d0 0x7f7fe0148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fe5800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00ce710 0x7f7fe01f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fe5800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe01f3620 con 0x7f7fe00b1c40 2024-03-23T06:13:48.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fe5800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00cb630 con 0x7f7fe00ca7d0 2024-03-23T06:13:48.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fe5800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe01f67b0 con 0x7f7fe00ce710 2024-03-23T06:13:48.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fde000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fe00ca7d0 0x7f7fe0148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fde000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fe00ca7d0 0x7f7fe0148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55432/0 (socket says 172.21.15.73:55432) 2024-03-23T06:13:48.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fde000640 1 -- 172.21.15.73:0/1241007102 learned_addr learned my addr 172.21.15.73:0/1241007102 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:48.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.199+0000 7f7fdea00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe00b1c40 0x7f7fe00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.200+0000 7f7fdf400640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00ce710 0x7f7fe01f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.201+0000 7f7fdf400640 1 -- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fe00ca7d0 msgr2=0x7f7fe0148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.201+0000 7f7fdf400640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fe00ca7d0 0x7f7fe0148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.201+0000 7f7fdf400640 1 -- 172.21.15.73:0/1241007102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe00b1c40 msgr2=0x7f7fe00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.201+0000 7f7fdf400640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fe00b1c40 0x7f7fe00cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.201+0000 7f7fdf400640 1 -- 172.21.15.73:0/1241007102 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00094d0 con 0x7f7fe00ce710 2024-03-23T06:13:48.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.201+0000 7f7fde000640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fe00ca7d0 0x7f7fe0148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:13:48.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.204+0000 7f7fdf400640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00ce710 0x7f7fe01f3ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0033000 tx=0x7f7fd00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.204+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031ea0 con 0x7f7fe00ce710 2024-03-23T06:13:48.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.204+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe01f6a50 con 0x7f7fe00ce710 2024-03-23T06:13:48.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.204+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd003aca0 con 0x7f7fe00ce710 2024-03-23T06:13:48.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.204+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0031ea0 con 0x7f7fe00ce710 2024-03-23T06:13:48.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.205+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe01f6ff0 con 0x7f7fe00ce710 2024-03-23T06:13:48.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.207+0000 7f7fe5800640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8002a30 0x7f7fb8004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.207+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8007e80 con 0x7f7fb8002a30 2024-03-23T06:13:48.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.211+0000 7f7fdea00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8002a30 0x7f7fb8004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.212+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7fd002f050 con 0x7f7fe00ce710 2024-03-23T06:13:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.214+0000 7f7fd6a00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7fc006ac90 0x7f7fc006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.214+0000 7f7fdea00640 1 -- 172.21.15.73:0/1241007102 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fb8008040 con 0x7f7fb8002a30 2024-03-23T06:13:48.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.214+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f7fd00ab110 con 0x7f7fe00ce710 2024-03-23T06:13:48.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.215+0000 7f7fde000640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7fc006ac90 0x7f7fc006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.215+0000 7f7fdea00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8002a30 0x7f7fb8004ef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc001350 tx=0x7f7fcc001750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.215+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc010510 con 0x7f7fb8002a30 2024-03-23T06:13:48.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.216+0000 7f7fde000640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7fc006ac90 0x7f7fc006d150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0158ad0 tx=0x7f7fd8007830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.216+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f7fcc010670 con 0x7f7fb8002a30 2024-03-23T06:13:48.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.216+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8002a30 msgr2=0x7f7fb8004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.216+0000 7f7fd6a00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8002a30 0x7f7fb8004ef0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc001350 tx=0x7f7fcc001750 comp rx=0 tx=0).stop 2024-03-23T06:13:48.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.216+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8002a30 msgr2=0x7f7fb8004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:48.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.216+0000 7f7fd6a00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8002a30 0x7f7fb8004ef0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc001350 tx=0x7f7fcc001750 comp rx=0 tx=0).stop 2024-03-23T06:13:48.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.250+0000 7f7fe5800640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8006f20 0x7f7fb80073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.252+0000 7f7fdea00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8006f20 0x7f7fb80073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.252+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8007920 con 0x7f7fb8006f20 2024-03-23T06:13:48.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.258+0000 7f7fdea00640 1 -- 172.21.15.73:0/1241007102 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7fb8007ae0 con 0x7f7fb8006f20 2024-03-23T06:13:48.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.258+0000 7f7fdea00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8006f20 0x7f7fb80073b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc001350 tx=0x7f7fcc000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.259+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc014990 con 0x7f7fb8006f20 2024-03-23T06:13:48.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.259+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4948 (secure 0 0 0) 0x7f7fcc01e470 con 0x7f7fb8006f20 2024-03-23T06:13:48.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.259+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8006f20 msgr2=0x7f7fb80073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.259 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:13:48.259 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 44, 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:13:48.260 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:13:48.261 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:13:48.263 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:48.264 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.265 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:48.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.268 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.269 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.270 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:13:48.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.272 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.273 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:13:48.273 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.260+0000 7f7fd6a00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8006f20 0x7f7fb80073b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc001350 tx=0x7f7fcc000ed0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.260+0000 7f7fd6a00640 1 -- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8006f20 msgr2=0x7f7fb80073b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.260+0000 7f7fd6a00640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb8006f20 0x7f7fb80073b0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc001350 tx=0x7f7fcc000ed0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.261+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7fc006ac90 msgr2=0x7f7fc006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.261+0000 7f7fe5800640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7fc006ac90 0x7f7fc006d150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0158ad0 tx=0x7f7fd8007830 comp rx=0 tx=0).stop 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.261+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00ce710 msgr2=0x7f7fe01f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.261+0000 7f7fe5800640 1 --2- 172.21.15.73:0/1241007102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fe00ce710 0x7f7fe01f3ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0033000 tx=0x7f7fd00046c0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.262+0000 7f7fdf400640 1 -- 172.21.15.73:0/1241007102 reap_dead start 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.262+0000 7f7fdf400640 1 -- 172.21.15.73:0/1241007102 reap_dead start 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.262+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 shutdown_connections 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.262+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 >> 172.21.15.73:0/1241007102 conn(0x7f7fe0071800 msgr2=0x7f7fe0157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:48.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.263+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 shutdown_connections 2024-03-23T06:13:48.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.263+0000 7f7fe5800640 1 -- 172.21.15.73:0/1241007102 wait complete. 2024-03-23T06:13:48.294 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:13:48.295 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:13:48.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:13:48.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.618+0000 7f503fa00640 1 Processor -- start 2024-03-23T06:13:48.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.618+0000 7f503fa00640 1 -- start start 2024-03-23T06:13:48.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.620+0000 7f503fa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50380cb050 0x7f50380c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.620+0000 7f503fa00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50380c9c80 con 0x7f5038153760 2024-03-23T06:13:48.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.620+0000 7f503fa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503806a2d0 con 0x7f5038159420 2024-03-23T06:13:48.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.620+0000 7f503fa00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5038159860 con 0x7f50380cb050 2024-03-23T06:13:48.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.620+0000 7f5037e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5038159420 0x7f50380ca940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:56776/0 (socket says 172.21.15.73:56776) 2024-03-23T06:13:48.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.620+0000 7f5037e00640 1 -- 172.21.15.73:0/3207793596 learned_addr learned my addr 172.21.15.73:0/3207793596 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:13:48.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166313314 0 0) 0x7f503806a2d0 con 0x7f5038159420 2024-03-23T06:13:48.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f501c003520 con 0x7f5038159420 2024-03-23T06:13:48.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 821909622 0 0) 0x7f501c003520 con 0x7f5038159420 2024-03-23T06:13:48.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 >> v2:172.21.15.110:3300/0 conn(0x7f50380cb050 msgr2=0x7f50380c9740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 --2- 172.21.15.73:0/3207793596 >> v2:172.21.15.110:3300/0 conn(0x7f50380cb050 0x7f50380c9740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 >> v1:172.21.15.73:6789/0 conn(0x7f5038153760 legacy=0x7f50380cb7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503806a5b0 con 0x7f5038159420 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f5028001670 con 0x7f5038159420 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 >> v1:172.21.15.110:6789/0 conn(0x7f5038159420 legacy=0x7f50380ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f501c003970 0x7f501c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.621+0000 7f5037400640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c0047c0 0x7f501c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.622+0000 7f5037400640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0052a0 0x7f501c014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.622+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5038159860 con 0x7f501c003970 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.622+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0149b0 con 0x7f501c0052a0 2024-03-23T06:13:48.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.622+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c014b70 con 0x7f501c0047c0 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.623+0000 7f5037e00640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c0047c0 0x7f501c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.624+0000 7f5037e00640 1 -- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0052a0 msgr2=0x7f501c014190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.624+0000 7f5037e00640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0052a0 0x7f501c014190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.624+0000 7f5037e00640 1 -- 172.21.15.73:0/3207793596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f501c003970 msgr2=0x7f501c003d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.624+0000 7f5037e00640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f501c003970 0x7f501c003d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.624+0000 7f5037e00640 1 -- 172.21.15.73:0/3207793596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503806a5b0 con 0x7f501c0047c0 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.625+0000 7f503da00640 1 -- 172.21.15.73:0/3207793596 reap_dead start 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.628+0000 7f5037e00640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c0047c0 0x7f501c004c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f502800c210 tx=0x7f501c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff5b05ea645a8d5a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.630+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502802cae0 con 0x7f501c0047c0 2024-03-23T06:13:48.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.630+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502802cc40 con 0x7f501c0047c0 2024-03-23T06:13:48.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.630+0000 7f5037400640 1 -- 172.21.15.73:0/3207793596 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50280058d0 con 0x7f501c0047c0 2024-03-23T06:13:48.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.631+0000 7f503fa00640 1 -- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c0047c0 msgr2=0x7f501c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.631+0000 7f503fa00640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c0047c0 0x7f501c004c40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f502800c210 tx=0x7f501c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.632+0000 7f503fa00640 1 -- 172.21.15.73:0/3207793596 shutdown_connections 2024-03-23T06:13:48.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.632+0000 7f503fa00640 1 --2- 172.21.15.73:0/3207793596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c0047c0 0x7f501c004c40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.632+0000 7f503fa00640 1 -- 172.21.15.73:0/3207793596 >> 172.21.15.73:0/3207793596 conn(0x7f503806c310 msgr2=0x7f50380713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:48.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.633+0000 7f503fa00640 1 -- 172.21.15.73:0/3207793596 shutdown_connections 2024-03-23T06:13:48.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.633+0000 7f503fa00640 1 -- 172.21.15.73:0/3207793596 wait complete. 2024-03-23T06:13:48.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.641+0000 7f503fa00640 1 Processor -- start 2024-03-23T06:13:48.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.641+0000 7f503fa00640 1 -- start start 2024-03-23T06:13:48.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.647+0000 7f503fa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0047c0 0x7f50380ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.647+0000 7f503d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0047c0 0x7f50380ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.647+0000 7f503d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0047c0 0x7f50380ce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55442/0 (socket says 172.21.15.73:55442) 2024-03-23T06:13:48.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.648+0000 7f503d000640 1 -- 172.21.15.73:0/2950488529 learned_addr learned my addr 172.21.15.73:0/2950488529 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:48.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.648+0000 7f503fa00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5038147530 0x7f50381524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.652+0000 7f503fa00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f503814f0e0 0x7f503814f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.652+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50380b3950 con 0x7f5038147530 2024-03-23T06:13:48.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.652+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503814faa0 con 0x7f501c0047c0 2024-03-23T06:13:48.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.652+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503814dbc0 con 0x7f503814f0e0 2024-03-23T06:13:48.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.651+0000 7f5037e00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5038147530 0x7f50381524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.699 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:13:48.699 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:13:48.699 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:13:48.699 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:13:48.699 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 44, 2024-03-23T06:13:48.699 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:13:48.699 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:13:48.699 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:48.700 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:48.701 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:48.702 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:13:48.703 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:13:48.704 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:13:48.705 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.707 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.709 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.710 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:13:48.711 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:13:48.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.653+0000 7f503d000640 1 -- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f503814f0e0 msgr2=0x7f503814f560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T06:13:48.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.653+0000 7f503d000640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f503814f0e0 0x7f503814f560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.653+0000 7f503d000640 1 -- 172.21.15.73:0/2950488529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5038147530 msgr2=0x7f50381524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.653+0000 7f503d000640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5038147530 0x7f50381524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.653+0000 7f503d000640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380b2260 con 0x7f501c0047c0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.654+0000 7f503d000640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0047c0 0x7f50380ce4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f502400b390 tx=0x7f502400b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.658+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024011830 con 0x7f501c0047c0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.658+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5038145c50 con 0x7f501c0047c0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.658+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5038146210 con 0x7f501c0047c0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.658+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5024011990 con 0x7f501c0047c0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.658+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024011830 con 0x7f501c0047c0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.660+0000 7f503fa00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5010002a30 0x7f5010004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.660+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5010018e90 con 0x7f5010002a30 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.662+0000 7f5037e00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5010002a30 0x7f5010004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.669+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5024011b00 con 0x7f501c0047c0 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.671+0000 7f5037e00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5010019050 con 0x7f5010002a30 2024-03-23T06:13:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.671+0000 7f5037e00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5010002a30 0x7f5010004ef0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f501c0057a0 tx=0x7f5028001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.674+0000 7f5034c00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f501806ac60 0x7f501806d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.676+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5024089330 con 0x7f501c0047c0 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.676+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028001430 con 0x7f5010002a30 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.676+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f502803a070 con 0x7f5010002a30 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.676+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5010002a30 msgr2=0x7f5010004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.676+0000 7f5034c00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5010002a30 0x7f5010004ef0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f501c0057a0 tx=0x7f5028001930 comp rx=0 tx=0).stop 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.676+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5010002a30 msgr2=0x7f5010004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.676+0000 7f5034c00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5010002a30 0x7f5010004ef0 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f501c0057a0 tx=0x7f5028001930 comp rx=0 tx=0).stop 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.676+0000 7f503da00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f501806ac60 0x7f501806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.682+0000 7f503da00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f501806ac60 0x7f501806d120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f50380cb430 tx=0x7f503002b220 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.693+0000 7f503fa00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50100194e0 0x7f5010019970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.693+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501001b150 con 0x7f50100194e0 2024-03-23T06:13:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.693+0000 7f5037e00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50100194e0 0x7f5010019970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.694+0000 7f5037e00640 1 -- 172.21.15.73:0/2950488529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5010008c90 con 0x7f50100194e0 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.697+0000 7f5037e00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50100194e0 0x7f5010019970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5010019020 tx=0x7f502802f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.699+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502804b9e0 con 0x7f50100194e0 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.699+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7f502804bb40 con 0x7f50100194e0 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.699+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50100194e0 msgr2=0x7f5010019970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.699+0000 7f5034c00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50100194e0 0x7f5010019970 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5010019020 tx=0x7f502802f000 comp rx=0 tx=0).stop 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.699+0000 7f5034c00640 1 -- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50100194e0 msgr2=0x7f5010019970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.699+0000 7f5034c00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50100194e0 0x7f5010019970 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f501806ac60 msgr2=0x7f501806d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503fa00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f501806ac60 0x7f501806d120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f50380cb430 tx=0x7f503002b220 comp rx=0 tx=0).stop 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0047c0 msgr2=0x7f50380ce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503fa00640 1 --2- 172.21.15.73:0/2950488529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c0047c0 0x7f50380ce4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f502400b390 tx=0x7f502400b850 comp rx=0 tx=0).stop 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503da00640 1 -- 172.21.15.73:0/2950488529 reap_dead start 2024-03-23T06:13:48.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503da00640 1 -- 172.21.15.73:0/2950488529 reap_dead start 2024-03-23T06:13:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 shutdown_connections 2024-03-23T06:13:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 >> 172.21.15.73:0/2950488529 conn(0x7f503806c310 msgr2=0x7f50380713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 shutdown_connections 2024-03-23T06:13:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:48.700+0000 7f503fa00640 1 -- 172.21.15.73:0/2950488529 wait complete. 2024-03-23T06:13:48.786 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:13:48.786 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:13:48.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:13:49.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.144+0000 7efdd5c00640 1 Processor -- start 2024-03-23T06:13:49.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.144+0000 7efdd5c00640 1 -- start start 2024-03-23T06:13:49.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.146+0000 7efdd5c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efdd0153a80 0x7efdd00cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:49.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.146+0000 7efdd5c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01594f0 0x7efdd00cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:49.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.146+0000 7efdd5c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd01599a0 con 0x7efdd01536a0 2024-03-23T06:13:49.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.146+0000 7efdd5c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd015a520 con 0x7efdd0153a80 2024-03-23T06:13:49.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.146+0000 7efdd5c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd0159c80 con 0x7efdd01594f0 2024-03-23T06:13:49.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.146+0000 7efdcf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01594f0 0x7efdd00cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.147+0000 7efdcf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01594f0 0x7efdd00cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:47076/0 (socket says 172.21.15.73:47076) 2024-03-23T06:13:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.147+0000 7efdcf400640 1 -- 172.21.15.73:0/396899550 learned_addr learned my addr 172.21.15.73:0/396899550 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.147+0000 7efdcf400640 1 -- 172.21.15.73:0/396899550 >> v2:172.21.15.73:3300/0 conn(0x7efdd0153a80 msgr2=0x7efdd00cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:13:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.147+0000 7efdcf400640 1 --2- 172.21.15.73:0/396899550 >> v2:172.21.15.73:3300/0 conn(0x7efdd0153a80 0x7efdd00cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.147+0000 7efdcf400640 1 -- 172.21.15.73:0/396899550 >> v1:172.21.15.73:6789/0 conn(0x7efdd01536a0 legacy=0x7efdd00ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:13:49.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.147+0000 7efdcf400640 1 -- 172.21.15.73:0/396899550 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0159f60 con 0x7efdd01594f0 2024-03-23T06:13:49.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.149+0000 7efdcf400640 1 --2- 172.21.15.73:0/396899550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01594f0 0x7efdd00cc3d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009e50 tx=0x7efdc802bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d8e35fa70bb7bf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:49.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.150+0000 7efdcd600640 1 -- 172.21.15.73:0/396899550 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc802ca80 con 0x7efdd01594f0 2024-03-23T06:13:49.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.150+0000 7efdcd600640 1 -- 172.21.15.73:0/396899550 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc802cbe0 con 0x7efdd01594f0 2024-03-23T06:13:49.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.150+0000 7efdcd600640 1 -- 172.21.15.73:0/396899550 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc80343f0 con 0x7efdd01594f0 2024-03-23T06:13:49.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.151+0000 7efdd5c00640 1 -- 172.21.15.73:0/396899550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01594f0 msgr2=0x7efdd00cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:49.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.151+0000 7efdd5c00640 1 --2- 172.21.15.73:0/396899550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01594f0 0x7efdd00cc3d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdc8009e50 tx=0x7efdc802bee0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.151+0000 7efdd5c00640 1 -- 172.21.15.73:0/396899550 shutdown_connections 2024-03-23T06:13:49.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.151+0000 7efdd5c00640 1 --2- 172.21.15.73:0/396899550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01594f0 0x7efdd00cc3d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.151+0000 7efdd5c00640 1 --2- 172.21.15.73:0/396899550 >> v2:172.21.15.73:3300/0 conn(0x7efdd0153a80 0x7efdd00cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.151+0000 7efdd5c00640 1 -- 172.21.15.73:0/396899550 >> 172.21.15.73:0/396899550 conn(0x7efdd006a060 msgr2=0x7efdd006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:49.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.152+0000 7efdd5c00640 1 -- 172.21.15.73:0/396899550 shutdown_connections 2024-03-23T06:13:49.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.152+0000 7efdd5c00640 1 -- 172.21.15.73:0/396899550 wait complete. 2024-03-23T06:13:49.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.158+0000 7efdd5c00640 1 Processor -- start 2024-03-23T06:13:49.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.158+0000 7efdd5c00640 1 -- start start 2024-03-23T06:13:49.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.160+0000 7efdd5c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01536a0 0x7efdd006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.160+0000 7efdd5c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdd0153a80 0x7efdd014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.160+0000 7efdcea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01536a0 0x7efdd006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:49.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.160+0000 7efdcea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01536a0 0x7efdd006bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:47084/0 (socket says 172.21.15.73:47084) 2024-03-23T06:13:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.161+0000 7efdd5c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdd01594f0 0x7efdd01f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.161+0000 7efdd5c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00b3080 con 0x7efdd01594f0 2024-03-23T06:13:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.161+0000 7efdd5c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd014f270 con 0x7efdd0153a80 2024-03-23T06:13:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.161+0000 7efdd5c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd00b2d50 con 0x7efdd01536a0 2024-03-23T06:13:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.161+0000 7efdcea00640 1 -- 172.21.15.73:0/1146637113 learned_addr learned my addr 172.21.15.73:0/1146637113 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:13:49.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.161+0000 7efdce000640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdd0153a80 0x7efdd014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:49.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.162+0000 7efdcf400640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdd01594f0 0x7efdd01f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:49.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.163+0000 7efdcf400640 1 -- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01536a0 msgr2=0x7efdd006bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.163+0000 7efdcf400640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01536a0 0x7efdd006bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.163+0000 7efdcf400640 1 -- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdd0153a80 msgr2=0x7efdd014af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.163+0000 7efdcf400640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdd0153a80 0x7efdd014af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.163+0000 7efdcf400640 1 -- 172.21.15.73:0/1146637113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc8009b30 con 0x7efdd01594f0 2024-03-23T06:13:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.163+0000 7efdcea00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01536a0 0x7efdd006bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:13:49.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.163+0000 7efdce000640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdd0153a80 0x7efdd014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:13:49.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.166+0000 7efdcf400640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdd01594f0 0x7efdd01f22f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efdc8032000 tx=0x7efdc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:49.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.166+0000 7efdc6a00640 1 -- 172.21.15.73:0/1146637113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8040470 con 0x7efdd01594f0 2024-03-23T06:13:49.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.166+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd00b3c50 con 0x7efdd01594f0 2024-03-23T06:13:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.166+0000 7efdc6a00640 1 -- 172.21.15.73:0/1146637113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc80405d0 con 0x7efdd01594f0 2024-03-23T06:13:49.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.167+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd014f7c0 con 0x7efdd01594f0 2024-03-23T06:13:49.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.168+0000 7efdc6a00640 1 -- 172.21.15.73:0/1146637113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc8040940 con 0x7efdd01594f0 2024-03-23T06:13:49.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.170+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8005250 con 0x7efdd01594f0 2024-03-23T06:13:49.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.172+0000 7efdc6a00640 1 -- 172.21.15.73:0/1146637113 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efdc802cd50 con 0x7efdd01594f0 2024-03-23T06:13:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.173+0000 7efdc6a00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efdb006ac00 0x7efdb006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:13:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.174+0000 7efdc6a00640 1 -- 172.21.15.73:0/1146637113 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7efdc80ac050 con 0x7efdd01594f0 2024-03-23T06:13:49.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.174+0000 7efdcea00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efdb006ac00 0x7efdb006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:13:49.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.175+0000 7efdcea00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efdb006ac00 0x7efdb006d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009d70 tx=0x7efdc00090e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:13:49.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.185+0000 7efdc6a00640 1 -- 172.21.15.73:0/1146637113 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efdc8076da0 con 0x7efdd01594f0 2024-03-23T06:13:49.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.691+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7efda8005d10 con 0x7efdd01594f0 2024-03-23T06:13:49.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.693+0000 7efdc6a00640 1 -- 172.21.15.73:0/1146637113 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7efdc807a3c0 con 0x7efdd01594f0 2024-03-23T06:13:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efdb006ac00 msgr2=0x7efdb006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efdb006ac00 0x7efdb006d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009d70 tx=0x7efdc00090e0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdd01594f0 msgr2=0x7efdd01f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdd01594f0 0x7efdd01f22f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efdc8032000 tx=0x7efdc8004a40 comp rx=0 tx=0).stop 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 shutdown_connections 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efdd01594f0 0x7efdd01f22f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efdd0153a80 0x7efdd014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efdb006ac00 0x7efdb006d0c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 --2- 172.21.15.73:0/1146637113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efdd01536a0 0x7efdd006bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.702+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 >> 172.21.15.73:0/1146637113 conn(0x7efdd006a060 msgr2=0x7efdd00cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.703+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 shutdown_connections 2024-03-23T06:13:49.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:13:49.703+0000 7efdd5c00640 1 -- 172.21.15.73:0/1146637113 wait complete. 2024-03-23T06:13:49.734 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:13:56.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:13:56.296 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:13:59.735 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:13:59.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:14:00.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.097+0000 7f7c94e00640 1 Processor -- start 2024-03-23T06:14:00.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.100+0000 7f7c94e00640 1 -- start start 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.101+0000 7f7c94e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c900cf100 0x7f7c900cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.101+0000 7f7c94e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c90159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.101+0000 7f7c94e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9015a370 con 0x7f7c900ced20 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.101+0000 7f7c94e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c900cb8d0 con 0x7f7c900cf100 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.101+0000 7f7c94e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900ca330 con 0x7f7c900caed0 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.101+0000 7f7c8ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c900cf100 0x7f7c900cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.101+0000 7f7c8ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c900cf100 0x7f7c900cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36070/0 (socket says 172.21.15.73:36070) 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.101+0000 7f7c8ea00640 1 -- 172.21.15.73:0/1380644215 learned_addr learned my addr 172.21.15.73:0/1380644215 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.102+0000 7f7c8ea00640 1 -- 172.21.15.73:0/1380644215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 msgr2=0x7f7c90159e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.102+0000 7f7c8ea00640 1 --2- 172.21.15.73:0/1380644215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c90159e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.102+0000 7f7c8ea00640 1 -- 172.21.15.73:0/1380644215 >> v1:172.21.15.73:6789/0 conn(0x7f7c900ced20 legacy=0x7f7c900ca7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:00.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.102+0000 7f7c8ea00640 1 -- 172.21.15.73:0/1380644215 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900cbab0 con 0x7f7c900cf100 2024-03-23T06:14:00.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.103+0000 7f7c8ea00640 1 --2- 172.21.15.73:0/1380644215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 0x7f7c900cb390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009870 tx=0x7f7c8002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01d2220d0e688f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:00.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.104+0000 7f7c8e000640 1 -- 172.21.15.73:0/1380644215 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c80030860 con 0x7f7c900cf100 2024-03-23T06:14:00.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.105+0000 7f7c8e000640 1 -- 172.21.15.73:0/1380644215 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c800309c0 con 0x7f7c900cf100 2024-03-23T06:14:00.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.105+0000 7f7c8e000640 1 -- 172.21.15.73:0/1380644215 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c80030d50 con 0x7f7c900cf100 2024-03-23T06:14:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.106+0000 7f7c94e00640 1 -- 172.21.15.73:0/1380644215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 msgr2=0x7f7c900cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:00.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.106+0000 7f7c94e00640 1 --2- 172.21.15.73:0/1380644215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 0x7f7c900cb390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c80009870 tx=0x7f7c8002b9a0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.106+0000 7f7c94e00640 1 -- 172.21.15.73:0/1380644215 shutdown_connections 2024-03-23T06:14:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.106+0000 7f7c94e00640 1 --2- 172.21.15.73:0/1380644215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c90159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.106+0000 7f7c94e00640 1 --2- 172.21.15.73:0/1380644215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 0x7f7c900cb390 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.106+0000 7f7c94e00640 1 -- 172.21.15.73:0/1380644215 >> 172.21.15.73:0/1380644215 conn(0x7f7c900713e0 msgr2=0x7f7c900717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:00.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.107+0000 7f7c94e00640 1 -- 172.21.15.73:0/1380644215 shutdown_connections 2024-03-23T06:14:00.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.107+0000 7f7c94e00640 1 -- 172.21.15.73:0/1380644215 wait complete. 2024-03-23T06:14:00.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.110+0000 7f7c94e00640 1 Processor -- start 2024-03-23T06:14:00.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.110+0000 7f7c94e00640 1 -- start start 2024-03-23T06:14:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.115+0000 7f7c94e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c901ef440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:00.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.115+0000 7f7c94e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c900ced20 0x7f7c90158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:00.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.116+0000 7f7c8f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c901ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.116+0000 7f7c8f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c901ef440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60102/0 (socket says 172.21.15.73:60102) 2024-03-23T06:14:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.118+0000 7f7c94e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 0x7f7c9015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.118+0000 7f7c94e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900c56f0 con 0x7f7c900cf100 2024-03-23T06:14:00.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.118+0000 7f7c8f400640 1 -- 172.21.15.73:0/812074798 learned_addr learned my addr 172.21.15.73:0/812074798 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.121+0000 7f7c8ea00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c900ced20 0x7f7c90158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.122+0000 7f7c8fe00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 0x7f7c9015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.121+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900c1990 con 0x7f7c900ced20 2024-03-23T06:14:00.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.122+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9015cf10 con 0x7f7c900caed0 2024-03-23T06:14:00.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.131+0000 7f7c8f400640 1 -- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c900ced20 msgr2=0x7f7c90158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:00.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.131+0000 7f7c8f400640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c900ced20 0x7f7c90158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.131+0000 7f7c8f400640 1 -- 172.21.15.73:0/812074798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 msgr2=0x7f7c9015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:00.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.132+0000 7f7c8f400640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 0x7f7c9015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.132+0000 7f7c8f400640 1 -- 172.21.15.73:0/812074798 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c800094d0 con 0x7f7c900caed0 2024-03-23T06:14:00.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.132+0000 7f7c8fe00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 0x7f7c9015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:14:00.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.133+0000 7f7c8f400640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c901ef440 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00b480 tx=0x7f7c7c00b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.134+0000 7f7c87400640 1 -- 172.21.15.73:0/812074798 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c010870 con 0x7f7c900caed0 2024-03-23T06:14:00.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.135+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c900ce050 con 0x7f7c900caed0 2024-03-23T06:14:00.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.135+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9015d440 con 0x7f7c900caed0 2024-03-23T06:14:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.136+0000 7f7c87400640 1 -- 172.21.15.73:0/812074798 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c0109f0 con 0x7f7c900caed0 2024-03-23T06:14:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.136+0000 7f7c87400640 1 -- 172.21.15.73:0/812074798 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c010da0 con 0x7f7c900caed0 2024-03-23T06:14:00.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.138+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9004e030 con 0x7f7c900caed0 2024-03-23T06:14:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.145+0000 7f7c87400640 1 -- 172.21.15.73:0/812074798 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7c7c019450 con 0x7f7c900caed0 2024-03-23T06:14:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.146+0000 7f7c87400640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7c7006acd0 0x7f7c7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:00.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.146+0000 7f7c87400640 1 -- 172.21.15.73:0/812074798 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f7c7c0898f0 con 0x7f7c900caed0 2024-03-23T06:14:00.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.149+0000 7f7c8ea00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7c7006acd0 0x7f7c7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:00.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.155+0000 7f7c8ea00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7c7006acd0 0x7f7c7006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c80036000 tx=0x7f7c8003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:00.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.155+0000 7f7c87400640 1 -- 172.21.15.73:0/812074798 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7c7c054880 con 0x7f7c900caed0 2024-03-23T06:14:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.623+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7c90071860 con 0x7f7c900caed0 2024-03-23T06:14:00.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.624+0000 7f7c87400640 1 -- 172.21.15.73:0/812074798 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f7c7c014620 con 0x7f7c900caed0 2024-03-23T06:14:00.624 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.637+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7c7006acd0 msgr2=0x7f7c7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.637+0000 7f7c94e00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7c7006acd0 0x7f7c7006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c80036000 tx=0x7f7c8003b040 comp rx=0 tx=0).stop 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.637+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 msgr2=0x7f7c901ef440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.637+0000 7f7c94e00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c901ef440 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00b480 tx=0x7f7c7c00b940 comp rx=0 tx=0).stop 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.638+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 shutdown_connections 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.638+0000 7f7c94e00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c900cf100 0x7f7c9015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.638+0000 7f7c94e00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c900ced20 0x7f7c90158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.638+0000 7f7c94e00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f7c7006acd0 0x7f7c7006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.638+0000 7f7c94e00640 1 --2- 172.21.15.73:0/812074798 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c900caed0 0x7f7c901ef440 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.638+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 >> 172.21.15.73:0/812074798 conn(0x7f7c900713e0 msgr2=0x7f7c90152190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.638+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 shutdown_connections 2024-03-23T06:14:00.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:00.638+0000 7f7c94e00640 1 -- 172.21.15.73:0/812074798 wait complete. 2024-03-23T06:14:00.691 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:14:00.691 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:14:00.692 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:14:00.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:14:01.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.076+0000 7f5a77a00640 1 Processor -- start 2024-03-23T06:14:01.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.076+0000 7f5a77a00640 1 -- start start 2024-03-23T06:14:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.077+0000 7f5a77a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a70157b70 0x7f5a700c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.077+0000 7f5a77a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700c94d0 con 0x7f5a7015e340 2024-03-23T06:14:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.077+0000 7f5a77a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700c9850 con 0x7f5a700caa20 2024-03-23T06:14:01.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.077+0000 7f5a77a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a700c76f0 con 0x7f5a70157b70 2024-03-23T06:14:01.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.078+0000 7f5a6fe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5a7015e340 0x7f5a700c7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45156/0 (socket says 172.21.15.73:45156) 2024-03-23T06:14:01.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.078+0000 7f5a75a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5a700caa20 0x7f5a70168240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:43718/0 (socket says 172.21.15.73:43718) 2024-03-23T06:14:01.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.078+0000 7f5a6fe00640 1 -- 172.21.15.73:0/638630513 learned_addr learned my addr 172.21.15.73:0/638630513 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:14:01.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.078+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906294988 0 0) 0x7f5a700c9850 con 0x7f5a700caa20 2024-03-23T06:14:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.078+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a54003520 con 0x7f5a700caa20 2024-03-23T06:14:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.079+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2329334373 0 0) 0x7f5a54003520 con 0x7f5a700caa20 2024-03-23T06:14:01.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.079+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 >> v2:172.21.15.73:3300/0 conn(0x7f5a70157b70 msgr2=0x7f5a700c5b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a75000640 1 --2- 172.21.15.73:0/638630513 >> v2:172.21.15.73:3300/0 conn(0x7f5a70157b70 0x7f5a700c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 --2- 172.21.15.73:0/638630513 >> v2:172.21.15.73:3300/0 conn(0x7f5a70157b70 0x7f5a700c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 >> v1:172.21.15.73:6789/0 conn(0x7f5a7015e340 legacy=0x7f5a700c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700c9c30 con 0x7f5a700caa20 2024-03-23T06:14:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f5a5c001650 con 0x7f5a700caa20 2024-03-23T06:14:01.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 >> v1:172.21.15.110:6789/0 conn(0x7f5a700caa20 legacy=0x7f5a70168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a54003970 0x7f5a54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a540047c0 0x7f5a54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a540052a0 0x7f5a5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c76f0 con 0x7f5a540047c0 2024-03-23T06:14:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5400c160 con 0x7f5a540052a0 2024-03-23T06:14:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.080+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5400c320 con 0x7f5a54003970 2024-03-23T06:14:01.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.081+0000 7f5a75a00640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a540052a0 0x7f5a5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.081+0000 7f5a6fe00640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a540047c0 0x7f5a54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.081+0000 7f5a75000640 1 --2- 172.21.15.73:0/638630513 >> v2:172.21.15.73:3300/0 conn(0x7f5a70157b70 0x7f5a700c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:14:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.082+0000 7f5a6fe00640 1 -- 172.21.15.73:0/638630513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a54003970 msgr2=0x7f5a54003d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:14:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.082+0000 7f5a6fe00640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a54003970 0x7f5a54003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.082+0000 7f5a6fe00640 1 -- 172.21.15.73:0/638630513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a540052a0 msgr2=0x7f5a5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:14:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.082+0000 7f5a6fe00640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a540052a0 0x7f5a5400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.082+0000 7f5a6fe00640 1 -- 172.21.15.73:0/638630513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a54003520 con 0x7f5a540047c0 2024-03-23T06:14:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.082+0000 7f5a75a00640 1 -- 172.21.15.73:0/638630513 reap_dead start 2024-03-23T06:14:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.083+0000 7f5a6fe00640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a540047c0 0x7f5a54004c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5a600019d0 tx=0x7f5a540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b1e12813a33ba1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.084+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600058d0 con 0x7f5a540047c0 2024-03-23T06:14:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.084+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60005a30 con 0x7f5a540047c0 2024-03-23T06:14:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.084+0000 7f5a6f400640 1 -- 172.21.15.73:0/638630513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60005e20 con 0x7f5a540047c0 2024-03-23T06:14:01.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.085+0000 7f5a77a00640 1 -- 172.21.15.73:0/638630513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a540047c0 msgr2=0x7f5a54004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.085+0000 7f5a77a00640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a540047c0 0x7f5a54004c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5a600019d0 tx=0x7f5a540057f0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.088+0000 7f5a77a00640 1 -- 172.21.15.73:0/638630513 shutdown_connections 2024-03-23T06:14:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.088+0000 7f5a77a00640 1 --2- 172.21.15.73:0/638630513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a540047c0 0x7f5a54004c40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.088+0000 7f5a77a00640 1 -- 172.21.15.73:0/638630513 >> 172.21.15.73:0/638630513 conn(0x7f5a70069cb0 msgr2=0x7f5a7006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:01.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.089+0000 7f5a77a00640 1 -- 172.21.15.73:0/638630513 shutdown_connections 2024-03-23T06:14:01.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.089+0000 7f5a77a00640 1 -- 172.21.15.73:0/638630513 wait complete. 2024-03-23T06:14:01.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.096+0000 7f5a77a00640 1 Processor -- start 2024-03-23T06:14:01.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.097+0000 7f5a77a00640 1 -- start start 2024-03-23T06:14:01.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.102+0000 7f5a77a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a540047c0 0x7f5a701f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.103+0000 7f5a77a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a700c4be0 0x7f5a701f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.103+0000 7f5a77a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70152b50 0x7f5a700c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.105+0000 7f5a77a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70151fb0 con 0x7f5a70152b50 2024-03-23T06:14:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.106+0000 7f5a75000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a540047c0 0x7f5a701f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.106+0000 7f5a6fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a700c4be0 0x7f5a701f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.106+0000 7f5a75a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70152b50 0x7f5a700c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.106+0000 7f5a75a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70152b50 0x7f5a700c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36096/0 (socket says 172.21.15.73:36096) 2024-03-23T06:14:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.106+0000 7f5a75a00640 1 -- 172.21.15.73:0/2603077325 learned_addr learned my addr 172.21.15.73:0/2603077325 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.106+0000 7f5a75000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a540047c0 0x7f5a701f6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60110/0 (socket says 172.21.15.73:60110) 2024-03-23T06:14:01.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.106+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701f74d0 con 0x7f5a700c4be0 2024-03-23T06:14:01.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.106+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a701f3fd0 con 0x7f5a540047c0 2024-03-23T06:14:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.109+0000 7f5a75a00640 1 -- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a540047c0 msgr2=0x7f5a701f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.109+0000 7f5a75a00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a540047c0 0x7f5a701f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.109+0000 7f5a75a00640 1 -- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a700c4be0 msgr2=0x7f5a701f3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.109+0000 7f5a75a00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a700c4be0 0x7f5a701f3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.109+0000 7f5a75a00640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a701f3010 con 0x7f5a70152b50 2024-03-23T06:14:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.112+0000 7f5a75a00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70152b50 0x7f5a700c6ac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5a7015e720 tx=0x7f5a5c00e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.113+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c010450 con 0x7f5a70152b50 2024-03-23T06:14:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.113+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c0105b0 con 0x7f5a70152b50 2024-03-23T06:14:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.113+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c010960 con 0x7f5a70152b50 2024-03-23T06:14:01.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.113+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7015a670 con 0x7f5a70152b50 2024-03-23T06:14:01.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.117+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7015abf0 con 0x7f5a70152b50 2024-03-23T06:14:01.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.124+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5a5c010ac0 con 0x7f5a70152b50 2024-03-23T06:14:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.124+0000 7f5a77a00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a701f31a0 0x7f5a70159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.124+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a70073bf0 con 0x7f5a701f31a0 2024-03-23T06:14:01.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.130+0000 7f5a75000640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a701f31a0 0x7f5a70159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.130+0000 7f5a6cc00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a5006ac80 0x7f5a5006d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.131+0000 7f5a75000640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a700c9ed0 con 0x7f5a701f31a0 2024-03-23T06:14:01.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.132+0000 7f5a75000640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a701f31a0 0x7f5a70159130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5a7006f200 tx=0x7f5a6800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.135+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5a5c0888a0 con 0x7f5a70152b50 2024-03-23T06:14:01.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.135+0000 7f5a6fe00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a5006ac80 0x7f5a5006d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.138+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68012070 con 0x7f5a701f31a0 2024-03-23T06:14:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.138+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5a68003990 con 0x7f5a701f31a0 2024-03-23T06:14:01.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.138+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a701f31a0 msgr2=0x7f5a70159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.143+0000 7f5a6cc00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a701f31a0 0x7f5a70159130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5a7006f200 tx=0x7f5a6800c8b0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.143+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a701f31a0 msgr2=0x7f5a70159130 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.143+0000 7f5a6cc00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a701f31a0 0x7f5a70159130 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5a7006f200 tx=0x7f5a6800c8b0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.144+0000 7f5a6fe00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a5006ac80 0x7f5a5006d140 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a60033000 tx=0x7f5a60009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.161+0000 7f5a77a00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70159670 0x7f5a70159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.161+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c8f50 con 0x7f5a70159670 2024-03-23T06:14:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.163+0000 7f5a75000640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70159670 0x7f5a70159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.164+0000 7f5a75000640 1 -- 172.21.15.73:0/2603077325 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5a700c91f0 con 0x7f5a70159670 2024-03-23T06:14:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.165+0000 7f5a75000640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70159670 0x7f5a70159a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a68016000 tx=0x7f5a68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.165+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6801b070 con 0x7f5a70159670 2024-03-23T06:14:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.166+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7f5a68004230 con 0x7f5a70159670 2024-03-23T06:14:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.166+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70159670 msgr2=0x7f5a70159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.166+0000 7f5a6cc00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70159670 0x7f5a70159a80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a68016000 tx=0x7f5a68004a40 comp rx=0 tx=0).stop 2024-03-23T06:14:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.166+0000 7f5a6cc00640 1 -- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70159670 msgr2=0x7f5a70159a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.166+0000 7f5a6cc00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70159670 0x7f5a70159a80 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a68016000 tx=0x7f5a68004a40 comp rx=0 tx=0).stop 2024-03-23T06:14:01.167 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:14:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:14:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:14:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 44, 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 14, 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:14:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:14:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:14:01.178 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:14:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.168+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a5006ac80 msgr2=0x7f5a5006d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.168+0000 7f5a77a00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a5006ac80 0x7f5a5006d140 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a60033000 tx=0x7f5a60009030 comp rx=0 tx=0).stop 2024-03-23T06:14:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.168+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70152b50 msgr2=0x7f5a700c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.168+0000 7f5a77a00640 1 --2- 172.21.15.73:0/2603077325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a70152b50 0x7f5a700c6ac0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5a7015e720 tx=0x7f5a5c00e880 comp rx=0 tx=0).stop 2024-03-23T06:14:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.168+0000 7f5a75a00640 1 -- 172.21.15.73:0/2603077325 reap_dead start 2024-03-23T06:14:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.168+0000 7f5a75a00640 1 -- 172.21.15.73:0/2603077325 reap_dead start 2024-03-23T06:14:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.169+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 shutdown_connections 2024-03-23T06:14:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.169+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 >> 172.21.15.73:0/2603077325 conn(0x7f5a70069cb0 msgr2=0x7f5a7015d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.171+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 shutdown_connections 2024-03-23T06:14:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.171+0000 7f5a77a00640 1 -- 172.21.15.73:0/2603077325 wait complete. 2024-03-23T06:14:01.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:14:01.201 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:14:01.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:14:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.518+0000 7f99fa400640 1 Processor -- start 2024-03-23T06:14:01.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.518+0000 7f99fa400640 1 -- start start 2024-03-23T06:14:01.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99fa400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99f4153760 0x7f99f4159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99fa400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f99f40c9740 0x7f99f40cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99fa400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f40cbd10 0x7f99f40ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99fa400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f406a2d0 con 0x7f99f40c9740 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99fa400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f406a5b0 con 0x7f99f4153760 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99fa400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f406a890 con 0x7f99f40cbd10 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99f3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f40cbd10 0x7f99f40ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99f3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f40cbd10 0x7f99f40ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60122/0 (socket says 172.21.15.73:60122) 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.520+0000 7f99f3e00640 1 -- 172.21.15.73:0/3189038507 learned_addr learned my addr 172.21.15.73:0/3189038507 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.521+0000 7f99f2a00640 1 --2- 172.21.15.73:0/3189038507 >> v2:172.21.15.73:3300/0 conn(0x7f99f40c9740 0x7f99f40cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.521+0000 7f99f3e00640 1 -- 172.21.15.73:0/3189038507 >> v2:172.21.15.110:3300/0 conn(0x7f99f4153760 msgr2=0x7f99f4159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.521+0000 7f99f3400640 1 --2- 172.21.15.73:0/3189038507 >> v2:172.21.15.110:3300/0 conn(0x7f99f4153760 0x7f99f4159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.521+0000 7f99f3e00640 1 --2- 172.21.15.73:0/3189038507 >> v2:172.21.15.110:3300/0 conn(0x7f99f4153760 0x7f99f4159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.521+0000 7f99f3e00640 1 -- 172.21.15.73:0/3189038507 >> v2:172.21.15.73:3300/0 conn(0x7f99f40c9740 msgr2=0x7f99f40cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.521+0000 7f99f3e00640 1 --2- 172.21.15.73:0/3189038507 >> v2:172.21.15.73:3300/0 conn(0x7f99f40c9740 0x7f99f40cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.521+0000 7f99f3e00640 1 -- 172.21.15.73:0/3189038507 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f406ab70 con 0x7f99f40cbd10 2024-03-23T06:14:01.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.521+0000 7f99f3400640 1 --2- 172.21.15.73:0/3189038507 >> v2:172.21.15.110:3300/0 conn(0x7f99f4153760 0x7f99f4159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:14:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.523+0000 7f99f3e00640 1 --2- 172.21.15.73:0/3189038507 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f40cbd10 0x7f99f40ca940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f99f40cfe30 tx=0x7f99ec034a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452e2e90212e732f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.524+0000 7f99f2000640 1 -- 172.21.15.73:0/3189038507 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0114e0 con 0x7f99f40cbd10 2024-03-23T06:14:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.524+0000 7f99f2000640 1 -- 172.21.15.73:0/3189038507 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec011640 con 0x7f99f40cbd10 2024-03-23T06:14:01.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.524+0000 7f99f2000640 1 -- 172.21.15.73:0/3189038507 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0119d0 con 0x7f99f40cbd10 2024-03-23T06:14:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 -- 172.21.15.73:0/3189038507 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f40cbd10 msgr2=0x7f99f40ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 --2- 172.21.15.73:0/3189038507 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f40cbd10 0x7f99f40ca940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f99f40cfe30 tx=0x7f99ec034a00 comp rx=0 tx=0).stop 2024-03-23T06:14:01.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 -- 172.21.15.73:0/3189038507 shutdown_connections 2024-03-23T06:14:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 --2- 172.21.15.73:0/3189038507 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f40cbd10 0x7f99f40ca940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 --2- 172.21.15.73:0/3189038507 >> v2:172.21.15.73:3300/0 conn(0x7f99f40c9740 0x7f99f40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 --2- 172.21.15.73:0/3189038507 >> v2:172.21.15.110:3300/0 conn(0x7f99f4153760 0x7f99f4159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 -- 172.21.15.73:0/3189038507 >> 172.21.15.73:0/3189038507 conn(0x7f99f406c310 msgr2=0x7f99f40713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 -- 172.21.15.73:0/3189038507 shutdown_connections 2024-03-23T06:14:01.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.527+0000 7f99fa400640 1 -- 172.21.15.73:0/3189038507 wait complete. 2024-03-23T06:14:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.529+0000 7f99fa400640 1 Processor -- start 2024-03-23T06:14:01.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.529+0000 7f99fa400640 1 -- start start 2024-03-23T06:14:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.530+0000 7f99fa400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f40c9740 0x7f99f41eaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.530+0000 7f99fa400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40cbd10 0x7f99f4148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.530+0000 7f99fa400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f4153760 0x7f99f4158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.530+0000 7f99fa400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4157660 con 0x7f99f40c9740 2024-03-23T06:14:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.530+0000 7f99fa400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4149900 con 0x7f99f40cbd10 2024-03-23T06:14:01.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.530+0000 7f99fa400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40ccea0 con 0x7f99f4153760 2024-03-23T06:14:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.531+0000 7f99f3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f40c9740 0x7f99f41eaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.531+0000 7f99f3400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f40c9740 0x7f99f41eaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36142/0 (socket says 172.21.15.73:36142) 2024-03-23T06:14:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.531+0000 7f99f3400640 1 -- 172.21.15.73:0/1136577523 learned_addr learned my addr 172.21.15.73:0/1136577523 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.531+0000 7f99f2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40cbd10 0x7f99f4148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.532+0000 7f99f3e00640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f4153760 0x7f99f4158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.532+0000 7f99f3400640 1 -- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f4153760 msgr2=0x7f99f4158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.532+0000 7f99f3400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f4153760 0x7f99f4158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.532+0000 7f99f3400640 1 -- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40cbd10 msgr2=0x7f99f4148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.532+0000 7f99f3400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40cbd10 0x7f99f4148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.532+0000 7f99f3400640 1 -- 172.21.15.73:0/1136577523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec014660 con 0x7f99f40c9740 2024-03-23T06:14:01.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.534+0000 7f99f2a00640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40cbd10 0x7f99f4148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:14:01.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.535+0000 7f99f3400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f40c9740 0x7f99f41eaae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c770 tx=0x7f99e400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.536+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4007820 con 0x7f99f40c9740 2024-03-23T06:14:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.536+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e4007980 con 0x7f99f40c9740 2024-03-23T06:14:01.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.536+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4007cf0 con 0x7f99f40c9740 2024-03-23T06:14:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.539+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f41edac0 con 0x7f99f40c9740 2024-03-23T06:14:01.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.539+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f41ee080 con 0x7f99f40c9740 2024-03-23T06:14:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.540+0000 7f99fa400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f41ee3c0 0x7f99f41593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.540+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4072510 con 0x7f99f41ee3c0 2024-03-23T06:14:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.544+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f99e40113f0 con 0x7f99f40c9740 2024-03-23T06:14:01.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.544+0000 7f99f2a00640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f41ee3c0 0x7f99f41593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.545+0000 7f99eb400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99d406ac50 0x7f99d406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.545+0000 7f99f2a00640 1 -- 172.21.15.73:0/1136577523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99f40c9b80 con 0x7f99f41ee3c0 2024-03-23T06:14:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.545+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f99e40896c0 con 0x7f99f40c9740 2024-03-23T06:14:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.545+0000 7f99f2a00640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f41ee3c0 0x7f99f41593d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99f4148910 tx=0x7f99e000d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.545+0000 7f99f3e00640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99d406ac50 0x7f99d406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.546+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0012870 con 0x7f99f41ee3c0 2024-03-23T06:14:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.550+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f99e000c040 con 0x7f99f41ee3c0 2024-03-23T06:14:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.550+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f41ee3c0 msgr2=0x7f99f41593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.550+0000 7f99eb400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f41ee3c0 0x7f99f41593d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99f4148910 tx=0x7f99e000d9e0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.550+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f41ee3c0 msgr2=0x7f99f41593d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.550+0000 7f99eb400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f41ee3c0 0x7f99f41593d0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99f4148910 tx=0x7f99e000d9e0 comp rx=0 tx=0).stop 2024-03-23T06:14:01.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.552+0000 7f99f3e00640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99d406ac50 0x7f99d406d110 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f99ec03e000 tx=0x7f99ec043040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.564+0000 7f99fa400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40ce6e0 0x7f99f40cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:01.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.564+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40cd010 con 0x7f99f40ce6e0 2024-03-23T06:14:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.569+0000 7f99f2a00640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40ce6e0 0x7f99f40cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.569+0000 7f99f2a00640 1 -- 172.21.15.73:0/1136577523 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f99f4153b40 con 0x7f99f40ce6e0 2024-03-23T06:14:01.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.571+0000 7f99f2a00640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40ce6e0 0x7f99f40cd330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99f4148910 tx=0x7f99e0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:01.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.572+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0020040 con 0x7f99f40ce6e0 2024-03-23T06:14:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.573+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4949 (secure 0 0 0) 0x7f99e00113c0 con 0x7f99f40ce6e0 2024-03-23T06:14:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.573+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40ce6e0 msgr2=0x7f99f40cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.573+0000 7f99eb400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40ce6e0 0x7f99f40cd330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99f4148910 tx=0x7f99e0004730 comp rx=0 tx=0).stop 2024-03-23T06:14:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.573+0000 7f99eb400640 1 -- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40ce6e0 msgr2=0x7f99f40cd330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:01.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.573+0000 7f99eb400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f40ce6e0 0x7f99f40cd330 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99f4148910 tx=0x7f99e0004730 comp rx=0 tx=0).stop 2024-03-23T06:14:01.573 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:14:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:14:01.573 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 44, 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 14, 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:01.574 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:01.575 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:14:01.576 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.577 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:01.578 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:01.579 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:01.580 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:01.582 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.583 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:14:01.584 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:14:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.574+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99d406ac50 msgr2=0x7f99d406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.574+0000 7f99fa400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99d406ac50 0x7f99d406d110 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f99ec03e000 tx=0x7f99ec043040 comp rx=0 tx=0).stop 2024-03-23T06:14:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.574+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f40c9740 msgr2=0x7f99f41eaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.574+0000 7f99fa400640 1 --2- 172.21.15.73:0/1136577523 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99f40c9740 0x7f99f41eaae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c770 tx=0x7f99e400cc30 comp rx=0 tx=0).stop 2024-03-23T06:14:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.574+0000 7f99f3e00640 1 -- 172.21.15.73:0/1136577523 reap_dead start 2024-03-23T06:14:01.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.574+0000 7f99f3e00640 1 -- 172.21.15.73:0/1136577523 reap_dead start 2024-03-23T06:14:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.575+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 shutdown_connections 2024-03-23T06:14:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.575+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 >> 172.21.15.73:0/1136577523 conn(0x7f99f406c310 msgr2=0x7f99f414d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.575+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 shutdown_connections 2024-03-23T06:14:01.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:01.575+0000 7f99fa400640 1 -- 172.21.15.73:0/1136577523 wait complete. 2024-03-23T06:14:01.612 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:14:01.612 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:14:01.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:14:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.004+0000 7fbdd7e00640 1 Processor -- start 2024-03-23T06:14:02.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.005+0000 7fbdd7e00640 1 -- start start 2024-03-23T06:14:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.007+0000 7fbdd7e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbdd00cba40 0x7fbdd00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.008+0000 7fbdd7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbdd00cbe20 0x7fbdd00ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.008+0000 7fbdd7e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd00ca7d0 con 0x7fbdd0157870 2024-03-23T06:14:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.008+0000 7fbdd7e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd00c9c80 con 0x7fbdd00cba40 2024-03-23T06:14:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.008+0000 7fbdd7e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd015e700 con 0x7fbdd00cbe20 2024-03-23T06:14:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.009+0000 7fbdd5e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbdd0157870 0x7fbdd006a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:43724/0 (socket says 172.21.15.73:43724) 2024-03-23T06:14:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.009+0000 7fbdd5e00640 1 -- 172.21.15.73:0/2903076035 learned_addr learned my addr 172.21.15.73:0/2903076035 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:14:02.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.009+0000 7fbdd4a00640 1 --2- 172.21.15.73:0/2903076035 >> v2:172.21.15.110:3300/0 conn(0x7fbdd00cbe20 0x7fbdd00ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:02.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.009+0000 7fbdd5400640 1 --2- 172.21.15.73:0/2903076035 >> v2:172.21.15.73:3300/0 conn(0x7fbdd00cba40 0x7fbdd00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:02.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.013+0000 7fbdd5400640 1 -- 172.21.15.73:0/2903076035 >> v2:172.21.15.110:3300/0 conn(0x7fbdd00cbe20 msgr2=0x7fbdd00ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:14:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.013+0000 7fbdd5400640 1 --2- 172.21.15.73:0/2903076035 >> v2:172.21.15.110:3300/0 conn(0x7fbdd00cbe20 0x7fbdd00ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.013+0000 7fbdcfe00640 1 -- 172.21.15.73:0/2903076035 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309028272 0 0) 0x7fbdc8001490 con 0x7fbdd0157870 2024-03-23T06:14:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.013+0000 7fbdd5400640 1 -- 172.21.15.73:0/2903076035 >> v1:172.21.15.110:6789/0 conn(0x7fbdd0157870 legacy=0x7fbdd006a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:02.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.013+0000 7fbdd5400640 1 -- 172.21.15.73:0/2903076035 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00c9e60 con 0x7fbdd00cba40 2024-03-23T06:14:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.016+0000 7fbdd5400640 1 --2- 172.21.15.73:0/2903076035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd00cba40 0x7fbdd00c9740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0071e10 tx=0x7fbdc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70f36d2f3773f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.017+0000 7fbdcfe00640 1 -- 172.21.15.73:0/2903076035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4031830 con 0x7fbdd00cba40 2024-03-23T06:14:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.017+0000 7fbdcfe00640 1 -- 172.21.15.73:0/2903076035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc4031990 con 0x7fbdd00cba40 2024-03-23T06:14:02.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.018+0000 7fbdcfe00640 1 -- 172.21.15.73:0/2903076035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4031830 con 0x7fbdd00cba40 2024-03-23T06:14:02.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.019+0000 7fbdd7e00640 1 -- 172.21.15.73:0/2903076035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd00cba40 msgr2=0x7fbdd00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:02.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.019+0000 7fbdd7e00640 1 --2- 172.21.15.73:0/2903076035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd00cba40 0x7fbdd00c9740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0071e10 tx=0x7fbdc402b8d0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.023+0000 7fbdd7e00640 1 -- 172.21.15.73:0/2903076035 shutdown_connections 2024-03-23T06:14:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.023+0000 7fbdd7e00640 1 --2- 172.21.15.73:0/2903076035 >> v2:172.21.15.110:3300/0 conn(0x7fbdd00cbe20 0x7fbdd00ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.023+0000 7fbdd7e00640 1 --2- 172.21.15.73:0/2903076035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd00cba40 0x7fbdd00c9740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.023+0000 7fbdd7e00640 1 -- 172.21.15.73:0/2903076035 >> 172.21.15.73:0/2903076035 conn(0x7fbdd006c310 msgr2=0x7fbdd00713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:02.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.024+0000 7fbdd7e00640 1 -- 172.21.15.73:0/2903076035 shutdown_connections 2024-03-23T06:14:02.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.024+0000 7fbdd7e00640 1 -- 172.21.15.73:0/2903076035 wait complete. 2024-03-23T06:14:02.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.030+0000 7fbdd7e00640 1 Processor -- start 2024-03-23T06:14:02.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.037+0000 7fbdd7e00640 1 -- start start 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.045+0000 7fbdd7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cba40 0x7fbdd01f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.046+0000 7fbdd7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd00cbe20 0x7fbdd01f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.046+0000 7fbdd7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd0157870 0x7fbdd00cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.046+0000 7fbdd5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cba40 0x7fbdd01f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.046+0000 7fbdd7e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd01f7430 con 0x7fbdd0157870 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.046+0000 7fbdd7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd014d0d0 con 0x7fbdd00cbe20 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.046+0000 7fbdd7e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd015b7c0 con 0x7fbdd00cba40 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.046+0000 7fbdd5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cba40 0x7fbdd01f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:60140/0 (socket says 172.21.15.73:60140) 2024-03-23T06:14:02.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.046+0000 7fbdd5400640 1 -- 172.21.15.73:0/3207518738 learned_addr learned my addr 172.21.15.73:0/3207518738 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:02.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.047+0000 7fbdd5e00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd0157870 0x7fbdd00cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.048+0000 7fbdd4a00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd00cbe20 0x7fbdd01f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.050+0000 7fbdd5400640 1 -- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd00cbe20 msgr2=0x7fbdd01f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.050+0000 7fbdd5400640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdd00cbe20 0x7fbdd01f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.050+0000 7fbdd5400640 1 -- 172.21.15.73:0/3207518738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd0157870 msgr2=0x7fbdd00cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.050+0000 7fbdd5400640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd0157870 0x7fbdd00cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.050+0000 7fbdd5400640 1 -- 172.21.15.73:0/3207518738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4009400 con 0x7fbdd00cba40 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.052+0000 7fbdd5e00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbdd0157870 0x7fbdd00cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.052+0000 7fbdd5400640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cba40 0x7fbdd01f6ef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009890 tx=0x7fbdc40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.052+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40042d0 con 0x7fbdd00cba40 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.053+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd014c310 con 0x7fbdd00cba40 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.053+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd014c8d0 con 0x7fbdd00cba40 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.053+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc4004430 con 0x7fbdd00cba40 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.053+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc4003810 con 0x7fbdd00cba40 2024-03-23T06:14:02.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.054+0000 7fbdd7e00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd01f34b0 0x7fbdd0153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.054+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd0072510 con 0x7fbdd01f34b0 2024-03-23T06:14:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.055+0000 7fbdd4a00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd01f34b0 0x7fbdd0153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.057+0000 7fbdd4a00640 1 -- 172.21.15.73:0/3207518738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbdd015e0b0 con 0x7fbdd01f34b0 2024-03-23T06:14:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.062+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbdc4003970 con 0x7fbdd00cba40 2024-03-23T06:14:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.063+0000 7fbdcd600640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbdb006ac00 0x7fbdb006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.063+0000 7fbdd5e00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbdb006ac00 0x7fbdb006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.064+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fbdc40ab450 con 0x7fbdd00cba40 2024-03-23T06:14:02.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.064+0000 7fbdd5e00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbdb006ac00 0x7fbdb006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80012e0 tx=0x7fbdc8005b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.065+0000 7fbdd4a00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd01f34b0 0x7fbdd0153ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbdd01574a0 tx=0x7fbdbc033d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.066+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004300 con 0x7fbdd01f34b0 2024-03-23T06:14:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.066+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fbdbc004460 con 0x7fbdd01f34b0 2024-03-23T06:14:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.066+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd01f34b0 msgr2=0x7fbdd0153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.066+0000 7fbdcd600640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd01f34b0 0x7fbdd0153ae0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbdd01574a0 tx=0x7fbdbc033d50 comp rx=0 tx=0).stop 2024-03-23T06:14:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.066+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd01f34b0 msgr2=0x7fbdd0153ae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:02.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.066+0000 7fbdcd600640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd01f34b0 0x7fbdd0153ae0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbdd01574a0 tx=0x7fbdbc033d50 comp rx=0 tx=0).stop 2024-03-23T06:14:02.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.082+0000 7fbdd7e00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cf950 0x7fbdd0154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:02.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.082+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd015ddd0 con 0x7fbdd00cf950 2024-03-23T06:14:02.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.084+0000 7fbdd4a00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cf950 0x7fbdd0154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:02.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.091+0000 7fbdd4a00640 1 -- 172.21.15.73:0/3207518738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbdd015e390 con 0x7fbdd00cf950 2024-03-23T06:14:02.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.091+0000 7fbdd4a00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cf950 0x7fbdd0154020 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbdd01574a0 tx=0x7fbdbc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:02.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.091+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc04e070 con 0x7fbdd00cf950 2024-03-23T06:14:02.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.091+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7fbdbc046040 con 0x7fbdd00cf950 2024-03-23T06:14:02.095 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 44, 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 15, 2024-03-23T06:14:02.096 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:02.097 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:02.098 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:02.099 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:02.100 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:14:02.101 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:02.102 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:14:02.103 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:02.104 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:02.105 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.106 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.107 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:02.108 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:14:02.110 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:14:02.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.091+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cf950 msgr2=0x7fbdd0154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.091+0000 7fbdcd600640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cf950 0x7fbdd0154020 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbdd01574a0 tx=0x7fbdbc0046c0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdcd600640 1 -- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cf950 msgr2=0x7fbdd0154020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdcd600640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cf950 0x7fbdd0154020 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbdb006ac00 msgr2=0x7fbdb006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdd7e00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbdb006ac00 0x7fbdb006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbdc80012e0 tx=0x7fbdc8005b70 comp rx=0 tx=0).stop 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cba40 msgr2=0x7fbdd01f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdd7e00640 1 --2- 172.21.15.73:0/3207518738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdd00cba40 0x7fbdd01f6ef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009890 tx=0x7fbdc40046c0 comp rx=0 tx=0).stop 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdd5e00640 1 -- 172.21.15.73:0/3207518738 reap_dead start 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdd5e00640 1 -- 172.21.15.73:0/3207518738 reap_dead start 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 shutdown_connections 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.097+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 >> 172.21.15.73:0/3207518738 conn(0x7fbdd006c310 msgr2=0x7fbdd00ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.099+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 shutdown_connections 2024-03-23T06:14:02.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:02.099+0000 7fbdd7e00640 1 -- 172.21.15.73:0/3207518738 wait complete. 2024-03-23T06:14:02.154 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:14:02.154 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T06:14:02.155 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-03-23T06:14:02.155 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T06:14:02.155 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T06:14:02.155 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T06:14:02.155 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:14:02.179 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T06:14:02.179 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-03-23T06:14:02.179 INFO:tasks.ceph.mon.a:Sent signal 19 2024-03-23T06:14:02.179 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T06:14:17.180 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-03-23T06:14:17.181 INFO:tasks.ceph.mon.a:Sent signal 18 2024-03-23T06:14:17.181 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:14:17.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:14:17.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.409+0000 7ffbcce00640 1 Processor -- start 2024-03-23T06:14:17.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.410+0000 7ffbcce00640 1 -- start start 2024-03-23T06:14:17.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbcce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:17.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbcce00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc8160ec0 con 0x7ffbc8161bf0 2024-03-23T06:14:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbcce00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc8157d90 con 0x7ffbc81579b0 2024-03-23T06:14:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbcce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80c7370 con 0x7ffbc80c66f0 2024-03-23T06:14:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbc5e00640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7ffbc81579b0 legacy=0x7ffbc80c0450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:14:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbc6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbc6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:33008/0 (socket says 172.21.15.73:33008) 2024-03-23T06:14:17.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 learned_addr learned my addr 172.21.15.73:0/3249262218 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:17.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:14:17.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:14:17.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:14:17.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.412+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:14:17.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.614+0000 7ffbc5e00640 1 -- 172.21.15.73:0/3249262218 >> v1:172.21.15.110:6789/0 conn(0x7ffbc81579b0 legacy=0x7ffbc80c0450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:14:17.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.615+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:17.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.615+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:14:17.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.615+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:14:17.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.615+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:14:17.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:17.615+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:14:18.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.015+0000 7ffbc5e00640 1 -- 172.21.15.73:0/3249262218 >> v1:172.21.15.110:6789/0 conn(0x7ffbc81579b0 legacy=0x7ffbc80c0450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:14:18.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.016+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:18.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.016+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:14:18.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.016+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:14:18.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.016+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:14:18.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.016+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:14:18.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.816+0000 7ffbc5e00640 1 -- 172.21.15.73:0/3249262218 >> v1:172.21.15.110:6789/0 conn(0x7ffbc81579b0 legacy=0x7ffbc80c0450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:14:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.819+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.820+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:14:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.820+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:14:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.820+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:14:18.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:18.820+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:14:20.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 msgr2=0x7ffbc80c5970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:20.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.411+0000 7ffbbf400640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc80c66f0 0x7ffbc80c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:20.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 >> v1:172.21.15.110:6789/0 conn(0x7ffbc81579b0 legacy=0x7ffbc80c0450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:20.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 >> v1:172.21.15.73:6789/0 conn(0x7ffbc8161bf0 legacy=0x7ffbc815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:20.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.411+0000 7ffbbf400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 0x7ffba8005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:20.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.411+0000 7ffbbf400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:20.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80c7370 con 0x7ffba80061c0 2024-03-23T06:14:20.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba8008d40 con 0x7ffba80036f0 2024-03-23T06:14:20.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.412+0000 7ffbc5e00640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 msgr2=0x7ffba8005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:20.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.412+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 0x7ffba8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:14:20.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.414+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:20.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.415+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:14:20.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.415+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:14:20.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.415+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:14:20.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.415+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:14:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.613+0000 7ffbc5e00640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 msgr2=0x7ffba8005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.613+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 0x7ffba8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:14:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.618+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.619+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:14:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.619+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:14:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.619+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:14:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:20.619+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:14:21.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.014+0000 7ffbc5e00640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 msgr2=0x7ffba8005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:21.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.014+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 0x7ffba8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:14:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.020+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.020+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:14:21.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.020+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:14:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.020+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:14:21.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.021+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:14:21.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.815+0000 7ffbc5e00640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 msgr2=0x7ffba8005b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:21.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.815+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 0x7ffba8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:14:21.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.822+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:21.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.823+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:14:21.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.823+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:14:21.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.823+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:14:21.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:21.823+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:14:23.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 msgr2=0x7ffba8005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:23.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.411+0000 7ffbbf400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba80036f0 0x7ffba8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 msgr2=0x7ffba8008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:23.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.411+0000 7ffbbf400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.73:3300/0 conn(0x7ffba80061c0 0x7ffba8008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.411+0000 7ffbbf400640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba8010010 0x7ffba80124a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:23.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc815e3f0 con 0x7ffbc8161bf0 2024-03-23T06:14:23.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc8157d90 con 0x7ffbc81579b0 2024-03-23T06:14:23.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.411+0000 7ffbbf400640 1 -- 172.21.15.73:0/3249262218 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc80c7370 con 0x7ffba8010010 2024-03-23T06:14:23.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.414+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 reap_dead start 2024-03-23T06:14:23.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.414+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> v1:172.21.15.110:6789/0 conn(0x7ffbc81579b0 legacy=0x7ffba800e8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:14:23.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.414+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba8010010 msgr2=0x7ffba80124a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:23.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.414+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba8010010 0x7ffba80124a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:14:23.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.415+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854389490 0 0) 0x7ffbc815e3f0 con 0x7ffbc8161bf0 2024-03-23T06:14:23.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.416+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbac003520 con 0x7ffbc8161bf0 2024-03-23T06:14:23.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.416+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250875507 0 0) 0x7ffbac003520 con 0x7ffbc8161bf0 2024-03-23T06:14:23.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.416+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba8010010 msgr2=0x7ffba80124a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:23.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.416+0000 7ffbc4a00640 1 --2- 172.21.15.73:0/3249262218 >> v2:172.21.15.110:3300/0 conn(0x7ffba8010010 0x7ffba80124a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.416+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 >> v1:172.21.15.110:6789/0 conn(0x7ffbc81579b0 legacy=0x7ffba800e8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:23.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.416+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8014bf0 con 0x7ffbc8161bf0 2024-03-23T06:14:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.417+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7ffbb8004320 con 0x7ffbc8161bf0 2024-03-23T06:14:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.417+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 >> v1:172.21.15.73:6789/0 conn(0x7ffbc8161bf0 legacy=0x7ffba800b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:23.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.418+0000 7ffbc4a00640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbac003970 0x7ffbac003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.418+0000 7ffbc4a00640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0047c0 0x7ffbac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.418+0000 7ffbc4a00640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbac0052a0 0x7ffbac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.418+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc80c7370 con 0x7ffbac003970 2024-03-23T06:14:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.418+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac00c1f0 con 0x7ffbac0047c0 2024-03-23T06:14:23.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.418+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbac00c3b0 con 0x7ffbac0052a0 2024-03-23T06:14:23.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.420+0000 7ffbc5400640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0047c0 msgr2=0x7ffbac004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:23.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.420+0000 7ffbc5400640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0047c0 0x7ffbac004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:14:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.420+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbac0052a0 0x7ffbac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.421+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbac003970 0x7ffbac003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:23.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.422+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0047c0 msgr2=0x7ffbac004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:23.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.422+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0047c0 0x7ffbac004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.422+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbac003970 msgr2=0x7ffbac003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:14:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.422+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbac003970 0x7ffbac003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.422+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac003520 con 0x7ffbac0052a0 2024-03-23T06:14:23.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.423+0000 7ffbc6800640 1 -- 172.21.15.73:0/3249262218 reap_dead start 2024-03-23T06:14:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.424+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbac003970 0x7ffbac003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:14:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.424+0000 7ffbc6800640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbac0052a0 0x7ffbac00b980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffba80065a0 tx=0x7ffbac0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36bc24ee994973e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:23.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.425+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000b2d0 con 0x7ffbac0052a0 2024-03-23T06:14:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.425+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc002f050 con 0x7ffbac0052a0 2024-03-23T06:14:23.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.426+0000 7ffbc4a00640 1 -- 172.21.15.73:0/3249262218 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00096d0 con 0x7ffbac0052a0 2024-03-23T06:14:23.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.427+0000 7ffbcce00640 1 -- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbac0052a0 msgr2=0x7ffbac00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:23.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.427+0000 7ffbcce00640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbac0052a0 0x7ffbac00b980 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffba80065a0 tx=0x7ffbac0057f0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.428+0000 7ffbcce00640 1 -- 172.21.15.73:0/3249262218 shutdown_connections 2024-03-23T06:14:23.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.428+0000 7ffbcce00640 1 --2- 172.21.15.73:0/3249262218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbac0052a0 0x7ffbac00b980 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.429+0000 7ffbcce00640 1 -- 172.21.15.73:0/3249262218 >> 172.21.15.73:0/3249262218 conn(0x7ffbc806bb40 msgr2=0x7ffbc806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:23.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.430+0000 7ffbcce00640 1 -- 172.21.15.73:0/3249262218 shutdown_connections 2024-03-23T06:14:23.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.431+0000 7ffbcce00640 1 -- 172.21.15.73:0/3249262218 wait complete. 2024-03-23T06:14:23.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.433+0000 7ffbcce00640 1 Processor -- start 2024-03-23T06:14:23.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.434+0000 7ffbcce00640 1 -- start start 2024-03-23T06:14:23.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.438+0000 7ffbcce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0052a0 0x7ffbc81f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.439+0000 7ffbcce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc815fd50 0x7ffbc815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.439+0000 7ffbcce00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc81591b0 0x7ffbc8150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.441+0000 7ffbcce00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc8158620 con 0x7ffbc81591b0 2024-03-23T06:14:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.441+0000 7ffbcce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc815c1c0 con 0x7ffbac0052a0 2024-03-23T06:14:23.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.441+0000 7ffbcce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc81f3f10 con 0x7ffbc815fd50 2024-03-23T06:14:23.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.441+0000 7ffbc5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc815fd50 0x7ffbc815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.441+0000 7ffbc6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc81591b0 0x7ffbc8150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:23.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.442+0000 7ffbc6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc81591b0 0x7ffbc8150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43094/0 (socket says 172.21.15.73:43094) 2024-03-23T06:14:23.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.442+0000 7ffbc6800640 1 -- 172.21.15.73:0/2964662583 learned_addr learned my addr 172.21.15.73:0/2964662583 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:23.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.442+0000 7ffbc6800640 1 -- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc815fd50 msgr2=0x7ffbc815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:23.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.441+0000 7ffbc5e00640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0052a0 msgr2=0x7ffbc81f39d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.443+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0052a0 0x7ffbc81f39d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:14:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.443+0000 7ffbc6800640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc815fd50 0x7ffbc815d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.443+0000 7ffbc6800640 1 -- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0052a0 msgr2=0x7ffbc81f39d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:14:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.443+0000 7ffbc6800640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0052a0 0x7ffbc81f39d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.443+0000 7ffbc6800640 1 -- 172.21.15.73:0/2964662583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc815b5b0 con 0x7ffbc81591b0 2024-03-23T06:14:23.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.445+0000 7ffbc5400640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc815fd50 0x7ffbc815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:14:23.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.446+0000 7ffbc6800640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc81591b0 0x7ffbc8150a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffbc002ca30 tx=0x7ffbc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:23.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.448+0000 7ffbbe000640 1 -- 172.21.15.73:0/2964662583 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc003d630 con 0x7ffbc81591b0 2024-03-23T06:14:23.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.448+0000 7ffbcce00640 1 -- 172.21.15.73:0/2964662583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc815b820 con 0x7ffbc81591b0 2024-03-23T06:14:23.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.448+0000 7ffbcce00640 1 -- 172.21.15.73:0/2964662583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc815bde0 con 0x7ffbc81591b0 2024-03-23T06:14:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.451+0000 7ffbbe000640 1 -- 172.21.15.73:0/2964662583 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc0039040 con 0x7ffbc81591b0 2024-03-23T06:14:23.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.451+0000 7ffbb3400640 1 -- 172.21.15.73:0/2964662583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba0005250 con 0x7ffbc81591b0 2024-03-23T06:14:23.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.452+0000 7ffbbe000640 1 -- 172.21.15.73:0/2964662583 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc003d630 con 0x7ffbc81591b0 2024-03-23T06:14:23.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.455+0000 7ffbbe000640 1 -- 172.21.15.73:0/2964662583 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ffbc0033400 con 0x7ffbc81591b0 2024-03-23T06:14:23.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.457+0000 7ffbbe000640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffba806bd80 0x7ffba806e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:23.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.458+0000 7ffbbe000640 1 -- 172.21.15.73:0/2964662583 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ffbc00aad10 con 0x7ffbc81591b0 2024-03-23T06:14:23.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.460+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffba806bd80 0x7ffba806e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:23.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.461+0000 7ffbc5e00640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffba806bd80 0x7ffba806e240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffba8003590 tx=0x7ffbb8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:23.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.466+0000 7ffbbe000640 1 -- 172.21.15.73:0/2964662583 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ffbc0075b90 con 0x7ffbc81591b0 2024-03-23T06:14:23.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.971+0000 7ffbb3400640 1 -- 172.21.15.73:0/2964662583 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ffba0005a80 con 0x7ffbc81591b0 2024-03-23T06:14:23.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.972+0000 7ffbbe000640 1 -- 172.21.15.73:0/2964662583 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7ffbc0042020 con 0x7ffbc81591b0 2024-03-23T06:14:23.973 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":48,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:14:23.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 -- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffba806bd80 msgr2=0x7ffba806e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffba806bd80 0x7ffba806e240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffba8003590 tx=0x7ffbb8009040 comp rx=0 tx=0).stop 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 -- 172.21.15.73:0/2964662583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc81591b0 msgr2=0x7ffbc8150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc81591b0 0x7ffbc8150a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffbc002ca30 tx=0x7ffbc0004a40 comp rx=0 tx=0).stop 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 -- 172.21.15.73:0/2964662583 shutdown_connections 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbc81591b0 0x7ffbc8150a20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ffba806bd80 0x7ffba806e240 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffba8003590 tx=0x7ffbb8009040 comp rx=0 tx=0).stop 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbc815fd50 0x7ffbc815d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 --2- 172.21.15.73:0/2964662583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbac0052a0 0x7ffbc81f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.976+0000 7ffbb3400640 1 -- 172.21.15.73:0/2964662583 >> 172.21.15.73:0/2964662583 conn(0x7ffbc806bb40 msgr2=0x7ffbc80c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:23.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.984+0000 7ffbb3400640 1 -- 172.21.15.73:0/2964662583 shutdown_connections 2024-03-23T06:14:23.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:23.984+0000 7ffbb3400640 1 -- 172.21.15.73:0/2964662583 wait complete. 2024-03-23T06:14:24.024 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:14:24.024 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T06:14:24.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:14:24.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.406+0000 7f79efe00640 1 Processor -- start 2024-03-23T06:14:24.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.406+0000 7f79efe00640 1 -- start start 2024-03-23T06:14:24.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.408+0000 7f79efe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79e8159420 0x7f79e80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.408+0000 7f79efe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79e80ca940 0x7f79e80cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.408+0000 7f79efe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80c9c80 con 0x7f79e8153760 2024-03-23T06:14:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.408+0000 7f79efe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e8159860 con 0x7f79e80ca940 2024-03-23T06:14:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.408+0000 7f79efe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80cb310 con 0x7f79e8159420 2024-03-23T06:14:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.409+0000 7f79ede00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79e80ca940 0x7f79e80cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.409+0000 7f79ede00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79e80ca940 0x7f79e80cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43108/0 (socket says 172.21.15.73:43108) 2024-03-23T06:14:24.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.409+0000 7f79ede00640 1 -- 172.21.15.73:0/3242716591 learned_addr learned my addr 172.21.15.73:0/3242716591 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:24.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.410+0000 7f79ede00640 1 -- 172.21.15.73:0/3242716591 >> v2:172.21.15.110:3300/0 conn(0x7f79e8159420 msgr2=0x7f79e80c9740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:24.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.410+0000 7f79ede00640 1 --2- 172.21.15.73:0/3242716591 >> v2:172.21.15.110:3300/0 conn(0x7f79e8159420 0x7f79e80c9740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.410+0000 7f79ede00640 1 -- 172.21.15.73:0/3242716591 >> v1:172.21.15.110:6789/0 conn(0x7f79e8153760 legacy=0x7f79e80cb7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:24.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.410+0000 7f79ede00640 1 -- 172.21.15.73:0/3242716591 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e806a2d0 con 0x7f79e80ca940 2024-03-23T06:14:24.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.413+0000 7f79ede00640 1 --2- 172.21.15.73:0/3242716591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ca940 0x7f79e80cadd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f79e80c5640 tx=0x7f79d402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde957ec4d743fdb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.415+0000 7f79e7e00640 1 -- 172.21.15.73:0/3242716591 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4031890 con 0x7f79e80ca940 2024-03-23T06:14:24.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.415+0000 7f79e7e00640 1 -- 172.21.15.73:0/3242716591 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d40319f0 con 0x7f79e80ca940 2024-03-23T06:14:24.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.415+0000 7f79e7e00640 1 -- 172.21.15.73:0/3242716591 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4031d80 con 0x7f79e80ca940 2024-03-23T06:14:24.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.416+0000 7f79efe00640 1 -- 172.21.15.73:0/3242716591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ca940 msgr2=0x7f79e80cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.416+0000 7f79efe00640 1 --2- 172.21.15.73:0/3242716591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ca940 0x7f79e80cadd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f79e80c5640 tx=0x7f79d402b930 comp rx=0 tx=0).stop 2024-03-23T06:14:24.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.420+0000 7f79efe00640 1 -- 172.21.15.73:0/3242716591 shutdown_connections 2024-03-23T06:14:24.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.420+0000 7f79efe00640 1 --2- 172.21.15.73:0/3242716591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80ca940 0x7f79e80cadd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.420+0000 7f79efe00640 1 --2- 172.21.15.73:0/3242716591 >> v2:172.21.15.110:3300/0 conn(0x7f79e8159420 0x7f79e80c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.420+0000 7f79efe00640 1 -- 172.21.15.73:0/3242716591 >> 172.21.15.73:0/3242716591 conn(0x7f79e806c310 msgr2=0x7f79e80713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:24.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.420+0000 7f79efe00640 1 -- 172.21.15.73:0/3242716591 shutdown_connections 2024-03-23T06:14:24.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.422+0000 7f79efe00640 1 -- 172.21.15.73:0/3242716591 wait complete. 2024-03-23T06:14:24.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.429+0000 7f79efe00640 1 Processor -- start 2024-03-23T06:14:24.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.432+0000 7f79efe00640 1 -- start start 2024-03-23T06:14:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.436+0000 7f79efe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e80ca940 0x7f79e8153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.436+0000 7f79efe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e8153760 0x7f79e81558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.436+0000 7f79efe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8159420 0x7f79e81eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.436+0000 7f79efe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8154590 con 0x7f79e8159420 2024-03-23T06:14:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.436+0000 7f79efe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c8cd0 con 0x7f79e80ca940 2024-03-23T06:14:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.436+0000 7f79efe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c6540 con 0x7f79e8153760 2024-03-23T06:14:24.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.436+0000 7f79ed400640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e80ca940 msgr2=0x7f79e8153d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:24.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.436+0000 7f79ed400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e80ca940 0x7f79e8153d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79ede00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8159420 0x7f79e81eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79ede00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8159420 0x7f79e81eee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43114/0 (socket says 172.21.15.73:43114) 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79ede00640 1 -- 172.21.15.73:0/3092483035 learned_addr learned my addr 172.21.15.73:0/3092483035 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79eca00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e8153760 0x7f79e81558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79ede00640 1 -- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e8153760 msgr2=0x7f79e81558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79ede00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79e8153760 0x7f79e81558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79ede00640 1 -- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e80ca940 msgr2=0x7f79e8153d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79ede00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79e80ca940 0x7f79e8153d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.437+0000 7f79ede00640 1 -- 172.21.15.73:0/3092483035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40094d0 con 0x7f79e8159420 2024-03-23T06:14:24.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.438+0000 7f79ede00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8159420 0x7f79e81eee90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f79d402b970 tx=0x7f79d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.439+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d403adf0 con 0x7f79e8159420 2024-03-23T06:14:24.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.439+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d40443f0 con 0x7f79e8159420 2024-03-23T06:14:24.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.439+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d40447a0 con 0x7f79e8159420 2024-03-23T06:14:24.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.439+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e80c6800 con 0x7f79e8159420 2024-03-23T06:14:24.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.439+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e80c8680 con 0x7f79e8159420 2024-03-23T06:14:24.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.440+0000 7f79efe00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80c88a0 0x7f79e81ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.440+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8072510 con 0x7f79e80c88a0 2024-03-23T06:14:24.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.440+0000 7f79ed400640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80c88a0 0x7f79e81ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.441+0000 7f79ed400640 1 -- 172.21.15.73:0/3092483035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79e806ab70 con 0x7f79e80c88a0 2024-03-23T06:14:24.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.441+0000 7f79ed400640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80c88a0 0x7f79e81ef3d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f79e000bc30 tx=0x7f79e000bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.442+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00052f0 con 0x7f79e80c88a0 2024-03-23T06:14:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.443+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f79e000f070 con 0x7f79e80c88a0 2024-03-23T06:14:24.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.443+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80c88a0 msgr2=0x7f79e81ef3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.444+0000 7f79e5600640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80c88a0 0x7f79e81ef3d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f79e000bc30 tx=0x7f79e000bd20 comp rx=0 tx=0).stop 2024-03-23T06:14:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.444+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80c88a0 msgr2=0x7f79e81ef3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:24.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.444+0000 7f79e5600640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80c88a0 0x7f79e81ef3d0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f79e000bc30 tx=0x7f79e000bd20 comp rx=0 tx=0).stop 2024-03-23T06:14:24.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.446+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f79d4044900 con 0x7f79e8159420 2024-03-23T06:14:24.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.447+0000 7f79e5600640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79c806a970 0x7f79c806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.448+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f79d407af10 con 0x7f79e8159420 2024-03-23T06:14:24.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.449+0000 7f79ed400640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79c806a970 0x7f79c806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.453+0000 7f79ed400640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79c806a970 0x7f79c806ce30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f79e000bd60 tx=0x7f79e000f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.456+0000 7f79efe00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8070ff0 0x7f79e8149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.456+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e806a890 con 0x7f79e8070ff0 2024-03-23T06:14:24.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.457+0000 7f79eca00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8070ff0 0x7f79e8149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.457+0000 7f79eca00640 1 -- 172.21.15.73:0/3092483035 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f79e806ae50 con 0x7f79e8070ff0 2024-03-23T06:14:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.458+0000 7f79eca00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8070ff0 0x7f79e8149670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79e80c9e90 tx=0x7f79dc00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.458+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc014620 con 0x7f79e8070ff0 2024-03-23T06:14:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.459+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4769 (secure 0 0 0) 0x7f79dc014780 con 0x7f79e8070ff0 2024-03-23T06:14:24.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.459+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8070ff0 msgr2=0x7f79e8149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 48, 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:24.460 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:14:24.461 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:24.462 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:14:24.463 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:24.464 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:24.465 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:24.466 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.467 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:14:24.468 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:14:24.469 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:14:24.470 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.471 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.472 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:14:24.472 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.459+0000 7f79e5600640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8070ff0 0x7f79e8149670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79e80c9e90 tx=0x7f79dc00d960 comp rx=0 tx=0).stop 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.460+0000 7f79e5600640 1 -- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8070ff0 msgr2=0x7f79e8149670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.460+0000 7f79e5600640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8070ff0 0x7f79e8149670 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.460+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79c806a970 msgr2=0x7f79c806ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.460+0000 7f79efe00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79c806a970 0x7f79c806ce30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f79e000bd60 tx=0x7f79e000f000 comp rx=0 tx=0).stop 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.460+0000 7f79ede00640 1 -- 172.21.15.73:0/3092483035 reap_dead start 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.461+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8159420 msgr2=0x7f79e81eee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.461+0000 7f79efe00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8159420 0x7f79e81eee90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f79d402b970 tx=0x7f79d40046c0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.461+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 shutdown_connections 2024-03-23T06:14:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.461+0000 7f79efe00640 1 --2- 172.21.15.73:0/3092483035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e8159420 0x7f79e81eee90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.461+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 >> 172.21.15.73:0/3092483035 conn(0x7f79e806c310 msgr2=0x7f79e80ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.461+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 shutdown_connections 2024-03-23T06:14:24.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.461+0000 7f79efe00640 1 -- 172.21.15.73:0/3092483035 wait complete. 2024-03-23T06:14:24.498 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:14:24.498 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T06:14:24.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:14:24.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.816+0000 7ff08ea00640 1 Processor -- start 2024-03-23T06:14:24.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.817+0000 7ff08ea00640 1 -- start start 2024-03-23T06:14:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.821+0000 7ff08ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0880cb050 0x7ff0880c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.821+0000 7ff08ea00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0880c9c80 con 0x7ff088153760 2024-03-23T06:14:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.821+0000 7ff08ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08806a2d0 con 0x7ff088159420 2024-03-23T06:14:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.821+0000 7ff08ea00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff088159860 con 0x7ff0880cb050 2024-03-23T06:14:24.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.823+0000 7ff087400640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7ff088159420 legacy=0x7ff0880ca940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:14:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.823+0000 7ff087e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff088153760 0x7ff0880cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47548/0 (socket says 172.21.15.73:47548) 2024-03-23T06:14:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.823+0000 7ff087e00640 1 -- 172.21.15.73:0/549735096 learned_addr learned my addr 172.21.15.73:0/549735096 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:14:24.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.823+0000 7ff08ca00640 1 --2- 172.21.15.73:0/549735096 >> v2:172.21.15.73:3300/0 conn(0x7ff0880cb050 0x7ff0880c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.830+0000 7ff086a00640 1 -- 172.21.15.73:0/549735096 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108126237 0 0) 0x7ff078001110 con 0x7ff088153760 2024-03-23T06:14:24.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.831+0000 7ff086a00640 1 -- 172.21.15.73:0/549735096 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff06c003520 con 0x7ff088153760 2024-03-23T06:14:24.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.831+0000 7ff08ca00640 1 -- 172.21.15.73:0/549735096 >> v1:172.21.15.110:6789/0 conn(0x7ff088159420 legacy=0x7ff0880ca940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:14:24.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.831+0000 7ff08ca00640 1 -- 172.21.15.73:0/549735096 >> v1:172.21.15.73:6789/0 conn(0x7ff088153760 legacy=0x7ff0880cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.831+0000 7ff08ca00640 1 -- 172.21.15.73:0/549735096 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08806a5b0 con 0x7ff0880cb050 2024-03-23T06:14:24.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.834+0000 7ff08ca00640 1 --2- 172.21.15.73:0/549735096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0880cb050 0x7ff0880c9740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff080009d90 tx=0x7ff08002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc03d4a8eef1559c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.834+0000 7ff086a00640 1 -- 172.21.15.73:0/549735096 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08002cc80 con 0x7ff0880cb050 2024-03-23T06:14:24.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.834+0000 7ff086a00640 1 -- 172.21.15.73:0/549735096 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08002cde0 con 0x7ff0880cb050 2024-03-23T06:14:24.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.834+0000 7ff086a00640 1 -- 172.21.15.73:0/549735096 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080034660 con 0x7ff0880cb050 2024-03-23T06:14:24.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.836+0000 7ff08ea00640 1 -- 172.21.15.73:0/549735096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0880cb050 msgr2=0x7ff0880c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.836+0000 7ff08ea00640 1 --2- 172.21.15.73:0/549735096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0880cb050 0x7ff0880c9740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff080009d90 tx=0x7ff08002bed0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.836+0000 7ff08ea00640 1 -- 172.21.15.73:0/549735096 shutdown_connections 2024-03-23T06:14:24.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.837+0000 7ff08ea00640 1 --2- 172.21.15.73:0/549735096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0880cb050 0x7ff0880c9740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.837+0000 7ff08ea00640 1 -- 172.21.15.73:0/549735096 >> 172.21.15.73:0/549735096 conn(0x7ff08806c310 msgr2=0x7ff0880713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:24.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.837+0000 7ff08ea00640 1 -- 172.21.15.73:0/549735096 shutdown_connections 2024-03-23T06:14:24.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.837+0000 7ff08ea00640 1 -- 172.21.15.73:0/549735096 wait complete. 2024-03-23T06:14:24.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.840+0000 7ff08ea00640 1 Processor -- start 2024-03-23T06:14:24.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.840+0000 7ff08ea00640 1 -- start start 2024-03-23T06:14:24.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.843+0000 7ff08ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0880cb050 0x7ff08815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.843+0000 7ff08ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff088153760 0x7ff0881f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.843+0000 7ff08ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff088159420 0x7ff08815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.843+0000 7ff08ea00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08815b760 con 0x7ff088159420 2024-03-23T06:14:24.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.843+0000 7ff08ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08814f370 con 0x7ff088153760 2024-03-23T06:14:24.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.843+0000 7ff08ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0881fbe50 con 0x7ff0880cb050 2024-03-23T06:14:24.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.846+0000 7ff087e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0880cb050 0x7ff08815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.846+0000 7ff087e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0880cb050 0x7ff08815af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:35122/0 (socket says 172.21.15.73:35122) 2024-03-23T06:14:24.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.846+0000 7ff087e00640 1 -- 172.21.15.73:0/3916552506 learned_addr learned my addr 172.21.15.73:0/3916552506 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:14:24.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.846+0000 7ff087400640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff088153760 msgr2=0x7ff0881f5900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:14:24.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.846+0000 7ff087400640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff088153760 0x7ff0881f5900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:14:24.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.846+0000 7ff08ca00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff088159420 0x7ff08815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.848+0000 7ff08ca00640 1 -- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0880cb050 msgr2=0x7ff08815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.848+0000 7ff08ca00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0880cb050 0x7ff08815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.848+0000 7ff08ca00640 1 -- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff088153760 msgr2=0x7ff0881f5900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:14:24.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.848+0000 7ff08ca00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff088153760 0x7ff0881f5900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.848+0000 7ff08ca00640 1 -- 172.21.15.73:0/3916552506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff080009a70 con 0x7ff088159420 2024-03-23T06:14:24.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.849+0000 7ff08ca00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff088159420 0x7ff08815c8b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff080033000 tx=0x7ff080004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.852+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08003e610 con 0x7ff088159420 2024-03-23T06:14:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.852+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff080035e90 con 0x7ff088159420 2024-03-23T06:14:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.852+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0881fc130 con 0x7ff088159420 2024-03-23T06:14:24.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.852+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0881fc6f0 con 0x7ff088159420 2024-03-23T06:14:24.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.853+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08003e9f0 con 0x7ff088159420 2024-03-23T06:14:24.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.857+0000 7ff08ea00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060002a30 0x7ff060004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.858+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff060007e80 con 0x7ff060002a30 2024-03-23T06:14:24.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.858+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff08003b050 con 0x7ff088159420 2024-03-23T06:14:24.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.858+0000 7ff087e00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060002a30 0x7ff060004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.859+0000 7ff087e00640 1 -- 172.21.15.73:0/3916552506 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff060008040 con 0x7ff060002a30 2024-03-23T06:14:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.859+0000 7ff07fe00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff06806ac00 0x7ff06806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.859+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff0800abe40 con 0x7ff088159420 2024-03-23T06:14:24.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.859+0000 7ff087e00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060002a30 0x7ff060004ef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff078000f60 tx=0x7ff078001b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.861+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07800f7a0 con 0x7ff060002a30 2024-03-23T06:14:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.861+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7ff07800f900 con 0x7ff060002a30 2024-03-23T06:14:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.861+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060002a30 msgr2=0x7ff060004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.861+0000 7ff07fe00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060002a30 0x7ff060004ef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff078000f60 tx=0x7ff078001b20 comp rx=0 tx=0).stop 2024-03-23T06:14:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.861+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060002a30 msgr2=0x7ff060004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:24.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.861+0000 7ff07fe00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060002a30 0x7ff060004ef0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff078000f60 tx=0x7ff078001b20 comp rx=0 tx=0).stop 2024-03-23T06:14:24.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.868+0000 7ff087400640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff06806ac00 0x7ff06806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.870+0000 7ff087400640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff06806ac00 0x7ff06806d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff074006fd0 tx=0x7ff074006d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.898+0000 7ff08ea00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060006ed0 0x7ff060007360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:14:24.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.898+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600078d0 con 0x7ff060006ed0 2024-03-23T06:14:24.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.899+0000 7ff087e00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060006ed0 0x7ff060007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:14:24.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.899+0000 7ff087e00640 1 -- 172.21.15.73:0/3916552506 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff060007a90 con 0x7ff060006ed0 2024-03-23T06:14:24.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.900+0000 7ff087e00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060006ed0 0x7ff060007360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff078000f60 tx=0x7ff0780012e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:14:24.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.900+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078024070 con 0x7ff060006ed0 2024-03-23T06:14:24.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.900+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7ff078006110 con 0x7ff060006ed0 2024-03-23T06:14:24.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.900+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060006ed0 msgr2=0x7ff060007360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.900+0000 7ff07fe00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060006ed0 0x7ff060007360 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff078000f60 tx=0x7ff0780012e0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.900+0000 7ff07fe00640 1 -- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060006ed0 msgr2=0x7ff060007360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:14:24.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.900+0000 7ff07fe00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff060006ed0 0x7ff060007360 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff078000f60 tx=0x7ff0780012e0 comp rx=0 tx=0).stop 2024-03-23T06:14:24.901 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:14:24.901 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:14:24.901 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:14:24.901 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:14:24.901 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 48, 2024-03-23T06:14:24.901 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:14:24.901 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:24.902 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:24.903 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:14:24.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:14:24.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:14:24.906 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:14:24.906 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:14:24.906 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:14:24.906 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.906 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:14:24.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.906 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:14:24.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.907 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:14:24.907 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:14:24.907 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:24.907 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:24.907 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.907 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:24.908 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:14:24.908 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.908 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:24.908 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:14:24.908 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.909 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.910 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:14:24.911 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.912 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:14:24.913 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:14:24.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.915 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:14:24.916 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:14:24.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.903+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff06806ac00 msgr2=0x7ff06806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.903+0000 7ff08ea00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff06806ac00 0x7ff06806d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff074006fd0 tx=0x7ff074006d80 comp rx=0 tx=0).stop 2024-03-23T06:14:24.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.903+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff088159420 msgr2=0x7ff08815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:14:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.903+0000 7ff08ea00640 1 --2- 172.21.15.73:0/3916552506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff088159420 0x7ff08815c8b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff080033000 tx=0x7ff080004a40 comp rx=0 tx=0).stop 2024-03-23T06:14:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.903+0000 7ff08ca00640 1 -- 172.21.15.73:0/3916552506 reap_dead start 2024-03-23T06:14:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.903+0000 7ff08ca00640 1 -- 172.21.15.73:0/3916552506 reap_dead start 2024-03-23T06:14:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.903+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 shutdown_connections 2024-03-23T06:14:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.903+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 >> 172.21.15.73:0/3916552506 conn(0x7ff08806c310 msgr2=0x7ff0881599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:14:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.904+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 shutdown_connections 2024-03-23T06:14:24.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:14:24.904+0000 7ff08ea00640 1 -- 172.21.15.73:0/3916552506 wait complete. 2024-03-23T06:14:24.941 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:14:24.941 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:14:28.070 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:14:28.080 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:14:44.942 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T06:14:44.942 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T06:14:44.942 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T06:14:44.943 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T06:14:44.945 INFO:tasks.ceph.mon.b:Started 2024-03-23T06:14:44.945 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-03-23T06:14:44.946 INFO:tasks.ceph.mon.a:Sent signal 19 2024-03-23T06:14:44.946 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T06:14:59.947 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-03-23T06:14:59.947 INFO:tasks.ceph.mon.a:Sent signal 18 2024-03-23T06:14:59.947 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:14:59.948 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:15:00.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:15:00.024 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:15:10.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.207+0000 7f1f4a600640 1 Processor -- start 2024-03-23T06:15:10.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.207+0000 7f1f4a600640 1 -- start start 2024-03-23T06:15:10.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.209+0000 7f1f4a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 0x7f1f4415d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:10.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.209+0000 7f1f4a600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1f440c66f0 0x7f1f4415de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:10.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.209+0000 7f1f4a600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f44160ec0 con 0x7f1f441579b0 2024-03-23T06:15:10.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.209+0000 7f1f4a600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440c7370 con 0x7f1f440c66f0 2024-03-23T06:15:10.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.209+0000 7f1f4a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f44157d90 con 0x7f1f44161bf0 2024-03-23T06:15:10.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.209+0000 7f1f43400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1f441579b0 0x7f1f440c0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:44896/0 (socket says 172.21.15.73:44896) 2024-03-23T06:15:10.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.209+0000 7f1f43400640 1 -- 172.21.15.73:0/2052041058 learned_addr learned my addr 172.21.15.73:0/2052041058 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:15:10.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.209+0000 7f1f42a00640 1 --2- 172.21.15.73:0/2052041058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 0x7f1f4415d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:10.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.211+0000 7f1f43e00640 1 --2- 172.21.15.73:0/2052041058 >> v2:172.21.15.110:3300/0 conn(0x7f1f440c66f0 0x7f1f4415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:10.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.211+0000 7f1f43e00640 1 -- 172.21.15.73:0/2052041058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 msgr2=0x7f1f4415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:10.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.211+0000 7f1f43e00640 1 --2- 172.21.15.73:0/2052041058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 0x7f1f4415d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.211+0000 7f1f43e00640 1 -- 172.21.15.73:0/2052041058 >> v1:172.21.15.73:6789/0 conn(0x7f1f441579b0 legacy=0x7f1f440c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:10.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.211+0000 7f1f43e00640 1 -- 172.21.15.73:0/2052041058 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4415e3f0 con 0x7f1f440c66f0 2024-03-23T06:15:10.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.213+0000 7f1f43e00640 1 --2- 172.21.15.73:0/2052041058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f440c66f0 0x7f1f4415de10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009d90 tx=0x7f1f3c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=785f0e8d6fee611e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:10.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.213+0000 7f1f42000640 1 -- 172.21.15.73:0/2052041058 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c02cbc0 con 0x7f1f440c66f0 2024-03-23T06:15:10.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.214+0000 7f1f42000640 1 -- 172.21.15.73:0/2052041058 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c02cd20 con 0x7f1f440c66f0 2024-03-23T06:15:10.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.214+0000 7f1f42000640 1 -- 172.21.15.73:0/2052041058 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c034660 con 0x7f1f440c66f0 2024-03-23T06:15:10.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.215+0000 7f1f4a600640 1 -- 172.21.15.73:0/2052041058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f440c66f0 msgr2=0x7f1f4415de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:10.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.215+0000 7f1f4a600640 1 --2- 172.21.15.73:0/2052041058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f440c66f0 0x7f1f4415de10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009d90 tx=0x7f1f3c02be10 comp rx=0 tx=0).stop 2024-03-23T06:15:10.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.215+0000 7f1f4a600640 1 -- 172.21.15.73:0/2052041058 shutdown_connections 2024-03-23T06:15:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.215+0000 7f1f4a600640 1 --2- 172.21.15.73:0/2052041058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f440c66f0 0x7f1f4415de10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.215+0000 7f1f4a600640 1 --2- 172.21.15.73:0/2052041058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 0x7f1f4415d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.215+0000 7f1f4a600640 1 -- 172.21.15.73:0/2052041058 >> 172.21.15.73:0/2052041058 conn(0x7f1f4406bb40 msgr2=0x7f1f4406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:10.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.216+0000 7f1f4a600640 1 -- 172.21.15.73:0/2052041058 shutdown_connections 2024-03-23T06:15:10.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.216+0000 7f1f4a600640 1 -- 172.21.15.73:0/2052041058 wait complete. 2024-03-23T06:15:10.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.218+0000 7f1f4a600640 1 Processor -- start 2024-03-23T06:15:10.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.218+0000 7f1f4a600640 1 -- start start 2024-03-23T06:15:10.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f4a600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f440c66f0 0x7f1f440caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:10.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f4a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f441579b0 0x7f1f440c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:10.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f4a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 0x7f1f44151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:10.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f4a600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440c9420 con 0x7f1f440c66f0 2024-03-23T06:15:10.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f4a600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441f77b0 con 0x7f1f441579b0 2024-03-23T06:15:10.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f4a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440caf40 con 0x7f1f44161bf0 2024-03-23T06:15:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f42a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f441579b0 0x7f1f440c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f42a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f441579b0 0x7f1f440c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37936/0 (socket says 172.21.15.73:37936) 2024-03-23T06:15:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f42a00640 1 -- 172.21.15.73:0/3138483866 learned_addr learned my addr 172.21.15.73:0/3138483866 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.220+0000 7f1f43400640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f440c66f0 0x7f1f440caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.221+0000 7f1f43e00640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 0x7f1f44151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.221+0000 7f1f43400640 1 -- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 msgr2=0x7f1f44151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.221+0000 7f1f43400640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 0x7f1f44151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.221+0000 7f1f43400640 1 -- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f441579b0 msgr2=0x7f1f440c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.221+0000 7f1f43400640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f441579b0 0x7f1f440c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.221+0000 7f1f43400640 1 -- 172.21.15.73:0/3138483866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c009a70 con 0x7f1f440c66f0 2024-03-23T06:15:10.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.223+0000 7f1f43400640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f440c66f0 0x7f1f440caa00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c800 tx=0x7f1f3400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:10.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.224+0000 7f1f3b400640 1 -- 172.21.15.73:0/3138483866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340058b0 con 0x7f1f440c66f0 2024-03-23T06:15:10.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.224+0000 7f1f3b400640 1 -- 172.21.15.73:0/3138483866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34005a10 con 0x7f1f440c66f0 2024-03-23T06:15:10.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.224+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f440c20a0 con 0x7f1f440c66f0 2024-03-23T06:15:10.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.224+0000 7f1f3b400640 1 -- 172.21.15.73:0/3138483866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34005d80 con 0x7f1f440c66f0 2024-03-23T06:15:10.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.224+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f440c4f50 con 0x7f1f440c66f0 2024-03-23T06:15:10.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.227+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f440c64d0 con 0x7f1f440c66f0 2024-03-23T06:15:10.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.227+0000 7f1f3b400640 1 -- 172.21.15.73:0/3138483866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1f34007070 con 0x7f1f440c66f0 2024-03-23T06:15:10.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.229+0000 7f1f3b400640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f2406acd0 0x7f1f2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:10.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.229+0000 7f1f3b400640 1 -- 172.21.15.73:0/3138483866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1f34088a30 con 0x7f1f440c66f0 2024-03-23T06:15:10.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.230+0000 7f1f42a00640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f2406acd0 0x7f1f2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:10.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.231+0000 7f1f42a00640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f2406acd0 0x7f1f2406d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1f440701f0 tx=0x7f1f30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:10.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.237+0000 7f1f3b400640 1 -- 172.21.15.73:0/3138483866 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1f34053930 con 0x7f1f440c66f0 2024-03-23T06:15:10.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.817+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1f441f74d0 con 0x7f1f440c66f0 2024-03-23T06:15:10.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.818+0000 7f1f3b400640 1 -- 172.21.15.73:0/3138483866 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f1f34056f50 con 0x7f1f440c66f0 2024-03-23T06:15:10.825 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":10,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:15:10.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f2406acd0 msgr2=0x7f1f2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f2406acd0 0x7f1f2406d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1f440701f0 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f440c66f0 msgr2=0x7f1f440caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f440c66f0 0x7f1f440caa00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c800 tx=0x7f1f3400ccc0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 shutdown_connections 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1f2406acd0 0x7f1f2406d190 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1f440701f0 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f44161bf0 0x7f1f44151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f441579b0 0x7f1f440c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 --2- 172.21.15.73:0/3138483866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f440c66f0 0x7f1f440caa00 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400c800 tx=0x7f1f3400ccc0 comp rx=0 tx=0).stop 2024-03-23T06:15:10.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.827+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 >> 172.21.15.73:0/3138483866 conn(0x7f1f4406bb40 msgr2=0x7f1f44160380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:10.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.831+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 shutdown_connections 2024-03-23T06:15:10.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:10.831+0000 7f1f4a600640 1 -- 172.21.15.73:0/3138483866 wait complete. 2024-03-23T06:15:11.088 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:15:11.088 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:15:11.088 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:15:14.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.472+0000 7fcdd6800640 1 Processor -- start 2024-03-23T06:15:14.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.472+0000 7fcdd6800640 1 -- start start 2024-03-23T06:15:14.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.474+0000 7fcdd6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd014f8b0 0x7fcdd00710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.474+0000 7fcdd6800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdd00cb070 0x7fcdd015fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.474+0000 7fcdd6800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd00ca090 con 0x7fcdd00c9350 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.474+0000 7fcdd6800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd0155e90 con 0x7fcdd00cb070 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.474+0000 7fcdd6800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00ca2c0 con 0x7fcdd014f8b0 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.475+0000 7fcdcf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd014f8b0 0x7fcdd00710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.475+0000 7fcdcf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd014f8b0 0x7fcdd00710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:44914/0 (socket says 172.21.15.73:44914) 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.475+0000 7fcdcf400640 1 -- 172.21.15.73:0/660142923 learned_addr learned my addr 172.21.15.73:0/660142923 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.475+0000 7fcdcf400640 1 -- 172.21.15.73:0/660142923 >> v2:172.21.15.73:3300/0 conn(0x7fcdd00cb070 msgr2=0x7fcdd015fd90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.475+0000 7fcdcf400640 1 --2- 172.21.15.73:0/660142923 >> v2:172.21.15.73:3300/0 conn(0x7fcdd00cb070 0x7fcdd015fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.475+0000 7fcdcf400640 1 -- 172.21.15.73:0/660142923 >> v1:172.21.15.110:6789/0 conn(0x7fcdd00c9350 legacy=0x7fcdd00ca960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:14.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.475+0000 7fcdcf400640 1 -- 172.21.15.73:0/660142923 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd014fc90 con 0x7fcdd014f8b0 2024-03-23T06:15:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.487+0000 7fcdcf400640 1 --2- 172.21.15.73:0/660142923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd014f8b0 0x7fcdd00710a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009870 tx=0x7fcdb802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d8c3158482b74 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.488+0000 7fcdcea00640 1 -- 172.21.15.73:0/660142923 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8031870 con 0x7fcdd014f8b0 2024-03-23T06:15:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.489+0000 7fcdcea00640 1 -- 172.21.15.73:0/660142923 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb80319d0 con 0x7fcdd014f8b0 2024-03-23T06:15:14.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.489+0000 7fcdcea00640 1 -- 172.21.15.73:0/660142923 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8031d60 con 0x7fcdd014f8b0 2024-03-23T06:15:14.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.490+0000 7fcdd6800640 1 -- 172.21.15.73:0/660142923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd014f8b0 msgr2=0x7fcdd00710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.490+0000 7fcdd6800640 1 --2- 172.21.15.73:0/660142923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd014f8b0 0x7fcdd00710a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009870 tx=0x7fcdb802b910 comp rx=0 tx=0).stop 2024-03-23T06:15:14.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.490+0000 7fcdd6800640 1 -- 172.21.15.73:0/660142923 shutdown_connections 2024-03-23T06:15:14.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.490+0000 7fcdd6800640 1 --2- 172.21.15.73:0/660142923 >> v2:172.21.15.73:3300/0 conn(0x7fcdd00cb070 0x7fcdd015fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.490+0000 7fcdd6800640 1 --2- 172.21.15.73:0/660142923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd014f8b0 0x7fcdd00710a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.490+0000 7fcdd6800640 1 -- 172.21.15.73:0/660142923 >> 172.21.15.73:0/660142923 conn(0x7fcdd0069cb0 msgr2=0x7fcdd006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:14.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.493+0000 7fcdd6800640 1 -- 172.21.15.73:0/660142923 shutdown_connections 2024-03-23T06:15:14.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.493+0000 7fcdd6800640 1 -- 172.21.15.73:0/660142923 wait complete. 2024-03-23T06:15:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.497+0000 7fcdd6800640 1 Processor -- start 2024-03-23T06:15:14.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.498+0000 7fcdd6800640 1 -- start start 2024-03-23T06:15:14.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.499+0000 7fcdd6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd00c9350 0x7fcdd00c2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.500+0000 7fcdd6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd014f8b0 0x7fcdd01f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.500+0000 7fcdcf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd00c9350 0x7fcdd00c2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.500+0000 7fcdcf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd00c9350 0x7fcdd00c2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:44920/0 (socket says 172.21.15.73:44920) 2024-03-23T06:15:14.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.501+0000 7fcdcf400640 1 -- 172.21.15.73:0/2684696877 learned_addr learned my addr 172.21.15.73:0/2684696877 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.502+0000 7fcdd6800640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f7300 0x7fcdd01540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.502+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00c4c30 con 0x7fcdd01f7300 2024-03-23T06:15:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.502+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd01f7810 con 0x7fcdd014f8b0 2024-03-23T06:15:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.502+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00c2270 con 0x7fcdd00c9350 2024-03-23T06:15:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.502+0000 7fcdc6a00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd014f8b0 0x7fcdd01f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.503+0000 7fcdcfe00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f7300 0x7fcdd01540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.503+0000 7fcdc6a00640 1 -- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd00c9350 msgr2=0x7fcdd00c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.503+0000 7fcdc6a00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdd00c9350 0x7fcdd00c2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.503+0000 7fcdc6a00640 1 -- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f7300 msgr2=0x7fcdd01540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.504+0000 7fcdc6a00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f7300 0x7fcdd01540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.504+0000 7fcdc6a00640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb80094d0 con 0x7fcdd014f8b0 2024-03-23T06:15:14.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.504+0000 7fcdcfe00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f7300 0x7fcdd01540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:15:14.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.505+0000 7fcdc6a00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd014f8b0 0x7fcdd01f3e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009fd0 tx=0x7fcdc000b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.514+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011830 con 0x7fcdd014f8b0 2024-03-23T06:15:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.514+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc00119b0 con 0x7fcdd014f8b0 2024-03-23T06:15:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.514+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011d60 con 0x7fcdd014f8b0 2024-03-23T06:15:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.515+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd01f3380 con 0x7fcdd014f8b0 2024-03-23T06:15:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.515+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd00c27f0 con 0x7fcdd014f8b0 2024-03-23T06:15:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.517+0000 7fcdd6800640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd00cb070 0x7fcdd0154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.517+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd00c2a10 con 0x7fcdd00cb070 2024-03-23T06:15:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.521+0000 7fcdcf400640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd00cb070 0x7fcdd0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.524+0000 7fcdcf400640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdd0155b20 con 0x7fcdd00cb070 2024-03-23T06:15:14.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.526+0000 7fcdcf400640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd00cb070 0x7fcdd0154620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8034040 tx=0x7fcdb8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.527+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcdc001a400 con 0x7fcdd014f8b0 2024-03-23T06:15:14.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.531+0000 7fcdc7e00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcdac06ac50 0x7fcdac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.533+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fcdc0089770 con 0x7fcdd014f8b0 2024-03-23T06:15:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.533+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8049070 con 0x7fcdd00cb070 2024-03-23T06:15:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.533+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fcdb803acb0 con 0x7fcdd00cb070 2024-03-23T06:15:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.533+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd00cb070 msgr2=0x7fcdd0154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.533+0000 7fcdc7e00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd00cb070 0x7fcdd0154620 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8034040 tx=0x7fcdb8004730 comp rx=0 tx=0).stop 2024-03-23T06:15:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.534+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd00cb070 msgr2=0x7fcdd0154620 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.534+0000 7fcdc7e00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd00cb070 0x7fcdd0154620 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.544+0000 7fcdcfe00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcdac06ac50 0x7fcdac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.555+0000 7fcdcfe00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcdac06ac50 0x7fcdac06d110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8007e10 tx=0x7fcdc8007320 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.576+0000 7fcdd6800640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f3510 0x7fcdd00c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.577+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd0073bf0 con 0x7fcdd01f3510 2024-03-23T06:15:14.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.577+0000 7fcdcf400640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f3510 0x7fcdd00c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.578+0000 7fcdcf400640 1 -- 172.21.15.73:0/2684696877 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcdd0155840 con 0x7fcdd01f3510 2024-03-23T06:15:14.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.579+0000 7fcdcf400640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f3510 0x7fcdd00c7740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcdb802b950 tx=0x7fcdb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.580+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8044a60 con 0x7fcdd01f3510 2024-03-23T06:15:14.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.580+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4781 (secure 0 0 0) 0x7fcdb803ae20 con 0x7fcdd01f3510 2024-03-23T06:15:14.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.580+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f3510 msgr2=0x7fcdd00c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.580 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:15:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:14.580 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 56, 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 14, 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:14.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:14.582 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:15:14.583 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:14.584 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:14.585 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:15:14.586 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.587 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:14.588 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:14.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:14.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:15:14.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:14.592 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:15:14.592 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:15:14.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.581+0000 7fcdc7e00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f3510 0x7fcdd00c7740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcdb802b950 tx=0x7fcdb80046c0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.581+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcdac06ac50 msgr2=0x7fcdac06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.581+0000 7fcdc7e00640 1 -- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f3510 msgr2=0x7fcdd00c7740 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:14.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.581+0000 7fcdc7e00640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdd01f3510 0x7fcdd00c7740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.581+0000 7fcdd6800640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcdac06ac50 0x7fcdac06d110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8007e10 tx=0x7fcdc8007320 comp rx=0 tx=0).stop 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.582+0000 7fcdcfe00640 1 -- 172.21.15.73:0/2684696877 reap_dead start 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.582+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd014f8b0 msgr2=0x7fcdd01f3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.582+0000 7fcdd6800640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd014f8b0 0x7fcdd01f3e40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009fd0 tx=0x7fcdc000b870 comp rx=0 tx=0).stop 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.583+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 shutdown_connections 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.583+0000 7fcdd6800640 1 --2- 172.21.15.73:0/2684696877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdd014f8b0 0x7fcdd01f3e40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.583+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 >> 172.21.15.73:0/2684696877 conn(0x7fcdd0069cb0 msgr2=0x7fcdd014d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.583+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 shutdown_connections 2024-03-23T06:15:14.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.584+0000 7fcdd6800640 1 -- 172.21.15.73:0/2684696877 wait complete. 2024-03-23T06:15:14.609 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:15:14.609 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:15:14.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:15:14.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.918+0000 7f5cb7200640 1 Processor -- start 2024-03-23T06:15:14.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.919+0000 7f5cb7200640 1 -- start start 2024-03-23T06:15:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.921+0000 7f5cb7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.921+0000 7f5cb7200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5cb8153750 0x7f5cb80b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.921+0000 7f5cb7200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb806a960 con 0x7f5cb80c9b70 2024-03-23T06:15:14.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.921+0000 7f5cb7200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb806adf0 con 0x7f5cb8153750 2024-03-23T06:15:14.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.921+0000 7f5cb7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8153bc0 con 0x7f5cb80c9790 2024-03-23T06:15:14.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.921+0000 7f5cb6800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5cb8153750 0x7f5cb80b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.921+0000 7f5cb6800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5cb8153750 0x7f5cb80b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51688/0 (socket says 172.21.15.73:51688) 2024-03-23T06:15:14.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.921+0000 7f5cb6800640 1 -- 172.21.15.73:0/1453255438 learned_addr learned my addr 172.21.15.73:0/1453255438 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:14.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.922+0000 7f5cb5e00640 1 --2- 172.21.15.73:0/1453255438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.924+0000 7f5cb5e00640 1 -- 172.21.15.73:0/1453255438 >> v2:172.21.15.73:3300/0 conn(0x7f5cb8153750 msgr2=0x7f5cb80b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:14.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.924+0000 7f5cb5e00640 1 --2- 172.21.15.73:0/1453255438 >> v2:172.21.15.73:3300/0 conn(0x7f5cb8153750 0x7f5cb80b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.924+0000 7f5cb5e00640 1 -- 172.21.15.73:0/1453255438 >> v1:172.21.15.73:6789/0 conn(0x7f5cb80c9b70 legacy=0x7f5cb8153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.925+0000 7f5cb5e00640 1 -- 172.21.15.73:0/1453255438 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb81596d0 con 0x7f5cb80c9790 2024-03-23T06:15:14.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.927+0000 7f5cb6800640 1 --2- 172.21.15.73:0/1453255438 >> v2:172.21.15.73:3300/0 conn(0x7f5cb8153750 0x7f5cb80b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:15:14.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.928+0000 7f5cb5e00640 1 --2- 172.21.15.73:0/1453255438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80b2260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80097a0 tx=0x7f5ca802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f99353fc88aefa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.929+0000 7f5cb5400640 1 -- 172.21.15.73:0/1453255438 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8030840 con 0x7f5cb80c9790 2024-03-23T06:15:14.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.929+0000 7f5cb5400640 1 -- 172.21.15.73:0/1453255438 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca80309a0 con 0x7f5cb80c9790 2024-03-23T06:15:14.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.929+0000 7f5cb5400640 1 -- 172.21.15.73:0/1453255438 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8030d70 con 0x7f5cb80c9790 2024-03-23T06:15:14.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.930+0000 7f5cb7200640 1 -- 172.21.15.73:0/1453255438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 msgr2=0x7f5cb80b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.930+0000 7f5cb7200640 1 --2- 172.21.15.73:0/1453255438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80b2260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80097a0 tx=0x7f5ca802b980 comp rx=0 tx=0).stop 2024-03-23T06:15:14.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.930+0000 7f5cb7200640 1 -- 172.21.15.73:0/1453255438 shutdown_connections 2024-03-23T06:15:14.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.931+0000 7f5cb7200640 1 --2- 172.21.15.73:0/1453255438 >> v2:172.21.15.73:3300/0 conn(0x7f5cb8153750 0x7f5cb80b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.931+0000 7f5cb7200640 1 --2- 172.21.15.73:0/1453255438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80b2260 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.931+0000 7f5cb7200640 1 -- 172.21.15.73:0/1453255438 >> 172.21.15.73:0/1453255438 conn(0x7f5cb8071d40 msgr2=0x7f5cb806bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:14.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.931+0000 7f5cb7200640 1 -- 172.21.15.73:0/1453255438 shutdown_connections 2024-03-23T06:15:14.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.931+0000 7f5cb7200640 1 -- 172.21.15.73:0/1453255438 wait complete. 2024-03-23T06:15:14.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.938+0000 7f5cb7200640 1 Processor -- start 2024-03-23T06:15:14.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.941+0000 7f5cb7200640 1 -- start start 2024-03-23T06:15:14.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.943+0000 7f5cb7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.943+0000 7f5cb7200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80c9b70 0x7f5cb80ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.944+0000 7f5cafe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80c9b70 0x7f5cb80ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.944+0000 7f5cafe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80c9b70 0x7f5cb80ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51692/0 (socket says 172.21.15.73:51692) 2024-03-23T06:15:14.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.945+0000 7f5cb5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.945+0000 7f5cb5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:44936/0 (socket says 172.21.15.73:44936) 2024-03-23T06:15:14.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.945+0000 7f5cafe00640 1 -- 172.21.15.73:0/370305386 learned_addr learned my addr 172.21.15.73:0/370305386 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:14.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.945+0000 7f5cb7200640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb8153750 0x7f5cb80ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.948+0000 7f5cb6800640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb8153750 0x7f5cb80ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.948+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80cb990 con 0x7f5cb80c9b70 2024-03-23T06:15:14.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.948+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80cebb0 con 0x7f5cb8153750 2024-03-23T06:15:14.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.948+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80cee90 con 0x7f5cb80c9790 2024-03-23T06:15:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.951+0000 7f5cb5e00640 1 -- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb8153750 msgr2=0x7f5cb80ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.951+0000 7f5cb5e00640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb8153750 0x7f5cb80ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.951+0000 7f5cb5e00640 1 -- 172.21.15.73:0/370305386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80c9b70 msgr2=0x7f5cb80ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.951+0000 7f5cb5e00640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80c9b70 0x7f5cb80ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.951+0000 7f5cb5e00640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb0009b30 con 0x7f5cb80c9790 2024-03-23T06:15:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.952+0000 7f5cb6800640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb8153750 0x7f5cb80ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:15:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.952+0000 7f5cafe00640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80c9b70 0x7f5cb80ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:15:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.954+0000 7f5cb5e00640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80ce2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8033000 tx=0x7f5ca8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.955+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca803e040 con 0x7f5cb80c9790 2024-03-23T06:15:14.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.955+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8039c30 con 0x7f5cb80c9790 2024-03-23T06:15:14.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.955+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80443f0 con 0x7f5cb80c9790 2024-03-23T06:15:14.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.955+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca8009400 con 0x7f5cb80c9790 2024-03-23T06:15:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.960+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb80cc340 con 0x7f5cb80c9790 2024-03-23T06:15:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.961+0000 7f5cb7200640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815aa90 0x7f5cb81f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.961+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80723f0 con 0x7f5cb815aa90 2024-03-23T06:15:14.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.964+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5ca802f390 con 0x7f5cb80c9790 2024-03-23T06:15:14.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.965+0000 7f5cae000640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5c9406ac00 0x7f5c9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.965+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5ca80ab910 con 0x7f5cb80c9790 2024-03-23T06:15:14.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.968+0000 7f5cafe00640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815aa90 0x7f5cb81f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.970+0000 7f5cb6800640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5c9406ac00 0x7f5c9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.970+0000 7f5cafe00640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cb806a030 con 0x7f5cb815aa90 2024-03-23T06:15:14.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.972+0000 7f5cafe00640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815aa90 0x7f5cb81f1e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000e700 tx=0x7f5ca000ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.973+0000 7f5cb6800640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5c9406ac00 0x7f5c9406d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80cd900 tx=0x7f5cb000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.973+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00050d0 con 0x7f5cb815aa90 2024-03-23T06:15:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.973+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5ca0005230 con 0x7f5cb815aa90 2024-03-23T06:15:14.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.976+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815aa90 msgr2=0x7f5cb81f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.976+0000 7f5cae000640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815aa90 0x7f5cb81f1e10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000e700 tx=0x7f5ca000ebc0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.976+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815aa90 msgr2=0x7f5cb81f1e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:14.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.976+0000 7f5cae000640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815aa90 0x7f5cb81f1e10 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000e700 tx=0x7f5ca000ebc0 comp rx=0 tx=0).stop 2024-03-23T06:15:14.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.995+0000 7f5cb7200640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815a540 0x7f5cb81f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:14.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.995+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb8069d50 con 0x7f5cb815a540 2024-03-23T06:15:14.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.995+0000 7f5cafe00640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815a540 0x7f5cb81f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:14.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.996+0000 7f5cafe00640 1 -- 172.21.15.73:0/370305386 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5cb806a310 con 0x7f5cb815a540 2024-03-23T06:15:14.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.996+0000 7f5cafe00640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815a540 0x7f5cb81f2350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000e700 tx=0x7f5ca0001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:14.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.997+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0022070 con 0x7f5cb815a540 2024-03-23T06:15:14.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.997+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f5ca00035f0 con 0x7f5cb815a540 2024-03-23T06:15:14.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.997+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815a540 msgr2=0x7f5cb81f2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:14.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.997+0000 7f5cae000640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815a540 0x7f5cb81f2350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000e700 tx=0x7f5ca0001120 comp rx=0 tx=0).stop 2024-03-23T06:15:14.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.997+0000 7f5cae000640 1 -- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815a540 msgr2=0x7f5cb81f2350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:14.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.997+0000 7f5cae000640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5cb815a540 0x7f5cb81f2350 secure :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ca000e700 tx=0x7f5ca0001120 comp rx=0 tx=0).stop 2024-03-23T06:15:14.998 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:15:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:14.998 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 56, 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 14, 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:14.999 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:15.000 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:15:15.001 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:15.002 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:15.003 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:15.004 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.005 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:15.006 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:15.007 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:15.008 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.009 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:15:15.009 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.999+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5c9406ac00 msgr2=0x7f5c9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.999+0000 7f5cb7200640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5c9406ac00 0x7f5c9406d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80cd900 tx=0x7f5cb000b040 comp rx=0 tx=0).stop 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.999+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 msgr2=0x7f5cb80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.999+0000 7f5cb7200640 1 --2- 172.21.15.73:0/370305386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5cb80c9790 0x7f5cb80ce2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8033000 tx=0x7f5ca8004730 comp rx=0 tx=0).stop 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:14.999+0000 7f5cb6800640 1 -- 172.21.15.73:0/370305386 reap_dead start 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.000+0000 7f5cb6800640 1 -- 172.21.15.73:0/370305386 reap_dead start 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.001+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 shutdown_connections 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.001+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 >> 172.21.15.73:0/370305386 conn(0x7f5cb8071d40 msgr2=0x7f5cb80c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.001+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 shutdown_connections 2024-03-23T06:15:15.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.002+0000 7f5cb7200640 1 -- 172.21.15.73:0/370305386 wait complete. 2024-03-23T06:15:15.033 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:15:15.033 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:15:15.033 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:15:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.405+0000 7f2fd1800640 1 Processor -- start 2024-03-23T06:15:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.405+0000 7f2fd1800640 1 -- start start 2024-03-23T06:15:15.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.409+0000 7f2fd1800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2fcc0ccd90 0x7f2fcc0c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.409+0000 7f2fd1800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fcc0cd170 0x7f2fcc06f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.409+0000 7f2fd1800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fcc157090 con 0x7f2fcc06fec0 2024-03-23T06:15:15.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.409+0000 7f2fd1800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc157fd0 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.409+0000 7f2fd1800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fcc0702d0 con 0x7f2fcc0cd170 2024-03-23T06:15:15.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.410+0000 7f2fca000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fcc0cd170 0x7f2fcc06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.410+0000 7f2fca000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2fcc0cd170 0x7f2fcc06f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37978/0 (socket says 172.21.15.73:37978) 2024-03-23T06:15:15.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.410+0000 7f2fca000640 1 -- 172.21.15.73:0/1054719290 learned_addr learned my addr 172.21.15.73:0/1054719290 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.412+0000 7f2fca000640 1 -- 172.21.15.73:0/1054719290 >> v2:172.21.15.73:3300/0 conn(0x7f2fcc0ccd90 msgr2=0x7f2fcc0c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.412+0000 7f2fca000640 1 --2- 172.21.15.73:0/1054719290 >> v2:172.21.15.73:3300/0 conn(0x7f2fcc0ccd90 0x7f2fcc0c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.412+0000 7f2fca000640 1 -- 172.21.15.73:0/1054719290 >> v1:172.21.15.73:6789/0 conn(0x7f2fcc06fec0 legacy=0x7f2fcc150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:15.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.412+0000 7f2fca000640 1 -- 172.21.15.73:0/1054719290 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc157350 con 0x7f2fcc0cd170 2024-03-23T06:15:15.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.416+0000 7f2fca000640 1 --2- 172.21.15.73:0/1054719290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fcc0cd170 0x7f2fcc06f980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc06d080 tx=0x7f2fb802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fb46b105cf1bca0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:15.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.417+0000 7f2fc9600640 1 -- 172.21.15.73:0/1054719290 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8031870 con 0x7f2fcc0cd170 2024-03-23T06:15:15.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.418+0000 7f2fc9600640 1 -- 172.21.15.73:0/1054719290 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb80319d0 con 0x7f2fcc0cd170 2024-03-23T06:15:15.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.419+0000 7f2fd1800640 1 -- 172.21.15.73:0/1054719290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fcc0cd170 msgr2=0x7f2fcc06f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.420+0000 7f2fc9600640 1 -- 172.21.15.73:0/1054719290 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8031d60 con 0x7f2fcc0cd170 2024-03-23T06:15:15.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.420+0000 7f2fd1800640 1 --2- 172.21.15.73:0/1054719290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fcc0cd170 0x7f2fcc06f980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc06d080 tx=0x7f2fb802b910 comp rx=0 tx=0).stop 2024-03-23T06:15:15.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.420+0000 7f2fd1800640 1 -- 172.21.15.73:0/1054719290 shutdown_connections 2024-03-23T06:15:15.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.420+0000 7f2fd1800640 1 --2- 172.21.15.73:0/1054719290 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fcc0cd170 0x7f2fcc06f980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.420+0000 7f2fd1800640 1 --2- 172.21.15.73:0/1054719290 >> v2:172.21.15.73:3300/0 conn(0x7f2fcc0ccd90 0x7f2fcc0c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.420+0000 7f2fd1800640 1 -- 172.21.15.73:0/1054719290 >> 172.21.15.73:0/1054719290 conn(0x7f2fcc071fe0 msgr2=0x7f2fcc06dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:15.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.421+0000 7f2fd1800640 1 -- 172.21.15.73:0/1054719290 shutdown_connections 2024-03-23T06:15:15.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.423+0000 7f2fd1800640 1 -- 172.21.15.73:0/1054719290 wait complete. 2024-03-23T06:15:15.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.426+0000 7f2fd1800640 1 Processor -- start 2024-03-23T06:15:15.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.426+0000 7f2fd1800640 1 -- start start 2024-03-23T06:15:15.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.427+0000 7f2fd1800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fcc06fec0 0x7f2fcc0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.427+0000 7f2fd1800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc0ccd90 0x7f2fcc1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.428+0000 7f2fd1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fcc0cd170 0x7f2fcc1f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.428+0000 7f2fd1800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc152e90 con 0x7f2fcc06fec0 2024-03-23T06:15:15.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.428+0000 7f2fd1800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc1493e0 con 0x7f2fcc0cd170 2024-03-23T06:15:15.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.428+0000 7f2fd1800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc06c7b0 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.429+0000 7f2fca000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc0ccd90 0x7f2fcc1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.429+0000 7f2fca000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc0ccd90 0x7f2fcc1534e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:44948/0 (socket says 172.21.15.73:44948) 2024-03-23T06:15:15.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.429+0000 7f2fca000640 1 -- 172.21.15.73:0/2936237596 learned_addr learned my addr 172.21.15.73:0/2936237596 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:15.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.429+0000 7f2fcb400640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fcc0cd170 0x7f2fcc1f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.430+0000 7f2fcaa00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fcc06fec0 0x7f2fcc0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.430+0000 7f2fca000640 1 -- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fcc0cd170 msgr2=0x7f2fcc1f66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.430+0000 7f2fca000640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2fcc0cd170 0x7f2fcc1f66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.430+0000 7f2fca000640 1 -- 172.21.15.73:0/2936237596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fcc06fec0 msgr2=0x7f2fcc0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.430+0000 7f2fca000640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fcc06fec0 0x7f2fcc0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.430+0000 7f2fca000640 1 -- 172.21.15.73:0/2936237596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb80094d0 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.431+0000 7f2fcaa00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2fcc06fec0 0x7f2fcc0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:15:15.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.431+0000 7f2fca000640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc0ccd90 0x7f2fcc1534e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8000c00 tx=0x7f2fb8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:15.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.431+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80443f0 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.432+0000 7f2fd1800640 1 -- 172.21.15.73:0/2936237596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc06ca70 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.432+0000 7f2fd1800640 1 -- 172.21.15.73:0/2936237596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc06cd50 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.432+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb8044570 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.432+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8044920 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.436+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2fb80303c0 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.438+0000 7f2fc2a00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fac06ac30 0x7f2fac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.438+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f2fb802d040 con 0x7f2fcc0ccd90 2024-03-23T06:15:15.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.439+0000 7f2fcaa00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fac06ac30 0x7f2fac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.440+0000 7f2fcaa00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fac06ac30 0x7f2fac06d0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000b60 tx=0x7f2fc40073c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.444+0000 7f2fb7e00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc06c200 0x7f2fcc0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.444+0000 7f2fb7e00640 1 -- 172.21.15.73:0/2936237596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc152670 con 0x7f2fcc06c200 2024-03-23T06:15:15.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.448+0000 7f2fcb400640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc06c200 0x7f2fcc0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.455+0000 7f2fcb400640 1 -- 172.21.15.73:0/2936237596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fcc157bf0 con 0x7f2fcc06c200 2024-03-23T06:15:15.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.456+0000 7f2fcb400640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc06c200 0x7f2fcc0ca990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d3b0 tx=0x7f2fbc00d870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:15.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.459+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00b070 con 0x7f2fcc06c200 2024-03-23T06:15:15.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.459+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f2fbc0035f0 con 0x7f2fcc06c200 2024-03-23T06:15:15.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.459+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc06c200 msgr2=0x7f2fcc0ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.459+0000 7f2fc2a00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc06c200 0x7f2fcc0ca990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d3b0 tx=0x7f2fbc00d870 comp rx=0 tx=0).stop 2024-03-23T06:15:15.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.459+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc06c200 msgr2=0x7f2fcc0ca990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:15.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.459+0000 7f2fc2a00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc06c200 0x7f2fcc0ca990 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d3b0 tx=0x7f2fbc00d870 comp rx=0 tx=0).stop 2024-03-23T06:15:15.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.470+0000 7f2fb7e00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc151980 0x7f2fcc0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.470+0000 7f2fb7e00640 1 -- 172.21.15.73:0/2936237596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc0696d0 con 0x7f2fcc151980 2024-03-23T06:15:15.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.470+0000 7f2fcb400640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc151980 0x7f2fcc0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.471+0000 7f2fcb400640 1 -- 172.21.15.73:0/2936237596 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2fcc157910 con 0x7f2fcc151980 2024-03-23T06:15:15.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.472+0000 7f2fcb400640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc151980 0x7f2fcc0caed0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d3b0 tx=0x7f2fbc001020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:15.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.475+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc013c00 con 0x7f2fcc151980 2024-03-23T06:15:15.475 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 56, 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 15, 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:15:15.476 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:15.477 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:15:15.478 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:15.479 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:15.480 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.481 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:15.482 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:15.483 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:15.484 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.485 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.486 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:15.487 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:15.488 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:15:15.488 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:15:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.475+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f2fbc013d60 con 0x7f2fcc151980 2024-03-23T06:15:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.475+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc151980 msgr2=0x7f2fcc0caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.475+0000 7f2fc2a00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc151980 0x7f2fcc0caed0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d3b0 tx=0x7f2fbc001020 comp rx=0 tx=0).stop 2024-03-23T06:15:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.475+0000 7f2fc2a00640 1 -- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc151980 msgr2=0x7f2fcc0caed0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.475+0000 7f2fc2a00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc151980 0x7f2fcc0caed0 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00d3b0 tx=0x7f2fbc001020 comp rx=0 tx=0).stop 2024-03-23T06:15:15.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.476+0000 7f2fb7e00640 1 -- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fac06ac30 msgr2=0x7f2fac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.476+0000 7f2fb7e00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2fac06ac30 0x7f2fac06d0f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000b60 tx=0x7f2fc40073c0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.476+0000 7f2fb7e00640 1 -- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc0ccd90 msgr2=0x7f2fcc1534e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.476+0000 7f2fb7e00640 1 --2- 172.21.15.73:0/2936237596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2fcc0ccd90 0x7f2fcc1534e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8000c00 tx=0x7f2fb8004730 comp rx=0 tx=0).stop 2024-03-23T06:15:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.477+0000 7f2fcb400640 1 -- 172.21.15.73:0/2936237596 reap_dead start 2024-03-23T06:15:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.478+0000 7f2fb7e00640 1 -- 172.21.15.73:0/2936237596 shutdown_connections 2024-03-23T06:15:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.478+0000 7f2fb7e00640 1 -- 172.21.15.73:0/2936237596 >> 172.21.15.73:0/2936237596 conn(0x7f2fcc071fe0 msgr2=0x7f2fcc14f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.478+0000 7f2fb7e00640 1 -- 172.21.15.73:0/2936237596 shutdown_connections 2024-03-23T06:15:15.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.479+0000 7f2fb7e00640 1 -- 172.21.15.73:0/2936237596 wait complete. 2024-03-23T06:15:15.503 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:15:15.503 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:15:15.504 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:15:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.825+0000 7fe01cc00640 1 Processor -- start 2024-03-23T06:15:15.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.826+0000 7fe01cc00640 1 -- start start 2024-03-23T06:15:15.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.827+0000 7fe01cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0180c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.827+0000 7fe01cc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0180c4d60 0x7fe018159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.827+0000 7fe01cc00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01815a630 con 0x7fe0180cabc0 2024-03-23T06:15:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.827+0000 7fe01cc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe018159bb0 con 0x7fe0180c4d60 2024-03-23T06:15:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.827+0000 7fe01cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe018159d90 con 0x7fe0180c4240 2024-03-23T06:15:15.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.828+0000 7fe017e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0180c4d60 0x7fe018159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.828+0000 7fe017e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0180c4d60 0x7fe018159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:38006/0 (socket says 172.21.15.73:38006) 2024-03-23T06:15:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.828+0000 7fe017e00640 1 -- 172.21.15.73:0/3165747547 learned_addr learned my addr 172.21.15.73:0/3165747547 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.829+0000 7fe017400640 1 --2- 172.21.15.73:0/3165747547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0180c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.830+0000 7fe017e00640 1 -- 172.21.15.73:0/3165747547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 msgr2=0x7fe0180c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.830+0000 7fe016000640 1 -- 172.21.15.73:0/3165747547 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683091382 0 0) 0x7fe004001110 con 0x7fe0180cabc0 2024-03-23T06:15:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.830+0000 7fe017e00640 1 --2- 172.21.15.73:0/3165747547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0180c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.830+0000 7fe017e00640 1 -- 172.21.15.73:0/3165747547 >> v1:172.21.15.73:6789/0 conn(0x7fe0180cabc0 legacy=0x7fe01815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.830+0000 7fe017e00640 1 -- 172.21.15.73:0/3165747547 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01815a070 con 0x7fe0180c4d60 2024-03-23T06:15:15.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.833+0000 7fe017e00640 1 --2- 172.21.15.73:0/3165747547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180c4d60 0x7fe018159670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe010009e50 tx=0x7fe01002c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b712eefe9bc81a0b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:15.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.834+0000 7fe016000640 1 -- 172.21.15.73:0/3165747547 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01002cbb0 con 0x7fe0180c4d60 2024-03-23T06:15:15.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.834+0000 7fe016000640 1 -- 172.21.15.73:0/3165747547 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01002cd10 con 0x7fe0180c4d60 2024-03-23T06:15:15.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.835+0000 7fe016000640 1 -- 172.21.15.73:0/3165747547 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010034610 con 0x7fe0180c4d60 2024-03-23T06:15:15.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.836+0000 7fe01cc00640 1 -- 172.21.15.73:0/3165747547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180c4d60 msgr2=0x7fe018159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.836+0000 7fe01cc00640 1 --2- 172.21.15.73:0/3165747547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180c4d60 0x7fe018159670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe010009e50 tx=0x7fe01002c010 comp rx=0 tx=0).stop 2024-03-23T06:15:15.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.837+0000 7fe01cc00640 1 -- 172.21.15.73:0/3165747547 shutdown_connections 2024-03-23T06:15:15.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.837+0000 7fe01cc00640 1 --2- 172.21.15.73:0/3165747547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180c4d60 0x7fe018159670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.837+0000 7fe01cc00640 1 --2- 172.21.15.73:0/3165747547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0180c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.837+0000 7fe01cc00640 1 -- 172.21.15.73:0/3165747547 >> 172.21.15.73:0/3165747547 conn(0x7fe018071d20 msgr2=0x7fe01806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:15.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.837+0000 7fe01cc00640 1 -- 172.21.15.73:0/3165747547 shutdown_connections 2024-03-23T06:15:15.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.837+0000 7fe01cc00640 1 -- 172.21.15.73:0/3165747547 wait complete. 2024-03-23T06:15:15.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.839+0000 7fe01cc00640 1 Processor -- start 2024-03-23T06:15:15.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.839+0000 7fe01cc00640 1 -- start start 2024-03-23T06:15:15.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe01cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0181f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe01cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0180c4d60 0x7fe018152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe01cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180cabc0 0x7fe018152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe01cc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0181504b0 con 0x7fe0180c4d60 2024-03-23T06:15:15.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe01cc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01815b200 con 0x7fe0180cabc0 2024-03-23T06:15:15.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe01cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0181f0910 con 0x7fe0180c4240 2024-03-23T06:15:15.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe017400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0181f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe017400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0181f03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:44980/0 (socket says 172.21.15.73:44980) 2024-03-23T06:15:15.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.841+0000 7fe017400640 1 -- 172.21.15.73:0/1563068425 learned_addr learned my addr 172.21.15.73:0/1563068425 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:15.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.842+0000 7fe017e00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180cabc0 0x7fe018152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.842+0000 7fe017400640 1 -- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180cabc0 msgr2=0x7fe018152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:15.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.842+0000 7fe017400640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180cabc0 0x7fe018152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.842+0000 7fe017400640 1 -- 172.21.15.73:0/1563068425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0180c4d60 msgr2=0x7fe018152210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:15:15.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.842+0000 7fe016a00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0180c4d60 0x7fe018152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.842+0000 7fe017400640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0180c4d60 0x7fe018152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.842+0000 7fe017400640 1 -- 172.21.15.73:0/1563068425 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe010009b30 con 0x7fe0180c4240 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.842+0000 7fe017e00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180cabc0 0x7fe018152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.843+0000 7fe016a00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0180c4d60 0x7fe018152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.843+0000 7fe017400640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0181f03d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe00800e870 tx=0x7fe00800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.843+0000 7fe00f400640 1 -- 172.21.15.73:0/1563068425 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0080094f0 con 0x7fe0180c4240 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.844+0000 7fe00f400640 1 -- 172.21.15.73:0/1563068425 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800c940 con 0x7fe0180c4240 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.844+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0181516a0 con 0x7fe0180c4240 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.844+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe018151c60 con 0x7fe0180c4240 2024-03-23T06:15:15.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.844+0000 7fe00f400640 1 -- 172.21.15.73:0/1563068425 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800ccf0 con 0x7fe0180c4240 2024-03-23T06:15:15.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.850+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff0005250 con 0x7fe0180c4240 2024-03-23T06:15:15.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.850+0000 7fe00f400640 1 -- 172.21.15.73:0/1563068425 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe008013470 con 0x7fe0180c4240 2024-03-23T06:15:15.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.852+0000 7fe00f400640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdff806ac00 0x7fdff806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:15.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.852+0000 7fe00f400640 1 -- 172.21.15.73:0/1563068425 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe0080897e0 con 0x7fe0180c4240 2024-03-23T06:15:15.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.852+0000 7fe016a00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdff806ac00 0x7fdff806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:15.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.855+0000 7fe016a00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdff806ac00 0x7fdff806d0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe004007fd0 tx=0x7fe004009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:15.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:15.859+0000 7fe00f400640 1 -- 172.21.15.73:0/1563068425 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe008054650 con 0x7fe0180c4240 2024-03-23T06:15:16.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.406+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fdff00057d0 con 0x7fe0180c4240 2024-03-23T06:15:16.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.410+0000 7fe00f400640 1 -- 172.21.15.73:0/1563068425 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fe008057c70 con 0x7fe0180c4240 2024-03-23T06:15:16.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.422+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdff806ac00 msgr2=0x7fdff806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:16.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.422+0000 7fe01cc00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdff806ac00 0x7fdff806d0c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe004007fd0 tx=0x7fe004009040 comp rx=0 tx=0).stop 2024-03-23T06:15:16.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 msgr2=0x7fe0181f03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:16.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0181f03d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe00800e870 tx=0x7fe00800ed30 comp rx=0 tx=0).stop 2024-03-23T06:15:16.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 shutdown_connections 2024-03-23T06:15:16.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0180cabc0 0x7fe018152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:16.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0180c4d60 0x7fe018152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:16.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdff806ac00 0x7fdff806d0c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:16.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 --2- 172.21.15.73:0/1563068425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0180c4240 0x7fe0181f03d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:16.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 >> 172.21.15.73:0/1563068425 conn(0x7fe018071d20 msgr2=0x7fe0180c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:16.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.423+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 shutdown_connections 2024-03-23T06:15:16.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:16.424+0000 7fe01cc00640 1 -- 172.21.15.73:0/1563068425 wait complete. 2024-03-23T06:15:16.461 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:15:26.462 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:15:26.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:15:27.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.224+0000 7fe774e00640 1 Processor -- start 2024-03-23T06:15:27.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.224+0000 7fe774e00640 1 -- start start 2024-03-23T06:15:27.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.232+0000 7fe774e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe77006bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.232+0000 7fe76de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe77006bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.232+0000 7fe76de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe77006bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41912/0 (socket says 172.21.15.73:41912) 2024-03-23T06:15:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.233+0000 7fe76de00640 1 -- 172.21.15.73:0/2999734577 learned_addr learned my addr 172.21.15.73:0/2999734577 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:27.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.233+0000 7fe774e00640 1 -- 172.21.15.73:0/2999734577 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7701561e0 con 0x7fe7700c6b00 2024-03-23T06:15:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.233+0000 7fe774e00640 1 -- 172.21.15.73:0/2999734577 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7700c01c0 con 0x7fe770155b60 2024-03-23T06:15:27.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.233+0000 7fe774e00640 1 -- 172.21.15.73:0/2999734577 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7700c0b60 con 0x7fe77014f610 2024-03-23T06:15:27.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.239+0000 7fe76de00640 1 -- 172.21.15.73:0/2999734577 >> v1:172.21.15.110:6789/0 conn(0x7fe770155b60 legacy=0x7fe77015fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:27.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.239+0000 7fe76de00640 1 -- 172.21.15.73:0/2999734577 >> v1:172.21.15.73:6789/0 conn(0x7fe7700c6b00 legacy=0x7fe770155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:27.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.241+0000 7fe76de00640 1 -- 172.21.15.73:0/2999734577 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7700c04a0 con 0x7fe77014f610 2024-03-23T06:15:27.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.246+0000 7fe76de00640 1 --2- 172.21.15.73:0/2999734577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe77006bde0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe768009e80 tx=0x7fe76802bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bc13a1f469b04db server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:27.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.246+0000 7fe76ca00640 1 -- 172.21.15.73:0/2999734577 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76802caf0 con 0x7fe77014f610 2024-03-23T06:15:27.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.247+0000 7fe76ca00640 1 -- 172.21.15.73:0/2999734577 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76802cc50 con 0x7fe77014f610 2024-03-23T06:15:27.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.247+0000 7fe76ca00640 1 -- 172.21.15.73:0/2999734577 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7680343f0 con 0x7fe77014f610 2024-03-23T06:15:27.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.248+0000 7fe774e00640 1 -- 172.21.15.73:0/2999734577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 msgr2=0x7fe77006bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:27.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.248+0000 7fe774e00640 1 --2- 172.21.15.73:0/2999734577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe77006bde0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe768009e80 tx=0x7fe76802bf50 comp rx=0 tx=0).stop 2024-03-23T06:15:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.256+0000 7fe774e00640 1 -- 172.21.15.73:0/2999734577 shutdown_connections 2024-03-23T06:15:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.256+0000 7fe774e00640 1 --2- 172.21.15.73:0/2999734577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe77006bde0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.256+0000 7fe774e00640 1 -- 172.21.15.73:0/2999734577 >> 172.21.15.73:0/2999734577 conn(0x7fe77006d980 msgr2=0x7fe77006dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:27.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.258+0000 7fe774e00640 1 -- 172.21.15.73:0/2999734577 shutdown_connections 2024-03-23T06:15:27.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.258+0000 7fe774e00640 1 -- 172.21.15.73:0/2999734577 wait complete. 2024-03-23T06:15:27.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.260+0000 7fe774e00640 1 Processor -- start 2024-03-23T06:15:27.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.260+0000 7fe774e00640 1 -- start start 2024-03-23T06:15:27.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.262+0000 7fe774e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c6b00 0x7fe770130c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:27.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.262+0000 7fe774e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe770131150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:27.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.262+0000 7fe774e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe770155b60 0x7fe77012f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:27.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.264+0000 7fe76de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c6b00 0x7fe770130c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:27.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.264+0000 7fe76de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c6b00 0x7fe770130c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33674/0 (socket says 172.21.15.73:33674) 2024-03-23T06:15:27.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.264+0000 7fe76e800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe770155b60 0x7fe77012f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:27.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.264+0000 7fe76de00640 1 -- 172.21.15.73:0/1044542166 learned_addr learned my addr 172.21.15.73:0/1044542166 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:27.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.266+0000 7fe76d400640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe770131150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:27.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.268+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe770133a20 con 0x7fe770155b60 2024-03-23T06:15:27.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.268+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe770133180 con 0x7fe7700c6b00 2024-03-23T06:15:27.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.268+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe770133460 con 0x7fe77014f610 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.270+0000 7fe76e800640 1 -- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 msgr2=0x7fe770131150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.270+0000 7fe76e800640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe770131150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.270+0000 7fe76e800640 1 -- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c6b00 msgr2=0x7fe770130c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.270+0000 7fe76e800640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c6b00 0x7fe770130c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.270+0000 7fe76e800640 1 -- 172.21.15.73:0/1044542166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768009b30 con 0x7fe770155b60 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.272+0000 7fe76e800640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe770155b60 0x7fe77012f940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c310 tx=0x7fe75c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.272+0000 7fe766000640 1 -- 172.21.15.73:0/1044542166 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c015e30 con 0x7fe770155b60 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.273+0000 7fe76d400640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe770131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.274+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7700c1100 con 0x7fe770155b60 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.274+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77012f140 con 0x7fe770155b60 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.276+0000 7fe766000640 1 -- 172.21.15.73:0/1044542166 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0050d0 con 0x7fe770155b60 2024-03-23T06:15:27.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.276+0000 7fe766000640 1 -- 172.21.15.73:0/1044542166 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c005440 con 0x7fe770155b60 2024-03-23T06:15:27.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.285+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe748005250 con 0x7fe770155b60 2024-03-23T06:15:27.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.287+0000 7fe766000640 1 -- 172.21.15.73:0/1044542166 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe75c015020 con 0x7fe770155b60 2024-03-23T06:15:27.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.301+0000 7fe766000640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe75006ac30 0x7fe75006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:27.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.301+0000 7fe766000640 1 -- 172.21.15.73:0/1044542166 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe75c088ea0 con 0x7fe770155b60 2024-03-23T06:15:27.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.307+0000 7fe76de00640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe75006ac30 0x7fe75006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:27.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.321+0000 7fe76de00640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe75006ac30 0x7fe75006d0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7680093e0 tx=0x7fe768030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:27.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.324+0000 7fe766000640 1 -- 172.21.15.73:0/1044542166 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe75c053c80 con 0x7fe770155b60 2024-03-23T06:15:27.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.883+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fe748005a80 con 0x7fe770155b60 2024-03-23T06:15:27.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.885+0000 7fe766000640 1 -- 172.21.15.73:0/1044542166 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fe75c053c80 con 0x7fe770155b60 2024-03-23T06:15:27.885 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":27,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:15:27.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe75006ac30 msgr2=0x7fe75006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:27.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe75006ac30 0x7fe75006d0f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7680093e0 tx=0x7fe768030000 comp rx=0 tx=0).stop 2024-03-23T06:15:27.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe770155b60 msgr2=0x7fe77012f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:27.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe770155b60 0x7fe77012f940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00c310 tx=0x7fe75c00c7d0 comp rx=0 tx=0).stop 2024-03-23T06:15:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 shutdown_connections 2024-03-23T06:15:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe770155b60 0x7fe77012f940 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe75006ac30 0x7fe75006d0f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe77014f610 0x7fe770131150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 --2- 172.21.15.73:0/1044542166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7700c6b00 0x7fe770130c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.890+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 >> 172.21.15.73:0/1044542166 conn(0x7fe77006d980 msgr2=0x7fe7701540b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.893+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 shutdown_connections 2024-03-23T06:15:27.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:27.894+0000 7fe774e00640 1 -- 172.21.15.73:0/1044542166 wait complete. 2024-03-23T06:15:27.936 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:15:27.936 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:15:27.936 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:15:27.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:15:28.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.412+0000 7f5dfb200640 1 Processor -- start 2024-03-23T06:15:28.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.412+0000 7f5dfb200640 1 -- start start 2024-03-23T06:15:28.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.414+0000 7f5dfb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0cb130 0x7f5dfc1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.414+0000 7f5dfb200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dfc0b4780 0x7f5dfc0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.414+0000 7f5dfb200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc15a1f0 con 0x7f5dfc0c5050 2024-03-23T06:15:28.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.414+0000 7f5dfb200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0c5430 con 0x7f5dfc0b4780 2024-03-23T06:15:28.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.414+0000 7f5dfb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc159950 con 0x7f5dfc0cb130 2024-03-23T06:15:28.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.415+0000 7f5dfa800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dfc0b4780 0x7f5dfc0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.415+0000 7f5df9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0cb130 0x7f5dfc1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.415+0000 7f5df9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0cb130 0x7f5dfc1592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41936/0 (socket says 172.21.15.73:41936) 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.415+0000 7f5df9400640 1 -- 172.21.15.73:0/3723996207 learned_addr learned my addr 172.21.15.73:0/3723996207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.415+0000 7f5df9e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5dfc0c5050 0x7f5dfc069cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:56462/0 (socket says 172.21.15.73:56462) 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.416+0000 7f5df8a00640 1 -- 172.21.15.73:0/3723996207 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605202240 0 0) 0x7f5dfc15a1f0 con 0x7f5dfc0c5050 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.416+0000 7f5df9400640 1 -- 172.21.15.73:0/3723996207 >> v2:172.21.15.110:3300/0 conn(0x7f5dfc0b4780 msgr2=0x7f5dfc0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.416+0000 7f5df9400640 1 --2- 172.21.15.73:0/3723996207 >> v2:172.21.15.110:3300/0 conn(0x7f5dfc0b4780 0x7f5dfc0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.416+0000 7f5df9400640 1 -- 172.21.15.73:0/3723996207 >> v1:172.21.15.110:6789/0 conn(0x7f5dfc0c5050 legacy=0x7f5dfc069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.416+0000 7f5df9400640 1 -- 172.21.15.73:0/3723996207 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc159c30 con 0x7f5dfc0cb130 2024-03-23T06:15:28.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.418+0000 7f5df9400640 1 --2- 172.21.15.73:0/3723996207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0cb130 0x7f5dfc1592a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009870 tx=0x7f5de402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c1ef0d1d63074a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.419+0000 7f5df8a00640 1 -- 172.21.15.73:0/3723996207 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4031640 con 0x7f5dfc0cb130 2024-03-23T06:15:28.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.419+0000 7f5df8a00640 1 -- 172.21.15.73:0/3723996207 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40317a0 con 0x7f5dfc0cb130 2024-03-23T06:15:28.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.419+0000 7f5df8a00640 1 -- 172.21.15.73:0/3723996207 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4031b30 con 0x7f5dfc0cb130 2024-03-23T06:15:28.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.421+0000 7f5dfb200640 1 -- 172.21.15.73:0/3723996207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0cb130 msgr2=0x7f5dfc1592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.421+0000 7f5dfb200640 1 --2- 172.21.15.73:0/3723996207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0cb130 0x7f5dfc1592a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009870 tx=0x7f5de402b8f0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.421+0000 7f5dfb200640 1 -- 172.21.15.73:0/3723996207 shutdown_connections 2024-03-23T06:15:28.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.421+0000 7f5dfb200640 1 --2- 172.21.15.73:0/3723996207 >> v2:172.21.15.110:3300/0 conn(0x7f5dfc0b4780 0x7f5dfc0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.421+0000 7f5dfb200640 1 --2- 172.21.15.73:0/3723996207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0cb130 0x7f5dfc1592a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.421+0000 7f5dfb200640 1 -- 172.21.15.73:0/3723996207 >> 172.21.15.73:0/3723996207 conn(0x7f5dfc0ceb80 msgr2=0x7f5dfc0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:28.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.428+0000 7f5dfb200640 1 -- 172.21.15.73:0/3723996207 shutdown_connections 2024-03-23T06:15:28.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.428+0000 7f5dfb200640 1 -- 172.21.15.73:0/3723996207 wait complete. 2024-03-23T06:15:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.436+0000 7f5dfb200640 1 Processor -- start 2024-03-23T06:15:28.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.436+0000 7f5dfb200640 1 -- start start 2024-03-23T06:15:28.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.440+0000 7f5dfb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc0b4780 0x7f5dfc156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.443+0000 7f5dfb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0c5050 0x7f5dfc156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.443+0000 7f5dfb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dfc0cb130 0x7f5dfc149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.443+0000 7f5dfb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc147e60 con 0x7f5dfc0b4780 2024-03-23T06:15:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.443+0000 7f5dfb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc154c70 con 0x7f5dfc0cb130 2024-03-23T06:15:28.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.443+0000 7f5dfb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc14abb0 con 0x7f5dfc0c5050 2024-03-23T06:15:28.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.446+0000 7f5df9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0c5050 0x7f5dfc156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.446+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dfc0cb130 0x7f5dfc149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.446+0000 7f5dfa800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dfc0cb130 0x7f5dfc149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33694/0 (socket says 172.21.15.73:33694) 2024-03-23T06:15:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.446+0000 7f5dfa800640 1 -- 172.21.15.73:0/3765894970 learned_addr learned my addr 172.21.15.73:0/3765894970 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:28.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.446+0000 7f5df9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc0b4780 0x7f5dfc156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.450+0000 7f5dfa800640 1 -- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0c5050 msgr2=0x7f5dfc156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.450+0000 7f5dfa800640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dfc0c5050 0x7f5dfc156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.450+0000 7f5dfa800640 1 -- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc0b4780 msgr2=0x7f5dfc156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.450+0000 7f5dfa800640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc0b4780 0x7f5dfc156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.450+0000 7f5dfa800640 1 -- 172.21.15.73:0/3765894970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40094d0 con 0x7f5dfc0cb130 2024-03-23T06:15:28.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.455+0000 7f5dfa800640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dfc0cb130 0x7f5dfc149470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5df4007e60 tx=0x7f5df400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.457+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4014420 con 0x7f5dfc0cb130 2024-03-23T06:15:28.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.457+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df40145a0 con 0x7f5dfc0cb130 2024-03-23T06:15:28.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.457+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0c7090 con 0x7f5dfc0cb130 2024-03-23T06:15:28.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.457+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4014950 con 0x7f5dfc0cb130 2024-03-23T06:15:28.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.458+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc13eaf0 con 0x7f5dfc0cb130 2024-03-23T06:15:28.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.459+0000 7f5dfb200640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc154de0 0x7f5dfc1499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.459+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0723f0 con 0x7f5dfc154de0 2024-03-23T06:15:28.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.460+0000 7f5df9e00640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc154de0 0x7f5dfc1499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.462+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5df4014ab0 con 0x7f5dfc0cb130 2024-03-23T06:15:28.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.463+0000 7f5df9e00640 1 -- 172.21.15.73:0/3765894970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5dfc0c9910 con 0x7f5dfc154de0 2024-03-23T06:15:28.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.464+0000 7f5df2000640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5dd806ac30 0x7f5dd806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.464+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5df4089fe0 con 0x7f5dfc0cb130 2024-03-23T06:15:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.464+0000 7f5df9e00640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc154de0 0x7f5dfc1499b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5dec000f60 tx=0x7f5dec001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.465+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec007150 con 0x7f5dfc154de0 2024-03-23T06:15:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.465+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5dec001d70 con 0x7f5dfc154de0 2024-03-23T06:15:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.465+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc154de0 msgr2=0x7f5dfc1499b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.465+0000 7f5df2000640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc154de0 0x7f5dfc1499b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5dec000f60 tx=0x7f5dec001c40 comp rx=0 tx=0).stop 2024-03-23T06:15:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.465+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc154de0 msgr2=0x7f5dfc1499b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.465+0000 7f5df2000640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc154de0 0x7f5dfc1499b0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5dec000f60 tx=0x7f5dec001c40 comp rx=0 tx=0).stop 2024-03-23T06:15:28.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.466+0000 7f5df9400640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5dd806ac30 0x7f5dd806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.468+0000 7f5df9400640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5dd806ac30 0x7f5dd806d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5de4036000 tx=0x7f5de403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.484+0000 7f5dfb200640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc1545d0 0x7f5dfc0c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.484+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0c9630 con 0x7f5dfc1545d0 2024-03-23T06:15:28.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.486+0000 7f5df9e00640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc1545d0 0x7f5dfc0c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.501+0000 7f5df9e00640 1 -- 172.21.15.73:0/3765894970 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5dfc06a3c0 con 0x7f5dfc1545d0 2024-03-23T06:15:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.501+0000 7f5df9e00640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc1545d0 0x7f5dfc0c0d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5dec000f60 tx=0x7f5dec001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.502+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec024070 con 0x7f5dfc1545d0 2024-03-23T06:15:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.506+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4781 (secure 0 0 0) 0x7f5dec01f0d0 con 0x7f5dfc1545d0 2024-03-23T06:15:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.506+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc1545d0 msgr2=0x7f5dfc0c0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.506+0000 7f5df2000640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc1545d0 0x7f5dfc0c0d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5dec000f60 tx=0x7f5dec001080 comp rx=0 tx=0).stop 2024-03-23T06:15:28.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.506+0000 7f5df2000640 1 -- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc1545d0 msgr2=0x7f5dfc0c0d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:28.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.506+0000 7f5df2000640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5dfc1545d0 0x7f5dfc0c0d20 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5dec000f60 tx=0x7f5dec001080 comp rx=0 tx=0).stop 2024-03-23T06:15:28.509 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:15:28.509 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 56, 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 28, 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:15:28.510 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:28.511 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:15:28.512 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:15:28.513 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:15:28.514 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:28.516 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:28.517 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.518 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.519 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:15:28.520 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:28.521 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.522 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:15:28.522 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:15:28.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.511+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5dd806ac30 msgr2=0x7f5dd806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.512+0000 7f5dfb200640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5dd806ac30 0x7f5dd806d0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5de4036000 tx=0x7f5de403c040 comp rx=0 tx=0).stop 2024-03-23T06:15:28.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.512+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dfc0cb130 msgr2=0x7f5dfc149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.512+0000 7f5dfb200640 1 --2- 172.21.15.73:0/3765894970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dfc0cb130 0x7f5dfc149470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5df4007e60 tx=0x7f5df400e4b0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.512+0000 7f5dfa800640 1 -- 172.21.15.73:0/3765894970 reap_dead start 2024-03-23T06:15:28.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.512+0000 7f5dfa800640 1 -- 172.21.15.73:0/3765894970 reap_dead start 2024-03-23T06:15:28.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.514+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 shutdown_connections 2024-03-23T06:15:28.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.514+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 >> 172.21.15.73:0/3765894970 conn(0x7f5dfc0ceb80 msgr2=0x7f5dfc069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:28.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.515+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 shutdown_connections 2024-03-23T06:15:28.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.518+0000 7f5dfb200640 1 -- 172.21.15.73:0/3765894970 wait complete. 2024-03-23T06:15:28.554 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:15:28.554 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:15:28.554 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:15:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.894+0000 7f2aca800640 1 Processor -- start 2024-03-23T06:15:28.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.894+0000 7f2aca800640 1 -- start start 2024-03-23T06:15:28.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.896+0000 7f2aca800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2abc0452a0 0x7f2abc0456d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.896+0000 7f2aca800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2abc0e6740 0x7f2abc0e6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.896+0000 7f2aca800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc007620 con 0x7f2abc0dd420 2024-03-23T06:15:28.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.896+0000 7f2aca800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc04baa0 con 0x7f2abc0e6740 2024-03-23T06:15:28.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.896+0000 7f2aca800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc045c10 con 0x7f2abc0452a0 2024-03-23T06:15:28.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.897+0000 7f2ac9400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2abc0dd420 0x7f2abc04b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55014/0 (socket says 172.21.15.73:55014) 2024-03-23T06:15:28.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.897+0000 7f2ac9400640 1 -- 172.21.15.73:0/1185707892 learned_addr learned my addr 172.21.15.73:0/1185707892 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:15:28.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.897+0000 7f2ac9e00640 1 --2- 172.21.15.73:0/1185707892 >> v2:172.21.15.73:3300/0 conn(0x7f2abc0e6740 0x7f2abc0e6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.898+0000 7f2ac9e00640 1 -- 172.21.15.73:0/1185707892 >> v2:172.21.15.110:3300/0 conn(0x7f2abc0452a0 msgr2=0x7f2abc0456d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:15:28.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.898+0000 7f2ac9e00640 1 --2- 172.21.15.73:0/1185707892 >> v2:172.21.15.110:3300/0 conn(0x7f2abc0452a0 0x7f2abc0456d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.898+0000 7f2ac9e00640 1 -- 172.21.15.73:0/1185707892 >> v1:172.21.15.73:6789/0 conn(0x7f2abc0dd420 legacy=0x7f2abc04b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:28.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.899+0000 7f2ac9e00640 1 -- 172.21.15.73:0/1185707892 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc006a10 con 0x7f2abc0e6740 2024-03-23T06:15:28.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.901+0000 7f2ac9e00640 1 --2- 172.21.15.73:0/1185707892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 0x7f2abc0e6b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2abc050fc0 tx=0x7f2ab002bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea86fcfcdeb997a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.902+0000 7f2ac3e00640 1 -- 172.21.15.73:0/1185707892 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab002c7b0 con 0x7f2abc0e6740 2024-03-23T06:15:28.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.902+0000 7f2ac3e00640 1 -- 172.21.15.73:0/1185707892 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab002c910 con 0x7f2abc0e6740 2024-03-23T06:15:28.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.902+0000 7f2ac3e00640 1 -- 172.21.15.73:0/1185707892 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab002c7b0 con 0x7f2abc0e6740 2024-03-23T06:15:28.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.903+0000 7f2aca800640 1 -- 172.21.15.73:0/1185707892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 msgr2=0x7f2abc0e6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.904+0000 7f2aca800640 1 --2- 172.21.15.73:0/1185707892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 0x7f2abc0e6b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2abc050fc0 tx=0x7f2ab002bc10 comp rx=0 tx=0).stop 2024-03-23T06:15:28.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.904+0000 7f2aca800640 1 -- 172.21.15.73:0/1185707892 shutdown_connections 2024-03-23T06:15:28.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.904+0000 7f2aca800640 1 --2- 172.21.15.73:0/1185707892 >> v2:172.21.15.110:3300/0 conn(0x7f2abc0452a0 0x7f2abc0456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.904+0000 7f2aca800640 1 --2- 172.21.15.73:0/1185707892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 0x7f2abc0e6b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.905+0000 7f2aca800640 1 -- 172.21.15.73:0/1185707892 >> 172.21.15.73:0/1185707892 conn(0x7f2abc050150 msgr2=0x7f2abc050560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:28.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.909+0000 7f2aca800640 1 -- 172.21.15.73:0/1185707892 shutdown_connections 2024-03-23T06:15:28.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.909+0000 7f2aca800640 1 -- 172.21.15.73:0/1185707892 wait complete. 2024-03-23T06:15:28.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.911+0000 7f2aca800640 1 Processor -- start 2024-03-23T06:15:28.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.922+0000 7f2aca800640 1 -- start start 2024-03-23T06:15:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.926+0000 7f2aca800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0452a0 0x7f2abc178760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.926+0000 7f2aca800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0dd420 0x7f2abc0dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.926+0000 7f2aca800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 0x7f2abc04efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.926+0000 7f2aca800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0e6440 con 0x7f2abc0e6740 2024-03-23T06:15:28.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.926+0000 7f2aca800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0e53f0 con 0x7f2abc0452a0 2024-03-23T06:15:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.926+0000 7f2aca800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc0e4f00 con 0x7f2abc0dd420 2024-03-23T06:15:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.927+0000 7f2ac9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 0x7f2abc04efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.927+0000 7f2ac9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 0x7f2abc04efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39500/0 (socket says 172.21.15.73:39500) 2024-03-23T06:15:28.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.927+0000 7f2ac9e00640 1 -- 172.21.15.73:0/398098703 learned_addr learned my addr 172.21.15.73:0/398098703 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:28.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.928+0000 7f2ac9400640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0452a0 0x7f2abc178760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.928+0000 7f2ac8a00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0dd420 0x7f2abc0dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.928+0000 7f2ac8a00640 1 -- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0452a0 msgr2=0x7f2abc178760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.928+0000 7f2ac8a00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2abc0452a0 0x7f2abc178760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.928+0000 7f2ac8a00640 1 -- 172.21.15.73:0/398098703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 msgr2=0x7f2abc04efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.929+0000 7f2ac8a00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 0x7f2abc04efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.929+0000 7f2ac8a00640 1 -- 172.21.15.73:0/398098703 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0009400 con 0x7f2abc0dd420 2024-03-23T06:15:28.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.929+0000 7f2ac8a00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0dd420 0x7f2abc0dbc20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800b3e0 tx=0x7f2ab800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.929+0000 7f2ac9e00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc0e6740 0x7f2abc04efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:15:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.931+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8011830 con 0x7f2abc0dd420 2024-03-23T06:15:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.931+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8011990 con 0x7f2abc0dd420 2024-03-23T06:15:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.931+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8011d40 con 0x7f2abc0dd420 2024-03-23T06:15:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.931+0000 7f2aca800640 1 -- 172.21.15.73:0/398098703 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc17c4c0 con 0x7f2abc0dd420 2024-03-23T06:15:28.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.931+0000 7f2aca800640 1 -- 172.21.15.73:0/398098703 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc17c150 con 0x7f2abc0dd420 2024-03-23T06:15:28.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.934+0000 7f2aca800640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0002a30 0x7f2aa0004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.934+0000 7f2aca800640 1 -- 172.21.15.73:0/398098703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0007e80 con 0x7f2aa0002a30 2024-03-23T06:15:28.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.936+0000 7f2ac9400640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0002a30 0x7f2aa0004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.936+0000 7f2ac9400640 1 -- 172.21.15.73:0/398098703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2aa0008040 con 0x7f2aa0002a30 2024-03-23T06:15:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.936+0000 7f2ac9400640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0002a30 0x7f2aa0004ef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ac404f930 tx=0x7f2ac4067930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.937+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4072470 con 0x7f2aa0002a30 2024-03-23T06:15:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.937+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f2ac40725d0 con 0x7f2aa0002a30 2024-03-23T06:15:28.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.937+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0002a30 msgr2=0x7f2aa0004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.937+0000 7f2ac1600640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0002a30 0x7f2aa0004ef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ac404f930 tx=0x7f2ac4067930 comp rx=0 tx=0).stop 2024-03-23T06:15:28.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.937+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0002a30 msgr2=0x7f2aa0004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:28.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.937+0000 7f2ac1600640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0002a30 0x7f2aa0004ef0 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ac404f930 tx=0x7f2ac4067930 comp rx=0 tx=0).stop 2024-03-23T06:15:28.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.947+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2ab801a400 con 0x7f2abc0dd420 2024-03-23T06:15:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.948+0000 7f2ac1600640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2aa406a930 0x7f2aa406cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.948+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f2ab8089610 con 0x7f2abc0dd420 2024-03-23T06:15:28.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.949+0000 7f2ac9400640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2aa406a930 0x7f2aa406cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.950+0000 7f2ac9400640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2aa406a930 0x7f2aa406cdf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0008010 tx=0x7f2ac408f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.954+0000 7f2aca800640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0006f10 0x7f2aa0007360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.954+0000 7f2aca800640 1 -- 172.21.15.73:0/398098703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00078d0 con 0x7f2aa0006f10 2024-03-23T06:15:28.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.955+0000 7f2ac9e00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0006f10 0x7f2aa0007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:28.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.957+0000 7f2ac9e00640 1 -- 172.21.15.73:0/398098703 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2aa0007a90 con 0x7f2aa0006f10 2024-03-23T06:15:28.964 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:15:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:15:28.964 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 56, 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 28, 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:28.965 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:28.966 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:15:28.967 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:28.968 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:15:28.969 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:28.970 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.971 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:28.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:15:28.973 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.974 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:15:28.975 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.959+0000 7f2ac9e00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0006f10 0x7f2aa0007360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ab002bc50 tx=0x7f2ab00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.963+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0003a20 con 0x7f2aa0006f10 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.963+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f2ab0043070 con 0x7f2aa0006f10 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.963+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0006f10 msgr2=0x7f2aa0007360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.963+0000 7f2ac1600640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0006f10 0x7f2aa0007360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ab002bc50 tx=0x7f2ab00046c0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.963+0000 7f2ac1600640 1 -- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0006f10 msgr2=0x7f2aa0007360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.963+0000 7f2ac1600640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aa0006f10 0x7f2aa0007360 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2ab002bc50 tx=0x7f2ab00046c0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.964+0000 7f2ab6a00640 1 -- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2aa406a930 msgr2=0x7f2aa406cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.964+0000 7f2ab6a00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2aa406a930 0x7f2aa406cdf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0008010 tx=0x7f2ac408f000 comp rx=0 tx=0).stop 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.964+0000 7f2ab6a00640 1 -- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0dd420 msgr2=0x7f2abc0dbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.964+0000 7f2ab6a00640 1 --2- 172.21.15.73:0/398098703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2abc0dd420 0x7f2abc0dbc20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800b3e0 tx=0x7f2ab800b8a0 comp rx=0 tx=0).stop 2024-03-23T06:15:28.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.965+0000 7f2ac9e00640 1 -- 172.21.15.73:0/398098703 reap_dead start 2024-03-23T06:15:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.965+0000 7f2ab6a00640 1 -- 172.21.15.73:0/398098703 shutdown_connections 2024-03-23T06:15:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.965+0000 7f2ab6a00640 1 -- 172.21.15.73:0/398098703 >> 172.21.15.73:0/398098703 conn(0x7f2abc050150 msgr2=0x7f2abc0da710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.965+0000 7f2ab6a00640 1 -- 172.21.15.73:0/398098703 shutdown_connections 2024-03-23T06:15:28.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:28.965+0000 7f2ab6a00640 1 -- 172.21.15.73:0/398098703 wait complete. 2024-03-23T06:15:28.998 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:15:28.998 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:15:28.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:15:29.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.263+0000 7f64bd000640 1 Processor -- start 2024-03-23T06:15:29.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.264+0000 7f64bd000640 1 -- start start 2024-03-23T06:15:29.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.268+0000 7f64bd000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64b8157110 0x7f64b80c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.268+0000 7f64bd000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b8158960 con 0x7f64b814f790 2024-03-23T06:15:29.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.268+0000 7f64bd000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b8158bb0 con 0x7f64b8155fc0 2024-03-23T06:15:29.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.268+0000 7f64bd000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b8158e90 con 0x7f64b8157110 2024-03-23T06:15:29.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.269+0000 7f64b7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64b8157110 0x7f64b80c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.269+0000 7f64b7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64b8157110 0x7f64b80c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33746/0 (socket says 172.21.15.73:33746) 2024-03-23T06:15:29.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.269+0000 7f64b7e00640 1 -- 172.21.15.73:0/1529837451 learned_addr learned my addr 172.21.15.73:0/1529837451 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:29.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.270+0000 7f64b7e00640 1 -- 172.21.15.73:0/1529837451 >> v1:172.21.15.110:6789/0 conn(0x7f64b8155fc0 legacy=0x7f64b8156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:29.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.270+0000 7f64b7e00640 1 -- 172.21.15.73:0/1529837451 >> v1:172.21.15.73:6789/0 conn(0x7f64b814f790 legacy=0x7f64b80c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:29.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.270+0000 7f64b7e00640 1 -- 172.21.15.73:0/1529837451 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b8159170 con 0x7f64b8157110 2024-03-23T06:15:29.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.271+0000 7f64b7e00640 1 --2- 172.21.15.73:0/1529837451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b8157110 0x7f64b80c7230 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64b000d370 tx=0x7f64b002e3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259c4ad9d97e6b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:29.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.272+0000 7f64b6000640 1 -- 172.21.15.73:0/1529837451 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0034480 con 0x7f64b8157110 2024-03-23T06:15:29.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.272+0000 7f64b6000640 1 -- 172.21.15.73:0/1529837451 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b0031030 con 0x7f64b8157110 2024-03-23T06:15:29.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.273+0000 7f64bd000640 1 -- 172.21.15.73:0/1529837451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b8157110 msgr2=0x7f64b80c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.273+0000 7f64bd000640 1 --2- 172.21.15.73:0/1529837451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b8157110 0x7f64b80c7230 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f64b000d370 tx=0x7f64b002e3a0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.273+0000 7f64bd000640 1 -- 172.21.15.73:0/1529837451 shutdown_connections 2024-03-23T06:15:29.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.273+0000 7f64bd000640 1 --2- 172.21.15.73:0/1529837451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b8157110 0x7f64b80c7230 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.273+0000 7f64bd000640 1 -- 172.21.15.73:0/1529837451 >> 172.21.15.73:0/1529837451 conn(0x7f64b806d3f0 msgr2=0x7f64b806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:29.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.272+0000 7f64b6000640 1 -- 172.21.15.73:0/1529837451 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0034800 con 0x7f64b8157110 2024-03-23T06:15:29.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.274+0000 7f64bd000640 1 -- 172.21.15.73:0/1529837451 shutdown_connections 2024-03-23T06:15:29.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.277+0000 7f64bd000640 1 -- 172.21.15.73:0/1529837451 wait complete. 2024-03-23T06:15:29.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.279+0000 7f64bd000640 1 Processor -- start 2024-03-23T06:15:29.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.279+0000 7f64bd000640 1 -- start start 2024-03-23T06:15:29.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.280+0000 7f64bd000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64b814f790 0x7f64b80bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.280+0000 7f64bd000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64b8155fc0 0x7f64b80be9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.280+0000 7f64bd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b80c0390 0x7f64b80bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.280+0000 7f64bd000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b814efa0 con 0x7f64b8155fc0 2024-03-23T06:15:29.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.280+0000 7f64bd000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80c11f0 con 0x7f64b80c0390 2024-03-23T06:15:29.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.280+0000 7f64bd000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b814ece0 con 0x7f64b814f790 2024-03-23T06:15:29.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.281+0000 7f64b6a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64b8155fc0 0x7f64b80be9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.281+0000 7f64b7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b80c0390 0x7f64b80bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.281+0000 7f64b7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b80c0390 0x7f64b80bef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33752/0 (socket says 172.21.15.73:33752) 2024-03-23T06:15:29.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.281+0000 7f64b7e00640 1 -- 172.21.15.73:0/1101294335 learned_addr learned my addr 172.21.15.73:0/1101294335 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:29.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.282+0000 7f64b7400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64b814f790 0x7f64b80bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.282+0000 7f64b7e00640 1 -- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64b814f790 msgr2=0x7f64b80bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.283+0000 7f64b7e00640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64b814f790 0x7f64b80bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.283+0000 7f64b7e00640 1 -- 172.21.15.73:0/1101294335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64b8155fc0 msgr2=0x7f64b80be9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.283+0000 7f64b7e00640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64b8155fc0 0x7f64b80be9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.283+0000 7f64b7e00640 1 -- 172.21.15.73:0/1101294335 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b000d050 con 0x7f64b80c0390 2024-03-23T06:15:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.283+0000 7f64b6a00640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64b8155fc0 0x7f64b80be9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:15:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.283+0000 7f64b7400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64b814f790 0x7f64b80bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:15:29.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.283+0000 7f64b7e00640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b80c0390 0x7f64b80bef00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007210 tx=0x7f64b0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.287+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0008450 con 0x7f64b80c0390 2024-03-23T06:15:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.287+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b00085b0 con 0x7f64b80c0390 2024-03-23T06:15:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.287+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b0008960 con 0x7f64b80c0390 2024-03-23T06:15:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.287+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80c3a80 con 0x7f64b80c0390 2024-03-23T06:15:29.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.287+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b80c0e80 con 0x7f64b80c0390 2024-03-23T06:15:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.289+0000 7f64bd000640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490002a30 0x7f6490004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.289+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6490007e80 con 0x7f6490002a30 2024-03-23T06:15:29.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.293+0000 7f64b7400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490002a30 0x7f6490004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.294+0000 7f64b7400640 1 -- 172.21.15.73:0/1101294335 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6490008040 con 0x7f6490002a30 2024-03-23T06:15:29.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.295+0000 7f64b7400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490002a30 0x7f6490004ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d3f0 tx=0x7f64a400d8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:29.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.296+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f64b0042480 con 0x7f64b80c0390 2024-03-23T06:15:29.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.310+0000 7f64af400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f649806ac50 0x7f649806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.310+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a400b070 con 0x7f6490002a30 2024-03-23T06:15:29.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.310+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f64b00ac440 con 0x7f64b80c0390 2024-03-23T06:15:29.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.311+0000 7f64b6a00640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f649806ac50 0x7f649806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.312+0000 7f64b6a00640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f649806ac50 0x7f649806d110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64b8067270 tx=0x7f64a8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:29.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.313+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f64a40054e0 con 0x7f6490002a30 2024-03-23T06:15:29.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.313+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490002a30 msgr2=0x7f6490004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.313+0000 7f64af400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490002a30 0x7f6490004ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d3f0 tx=0x7f64a400d8b0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.313+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490002a30 msgr2=0x7f6490004ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:29.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.313+0000 7f64af400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490002a30 0x7f6490004ef0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.339+0000 7f64bd000640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490006ef0 0x7f6490007380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.339+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6490007970 con 0x7f6490006ef0 2024-03-23T06:15:29.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.340+0000 7f64b7400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490006ef0 0x7f6490007380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.340+0000 7f64b7400640 1 -- 172.21.15.73:0/1101294335 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6490007b30 con 0x7f6490006ef0 2024-03-23T06:15:29.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.341+0000 7f64b7400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490006ef0 0x7f6490007380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d3f0 tx=0x7f64a4001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:29.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.341+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4003800 con 0x7f6490006ef0 2024-03-23T06:15:29.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.341+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f64a4003960 con 0x7f6490006ef0 2024-03-23T06:15:29.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.341+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490006ef0 msgr2=0x7f6490007380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.341+0000 7f64af400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490006ef0 0x7f6490007380 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d3f0 tx=0x7f64a4001080 comp rx=0 tx=0).stop 2024-03-23T06:15:29.342 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:15:29.342 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:29.342 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 56, 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 29, 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:15:29.343 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:29.344 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:15:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:29.346 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:29.347 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.348 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.349 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.350 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:29.351 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.352 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:15:29.353 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:29.354 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:29.355 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:15:29.355 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:15:29.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.342+0000 7f64af400640 1 -- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490006ef0 msgr2=0x7f6490007380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:29.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.342+0000 7f64af400640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490006ef0 0x7f6490007380 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d3f0 tx=0x7f64a4001080 comp rx=0 tx=0).stop 2024-03-23T06:15:29.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.345+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f649806ac50 msgr2=0x7f649806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.345+0000 7f64bd000640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f649806ac50 0x7f649806d110 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64b8067270 tx=0x7f64a8009060 comp rx=0 tx=0).stop 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.345+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b80c0390 msgr2=0x7f64b80bef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.345+0000 7f64bd000640 1 --2- 172.21.15.73:0/1101294335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64b80c0390 0x7f64b80bef00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007210 tx=0x7f64b0004a40 comp rx=0 tx=0).stop 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.346+0000 7f64b7e00640 1 -- 172.21.15.73:0/1101294335 reap_dead start 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.346+0000 7f64b7e00640 1 -- 172.21.15.73:0/1101294335 reap_dead start 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.350+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 shutdown_connections 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.350+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 >> 172.21.15.73:0/1101294335 conn(0x7f64b806d3f0 msgr2=0x7f64b814e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.351+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 shutdown_connections 2024-03-23T06:15:29.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.351+0000 7f64bd000640 1 -- 172.21.15.73:0/1101294335 wait complete. 2024-03-23T06:15:29.387 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:15:29.387 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T06:15:29.387 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T06:15:29.387 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T06:15:29.387 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T06:15:29.387 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T06:15:29.387 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:15:29.397 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T06:15:29.397 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:15:29.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:15:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.745+0000 7f1d87c00640 1 Processor -- start 2024-03-23T06:15:29.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.745+0000 7f1d87c00640 1 -- start start 2024-03-23T06:15:29.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.750+0000 7f1d87c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 0x7f1d800c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.750+0000 7f1d87c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d800c5970 0x7f1d8006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.750+0000 7f1d87c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8006d6e0 con 0x7f1d8014fb40 2024-03-23T06:15:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.750+0000 7f1d87c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d800c6900 con 0x7f1d800c5970 2024-03-23T06:15:29.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.750+0000 7f1d87c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800c7e00 con 0x7f1d8006f9b0 2024-03-23T06:15:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.750+0000 7f1d85c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d800c5970 0x7f1d8006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.750+0000 7f1d85c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d800c5970 0x7f1d8006db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:39518/0 (socket says 172.21.15.73:39518) 2024-03-23T06:15:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.750+0000 7f1d85c00640 1 -- 172.21.15.73:0/2512670411 learned_addr learned my addr 172.21.15.73:0/2512670411 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.751+0000 7f1d85c00640 1 -- 172.21.15.73:0/2512670411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 msgr2=0x7f1d800c0750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.751+0000 7f1d85c00640 1 --2- 172.21.15.73:0/2512670411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 0x7f1d800c0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.751+0000 7f1d85c00640 1 -- 172.21.15.73:0/2512670411 >> v1:172.21.15.73:6789/0 conn(0x7f1d8014fb40 legacy=0x7f1d80158b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:29.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.754+0000 7f1d85c00640 1 -- 172.21.15.73:0/2512670411 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800c6ba0 con 0x7f1d800c5970 2024-03-23T06:15:29.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.755+0000 7f1d85c00640 1 --2- 172.21.15.73:0/2512670411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 0x7f1d8006db70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800d150 tx=0x7f1d7802e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54151ac89acfb44d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:29.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.756+0000 7f1d7f400640 1 -- 172.21.15.73:0/2512670411 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7802eea0 con 0x7f1d800c5970 2024-03-23T06:15:29.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.756+0000 7f1d7f400640 1 -- 172.21.15.73:0/2512670411 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78032070 con 0x7f1d800c5970 2024-03-23T06:15:29.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.756+0000 7f1d7f400640 1 -- 172.21.15.73:0/2512670411 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78038620 con 0x7f1d800c5970 2024-03-23T06:15:29.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.757+0000 7f1d87c00640 1 -- 172.21.15.73:0/2512670411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 msgr2=0x7f1d8006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.757+0000 7f1d87c00640 1 --2- 172.21.15.73:0/2512670411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 0x7f1d8006db70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800d150 tx=0x7f1d7802e0f0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.757+0000 7f1d87c00640 1 -- 172.21.15.73:0/2512670411 shutdown_connections 2024-03-23T06:15:29.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.757+0000 7f1d87c00640 1 --2- 172.21.15.73:0/2512670411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 0x7f1d800c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.757+0000 7f1d87c00640 1 --2- 172.21.15.73:0/2512670411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 0x7f1d8006db70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.757+0000 7f1d87c00640 1 -- 172.21.15.73:0/2512670411 >> 172.21.15.73:0/2512670411 conn(0x7f1d8006bb40 msgr2=0x7f1d8006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:29.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.757+0000 7f1d87c00640 1 -- 172.21.15.73:0/2512670411 shutdown_connections 2024-03-23T06:15:29.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.757+0000 7f1d87c00640 1 -- 172.21.15.73:0/2512670411 wait complete. 2024-03-23T06:15:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.760+0000 7f1d87c00640 1 Processor -- start 2024-03-23T06:15:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.760+0000 7f1d87c00640 1 -- start start 2024-03-23T06:15:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.762+0000 7f1d87c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 0x7f1d800c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.762+0000 7f1d87c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 0x7f1d801534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.762+0000 7f1d85200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 0x7f1d800c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.762+0000 7f1d85200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 0x7f1d800c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41990/0 (socket says 172.21.15.73:41990) 2024-03-23T06:15:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.763+0000 7f1d87c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d8014fb40 0x7f1d800ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.763+0000 7f1d85200640 1 -- 172.21.15.73:0/920709962 learned_addr learned my addr 172.21.15.73:0/920709962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.763+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80154020 con 0x7f1d800c5970 2024-03-23T06:15:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.763+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800c9840 con 0x7f1d8014fb40 2024-03-23T06:15:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.763+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d801f3ed0 con 0x7f1d8006f9b0 2024-03-23T06:15:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.763+0000 7f1d85c00640 1 -- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d8014fb40 msgr2=0x7f1d800ca140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.764+0000 7f1d85c00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d8014fb40 0x7f1d800ca140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:29.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.764+0000 7f1d7fe00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 0x7f1d801534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.766+0000 7f1d7fe00640 1 -- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 msgr2=0x7f1d800c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.766+0000 7f1d7fe00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 0x7f1d800c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.766+0000 7f1d7fe00640 1 -- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d8014fb40 msgr2=0x7f1d800ca140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:15:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.766+0000 7f1d7fe00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d8014fb40 0x7f1d800ca140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.766+0000 7f1d7fe00640 1 -- 172.21.15.73:0/920709962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7800bd40 con 0x7f1d800c5970 2024-03-23T06:15:29.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.770+0000 7f1d7fe00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 0x7f1d801534a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009fd0 tx=0x7f1d6c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.771+0000 7f1d7cc00640 1 -- 172.21.15.73:0/920709962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c011830 con 0x7f1d800c5970 2024-03-23T06:15:29.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.771+0000 7f1d7cc00640 1 -- 172.21.15.73:0/920709962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c011990 con 0x7f1d800c5970 2024-03-23T06:15:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.771+0000 7f1d7cc00640 1 -- 172.21.15.73:0/920709962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c011d20 con 0x7f1d800c5970 2024-03-23T06:15:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.771+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d801f41b0 con 0x7f1d800c5970 2024-03-23T06:15:29.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.771+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d800b0a00 con 0x7f1d800c5970 2024-03-23T06:15:29.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.775+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d800c89e0 con 0x7f1d800c5970 2024-03-23T06:15:29.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.778+0000 7f1d7cc00640 1 -- 172.21.15.73:0/920709962 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1d6c01a400 con 0x7f1d800c5970 2024-03-23T06:15:29.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.779+0000 7f1d7cc00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1d6006ac00 0x7f1d6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:29.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.781+0000 7f1d7cc00640 1 -- 172.21.15.73:0/920709962 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1d6c089840 con 0x7f1d800c5970 2024-03-23T06:15:29.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.782+0000 7f1d85200640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1d6006ac00 0x7f1d6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:29.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.785+0000 7f1d85200640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1d6006ac00 0x7f1d6006d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d70006fd0 tx=0x7f1d70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:29.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:29.788+0000 7f1d7cc00640 1 -- 172.21.15.73:0/920709962 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1d6c054690 con 0x7f1d800c5970 2024-03-23T06:15:30.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.331+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1d800c6140 con 0x7f1d800c5970 2024-03-23T06:15:30.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.331+0000 7f1d7cc00640 1 -- 172.21.15.73:0/920709962 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f1d6c057cb0 con 0x7f1d800c5970 2024-03-23T06:15:30.332 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":30,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:15:30.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.335+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1d6006ac00 msgr2=0x7f1d6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:30.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.335+0000 7f1d87c00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1d6006ac00 0x7f1d6006d0c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d70006fd0 tx=0x7f1d70008040 comp rx=0 tx=0).stop 2024-03-23T06:15:30.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.335+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 msgr2=0x7f1d801534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:30.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.335+0000 7f1d87c00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 0x7f1d801534a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009fd0 tx=0x7f1d6c00b870 comp rx=0 tx=0).stop 2024-03-23T06:15:30.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.336+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 shutdown_connections 2024-03-23T06:15:30.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.336+0000 7f1d87c00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d8014fb40 0x7f1d800ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:30.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.336+0000 7f1d87c00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d800c5970 0x7f1d801534a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:30.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.336+0000 7f1d87c00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1d6006ac00 0x7f1d6006d0c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:30.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.336+0000 7f1d87c00640 1 --2- 172.21.15.73:0/920709962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d8006f9b0 0x7f1d800c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:30.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.336+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 >> 172.21.15.73:0/920709962 conn(0x7f1d8006bb40 msgr2=0x7f1d8014e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:30.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.338+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 shutdown_connections 2024-03-23T06:15:30.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:30.341+0000 7f1d87c00640 1 -- 172.21.15.73:0/920709962 wait complete. 2024-03-23T06:15:33.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:15:34.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.285+0000 7fd983000640 1 Processor -- start 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.285+0000 7fd983000640 1 -- start start 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.287+0000 7fd983000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.287+0000 7fd983000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd97c15d660 0x7fd97c0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.287+0000 7fd983000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97c161b30 con 0x7fd97c161710 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.287+0000 7fd983000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97c15df10 con 0x7fd97c15d660 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.287+0000 7fd983000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c15e1f0 con 0x7fd97c157bc0 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.287+0000 7fd97b400640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7fd97c161710 legacy=0x7fd97c0c6560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.288+0000 7fd97be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.288+0000 7fd97be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c06fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:36084/0 (socket says 172.21.15.73:36084) 2024-03-23T06:15:34.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.288+0000 7fd97be00640 1 -- 172.21.15.73:0/1591213075 learned_addr learned my addr 172.21.15.73:0/1591213075 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:34.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.289+0000 7fd981000640 1 --2- 172.21.15.73:0/1591213075 >> v2:172.21.15.73:3300/0 conn(0x7fd97c15d660 0x7fd97c0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:34.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.290+0000 7fd97be00640 1 -- 172.21.15.73:0/1591213075 >> v2:172.21.15.73:3300/0 conn(0x7fd97c15d660 msgr2=0x7fd97c0c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:34.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.290+0000 7fd97be00640 1 --2- 172.21.15.73:0/1591213075 >> v2:172.21.15.73:3300/0 conn(0x7fd97c15d660 0x7fd97c0c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.291+0000 7fd97be00640 1 -- 172.21.15.73:0/1591213075 >> v1:172.21.15.110:6789/0 conn(0x7fd97c161710 legacy=0x7fd97c0c6560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:34.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.293+0000 7fd97be00640 1 -- 172.21.15.73:0/1591213075 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c15e4d0 con 0x7fd97c157bc0 2024-03-23T06:15:34.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.293+0000 7fd981000640 1 --2- 172.21.15.73:0/1591213075 >> v2:172.21.15.73:3300/0 conn(0x7fd97c15d660 0x7fd97c0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:15:34.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.297+0000 7fd97be00640 1 --2- 172.21.15.73:0/1591213075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c06fbe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd970009870 tx=0x7fd97002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c79f186e1d8a75b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:34.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.298+0000 7fd97aa00640 1 -- 172.21.15.73:0/1591213075 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970030840 con 0x7fd97c157bc0 2024-03-23T06:15:34.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.298+0000 7fd97aa00640 1 -- 172.21.15.73:0/1591213075 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9700309a0 con 0x7fd97c157bc0 2024-03-23T06:15:34.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.298+0000 7fd97aa00640 1 -- 172.21.15.73:0/1591213075 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970030840 con 0x7fd97c157bc0 2024-03-23T06:15:34.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.300+0000 7fd983000640 1 -- 172.21.15.73:0/1591213075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 msgr2=0x7fd97c06fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:34.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.300+0000 7fd983000640 1 --2- 172.21.15.73:0/1591213075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c06fbe0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd970009870 tx=0x7fd97002b980 comp rx=0 tx=0).stop 2024-03-23T06:15:34.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.301+0000 7fd983000640 1 -- 172.21.15.73:0/1591213075 shutdown_connections 2024-03-23T06:15:34.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.301+0000 7fd983000640 1 --2- 172.21.15.73:0/1591213075 >> v2:172.21.15.73:3300/0 conn(0x7fd97c15d660 0x7fd97c0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.302+0000 7fd983000640 1 --2- 172.21.15.73:0/1591213075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c06fbe0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.302+0000 7fd983000640 1 -- 172.21.15.73:0/1591213075 >> 172.21.15.73:0/1591213075 conn(0x7fd97c0ca850 msgr2=0x7fd97c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:34.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.302+0000 7fd983000640 1 -- 172.21.15.73:0/1591213075 shutdown_connections 2024-03-23T06:15:34.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.302+0000 7fd983000640 1 -- 172.21.15.73:0/1591213075 wait complete. 2024-03-23T06:15:34.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.306+0000 7fd983000640 1 Processor -- start 2024-03-23T06:15:34.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.307+0000 7fd983000640 1 -- start start 2024-03-23T06:15:34.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.309+0000 7fd983000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c1ff720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:34.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.309+0000 7fd983000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c15d660 0x7fd97c0c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:34.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.309+0000 7fd983000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd97c161710 0x7fd97c145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:34.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.309+0000 7fd97be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c1ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:34.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.309+0000 7fd97be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c1ff720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:36086/0 (socket says 172.21.15.73:36086) 2024-03-23T06:15:34.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.310+0000 7fd97be00640 1 -- 172.21.15.73:0/3661704284 learned_addr learned my addr 172.21.15.73:0/3661704284 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.310+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c157fd0 con 0x7fd97c161710 2024-03-23T06:15:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.310+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c145790 con 0x7fd97c15d660 2024-03-23T06:15:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.310+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c158220 con 0x7fd97c157bc0 2024-03-23T06:15:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.310+0000 7fd97b400640 1 -- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c15d660 msgr2=0x7fd97c0c3800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.311+0000 7fd97b400640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c15d660 0x7fd97c0c3800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:34.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.311+0000 7fd97be00640 1 -- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c15d660 msgr2=0x7fd97c0c3800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:15:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.311+0000 7fd97be00640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c15d660 0x7fd97c0c3800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.312+0000 7fd97be00640 1 -- 172.21.15.73:0/3661704284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd97c161710 msgr2=0x7fd97c145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.312+0000 7fd97be00640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd97c161710 0x7fd97c145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.312+0000 7fd97be00640 1 -- 172.21.15.73:0/3661704284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974009a70 con 0x7fd97c157bc0 2024-03-23T06:15:34.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.313+0000 7fd97be00640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c1ff720 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9700090b0 tx=0x7fd9700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.313+0000 7fd96fe00640 1 -- 172.21.15.73:0/3661704284 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970003a20 con 0x7fd97c157bc0 2024-03-23T06:15:34.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.314+0000 7fd96fe00640 1 -- 172.21.15.73:0/3661704284 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd970003b80 con 0x7fd97c157bc0 2024-03-23T06:15:34.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.314+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9700094d0 con 0x7fd97c157bc0 2024-03-23T06:15:34.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.314+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c1587e0 con 0x7fd97c157bc0 2024-03-23T06:15:34.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.314+0000 7fd96fe00640 1 -- 172.21.15.73:0/3661704284 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970039450 con 0x7fd97c157bc0 2024-03-23T06:15:34.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.319+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd958005250 con 0x7fd97c157bc0 2024-03-23T06:15:34.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.323+0000 7fd96fe00640 1 -- 172.21.15.73:0/3661704284 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd9700395b0 con 0x7fd97c157bc0 2024-03-23T06:15:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.326+0000 7fd96fe00640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd95c06abb0 0x7fd95c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:34.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.329+0000 7fd96fe00640 1 -- 172.21.15.73:0/3661704284 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd9700ac2f0 con 0x7fd97c157bc0 2024-03-23T06:15:34.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.329+0000 7fd97b400640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd95c06abb0 0x7fd95c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:34.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.331+0000 7fd97b400640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd95c06abb0 0x7fd95c06d070 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd968006fd0 tx=0x7fd968006d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:34.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.334+0000 7fd96fe00640 1 -- 172.21.15.73:0/3661704284 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd970077290 con 0x7fd97c157bc0 2024-03-23T06:15:34.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.972+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd9580050c0 con 0x7fd97c157bc0 2024-03-23T06:15:34.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.974+0000 7fd96fe00640 1 -- 172.21.15.73:0/3661704284 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fd970034620 con 0x7fd97c157bc0 2024-03-23T06:15:34.974 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":56,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":34,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:15:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd95c06abb0 msgr2=0x7fd95c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd95c06abb0 0x7fd95c06d070 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd968006fd0 tx=0x7fd968006d80 comp rx=0 tx=0).stop 2024-03-23T06:15:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 msgr2=0x7fd97c1ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c1ff720 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9700090b0 tx=0x7fd9700046c0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 shutdown_connections 2024-03-23T06:15:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd97c161710 0x7fd97c145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd97c15d660 0x7fd97c0c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd95c06abb0 0x7fd95c06d070 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 --2- 172.21.15.73:0/3661704284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd97c157bc0 0x7fd97c1ff720 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:34.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.978+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 >> 172.21.15.73:0/3661704284 conn(0x7fd97c0ca850 msgr2=0x7fd97c0c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:34.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.988+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 shutdown_connections 2024-03-23T06:15:34.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:34.989+0000 7fd983000640 1 -- 172.21.15.73:0/3661704284 wait complete. 2024-03-23T06:15:36.194 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:15:36.206 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:15:38.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:15:38.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.423+0000 7f4102200640 1 Processor -- start 2024-03-23T06:15:38.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.423+0000 7f4102200640 1 -- start start 2024-03-23T06:15:38.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.429+0000 7f4102200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:38.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.429+0000 7f4102200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc0ca090 con 0x7f40fc0cade0 2024-03-23T06:15:38.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.429+0000 7f4102200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc15d2b0 con 0x7f40fc0ceb00 2024-03-23T06:15:38.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.429+0000 7f4102200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc15d740 con 0x7f40fc153550 2024-03-23T06:15:38.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.433+0000 7f4101800640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f40fc0ceb00 legacy=0x7f40fc163be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:15:38.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.435+0000 7f40fbe00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f40fc0cade0 0x7f40fc0c3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57094/0 (socket says 172.21.15.73:57094) 2024-03-23T06:15:38.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.435+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 learned_addr learned my addr 172.21.15.73:0/2592492478 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:15:38.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.447+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:38.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.453+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:15:38.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.453+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:15:38.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.453+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:15:38.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.453+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:38.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.636+0000 7f4101800640 1 -- 172.21.15.73:0/2592492478 >> v1:172.21.15.110:6789/0 conn(0x7f40fc0ceb00 legacy=0x7f40fc163be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:15:38.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.654+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.655+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:15:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.655+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:15:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.655+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:15:38.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:38.655+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:15:39.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.037+0000 7f4101800640 1 -- 172.21.15.73:0/2592492478 >> v1:172.21.15.110:6789/0 conn(0x7f40fc0ceb00 legacy=0x7f40fc163be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:15:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.056+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:39.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.057+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:15:39.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.057+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:15:39.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.057+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:15:39.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.057+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:15:39.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.838+0000 7f4101800640 1 -- 172.21.15.73:0/2592492478 >> v1:172.21.15.110:6789/0 conn(0x7f40fc0ceb00 legacy=0x7f40fc163be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:15:39.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.860+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:39.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.860+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:15:39.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.860+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:15:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.860+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:15:39.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:39.860+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:15:41.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.429+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40fc159d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.429+0000 7f40fa000640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40fc159d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.429+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 >> v1:172.21.15.110:6789/0 conn(0x7f40fc0ceb00 legacy=0x7f40fc163be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.429+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 >> v1:172.21.15.73:6789/0 conn(0x7f40fc0cade0 legacy=0x7f40fc0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.429+0000 7f40fa000640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 0x7f40dc005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.429+0000 7f40fa000640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.429+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc15d740 con 0x7f40dc0036c0 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.429+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc008d10 con 0x7f40dc006130 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.430+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 msgr2=0x7f40dc005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:41.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.430+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 0x7f40dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.431+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.431+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:15:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.431+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:15:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.431+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:15:41.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.431+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:41.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.631+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 msgr2=0x7f40dc005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:41.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.631+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 0x7f40dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:15:41.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.633+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:41.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.633+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:15:41.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.633+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:15:41.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.633+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:15:41.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:41.633+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:15:42.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.032+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 msgr2=0x7f40dc005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:42.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.032+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 0x7f40dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:15:42.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.034+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:42.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.034+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:15:42.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.034+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:15:42.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.034+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:15:42.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.034+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:15:42.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.832+0000 7f4100e00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 msgr2=0x7f40dc005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:42.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.832+0000 7f4100e00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 0x7f40dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:15:42.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.834+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:42.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.834+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:15:42.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.834+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:15:42.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.834+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:15:42.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:42.834+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:15:44.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc0085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 msgr2=0x7f40dc005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.110:3300/0 conn(0x7f40dc0036c0 0x7f40dc005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc00c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40dc00edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40fc0c9db0 con 0x7f40fc0cade0 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40fc15d740 con 0x7f40fc153550 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fa000640 1 -- 172.21.15.73:0/2592492478 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc008d10 con 0x7f40dc006130 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f4101800640 1 -- 172.21.15.73:0/2592492478 reap_dead start 2024-03-23T06:15:44.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.428+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc00c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.429+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 msgr2=0x7f40dc00edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.429+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40dc00edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.429+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 >> v1:172.21.15.73:6789/0 conn(0x7f40fc0cade0 legacy=0x7f40dc00b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:15:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.429+0000 7f40fbe00640 1 -- 172.21.15.73:0/2592492478 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc15d2b0 con 0x7f40dc006130 2024-03-23T06:15:44.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.430+0000 7f40fbe00640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc00c860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40e8007d20 tx=0x7f40e802c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecfe43379de899c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.431+0000 7f40fb400640 1 -- 172.21.15.73:0/2592492478 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8035410 con 0x7f40dc006130 2024-03-23T06:15:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.431+0000 7f40fb400640 1 -- 172.21.15.73:0/2592492478 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e802f030 con 0x7f40dc006130 2024-03-23T06:15:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.431+0000 7f40fb400640 1 -- 172.21.15.73:0/2592492478 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80357b0 con 0x7f40dc006130 2024-03-23T06:15:44.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.431+0000 7f4102200640 1 -- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 msgr2=0x7f40dc00c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.431+0000 7f4102200640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc00c860 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40e8007d20 tx=0x7f40e802c3e0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.432+0000 7f4102200640 1 -- 172.21.15.73:0/2592492478 shutdown_connections 2024-03-23T06:15:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.432+0000 7f4102200640 1 --2- 172.21.15.73:0/2592492478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40dc006130 0x7f40dc00c860 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.432+0000 7f4102200640 1 --2- 172.21.15.73:0/2592492478 >> v2:172.21.15.73:3300/0 conn(0x7f40fc153550 0x7f40dc00edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.432+0000 7f4102200640 1 -- 172.21.15.73:0/2592492478 >> 172.21.15.73:0/2592492478 conn(0x7f40fc06a480 msgr2=0x7f40fc0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.433+0000 7f4102200640 1 -- 172.21.15.73:0/2592492478 shutdown_connections 2024-03-23T06:15:44.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.433+0000 7f4102200640 1 -- 172.21.15.73:0/2592492478 wait complete. 2024-03-23T06:15:44.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.435+0000 7f4102200640 1 Processor -- start 2024-03-23T06:15:44.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.436+0000 7f4102200640 1 -- start start 2024-03-23T06:15:44.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.438+0000 7f4102200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40dc006130 0x7f40fc0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.438+0000 7f4102200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40fc0cade0 0x7f40fc14e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:44.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.438+0000 7f4102200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40fc153550 0x7f40fc14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.439+0000 7f4101800640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40fc153550 msgr2=0x7f40fc14f740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.439+0000 7f4101800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40fc153550 0x7f40fc14f740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:44.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.439+0000 7f4102200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc1f3f60 con 0x7f40dc006130 2024-03-23T06:15:44.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.440+0000 7f4102200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc0c6a90 con 0x7f40fc153550 2024-03-23T06:15:44.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.440+0000 7f4102200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc14dd50 con 0x7f40fc0cade0 2024-03-23T06:15:44.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.439+0000 7f40fbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40fc0cade0 0x7f40fc14e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:44.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.440+0000 7f40fbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40fc0cade0 0x7f40fc14e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51442/0 (socket says 172.21.15.73:51442) 2024-03-23T06:15:44.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.440+0000 7f40fbe00640 1 -- 172.21.15.73:0/1689035039 learned_addr learned my addr 172.21.15.73:0/1689035039 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:44.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.440+0000 7f4100e00640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40dc006130 0x7f40fc0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:44.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.441+0000 7f40fbe00640 1 -- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40fc153550 msgr2=0x7f40fc14f740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:15:44.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.441+0000 7f40fbe00640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40fc153550 0x7f40fc14f740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.442+0000 7f40fbe00640 1 -- 172.21.15.73:0/1689035039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40dc006130 msgr2=0x7f40fc0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:44.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.442+0000 7f40fbe00640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40dc006130 0x7f40fc0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.442+0000 7f40fbe00640 1 -- 172.21.15.73:0/1689035039 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e800f040 con 0x7f40fc0cade0 2024-03-23T06:15:44.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.442+0000 7f4100e00640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40dc006130 0x7f40fc0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:15:44.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.443+0000 7f40fbe00640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40fc0cade0 0x7f40fc14e1d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f40e802c420 tx=0x7f40e8001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:44.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.444+0000 7f40f8c00640 1 -- 172.21.15.73:0/1689035039 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80079c0 con 0x7f40fc0cade0 2024-03-23T06:15:44.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.444+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc1f3320 con 0x7f40fc0cade0 2024-03-23T06:15:44.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.445+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc1f38a0 con 0x7f40fc0cade0 2024-03-23T06:15:44.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.445+0000 7f40f8c00640 1 -- 172.21.15.73:0/1689035039 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e8035410 con 0x7f40fc0cade0 2024-03-23T06:15:44.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.445+0000 7f40f8c00640 1 -- 172.21.15.73:0/1689035039 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e80079c0 con 0x7f40fc0cade0 2024-03-23T06:15:44.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.446+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d8005250 con 0x7f40fc0cade0 2024-03-23T06:15:44.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.448+0000 7f40f8c00640 1 -- 172.21.15.73:0/1689035039 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f40e803c040 con 0x7f40fc0cade0 2024-03-23T06:15:44.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.449+0000 7f40f8c00640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f40dc06baa0 0x7f40dc06df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.450+0000 7f40f8c00640 1 -- 172.21.15.73:0/1689035039 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f40e80ab800 con 0x7f40fc0cade0 2024-03-23T06:15:44.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.451+0000 7f4100e00640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f40dc06baa0 0x7f40dc06df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:44.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.453+0000 7f4100e00640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f40dc06baa0 0x7f40dc06df60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40f0000c00 tx=0x7f40f00046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:44.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.453+0000 7f40f8c00640 1 -- 172.21.15.73:0/1689035039 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f40e8076790 con 0x7f40fc0cade0 2024-03-23T06:15:44.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.921+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f40d80057d0 con 0x7f40fc0cade0 2024-03-23T06:15:44.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.921+0000 7f40f8c00640 1 -- 172.21.15.73:0/1689035039 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f40e803a020 con 0x7f40fc0cade0 2024-03-23T06:15:44.923 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":60,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:15:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.925+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f40dc06baa0 msgr2=0x7f40dc06df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.925+0000 7f4102200640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f40dc06baa0 0x7f40dc06df60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40f0000c00 tx=0x7f40f00046c0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.926+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40fc0cade0 msgr2=0x7f40fc14e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:44.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.926+0000 7f4102200640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40fc0cade0 0x7f40fc14e1d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f40e802c420 tx=0x7f40e8001120 comp rx=0 tx=0).stop 2024-03-23T06:15:44.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.927+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 shutdown_connections 2024-03-23T06:15:44.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.927+0000 7f4102200640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40fc153550 0x7f40fc14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.927+0000 7f4102200640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f40dc06baa0 0x7f40dc06df60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.927+0000 7f4102200640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40fc0cade0 0x7f40fc14e1d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.927+0000 7f4102200640 1 --2- 172.21.15.73:0/1689035039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40dc006130 0x7f40fc0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:44.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.927+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 >> 172.21.15.73:0/1689035039 conn(0x7f40fc06a480 msgr2=0x7f40fc06baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:44.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.930+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 shutdown_connections 2024-03-23T06:15:44.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:44.930+0000 7f4102200640 1 -- 172.21.15.73:0/1689035039 wait complete. 2024-03-23T06:15:44.955 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:15:44.955 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T06:15:44.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:15:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.623+0000 7fc7be600640 1 Processor -- start 2024-03-23T06:15:45.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.623+0000 7fc7be600640 1 -- start start 2024-03-23T06:15:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.625+0000 7fc7be600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b8157d70 0x7fc7b80b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.625+0000 7fc7be600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc7b80c9ca0 0x7fc7b815d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.625+0000 7fc7be600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b8158150 con 0x7fc7b80b0cd0 2024-03-23T06:15:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.625+0000 7fc7be600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b8070110 con 0x7fc7b80c9ca0 2024-03-23T06:15:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.625+0000 7fc7be600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80ca0f0 con 0x7fc7b8157d70 2024-03-23T06:15:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.626+0000 7fc7b7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b8157d70 0x7fc7b80b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.626+0000 7fc7b6a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc7b80b0cd0 0x7fc7b80c8f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57996/0 (socket says 172.21.15.73:57996) 2024-03-23T06:15:45.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.626+0000 7fc7b6a00640 1 -- 172.21.15.73:0/989833115 learned_addr learned my addr 172.21.15.73:0/989833115 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:15:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.626+0000 7fc7b7400640 1 -- 172.21.15.73:0/989833115 >> v2:172.21.15.73:3300/0 conn(0x7fc7b80c9ca0 msgr2=0x7fc7b815d980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.626+0000 7fc7b7400640 1 --2- 172.21.15.73:0/989833115 >> v2:172.21.15.73:3300/0 conn(0x7fc7b80c9ca0 0x7fc7b815d980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.626+0000 7fc7b7400640 1 -- 172.21.15.73:0/989833115 >> v1:172.21.15.73:6789/0 conn(0x7fc7b80b0cd0 legacy=0x7fc7b80c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.626+0000 7fc7b7400640 1 -- 172.21.15.73:0/989833115 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b80ca2e0 con 0x7fc7b8157d70 2024-03-23T06:15:45.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.628+0000 7fc7b7400640 1 --2- 172.21.15.73:0/989833115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b8157d70 0x7fc7b80b0700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009d90 tx=0x7fc7b002bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f695b485e2cdb1b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.628+0000 7fc7b6000640 1 -- 172.21.15.73:0/989833115 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b002cd30 con 0x7fc7b8157d70 2024-03-23T06:15:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.629+0000 7fc7b6000640 1 -- 172.21.15.73:0/989833115 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b002ce90 con 0x7fc7b8157d70 2024-03-23T06:15:45.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.629+0000 7fc7b6000640 1 -- 172.21.15.73:0/989833115 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0034660 con 0x7fc7b8157d70 2024-03-23T06:15:45.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.630+0000 7fc7be600640 1 -- 172.21.15.73:0/989833115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b8157d70 msgr2=0x7fc7b80b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:45.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.630+0000 7fc7be600640 1 --2- 172.21.15.73:0/989833115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b8157d70 0x7fc7b80b0700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009d90 tx=0x7fc7b002bf80 comp rx=0 tx=0).stop 2024-03-23T06:15:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.631+0000 7fc7be600640 1 -- 172.21.15.73:0/989833115 shutdown_connections 2024-03-23T06:15:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.631+0000 7fc7be600640 1 --2- 172.21.15.73:0/989833115 >> v2:172.21.15.73:3300/0 conn(0x7fc7b80c9ca0 0x7fc7b815d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.631+0000 7fc7be600640 1 --2- 172.21.15.73:0/989833115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b8157d70 0x7fc7b80b0700 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:45.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.631+0000 7fc7be600640 1 -- 172.21.15.73:0/989833115 >> 172.21.15.73:0/989833115 conn(0x7fc7b8069cb0 msgr2=0x7fc7b806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:45.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.632+0000 7fc7be600640 1 -- 172.21.15.73:0/989833115 shutdown_connections 2024-03-23T06:15:45.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.632+0000 7fc7be600640 1 -- 172.21.15.73:0/989833115 wait complete. 2024-03-23T06:15:45.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.638+0000 7fc7be600640 1 Processor -- start 2024-03-23T06:15:45.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.639+0000 7fc7be600640 1 -- start start 2024-03-23T06:15:45.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.641+0000 7fc7be600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b80b0cd0 0x7fc7b814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.642+0000 7fc7b7400640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b80b0cd0 msgr2=0x7fc7b814f040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.642+0000 7fc7b7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b80b0cd0 0x7fc7b814f040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:45.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.642+0000 7fc7be600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b80c9ca0 0x7fc7b814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.643+0000 7fc7be600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b8157d70 0x7fc7b8158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.643+0000 7fc7b6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b80c9ca0 0x7fc7b814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.643+0000 7fc7b6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b80c9ca0 0x7fc7b814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51456/0 (socket says 172.21.15.73:51456) 2024-03-23T06:15:45.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.644+0000 7fc7b6a00640 1 -- 172.21.15.73:0/2626018513 learned_addr learned my addr 172.21.15.73:0/2626018513 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.644+0000 7fc7be600640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b815a3f0 con 0x7fc7b8157d70 2024-03-23T06:15:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.644+0000 7fc7be600640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b814a600 con 0x7fc7b80b0cd0 2024-03-23T06:15:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.644+0000 7fc7b7e00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b8157d70 0x7fc7b8158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:45.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.644+0000 7fc7be600640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81582f0 con 0x7fc7b80c9ca0 2024-03-23T06:15:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.645+0000 7fc7b7e00640 1 -- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b80c9ca0 msgr2=0x7fc7b814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:45.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.646+0000 7fc7b7e00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7b80c9ca0 0x7fc7b814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:45.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.646+0000 7fc7b7e00640 1 -- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b80b0cd0 msgr2=0x7fc7b814f040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:15:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.647+0000 7fc7b7e00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7b80b0cd0 0x7fc7b814f040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.647+0000 7fc7b7e00640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0009a70 con 0x7fc7b8157d70 2024-03-23T06:15:45.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.648+0000 7fc7b7e00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b8157d70 0x7fc7b8158780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400b410 tx=0x7fc7a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:45.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.648+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4011830 con 0x7fc7b8157d70 2024-03-23T06:15:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.649+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a40119b0 con 0x7fc7b8157d70 2024-03-23T06:15:45.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.649+0000 7fc7be600640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b8155cb0 con 0x7fc7b8157d70 2024-03-23T06:15:45.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.649+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4011d60 con 0x7fc7b8157d70 2024-03-23T06:15:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.649+0000 7fc7be600640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b8154850 con 0x7fc7b8157d70 2024-03-23T06:15:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.654+0000 7fc7acc00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b81554e0 0x7fc7b8158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.654+0000 7fc7acc00640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b8073bf0 con 0x7fc7b81554e0 2024-03-23T06:15:45.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.655+0000 7fc7b7400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b81554e0 0x7fc7b8158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.656+0000 7fc7b7400640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7b81614b0 con 0x7fc7b81554e0 2024-03-23T06:15:45.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.656+0000 7fc7b7400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b81554e0 0x7fc7b8158cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80c8620 tx=0x7fc7b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:45.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.662+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc7a4004020 con 0x7fc7b8157d70 2024-03-23T06:15:45.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.664+0000 7fc7af400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc79806abb0 0x7fc79806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:45.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.664+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0003b90 con 0x7fc7b81554e0 2024-03-23T06:15:45.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.665+0000 7fc7b6a00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc79806abb0 0x7fc79806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:45.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.665+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fc7a40893f0 con 0x7fc7b8157d70 2024-03-23T06:15:45.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.666+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fc7b0003cf0 con 0x7fc7b81554e0 2024-03-23T06:15:45.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.666+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b81554e0 msgr2=0x7fc7b8158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:45.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.666+0000 7fc7af400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b81554e0 0x7fc7b8158cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80c8620 tx=0x7fc7b0004a40 comp rx=0 tx=0).stop 2024-03-23T06:15:45.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.666+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b81554e0 msgr2=0x7fc7b8158cc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:45.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.666+0000 7fc7af400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b81554e0 0x7fc7b8158cc0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80c8620 tx=0x7fc7b0004a40 comp rx=0 tx=0).stop 2024-03-23T06:15:45.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.667+0000 7fc7b6a00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc79806abb0 0x7fc79806d070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc7b81553b0 tx=0x7fc7a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:45.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.696+0000 7fc7acc00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b815af90 0x7fc7b81f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:45.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.696+0000 7fc7acc00640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81f7890 con 0x7fc7b815af90 2024-03-23T06:15:45.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.698+0000 7fc7b7400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b815af90 0x7fc7b81f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:45.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.699+0000 7fc7b7400640 1 -- 172.21.15.73:0/2626018513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc7b81611d0 con 0x7fc7b815af90 2024-03-23T06:15:45.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.700+0000 7fc7b7400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b815af90 0x7fc7b81f7350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009d90 tx=0x7fc7b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:45.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.701+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b004f070 con 0x7fc7b815af90 2024-03-23T06:15:45.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.701+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4769 (secure 0 0 0) 0x7fc7b0003e60 con 0x7fc7b815af90 2024-03-23T06:15:45.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.701+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b815af90 msgr2=0x7fc7b81f7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:45.703 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:15:45.703 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:45.703 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:45.703 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:15:45.703 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 60, 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:45.704 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:45.705 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:15:45.706 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:15:45.707 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:45.709 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:15:45.711 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:45.712 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:45.713 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:45.714 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:45.715 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:15:45.715 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.702+0000 7fc7af400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b815af90 0x7fc7b81f7350 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009d90 tx=0x7fc7b0009750 comp rx=0 tx=0).stop 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.702+0000 7fc7af400640 1 -- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b815af90 msgr2=0x7fc7b81f7350 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.702+0000 7fc7af400640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b815af90 0x7fc7b81f7350 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0009d90 tx=0x7fc7b0009750 comp rx=0 tx=0).stop 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.703+0000 7fc7acc00640 1 -- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc79806abb0 msgr2=0x7fc79806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.703+0000 7fc7acc00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc79806abb0 0x7fc79806d070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc7b81553b0 tx=0x7fc7a8009040 comp rx=0 tx=0).stop 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.703+0000 7fc7acc00640 1 -- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b8157d70 msgr2=0x7fc7b8158780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.704+0000 7fc7acc00640 1 --2- 172.21.15.73:0/2626018513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7b8157d70 0x7fc7b8158780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400b410 tx=0x7fc7a400b8d0 comp rx=0 tx=0).stop 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.704+0000 7fc7b7e00640 1 -- 172.21.15.73:0/2626018513 reap_dead start 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.704+0000 7fc7b7e00640 1 -- 172.21.15.73:0/2626018513 reap_dead start 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.705+0000 7fc7acc00640 1 -- 172.21.15.73:0/2626018513 shutdown_connections 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.705+0000 7fc7acc00640 1 -- 172.21.15.73:0/2626018513 >> 172.21.15.73:0/2626018513 conn(0x7fc7b8069cb0 msgr2=0x7fc7b80c1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.705+0000 7fc7acc00640 1 -- 172.21.15.73:0/2626018513 shutdown_connections 2024-03-23T06:15:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:45.705+0000 7fc7acc00640 1 -- 172.21.15.73:0/2626018513 wait complete. 2024-03-23T06:15:45.742 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:15:45.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T06:15:45.743 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:15:46.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.054+0000 7f429ac00640 1 Processor -- start 2024-03-23T06:15:46.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.054+0000 7f429ac00640 1 -- start start 2024-03-23T06:15:46.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.056+0000 7f429ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294159420 0x7f42940c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.056+0000 7f429ac00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42940ca940 0x7f42940cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.056+0000 7f429ac00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42940c9c80 con 0x7f4294153760 2024-03-23T06:15:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.056+0000 7f429ac00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4294159860 con 0x7f42940ca940 2024-03-23T06:15:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.056+0000 7f429ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42940cb310 con 0x7f4294159420 2024-03-23T06:15:46.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.056+0000 7f4293e00640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f4294153760 legacy=0x7f42940cb7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:15:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.057+0000 7f4293400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294159420 0x7f42940c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.057+0000 7f4298c00640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f42940ca940 msgr2=0x7f42940cadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.057+0000 7f4298c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42940ca940 0x7f42940cadd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.058+0000 7f4293400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294159420 0x7f42940c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51462/0 (socket says 172.21.15.73:51462) 2024-03-23T06:15:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.058+0000 7f4293400640 1 -- 172.21.15.73:0/3072363398 learned_addr learned my addr 172.21.15.73:0/3072363398 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:46.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.058+0000 7f4293400640 1 -- 172.21.15.73:0/3072363398 >> v2:172.21.15.110:3300/0 conn(0x7f42940ca940 msgr2=0x7f42940cadd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.059+0000 7f4293400640 1 --2- 172.21.15.73:0/3072363398 >> v2:172.21.15.110:3300/0 conn(0x7f42940ca940 0x7f42940cadd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:46.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.059+0000 7f4293400640 1 -- 172.21.15.73:0/3072363398 >> v1:172.21.15.110:6789/0 conn(0x7f4294153760 legacy=0x7f42940cb7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:15:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.059+0000 7f4293400640 1 -- 172.21.15.73:0/3072363398 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429406a2d0 con 0x7f4294159420 2024-03-23T06:15:46.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.061+0000 7f4293400640 1 --2- 172.21.15.73:0/3072363398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294159420 0x7f42940c9740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4284009870 tx=0x7f428402b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a94969db806c097 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:46.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.061+0000 7f4292a00640 1 -- 172.21.15.73:0/3072363398 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284031870 con 0x7f4294159420 2024-03-23T06:15:46.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.062+0000 7f4292a00640 1 -- 172.21.15.73:0/3072363398 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840319d0 con 0x7f4294159420 2024-03-23T06:15:46.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.062+0000 7f4292a00640 1 -- 172.21.15.73:0/3072363398 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284031d60 con 0x7f4294159420 2024-03-23T06:15:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.063+0000 7f429ac00640 1 -- 172.21.15.73:0/3072363398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294159420 msgr2=0x7f42940c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:46.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.064+0000 7f429ac00640 1 --2- 172.21.15.73:0/3072363398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294159420 0x7f42940c9740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4284009870 tx=0x7f428402b910 comp rx=0 tx=0).stop 2024-03-23T06:15:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.064+0000 7f429ac00640 1 -- 172.21.15.73:0/3072363398 shutdown_connections 2024-03-23T06:15:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.064+0000 7f429ac00640 1 --2- 172.21.15.73:0/3072363398 >> v2:172.21.15.110:3300/0 conn(0x7f42940ca940 0x7f42940cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.064+0000 7f429ac00640 1 --2- 172.21.15.73:0/3072363398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294159420 0x7f42940c9740 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.064+0000 7f429ac00640 1 -- 172.21.15.73:0/3072363398 >> 172.21.15.73:0/3072363398 conn(0x7f429406c310 msgr2=0x7f42940713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:46.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.065+0000 7f429ac00640 1 -- 172.21.15.73:0/3072363398 shutdown_connections 2024-03-23T06:15:46.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.065+0000 7f429ac00640 1 -- 172.21.15.73:0/3072363398 wait complete. 2024-03-23T06:15:46.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.069+0000 7f429ac00640 1 Processor -- start 2024-03-23T06:15:46.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.069+0000 7f429ac00640 1 -- start start 2024-03-23T06:15:46.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.071+0000 7f429ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42940ca940 0x7f42940ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:46.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.072+0000 7f429ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294153760 0x7f42941ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:46.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.076+0000 7f429ac00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4294159420 0x7f42941486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.076+0000 7f429ac00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294157180 con 0x7f4294159420 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.076+0000 7f429ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294149670 con 0x7f42940ca940 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.076+0000 7f429ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4294148bf0 con 0x7f4294153760 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.076+0000 7f4293400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294153760 0x7f42941ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.076+0000 7f4293400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294153760 0x7f42941ef260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51472/0 (socket says 172.21.15.73:51472) 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.076+0000 7f4293400640 1 -- 172.21.15.73:0/4202152742 learned_addr learned my addr 172.21.15.73:0/4202152742 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.072+0000 7f4293e00640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42940ca940 msgr2=0x7f42940ccf80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.077+0000 7f4298c00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4294159420 0x7f42941486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.077+0000 7f4293e00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42940ca940 0x7f42940ccf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:15:46.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.077+0000 7f4293400640 1 -- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42940ca940 msgr2=0x7f42940ccf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:15:46.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.082+0000 7f4293400640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42940ca940 0x7f42940ccf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:46.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.082+0000 7f4293400640 1 -- 172.21.15.73:0/4202152742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4294159420 msgr2=0x7f42941486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:46.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.082+0000 7f4293400640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4294159420 0x7f42941486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:15:46.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.082+0000 7f4293400640 1 -- 172.21.15.73:0/4202152742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42840094d0 con 0x7f4294153760 2024-03-23T06:15:46.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.082+0000 7f4298c00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4294159420 0x7f42941486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:15:46.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.083+0000 7f4293400640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294153760 0x7f42941ef260 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4284000c00 tx=0x7f42840046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:46.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.083+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428403bd40 con 0x7f4294153760 2024-03-23T06:15:46.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.084+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840453f0 con 0x7f4294153760 2024-03-23T06:15:46.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.084+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428403bea0 con 0x7f4294153760 2024-03-23T06:15:46.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.085+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4294148050 con 0x7f4294153760 2024-03-23T06:15:46.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.085+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42941498c0 con 0x7f4294153760 2024-03-23T06:15:46.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.087+0000 7f429ac00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294149a80 0x7f42941e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:46.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.087+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4294072510 con 0x7f4294149a80 2024-03-23T06:15:46.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.087+0000 7f4293e00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294149a80 0x7f42941e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:46.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.089+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f428404e450 con 0x7f4294153760 2024-03-23T06:15:46.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.090+0000 7f428be00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f427406ac00 0x7f427406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:46.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.091+0000 7f4293e00640 1 -- 172.21.15.73:0/4202152742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f429406ab70 con 0x7f4294149a80 2024-03-23T06:15:46.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.091+0000 7f4293e00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294149a80 0x7f42941e6270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4280003930 tx=0x7f428000b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:46.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.091+0000 7f4298c00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f427406ac00 0x7f427406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:46.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.092+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f428402d040 con 0x7f4294153760 2024-03-23T06:15:46.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.092+0000 7f4298c00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f427406ac00 0x7f427406d0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f428c003bc0 tx=0x7f428c009510 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:46.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.093+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280003e10 con 0x7f4294149a80 2024-03-23T06:15:46.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.094+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f4280005070 con 0x7f4294149a80 2024-03-23T06:15:46.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.094+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294149a80 msgr2=0x7f42941e6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:46.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.094+0000 7f428be00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294149a80 0x7f42941e6270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4280003930 tx=0x7f428000b8c0 comp rx=0 tx=0).stop 2024-03-23T06:15:46.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.094+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294149a80 msgr2=0x7f42941e6270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:46.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.094+0000 7f428be00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294149a80 0x7f42941e6270 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4280003930 tx=0x7f428000b8c0 comp rx=0 tx=0).stop 2024-03-23T06:15:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.114+0000 7f429ac00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42941e5550 0x7f4294143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:15:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.114+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429406a890 con 0x7f42941e5550 2024-03-23T06:15:46.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.115+0000 7f4293e00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42941e5550 0x7f4294143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:15:46.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.115+0000 7f4293e00640 1 -- 172.21.15.73:0/4202152742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f429406ae50 con 0x7f42941e5550 2024-03-23T06:15:46.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.116+0000 7f4293e00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42941e5550 0x7f4294143b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4280003930 tx=0x7f4280005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:15:46.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.116+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280020070 con 0x7f42941e5550 2024-03-23T06:15:46.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.117+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7f4280010400 con 0x7f42941e5550 2024-03-23T06:15:46.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.117+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42941e5550 msgr2=0x7f4294143b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.117+0000 7f428be00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42941e5550 0x7f4294143b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4280003930 tx=0x7f4280005a20 comp rx=0 tx=0).stop 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.117+0000 7f428be00640 1 -- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42941e5550 msgr2=0x7f4294143b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.117+0000 7f428be00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42941e5550 0x7f4294143b60 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4280003930 tx=0x7f4280005a20 comp rx=0 tx=0).stop 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 60, 2024-03-23T06:15:46.119 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:46.120 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:46.121 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:46.122 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:15:46.123 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:15:46.124 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.125 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:15:46.126 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.127 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:15:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:15:46.129 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:15:46.130 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:15:46.131 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:15:46.132 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:15:46.132 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:15:46.132 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:15:46.132 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:15:46.132 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:15:46.132 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:15:46.132 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:15:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.121+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f427406ac00 msgr2=0x7f427406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.121+0000 7f429ac00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f427406ac00 0x7f427406d0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f428c003bc0 tx=0x7f428c009510 comp rx=0 tx=0).stop 2024-03-23T06:15:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.121+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294153760 msgr2=0x7f42941ef260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:15:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.121+0000 7f429ac00640 1 --2- 172.21.15.73:0/4202152742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4294153760 0x7f42941ef260 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4284000c00 tx=0x7f42840046c0 comp rx=0 tx=0).stop 2024-03-23T06:15:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.122+0000 7f4298c00640 1 -- 172.21.15.73:0/4202152742 reap_dead start 2024-03-23T06:15:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.122+0000 7f4298c00640 1 -- 172.21.15.73:0/4202152742 reap_dead start 2024-03-23T06:15:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.123+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 shutdown_connections 2024-03-23T06:15:46.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.123+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 >> 172.21.15.73:0/4202152742 conn(0x7f429406c310 msgr2=0x7f42941583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:15:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.123+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 shutdown_connections 2024-03-23T06:15:46.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:15:46.123+0000 7f429ac00640 1 -- 172.21.15.73:0/4202152742 wait complete. 2024-03-23T06:15:46.159 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:15:46.159 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:16:06.160 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T06:16:06.160 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T06:16:06.160 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T06:16:06.161 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T06:16:06.163 INFO:tasks.ceph.mon.b:Started 2024-03-23T06:16:06.163 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:16:06.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:16:07.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.591+0000 7f8535600640 1 Processor -- start 2024-03-23T06:16:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.591+0000 7f8535600640 1 -- start start 2024-03-23T06:16:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.593+0000 7f8535600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.593+0000 7f8535600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:07.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.593+0000 7f8535600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:07.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.593+0000 7f8535600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300c7370 con 0x7f85301579b0 2024-03-23T06:16:07.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.593+0000 7f8535600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8530160ec0 con 0x7f8530161bf0 2024-03-23T06:16:07.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.593+0000 7f8535600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8530157d90 con 0x7f85300c66f0 2024-03-23T06:16:07.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.594+0000 7f852f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:07.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.594+0000 7f852f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:46530/0 (socket says 172.21.15.73:46530) 2024-03-23T06:16:07.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.594+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 learned_addr learned my addr 172.21.15.73:0/421035728 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:07.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.595+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:16:07.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.595+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:07.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.595+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:07.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.595+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.596+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.597+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:16:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.597+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.597+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:07.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.597+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:07.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.598+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.599+0000 7f852ea00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.599+0000 7f852ea00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.599+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:07.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.599+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:07.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:07.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:07.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:16:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852ea00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:16:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852ea00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:07.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.801+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:16:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.803+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.803+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.803+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.803+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:07.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:07.803+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:16:08.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.202+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:08.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.202+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:08.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.202+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:16:08.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.203+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:08.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.203+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:08.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.203+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:16:08.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852ea00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852ea00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:16:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:16:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:08.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:08.204+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:16:08.520 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:16:08.525 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:16:09.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.004+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:09.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.004+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:09.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:09.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:09.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:09.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:16:09.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852ea00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:16:09.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852ea00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:16:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.005+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.006+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:16:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.006+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.006+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:09.006+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:16:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:10.594+0000 7f8527e00640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 msgr2=0x7f853015de10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:10.594+0000 7f8527e00640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85300c66f0 0x7f853015de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:10.594+0000 7f8527e00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 msgr2=0x7f853015d8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:10.594+0000 7f8527e00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.110:3300/0 conn(0x7f8530161bf0 0x7f853015d8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:10.594+0000 7f8527e00640 1 -- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 msgr2=0x7f85300c0450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:10.594+0000 7f8527e00640 1 --2- 172.21.15.73:0/421035728 >> v2:172.21.15.73:3300/0 conn(0x7f85301579b0 0x7f85300c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:10.595+0000 7f8527e00640 1 -- 172.21.15.73:0/421035728 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853015e3f0 con 0x7f8514003690 2024-03-23T06:16:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:10.595+0000 7f8527e00640 1 -- 172.21.15.73:0/421035728 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851400c0a0 con 0x7f8514007320 2024-03-23T06:16:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.351+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082469216 0 0) 0x7f853015e3f0 con 0x7f8514003690 2024-03-23T06:16:11.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.351+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510003520 con 0x7f8514003690 2024-03-23T06:16:11.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3894184948 0 0) 0x7f8510003520 con 0x7f8514003690 2024-03-23T06:16:11.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 >> v1:172.21.15.110:6789/0 conn(0x7f8514007320 legacy=0x7f85140097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:11.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851400d2a0 con 0x7f8514003690 2024-03-23T06:16:11.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f852000d580 con 0x7f8514003690 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 >> v1:172.21.15.73:6789/0 conn(0x7f8514003690 legacy=0x7f8514005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852f400640 1 -- 172.21.15.73:0/421035728 reap_dead start 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100039f0 0x7f8510003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100047c0 0x7f8510004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8510009970 0x7f851000bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851000c350 con 0x7f85100039f0 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851000c490 con 0x7f85100047c0 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.540+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851000c650 con 0x7f8510009970 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100047c0 0x7f8510004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852f400640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8510009970 0x7f851000bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8510009970 msgr2=0x7f851000bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8510009970 0x7f851000bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:11.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100039f0 0x7f8510003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100039f0 msgr2=0x7f8510003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100039f0 0x7f8510003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852e000640 1 -- 172.21.15.73:0/421035728 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851400d2a0 con 0x7f85100047c0 2024-03-23T06:16:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.541+0000 7f852ea00640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100039f0 0x7f8510003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:16:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.543+0000 7f852e000640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100047c0 0x7f8510004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f851400aff0 tx=0x7f85100057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a273cd7837a28dc server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.543+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c035410 con 0x7f85100047c0 2024-03-23T06:16:11.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.543+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c02f030 con 0x7f85100047c0 2024-03-23T06:16:11.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.543+0000 7f852d600640 1 -- 172.21.15.73:0/421035728 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c0355d0 con 0x7f85100047c0 2024-03-23T06:16:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.544+0000 7f8535600640 1 -- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100047c0 msgr2=0x7f8510004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.544+0000 7f8535600640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100047c0 0x7f8510004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f851400aff0 tx=0x7f85100057f0 comp rx=0 tx=0).stop 2024-03-23T06:16:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.545+0000 7f8535600640 1 -- 172.21.15.73:0/421035728 shutdown_connections 2024-03-23T06:16:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.545+0000 7f8535600640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8510009970 0x7f851000bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.545+0000 7f8535600640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85100047c0 0x7f8510004c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.545+0000 7f8535600640 1 --2- 172.21.15.73:0/421035728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100039f0 0x7f8510003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.545+0000 7f8535600640 1 -- 172.21.15.73:0/421035728 >> 172.21.15.73:0/421035728 conn(0x7f853006bb40 msgr2=0x7f853006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:11.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.545+0000 7f8535600640 1 -- 172.21.15.73:0/421035728 shutdown_connections 2024-03-23T06:16:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.545+0000 7f8535600640 1 -- 172.21.15.73:0/421035728 wait complete. 2024-03-23T06:16:11.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.556+0000 7f8535600640 1 Processor -- start 2024-03-23T06:16:11.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.558+0000 7f8535600640 1 -- start start 2024-03-23T06:16:11.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f8535600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85100039f0 0x7f85301357c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:11.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f8535600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100047c0 0x7f853015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:11.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f8535600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8510009970 0x7f853013a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f8535600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530133c40 con 0x7f85100047c0 2024-03-23T06:16:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f8535600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853015e410 con 0x7f8510009970 2024-03-23T06:16:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f8535600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853015a8c0 con 0x7f85100039f0 2024-03-23T06:16:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f852f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8510009970 0x7f853013a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f852f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8510009970 0x7f853013a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33358/0 (socket says 172.21.15.73:33358) 2024-03-23T06:16:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.559+0000 7f852f400640 1 -- 172.21.15.73:0/3530987981 learned_addr learned my addr 172.21.15.73:0/3530987981 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.560+0000 7f852f400640 1 -- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85100039f0 msgr2=0x7f85301357c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:11.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.560+0000 7f852ea00640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85100039f0 0x7f85301357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:11.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.561+0000 7f852e000640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100047c0 0x7f853015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:11.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.561+0000 7f852f400640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85100039f0 0x7f85301357c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:11.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.561+0000 7f852f400640 1 -- 172.21.15.73:0/3530987981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100047c0 msgr2=0x7f853015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:11.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.562+0000 7f852f400640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100047c0 0x7f853015aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:11.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.562+0000 7f852f400640 1 -- 172.21.15.73:0/3530987981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853015e150 con 0x7f8510009970 2024-03-23T06:16:11.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.562+0000 7f852e000640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100047c0 0x7f853015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:16:11.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.564+0000 7f852ea00640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85100039f0 0x7f85301357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:16:11.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.564+0000 7f852f400640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8510009970 0x7f853013a5a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8514007290 tx=0x7f8528008d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:11.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.565+0000 7f8526a00640 1 -- 172.21.15.73:0/3530987981 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528007a30 con 0x7f8510009970 2024-03-23T06:16:11.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.565+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853015c6a0 con 0x7f8510009970 2024-03-23T06:16:11.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.565+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8530134ed0 con 0x7f8510009970 2024-03-23T06:16:11.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.566+0000 7f8526a00640 1 -- 172.21.15.73:0/3530987981 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852800f040 con 0x7f8510009970 2024-03-23T06:16:11.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.566+0000 7f8526a00640 1 -- 172.21.15.73:0/3530987981 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528007a30 con 0x7f8510009970 2024-03-23T06:16:11.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.567+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8508005250 con 0x7f8510009970 2024-03-23T06:16:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.573+0000 7f8526a00640 1 -- 172.21.15.73:0/3530987981 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8528007b90 con 0x7f8510009970 2024-03-23T06:16:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.574+0000 7f8526a00640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f851406bb90 0x7f851406e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.574+0000 7f8526a00640 1 -- 172.21.15.73:0/3530987981 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f852808aa50 con 0x7f8510009970 2024-03-23T06:16:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.576+0000 7f852ea00640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f851406bb90 0x7f851406e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:11.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.580+0000 7f852ea00640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f851406bb90 0x7f851406e050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8520006d40 tx=0x7f8520008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:11.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:11.582+0000 7f8526a00640 1 -- 172.21.15.73:0/3530987981 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f85280559f0 con 0x7f8510009970 2024-03-23T06:16:12.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.074+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f85080050c0 con 0x7f8510009970 2024-03-23T06:16:12.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.079+0000 7f8526a00640 1 -- 172.21.15.73:0/3530987981 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f852801c620 con 0x7f8510009970 2024-03-23T06:16:12.083 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:16:12.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f851406bb90 msgr2=0x7f851406e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f851406bb90 0x7f851406e050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8520006d40 tx=0x7f8520008040 comp rx=0 tx=0).stop 2024-03-23T06:16:12.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8510009970 msgr2=0x7f853013a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8510009970 0x7f853013a5a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8514007290 tx=0x7f8528008d90 comp rx=0 tx=0).stop 2024-03-23T06:16:12.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 shutdown_connections 2024-03-23T06:16:12.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8510009970 0x7f853013a5a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85100047c0 0x7f853015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f851406bb90 0x7f851406e050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 --2- 172.21.15.73:0/3530987981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85100039f0 0x7f85301357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 >> 172.21.15.73:0/3530987981 conn(0x7f853006bb40 msgr2=0x7f853015f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:12.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 shutdown_connections 2024-03-23T06:16:12.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.087+0000 7f8535600640 1 -- 172.21.15.73:0/3530987981 wait complete. 2024-03-23T06:16:12.124 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:16:12.124 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:16:12.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:16:12.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.401+0000 7fdaef200640 1 Processor -- start 2024-03-23T06:16:12.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.401+0000 7fdaef200640 1 -- start start 2024-03-23T06:16:12.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.403+0000 7fdaef200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdae806a840 0x7fdae806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.403+0000 7fdaef200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae8157e30 con 0x7fdae80c56c0 2024-03-23T06:16:12.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.403+0000 7fdaef200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80c5c50 con 0x7fdae8157a50 2024-03-23T06:16:12.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.403+0000 7fdaef200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80c7620 con 0x7fdae806a840 2024-03-23T06:16:12.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.404+0000 7fdaede00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fdae8157a50 0x7fdae815e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:53916/0 (socket says 172.21.15.73:53916) 2024-03-23T06:16:12.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.404+0000 7fdaede00640 1 -- 172.21.15.73:0/376945370 learned_addr learned my addr 172.21.15.73:0/376945370 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:16:12.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.404+0000 7fdaed400640 1 --2- 172.21.15.73:0/376945370 >> v2:172.21.15.73:3300/0 conn(0x7fdae806a840 0x7fdae806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.404+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101851391 0 0) 0x7fdae80c5c50 con 0x7fdae8157a50 2024-03-23T06:16:12.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.404+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdad0003520 con 0x7fdae8157a50 2024-03-23T06:16:12.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.405+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2134088217 0 0) 0x7fdad0003520 con 0x7fdae8157a50 2024-03-23T06:16:12.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.405+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 >> v2:172.21.15.73:3300/0 conn(0x7fdae806a840 msgr2=0x7fdae806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:12.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 --2- 172.21.15.73:0/376945370 >> v2:172.21.15.73:3300/0 conn(0x7fdae806a840 0x7fdae806f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 >> v1:172.21.15.73:6789/0 conn(0x7fdae80c56c0 legacy=0x7fdae8069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80c6a10 con 0x7fdae8157a50 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fdadc001670 con 0x7fdae8157a50 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 >> v1:172.21.15.110:6789/0 conn(0x7fdae8157a50 legacy=0x7fdae815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 0x7fdad0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad00047c0 0x7fdad0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdad00051d0 0x7fdad000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80c7620 con 0x7fdad00039c0 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad000c120 con 0x7fdad00047c0 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.406+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad000c2e0 con 0x7fdad00051d0 2024-03-23T06:16:12.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.407+0000 7fdaede00640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 0x7fdad0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.407+0000 7fdaed400640 1 --2- 172.21.15.73:0/376945370 >> v2:172.21.15.73:3300/0 conn(0x7fdae806a840 0x7fdae806f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:16:12.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.407+0000 7fdaede00640 1 -- 172.21.15.73:0/376945370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdad00051d0 msgr2=0x7fdad000b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:12.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.407+0000 7fdaede00640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdad00051d0 0x7fdad000b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.407+0000 7fdaede00640 1 -- 172.21.15.73:0/376945370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad00047c0 msgr2=0x7fdad0004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:16:12.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.407+0000 7fdaede00640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdad00047c0 0x7fdad0004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.407+0000 7fdaede00640 1 -- 172.21.15.73:0/376945370 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0003520 con 0x7fdad00039c0 2024-03-23T06:16:12.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.408+0000 7fdaee800640 1 -- 172.21.15.73:0/376945370 reap_dead start 2024-03-23T06:16:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.409+0000 7fdaede00640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 0x7fdad0003de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdadc007fd0 tx=0x7fdad00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be647b0574023093 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.409+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc005ad0 con 0x7fdad00039c0 2024-03-23T06:16:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.409+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc005c30 con 0x7fdad00039c0 2024-03-23T06:16:12.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.409+0000 7fdaeca00640 1 -- 172.21.15.73:0/376945370 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc02c9e0 con 0x7fdad00039c0 2024-03-23T06:16:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.410+0000 7fdaef200640 1 -- 172.21.15.73:0/376945370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 msgr2=0x7fdad0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.410+0000 7fdaef200640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 0x7fdad0003de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdadc007fd0 tx=0x7fdad00057f0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.411+0000 7fdaef200640 1 -- 172.21.15.73:0/376945370 shutdown_connections 2024-03-23T06:16:12.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.411+0000 7fdaef200640 1 --2- 172.21.15.73:0/376945370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 0x7fdad0003de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.411+0000 7fdaef200640 1 -- 172.21.15.73:0/376945370 >> 172.21.15.73:0/376945370 conn(0x7fdae806d3f0 msgr2=0x7fdae806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:12.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.411+0000 7fdaef200640 1 -- 172.21.15.73:0/376945370 shutdown_connections 2024-03-23T06:16:12.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.411+0000 7fdaef200640 1 -- 172.21.15.73:0/376945370 wait complete. 2024-03-23T06:16:12.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.414+0000 7fdaef200640 1 Processor -- start 2024-03-23T06:16:12.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.414+0000 7fdaef200640 1 -- start start 2024-03-23T06:16:12.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.416+0000 7fdaef200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 0x7fdae815c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.416+0000 7fdaef200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae815c970 0x7fdae8153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.416+0000 7fdaef200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae81540f0 0x7fdae8150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.416+0000 7fdaef200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80be690 con 0x7fdad00039c0 2024-03-23T06:16:12.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.417+0000 7fdaef200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae81f3400 con 0x7fdae81540f0 2024-03-23T06:16:12.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.417+0000 7fdaed400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae815c970 0x7fdae8153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.417+0000 7fdaed400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae815c970 0x7fdae8153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41488/0 (socket says 172.21.15.73:41488) 2024-03-23T06:16:12.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.417+0000 7fdaef200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae815b3d0 con 0x7fdae815c970 2024-03-23T06:16:12.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.417+0000 7fdaee800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae81540f0 0x7fdae8150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.418+0000 7fdaee800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae81540f0 0x7fdae8150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33378/0 (socket says 172.21.15.73:33378) 2024-03-23T06:16:12.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.418+0000 7fdaed400640 1 -- 172.21.15.73:0/2084668475 learned_addr learned my addr 172.21.15.73:0/2084668475 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:12.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.418+0000 7fdaede00640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 0x7fdae815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.420+0000 7fdaed400640 1 -- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae81540f0 msgr2=0x7fdae8150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.420+0000 7fdaed400640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae81540f0 0x7fdae8150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.420+0000 7fdaed400640 1 -- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 msgr2=0x7fdae815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.420+0000 7fdaed400640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdad00039c0 0x7fdae815c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.420+0000 7fdaed400640 1 -- 172.21.15.73:0/2084668475 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae815b670 con 0x7fdae815c970 2024-03-23T06:16:12.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.420+0000 7fdaee800640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdae81540f0 0x7fdae8150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:16:12.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.421+0000 7fdaed400640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae815c970 0x7fdae8153bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdad800e930 tx=0x7fdad800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.421+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8009700 con 0x7fdae815c970 2024-03-23T06:16:12.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.421+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad800ca00 con 0x7fdae815c970 2024-03-23T06:16:12.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.421+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae815b950 con 0x7fdae815c970 2024-03-23T06:16:12.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.422+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae815bf10 con 0x7fdae815c970 2024-03-23T06:16:12.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.422+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800cd90 con 0x7fdae815c970 2024-03-23T06:16:12.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.425+0000 7fdaef200640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae8150b90 0x7fdae8150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.425+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae815b800 con 0x7fdae8150b90 2024-03-23T06:16:12.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.427+0000 7fdaede00640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae8150b90 0x7fdae8150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.428+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdad8013470 con 0x7fdae815c970 2024-03-23T06:16:12.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.428+0000 7fdaede00640 1 -- 172.21.15.73:0/2084668475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdae80c72b0 con 0x7fdae8150b90 2024-03-23T06:16:12.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.429+0000 7fdaede00640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae8150b90 0x7fdae8150f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdad0004740 tx=0x7fdae80c6170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.429+0000 7fdae2000640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdacc06acd0 0x7fdacc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.429+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fdad8089220 con 0x7fdae815c970 2024-03-23T06:16:12.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.430+0000 7fdaee800640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdacc06acd0 0x7fdacc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.430+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc001640 con 0x7fdae8150b90 2024-03-23T06:16:12.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.430+0000 7fdaee800640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdacc06acd0 0x7fdacc06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdae8073d70 tx=0x7fdae4007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.431+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fdadc03a030 con 0x7fdae8150b90 2024-03-23T06:16:12.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.431+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae8150b90 msgr2=0x7fdae8150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.431+0000 7fdae2000640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae8150b90 0x7fdae8150f70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdad0004740 tx=0x7fdae80c6170 comp rx=0 tx=0).stop 2024-03-23T06:16:12.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.431+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae8150b90 msgr2=0x7fdae8150f70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:12.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.431+0000 7fdae2000640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae8150b90 0x7fdae8150f70 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdad0004740 tx=0x7fdae80c6170 comp rx=0 tx=0).stop 2024-03-23T06:16:12.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.443+0000 7fdaef200640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae81f65c0 0x7fdae81f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.443+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae8073aa0 con 0x7fdae81f65c0 2024-03-23T06:16:12.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.445+0000 7fdaede00640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae81f65c0 0x7fdae81f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.446+0000 7fdaede00640 1 -- 172.21.15.73:0/2084668475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdae80c6fd0 con 0x7fdae81f65c0 2024-03-23T06:16:12.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.447+0000 7fdaede00640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae81f65c0 0x7fdae81f69d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009000 tx=0x7fdadc02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.447+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdadc035690 con 0x7fdae81f65c0 2024-03-23T06:16:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.448+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4780 (secure 0 0 0) 0x7fdadc007710 con 0x7fdae81f65c0 2024-03-23T06:16:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.448+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae81f65c0 msgr2=0x7fdae81f69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 68, 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:12.451 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:16:12.452 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:16:12.453 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:16:12.454 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:16:12.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.459 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:12.460 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:12.461 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:16:12.462 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:16:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.448+0000 7fdae2000640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae81f65c0 0x7fdae81f69d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdadc009000 tx=0x7fdadc02f000 comp rx=0 tx=0).stop 2024-03-23T06:16:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.448+0000 7fdae2000640 1 -- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae81f65c0 msgr2=0x7fdae81f69d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.448+0000 7fdae2000640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdae81f65c0 0x7fdae81f69d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.449+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdacc06acd0 msgr2=0x7fdacc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.449+0000 7fdaef200640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdacc06acd0 0x7fdacc06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdae8073d70 tx=0x7fdae4007e50 comp rx=0 tx=0).stop 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.450+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae815c970 msgr2=0x7fdae8153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.450+0000 7fdaef200640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae815c970 0x7fdae8153bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdad800e930 tx=0x7fdad800edf0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.450+0000 7fdaee800640 1 -- 172.21.15.73:0/2084668475 reap_dead start 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.451+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 shutdown_connections 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.451+0000 7fdaef200640 1 --2- 172.21.15.73:0/2084668475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdae815c970 0x7fdae8153bb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.451+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 >> 172.21.15.73:0/2084668475 conn(0x7fdae806d3f0 msgr2=0x7fdae806f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.451+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 shutdown_connections 2024-03-23T06:16:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.451+0000 7fdaef200640 1 -- 172.21.15.73:0/2084668475 wait complete. 2024-03-23T06:16:12.474 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:16:12.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:16:12.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:16:12.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.804+0000 7f3b9d000640 1 Processor -- start 2024-03-23T06:16:12.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.804+0000 7f3b9d000640 1 -- start start 2024-03-23T06:16:12.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.806+0000 7f3b9d000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3b98157b70 0x7f3b980c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.806+0000 7f3b9d000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3b980caa20 0x7f3b980cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.806+0000 7f3b9d000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980c94d0 con 0x7f3b9815e340 2024-03-23T06:16:12.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.806+0000 7f3b9d000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980c76f0 con 0x7f3b980caa20 2024-03-23T06:16:12.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.806+0000 7f3b9d000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980c9850 con 0x7f3b98157b70 2024-03-23T06:16:12.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.806+0000 7f3b96800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3b980caa20 0x7f3b980cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.806+0000 7f3b96800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3b980caa20 0x7f3b980cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:44440/0 (socket says 172.21.15.73:44440) 2024-03-23T06:16:12.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.806+0000 7f3b96800640 1 -- 172.21.15.73:0/3247805680 learned_addr learned my addr 172.21.15.73:0/3247805680 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:12.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.807+0000 7f3b95e00640 1 --2- 172.21.15.73:0/3247805680 >> v2:172.21.15.110:3300/0 conn(0x7f3b98157b70 0x7f3b980c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.807+0000 7f3b96800640 1 -- 172.21.15.73:0/3247805680 >> v2:172.21.15.110:3300/0 conn(0x7f3b98157b70 msgr2=0x7f3b980c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:12.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.807+0000 7f3b96800640 1 --2- 172.21.15.73:0/3247805680 >> v2:172.21.15.110:3300/0 conn(0x7f3b98157b70 0x7f3b980c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.807+0000 7f3b96800640 1 -- 172.21.15.73:0/3247805680 >> v1:172.21.15.110:6789/0 conn(0x7f3b9815e340 legacy=0x7f3b980c7b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:16:12.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.807+0000 7f3b96800640 1 -- 172.21.15.73:0/3247805680 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980c9c30 con 0x7f3b980caa20 2024-03-23T06:16:12.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.809+0000 7f3b96800640 1 --2- 172.21.15.73:0/3247805680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b980caa20 0x7f3b980cae60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b980ca970 tx=0x7f3b9002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d55d250a5990f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.810+0000 7f3b94a00640 1 -- 172.21.15.73:0/3247805680 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9002cb10 con 0x7f3b980caa20 2024-03-23T06:16:12.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.810+0000 7f3b94a00640 1 -- 172.21.15.73:0/3247805680 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9002cc70 con 0x7f3b980caa20 2024-03-23T06:16:12.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.810+0000 7f3b94a00640 1 -- 172.21.15.73:0/3247805680 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900343f0 con 0x7f3b980caa20 2024-03-23T06:16:12.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.811+0000 7f3b9d000640 1 -- 172.21.15.73:0/3247805680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b980caa20 msgr2=0x7f3b980cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.811+0000 7f3b9d000640 1 --2- 172.21.15.73:0/3247805680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b980caa20 0x7f3b980cae60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b980ca970 tx=0x7f3b9002bf70 comp rx=0 tx=0).stop 2024-03-23T06:16:12.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.811+0000 7f3b9d000640 1 -- 172.21.15.73:0/3247805680 shutdown_connections 2024-03-23T06:16:12.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.811+0000 7f3b9d000640 1 --2- 172.21.15.73:0/3247805680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b980caa20 0x7f3b980cae60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.811+0000 7f3b9d000640 1 --2- 172.21.15.73:0/3247805680 >> v2:172.21.15.110:3300/0 conn(0x7f3b98157b70 0x7f3b980c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.811+0000 7f3b9d000640 1 -- 172.21.15.73:0/3247805680 >> 172.21.15.73:0/3247805680 conn(0x7f3b98069cb0 msgr2=0x7f3b9806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:12.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.814+0000 7f3b9d000640 1 -- 172.21.15.73:0/3247805680 shutdown_connections 2024-03-23T06:16:12.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.814+0000 7f3b9d000640 1 -- 172.21.15.73:0/3247805680 wait complete. 2024-03-23T06:16:12.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.818+0000 7f3b9d000640 1 Processor -- start 2024-03-23T06:16:12.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.820+0000 7f3b9d000640 1 -- start start 2024-03-23T06:16:12.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.821+0000 7f3b9d000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b980caa20 0x7f3b980c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.821+0000 7f3b9d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98157b70 0x7f3b981ff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.821+0000 7f3b9d000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9815e340 0x7f3b98158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.821+0000 7f3b9d000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c6610 con 0x7f3b980caa20 2024-03-23T06:16:12.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.821+0000 7f3b9d000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981ffce0 con 0x7f3b98157b70 2024-03-23T06:16:12.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.821+0000 7f3b9d000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c67f0 con 0x7f3b9815e340 2024-03-23T06:16:12.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98157b70 0x7f3b981ff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98157b70 0x7f3b981ff7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33384/0 (socket says 172.21.15.73:33384) 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 -- 172.21.15.73:0/2043546388 learned_addr learned my addr 172.21.15.73:0/2043546388 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 -- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9815e340 msgr2=0x7f3b98158350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9815e340 0x7f3b98158350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 -- 172.21.15.73:0/2043546388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b980caa20 msgr2=0x7f3b980c60d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b980caa20 0x7f3b980c60d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 -- 172.21.15.73:0/2043546388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009b30 con 0x7f3b98157b70 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.822+0000 7f3b95400640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98157b70 0x7f3b981ff7a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400b480 tx=0x7f3b8400b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.823+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84010870 con 0x7f3b98157b70 2024-03-23T06:16:12.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.823+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b840109f0 con 0x7f3b98157b70 2024-03-23T06:16:12.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.826+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b981fb930 con 0x7f3b98157b70 2024-03-23T06:16:12.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.826+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84010da0 con 0x7f3b98157b70 2024-03-23T06:16:12.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.826+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b981fbef0 con 0x7f3b98157b70 2024-03-23T06:16:12.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.832+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3b8400f3c0 con 0x7f3b98157b70 2024-03-23T06:16:12.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.832+0000 7f3b8e000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3b7806acd0 0x7f3b7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.833+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f3b840896a0 con 0x7f3b98157b70 2024-03-23T06:16:12.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.834+0000 7f3b95e00640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3b7806acd0 0x7f3b7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.834+0000 7f3b9d000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b981fc100 0x7f3b98158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.834+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98073bf0 con 0x7f3b981fc100 2024-03-23T06:16:12.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.835+0000 7f3b96800640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b981fc100 0x7f3b98158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.836+0000 7f3b96800640 1 -- 172.21.15.73:0/2043546388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b980c9ed0 con 0x7f3b981fc100 2024-03-23T06:16:12.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.838+0000 7f3b96800640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b981fc100 0x7f3b98158d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b980c60a0 tx=0x7f3b90004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.839+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9003e450 con 0x7f3b981fc100 2024-03-23T06:16:12.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.839+0000 7f3b95e00640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3b7806acd0 0x7f3b7806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009870 tx=0x7f3b88008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.840+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f3b9003e5b0 con 0x7f3b981fc100 2024-03-23T06:16:12.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.840+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b981fc100 msgr2=0x7f3b98158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.840+0000 7f3b8e000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b981fc100 0x7f3b98158d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b980c60a0 tx=0x7f3b90004a40 comp rx=0 tx=0).stop 2024-03-23T06:16:12.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.840+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b981fc100 msgr2=0x7f3b98158d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:12.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.840+0000 7f3b8e000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b981fc100 0x7f3b98158d30 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3b980c60a0 tx=0x7f3b90004a40 comp rx=0 tx=0).stop 2024-03-23T06:16:12.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.854+0000 7f3b9d000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98152ad0 0x7f3b98152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:12.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.854+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c8f50 con 0x7f3b98152ad0 2024-03-23T06:16:12.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.854+0000 7f3b96800640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98152ad0 0x7f3b98152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:12.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.855+0000 7f3b96800640 1 -- 172.21.15.73:0/2043546388 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3b980c91f0 con 0x7f3b98152ad0 2024-03-23T06:16:12.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.857+0000 7f3b96800640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98152ad0 0x7f3b98152ee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b9002bfb0 tx=0x7f3b90009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:12.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.859+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9004d070 con 0x7f3b98152ad0 2024-03-23T06:16:12.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.859+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f3b90003fa0 con 0x7f3b98152ad0 2024-03-23T06:16:12.860 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:16:12.860 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:12.860 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:12.860 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:16:12.860 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 68, 2024-03-23T06:16:12.860 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:12.862 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:16:12.863 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:12.864 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:12.865 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:12.866 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:12.867 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:12.868 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:16:12.869 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.870 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:16:12.871 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:16:12.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.861+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98152ad0 msgr2=0x7f3b98152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.861+0000 7f3b8e000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98152ad0 0x7f3b98152ee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b9002bfb0 tx=0x7f3b90009810 comp rx=0 tx=0).stop 2024-03-23T06:16:12.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.861+0000 7f3b8e000640 1 -- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98152ad0 msgr2=0x7f3b98152ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:12.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.861+0000 7f3b8e000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98152ad0 0x7f3b98152ee0 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b9002bfb0 tx=0x7f3b90009810 comp rx=0 tx=0).stop 2024-03-23T06:16:12.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.862+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3b7806acd0 msgr2=0x7f3b7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.862+0000 7f3b9d000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3b7806acd0 0x7f3b7806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009870 tx=0x7f3b88008040 comp rx=0 tx=0).stop 2024-03-23T06:16:12.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.862+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98157b70 msgr2=0x7f3b981ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:12.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.862+0000 7f3b9d000640 1 --2- 172.21.15.73:0/2043546388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b98157b70 0x7f3b981ff7a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400b480 tx=0x7f3b8400b940 comp rx=0 tx=0).stop 2024-03-23T06:16:12.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.862+0000 7f3b96800640 1 -- 172.21.15.73:0/2043546388 reap_dead start 2024-03-23T06:16:12.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.862+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 shutdown_connections 2024-03-23T06:16:12.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.862+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 >> 172.21.15.73:0/2043546388 conn(0x7f3b98069cb0 msgr2=0x7f3b98155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:12.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.863+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 shutdown_connections 2024-03-23T06:16:12.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:12.863+0000 7f3b9d000640 1 -- 172.21.15.73:0/2043546388 wait complete. 2024-03-23T06:16:12.895 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:16:12.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:16:12.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:16:13.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.388+0000 7fb8b9400640 1 Processor -- start 2024-03-23T06:16:13.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.389+0000 7fb8b9400640 1 -- start start 2024-03-23T06:16:13.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.391+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4153760 0x7fb8b4159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.392+0000 7fb8b2800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4153760 0x7fb8b4159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.392+0000 7fb8b2800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4153760 0x7fb8b4159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41496/0 (socket says 172.21.15.73:41496) 2024-03-23T06:16:13.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.392+0000 7fb8b2800640 1 -- 172.21.15.73:0/3010870232 learned_addr learned my addr 172.21.15.73:0/3010870232 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:13.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.392+0000 7fb8b9400640 1 --2- 172.21.15.73:0/3010870232 >> v2:172.21.15.73:3300/0 conn(0x7fb8b40c9740 0x7fb8b40cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.393+0000 7fb8b9400640 1 --2- 172.21.15.73:0/3010870232 >> v2:172.21.15.110:3300/0 conn(0x7fb8b40cbd10 0x7fb8b40ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.394+0000 7fb8b3200640 1 --2- 172.21.15.73:0/3010870232 >> v2:172.21.15.110:3300/0 conn(0x7fb8b40cbd10 0x7fb8b40ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.395+0000 7fb8b1e00640 1 --2- 172.21.15.73:0/3010870232 >> v2:172.21.15.73:3300/0 conn(0x7fb8b40c9740 0x7fb8b40cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.395+0000 7fb8b9400640 1 -- 172.21.15.73:0/3010870232 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b406a2d0 con 0x7fb8b40c9740 2024-03-23T06:16:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.395+0000 7fb8b9400640 1 -- 172.21.15.73:0/3010870232 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b406a5b0 con 0x7fb8b40cbd10 2024-03-23T06:16:13.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.395+0000 7fb8b9400640 1 -- 172.21.15.73:0/3010870232 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b406a890 con 0x7fb8b4153760 2024-03-23T06:16:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.396+0000 7fb8b3200640 1 -- 172.21.15.73:0/3010870232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4153760 msgr2=0x7fb8b4159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.396+0000 7fb8b3200640 1 --2- 172.21.15.73:0/3010870232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4153760 0x7fb8b4159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.396+0000 7fb8b3200640 1 -- 172.21.15.73:0/3010870232 >> v2:172.21.15.73:3300/0 conn(0x7fb8b40c9740 msgr2=0x7fb8b40cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.397+0000 7fb8b3200640 1 --2- 172.21.15.73:0/3010870232 >> v2:172.21.15.73:3300/0 conn(0x7fb8b40c9740 0x7fb8b40cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.397+0000 7fb8b3200640 1 -- 172.21.15.73:0/3010870232 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b406ab70 con 0x7fb8b40cbd10 2024-03-23T06:16:13.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.398+0000 7fb8b1e00640 1 --2- 172.21.15.73:0/3010870232 >> v2:172.21.15.73:3300/0 conn(0x7fb8b40c9740 0x7fb8b40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:16:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.400+0000 7fb8b3200640 1 --2- 172.21.15.73:0/3010870232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8b40cbd10 0x7fb8b40ca940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40097a0 tx=0x7fb8a402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a569bb8f6b8d5cd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:13.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.400+0000 7fb8b1400640 1 -- 172.21.15.73:0/3010870232 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a402e070 con 0x7fb8b40cbd10 2024-03-23T06:16:13.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.400+0000 7fb8b1400640 1 -- 172.21.15.73:0/3010870232 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a40315a0 con 0x7fb8b40cbd10 2024-03-23T06:16:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.400+0000 7fb8b1400640 1 -- 172.21.15.73:0/3010870232 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4031970 con 0x7fb8b40cbd10 2024-03-23T06:16:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.401+0000 7fb8b9400640 1 -- 172.21.15.73:0/3010870232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8b40cbd10 msgr2=0x7fb8b40ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.401+0000 7fb8b9400640 1 --2- 172.21.15.73:0/3010870232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8b40cbd10 0x7fb8b40ca940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40097a0 tx=0x7fb8a402b840 comp rx=0 tx=0).stop 2024-03-23T06:16:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.402+0000 7fb8b9400640 1 -- 172.21.15.73:0/3010870232 shutdown_connections 2024-03-23T06:16:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.402+0000 7fb8b9400640 1 --2- 172.21.15.73:0/3010870232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8b40cbd10 0x7fb8b40ca940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.402+0000 7fb8b9400640 1 --2- 172.21.15.73:0/3010870232 >> v2:172.21.15.73:3300/0 conn(0x7fb8b40c9740 0x7fb8b40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.402+0000 7fb8b9400640 1 --2- 172.21.15.73:0/3010870232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4153760 0x7fb8b4159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.402+0000 7fb8b9400640 1 -- 172.21.15.73:0/3010870232 >> 172.21.15.73:0/3010870232 conn(0x7fb8b406c310 msgr2=0x7fb8b40713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.402+0000 7fb8b9400640 1 -- 172.21.15.73:0/3010870232 shutdown_connections 2024-03-23T06:16:13.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.402+0000 7fb8b9400640 1 -- 172.21.15.73:0/3010870232 wait complete. 2024-03-23T06:16:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.404+0000 7fb8b9400640 1 Processor -- start 2024-03-23T06:16:13.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.404+0000 7fb8b9400640 1 -- start start 2024-03-23T06:16:13.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.405+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8b40c9740 0x7fb8b4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.405+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40cbd10 0x7fb8b4155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.405+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b4153760 0x7fb8b40c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.405+0000 7fb8b9400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4155410 con 0x7fb8b4153760 2024-03-23T06:16:13.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.405+0000 7fb8b9400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40c7dd0 con 0x7fb8b40c9740 2024-03-23T06:16:13.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.405+0000 7fb8b9400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4156c90 con 0x7fb8b40cbd10 2024-03-23T06:16:13.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.406+0000 7fb8b1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40cbd10 0x7fb8b4155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.406+0000 7fb8b2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8b40c9740 0x7fb8b4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.406+0000 7fb8b1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40cbd10 0x7fb8b4155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41506/0 (socket says 172.21.15.73:41506) 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.406+0000 7fb8b1e00640 1 -- 172.21.15.73:0/689043830 learned_addr learned my addr 172.21.15.73:0/689043830 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.406+0000 7fb8b3200640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b4153760 0x7fb8b40c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.407+0000 7fb8b1e00640 1 -- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8b40c9740 msgr2=0x7fb8b4157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.407+0000 7fb8b1e00640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8b40c9740 0x7fb8b4157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.407+0000 7fb8b1e00640 1 -- 172.21.15.73:0/689043830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b4153760 msgr2=0x7fb8b40c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.407+0000 7fb8b1e00640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8b4153760 0x7fb8b40c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.407+0000 7fb8b1e00640 1 -- 172.21.15.73:0/689043830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac009a70 con 0x7fb8b40cbd10 2024-03-23T06:16:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.408+0000 7fb8b1e00640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40cbd10 0x7fb8b4155830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00ef00 tx=0x7fb8ac00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:13.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.408+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac010040 con 0x7fb8b40cbd10 2024-03-23T06:16:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.408+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac014400 con 0x7fb8b40cbd10 2024-03-23T06:16:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.408+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac014790 con 0x7fb8b40cbd10 2024-03-23T06:16:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.408+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a4009400 con 0x7fb8b40cbd10 2024-03-23T06:16:13.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.408+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b4154a70 con 0x7fb8b40cbd10 2024-03-23T06:16:13.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.411+0000 7fb8b9400640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40c7720 0x7fb8b4154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.411+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b41551d0 con 0x7fb8b40c7720 2024-03-23T06:16:13.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.412+0000 7fb8b2800640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40c7720 0x7fb8b4154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.413+0000 7fb8b2800640 1 -- 172.21.15.73:0/689043830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8b40c9b80 con 0x7fb8b40c7720 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.413+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb8ac0148f0 con 0x7fb8b40cbd10 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.414+0000 7fb8aaa00640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb89006ad00 0x7fb89006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.414+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb8ac08a220 con 0x7fb8b40cbd10 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.415+0000 7fb8b2800640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40c7720 0x7fb8b4154c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb89c011890 tx=0x7fb89c011d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.415+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00fb60 con 0x7fb8b40c7720 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.415+0000 7fb8b3200640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb89006ad00 0x7fb89006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.416+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fb89c00fcc0 con 0x7fb8b40c7720 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.416+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40c7720 msgr2=0x7fb8b4154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.416+0000 7fb8aaa00640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40c7720 0x7fb8b4154c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb89c011890 tx=0x7fb89c011d50 comp rx=0 tx=0).stop 2024-03-23T06:16:13.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.416+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40c7720 msgr2=0x7fb8b4154c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:13.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.416+0000 7fb8aaa00640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40c7720 0x7fb8b4154c90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.416+0000 7fb8b3200640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb89006ad00 0x7fb89006d1c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4036000 tx=0x7fb8a403d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:13.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.428+0000 7fb8b9400640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4154000 0x7fb8b41437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.428+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4072510 con 0x7fb8b4154000 2024-03-23T06:16:13.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.430+0000 7fb8b2800640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4154000 0x7fb8b41437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.431+0000 7fb8b2800640 1 -- 172.21.15.73:0/689043830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb8b4153b40 con 0x7fb8b4154000 2024-03-23T06:16:13.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.431+0000 7fb8b2800640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4154000 0x7fb8b41437d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb89c011890 tx=0x7fb89c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:13.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.431+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c014640 con 0x7fb8b4154000 2024-03-23T06:16:13.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.432+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7fb89c0147a0 con 0x7fb8b4154000 2024-03-23T06:16:13.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.432+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4154000 msgr2=0x7fb8b41437d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.432+0000 7fb8aaa00640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4154000 0x7fb8b41437d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb89c011890 tx=0x7fb89c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.432+0000 7fb8aaa00640 1 -- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4154000 msgr2=0x7fb8b41437d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:13.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.432+0000 7fb8aaa00640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b4154000 0x7fb8b41437d0 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb89c011890 tx=0x7fb89c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 68, 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:13.433 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:13.434 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:16:13.435 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:16:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:16:13.437 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:13.438 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:13.439 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:16:13.440 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:16:13.441 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:13.442 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:13.443 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:16:13.444 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:16:13.445 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:16:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb89006ad00 msgr2=0x7fb89006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b9400640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb89006ad00 0x7fb89006d1c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4036000 tx=0x7fb8a403d040 comp rx=0 tx=0).stop 2024-03-23T06:16:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40cbd10 msgr2=0x7fb8b4155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b9400640 1 --2- 172.21.15.73:0/689043830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8b40cbd10 0x7fb8b4155830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00ef00 tx=0x7fb8ac00b480 comp rx=0 tx=0).stop 2024-03-23T06:16:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b3200640 1 -- 172.21.15.73:0/689043830 reap_dead start 2024-03-23T06:16:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b3200640 1 -- 172.21.15.73:0/689043830 reap_dead start 2024-03-23T06:16:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 shutdown_connections 2024-03-23T06:16:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 >> 172.21.15.73:0/689043830 conn(0x7fb8b406c310 msgr2=0x7fb8b41599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 shutdown_connections 2024-03-23T06:16:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.434+0000 7fb8b9400640 1 -- 172.21.15.73:0/689043830 wait complete. 2024-03-23T06:16:13.462 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:16:13.462 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:16:13.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:16:13.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.823+0000 7fb9abc00640 1 Processor -- start 2024-03-23T06:16:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.823+0000 7fb9abc00640 1 -- start start 2024-03-23T06:16:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.825+0000 7fb9abc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9a414dc70 0x7fb9a406df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.825+0000 7fb9abc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a406edb0 0x7fb9a406e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.825+0000 7fb9abc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a406e980 con 0x7fb9a415a850 2024-03-23T06:16:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.825+0000 7fb9abc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a406da20 con 0x7fb9a414dc70 2024-03-23T06:16:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.825+0000 7fb9abc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40c2c30 con 0x7fb9a406edb0 2024-03-23T06:16:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.825+0000 7fb9a9200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9a414dc70 0x7fb9a406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.825+0000 7fb9a9200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9a414dc70 0x7fb9a406df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33430/0 (socket says 172.21.15.73:33430) 2024-03-23T06:16:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.825+0000 7fb9a9200640 1 -- 172.21.15.73:0/3673656302 learned_addr learned my addr 172.21.15.73:0/3673656302 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:13.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.826+0000 7fb9a3e00640 1 --2- 172.21.15.73:0/3673656302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a406edb0 0x7fb9a406e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.826+0000 7fb9a9200640 1 -- 172.21.15.73:0/3673656302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a406edb0 msgr2=0x7fb9a406e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:13.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.826+0000 7fb9a9200640 1 --2- 172.21.15.73:0/3673656302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a406edb0 0x7fb9a406e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.826+0000 7fb9a9200640 1 -- 172.21.15.73:0/3673656302 >> v1:172.21.15.110:6789/0 conn(0x7fb9a415a850 legacy=0x7fb9a415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:13.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.826+0000 7fb9a9200640 1 -- 172.21.15.73:0/3673656302 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40c7ee0 con 0x7fb9a414dc70 2024-03-23T06:16:13.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.827+0000 7fb9a9200640 1 --2- 172.21.15.73:0/3673656302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a414dc70 0x7fb9a406df00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb998009870 tx=0x7fb99802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81dce3f19280c90f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.828+0000 7fb9a3400640 1 -- 172.21.15.73:0/3673656302 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998031640 con 0x7fb9a414dc70 2024-03-23T06:16:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.828+0000 7fb9a3400640 1 -- 172.21.15.73:0/3673656302 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9980317a0 con 0x7fb9a414dc70 2024-03-23T06:16:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.828+0000 7fb9a3400640 1 -- 172.21.15.73:0/3673656302 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998031b30 con 0x7fb9a414dc70 2024-03-23T06:16:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.829+0000 7fb9abc00640 1 -- 172.21.15.73:0/3673656302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a414dc70 msgr2=0x7fb9a406df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.829+0000 7fb9abc00640 1 --2- 172.21.15.73:0/3673656302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a414dc70 0x7fb9a406df00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb998009870 tx=0x7fb99802b8f0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.829+0000 7fb9abc00640 1 -- 172.21.15.73:0/3673656302 shutdown_connections 2024-03-23T06:16:13.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.829+0000 7fb9abc00640 1 --2- 172.21.15.73:0/3673656302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a406edb0 0x7fb9a406e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.829+0000 7fb9abc00640 1 --2- 172.21.15.73:0/3673656302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a414dc70 0x7fb9a406df00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.829+0000 7fb9abc00640 1 -- 172.21.15.73:0/3673656302 >> 172.21.15.73:0/3673656302 conn(0x7fb9a40ccf40 msgr2=0x7fb9a40cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:13.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.829+0000 7fb9abc00640 1 -- 172.21.15.73:0/3673656302 shutdown_connections 2024-03-23T06:16:13.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.829+0000 7fb9abc00640 1 -- 172.21.15.73:0/3673656302 wait complete. 2024-03-23T06:16:13.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.832+0000 7fb9abc00640 1 Processor -- start 2024-03-23T06:16:13.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.832+0000 7fb9abc00640 1 -- start start 2024-03-23T06:16:13.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.835+0000 7fb9abc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9a406edb0 0x7fb9a41f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.835+0000 7fb9abc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a414dc70 0x7fb9a41597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.835+0000 7fb9abc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a415a850 0x7fb9a4142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.835+0000 7fb9abc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41f3b10 con 0x7fb9a406edb0 2024-03-23T06:16:13.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.835+0000 7fb9abc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41e96c0 con 0x7fb9a415a850 2024-03-23T06:16:13.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.835+0000 7fb9abc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41e93e0 con 0x7fb9a414dc70 2024-03-23T06:16:13.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.836+0000 7fb9a9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a415a850 0x7fb9a4142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.836+0000 7fb9a9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a415a850 0x7fb9a4142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33436/0 (socket says 172.21.15.73:33436) 2024-03-23T06:16:13.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.836+0000 7fb9a9c00640 1 -- 172.21.15.73:0/1372801313 learned_addr learned my addr 172.21.15.73:0/1372801313 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:13.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.836+0000 7fb9a3e00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a414dc70 0x7fb9a41597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.837+0000 7fb9a9200640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9a406edb0 0x7fb9a41f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.837+0000 7fb9a3e00640 1 -- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a415a850 msgr2=0x7fb9a4142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.839+0000 7fb9a3e00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a415a850 0x7fb9a4142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.839+0000 7fb9a3e00640 1 -- 172.21.15.73:0/1372801313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9a406edb0 msgr2=0x7fb9a41f3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:13.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.839+0000 7fb9a3e00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9a406edb0 0x7fb9a41f3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:13.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.839+0000 7fb9a3e00640 1 -- 172.21.15.73:0/1372801313 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980094d0 con 0x7fb9a414dc70 2024-03-23T06:16:13.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.839+0000 7fb9a9c00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a415a850 0x7fb9a4142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:16:13.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.840+0000 7fb9a3e00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a414dc70 0x7fb9a41597d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d5f0 tx=0x7fb99000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:13.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.840+0000 7fb9a0c00640 1 -- 172.21.15.73:0/1372801313 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9900125f0 con 0x7fb9a414dc70 2024-03-23T06:16:13.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.840+0000 7fb9a0c00640 1 -- 172.21.15.73:0/1372801313 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb990012750 con 0x7fb9a414dc70 2024-03-23T06:16:13.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.840+0000 7fb9a0c00640 1 -- 172.21.15.73:0/1372801313 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990012b00 con 0x7fb9a414dc70 2024-03-23T06:16:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.841+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a4149c90 con 0x7fb9a414dc70 2024-03-23T06:16:13.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.841+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a4149f70 con 0x7fb9a414dc70 2024-03-23T06:16:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.847+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb980005250 con 0x7fb9a414dc70 2024-03-23T06:16:13.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.848+0000 7fb9a0c00640 1 -- 172.21.15.73:0/1372801313 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb990012c60 con 0x7fb9a414dc70 2024-03-23T06:16:13.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.854+0000 7fb9a0c00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb98c06adb0 0x7fb98c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.855+0000 7fb9a0c00640 1 -- 172.21.15.73:0/1372801313 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb990089c20 con 0x7fb9a414dc70 2024-03-23T06:16:13.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.855+0000 7fb9a9200640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb98c06adb0 0x7fb98c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:13.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.858+0000 7fb9a9200640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb98c06adb0 0x7fb98c06d270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb998036000 tx=0x7fb99803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:13.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:13.862+0000 7fb9a0c00640 1 -- 172.21.15.73:0/1372801313 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb990054960 con 0x7fb9a414dc70 2024-03-23T06:16:14.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.372+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fb980005d10 con 0x7fb9a414dc70 2024-03-23T06:16:14.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.378+0000 7fb9a0c00640 1 -- 172.21.15.73:0/1372801313 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fb990054960 con 0x7fb9a414dc70 2024-03-23T06:16:14.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb98c06adb0 msgr2=0x7fb98c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:14.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb98c06adb0 0x7fb98c06d270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb998036000 tx=0x7fb99803c040 comp rx=0 tx=0).stop 2024-03-23T06:16:14.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a414dc70 msgr2=0x7fb9a41597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:14.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a414dc70 0x7fb9a41597d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d5f0 tx=0x7fb99000dab0 comp rx=0 tx=0).stop 2024-03-23T06:16:14.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 shutdown_connections 2024-03-23T06:16:14.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9a415a850 0x7fb9a4142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:14.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb98c06adb0 0x7fb98c06d270 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:14.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9a414dc70 0x7fb9a41597d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:14.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 --2- 172.21.15.73:0/1372801313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9a406edb0 0x7fb9a41f3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:14.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 >> 172.21.15.73:0/1372801313 conn(0x7fb9a40ccf40 msgr2=0x7fb9a406de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:14.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 shutdown_connections 2024-03-23T06:16:14.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:14.383+0000 7fb9abc00640 1 -- 172.21.15.73:0/1372801313 wait complete. 2024-03-23T06:16:14.408 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:16:24.408 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:16:24.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:16:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.210+0000 7fbe37e00640 1 Processor -- start 2024-03-23T06:16:25.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.210+0000 7fbe37e00640 1 -- start start 2024-03-23T06:16:25.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.212+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe30037150 0x7fbe300e29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:25.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.212+0000 7fbe37e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe300376b0 con 0x7fbe30038d30 2024-03-23T06:16:25.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.212+0000 7fbe37e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe300502a0 con 0x7fbe300d9290 2024-03-23T06:16:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.212+0000 7fbe37e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30050580 con 0x7fbe30037150 2024-03-23T06:16:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.213+0000 7fbe36000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbe30038d30 0x7fbe300e22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47994/0 (socket says 172.21.15.73:47994) 2024-03-23T06:16:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.213+0000 7fbe36000640 1 -- 172.21.15.73:0/2305002561 learned_addr learned my addr 172.21.15.73:0/2305002561 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:16:25.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.213+0000 7fbe37400640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe30037150 0x7fbe300e29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.214+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145579337 0 0) 0x7fbe300376b0 con 0x7fbe30038d30 2024-03-23T06:16:25.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.214+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe1c003520 con 0x7fbe30038d30 2024-03-23T06:16:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.214+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2995081869 0 0) 0x7fbe1c003520 con 0x7fbe30038d30 2024-03-23T06:16:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.214+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe30037150 msgr2=0x7fbe300e29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.214+0000 7fbe35600640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe30037150 0x7fbe300e29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 >> v1:172.21.15.110:6789/0 conn(0x7fbe300d9290 legacy=0x7fbe30038620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:16:25.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30050860 con 0x7fbe30038d30 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fbe28001670 con 0x7fbe30038d30 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 >> v1:172.21.15.73:6789/0 conn(0x7fbe30038d30 legacy=0x7fbe300e22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe1c003a20 0x7fbe1c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c0047c0 0x7fbe1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe30037150 0x7fbe1c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30050580 con 0x7fbe1c0047c0 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c00ba90 con 0x7fbe1c003a20 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c00bc50 con 0x7fbe30037150 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.215+0000 7fbe37400640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe30037150 0x7fbe1c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.216+0000 7fbe36000640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c0047c0 0x7fbe1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:25.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.216+0000 7fbe36a00640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe1c003a20 0x7fbe1c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:25.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.216+0000 7fbe36a00640 1 -- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe30037150 msgr2=0x7fbe1c0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:25.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.216+0000 7fbe36a00640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe30037150 0x7fbe1c0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.216+0000 7fbe36a00640 1 -- 172.21.15.73:0/2305002561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c0047c0 msgr2=0x7fbe1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:25.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.217+0000 7fbe36a00640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c0047c0 0x7fbe1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.217+0000 7fbe36a00640 1 -- 172.21.15.73:0/2305002561 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c003520 con 0x7fbe1c003a20 2024-03-23T06:16:25.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.217+0000 7fbe36000640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c0047c0 0x7fbe1c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.218+0000 7fbe36a00640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe1c003a20 0x7fbe1c003e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe38063b00 tx=0x7fbe1c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc0cd2f00ba92b2b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.218+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380af8c0 con 0x7fbe1c003a20 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.218+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe380afa60 con 0x7fbe1c003a20 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.218+0000 7fbe35600640 1 -- 172.21.15.73:0/2305002561 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe380afe50 con 0x7fbe1c003a20 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.219+0000 7fbe37e00640 1 -- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe1c003a20 msgr2=0x7fbe1c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.219+0000 7fbe37e00640 1 --2- 172.21.15.73:0/2305002561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe1c003a20 0x7fbe1c003e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbe38063b00 tx=0x7fbe1c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.220+0000 7fbe37400640 1 -- 172.21.15.73:0/2305002561 reap_dead start 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.220+0000 7fbe37e00640 1 -- 172.21.15.73:0/2305002561 shutdown_connections 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.220+0000 7fbe37e00640 1 -- 172.21.15.73:0/2305002561 >> 172.21.15.73:0/2305002561 conn(0x7fbe300545e0 msgr2=0x7fbe300549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.220+0000 7fbe37e00640 1 -- 172.21.15.73:0/2305002561 shutdown_connections 2024-03-23T06:16:25.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.220+0000 7fbe37e00640 1 -- 172.21.15.73:0/2305002561 wait complete. 2024-03-23T06:16:25.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.223+0000 7fbe37e00640 1 Processor -- start 2024-03-23T06:16:25.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.223+0000 7fbe37e00640 1 -- start start 2024-03-23T06:16:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.225+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c003a20 0x7fbe300d3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:25.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.225+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe3004e630 0x7fbe30053b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:25.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe301722a0 0x7fbe30172720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:25.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe300cd1b0 con 0x7fbe1c003a20 2024-03-23T06:16:25.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30172c60 con 0x7fbe301722a0 2024-03-23T06:16:25.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30171520 con 0x7fbe3004e630 2024-03-23T06:16:25.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe301722a0 0x7fbe30172720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:25.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe301722a0 0x7fbe30172720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37372/0 (socket says 172.21.15.73:37372) 2024-03-23T06:16:25.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37400640 1 -- 172.21.15.73:0/2023016201 learned_addr learned my addr 172.21.15.73:0/2023016201 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe36000640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe3004e630 0x7fbe30053b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37400640 1 -- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe3004e630 msgr2=0x7fbe30053b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37400640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe3004e630 0x7fbe30053b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37400640 1 -- 172.21.15.73:0/2023016201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c003a20 msgr2=0x7fbe300d3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37400640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c003a20 0x7fbe300d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.226+0000 7fbe37400640 1 -- 172.21.15.73:0/2023016201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe300cdd70 con 0x7fbe301722a0 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.227+0000 7fbe36000640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe3004e630 0x7fbe30053b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.227+0000 7fbe37400640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe301722a0 0x7fbe30172720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe300375e0 tx=0x7fbe24011cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.227+0000 7fbe2ea00640 1 -- 172.21.15.73:0/2023016201 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011ee0 con 0x7fbe301722a0 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.227+0000 7fbe2ea00640 1 -- 172.21.15.73:0/2023016201 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe24004240 con 0x7fbe301722a0 2024-03-23T06:16:25.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.227+0000 7fbe2ea00640 1 -- 172.21.15.73:0/2023016201 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2400f7a0 con 0x7fbe301722a0 2024-03-23T06:16:25.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.227+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe300ce040 con 0x7fbe301722a0 2024-03-23T06:16:25.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.228+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe301717c0 con 0x7fbe301722a0 2024-03-23T06:16:25.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.230+0000 7fbe2ea00640 1 -- 172.21.15.73:0/2023016201 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbe2400f900 con 0x7fbe301722a0 2024-03-23T06:16:25.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.230+0000 7fbe2ea00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe1806ac80 0x7fbe1806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:25.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.231+0000 7fbe2ea00640 1 -- 172.21.15.73:0/2023016201 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fbe24089650 con 0x7fbe301722a0 2024-03-23T06:16:25.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.233+0000 7fbe36a00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe1806ac80 0x7fbe1806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.236+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe300cc880 con 0x7fbe301722a0 2024-03-23T06:16:25.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.236+0000 7fbe36a00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe1806ac80 0x7fbe1806d140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00bc20 tx=0x7fbe3808bf90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:25.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.247+0000 7fbe2ea00640 1 -- 172.21.15.73:0/2023016201 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbe300cc880 con 0x7fbe301722a0 2024-03-23T06:16:25.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.855+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbe300cc880 con 0x7fbe301722a0 2024-03-23T06:16:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.858+0000 7fbe2ea00640 1 -- 172.21.15.73:0/2023016201 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fbe300cc880 con 0x7fbe301722a0 2024-03-23T06:16:25.863 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":68,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:16:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.862+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe1806ac80 msgr2=0x7fbe1806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.862+0000 7fbe37e00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe1806ac80 0x7fbe1806d140 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00bc20 tx=0x7fbe3808bf90 comp rx=0 tx=0).stop 2024-03-23T06:16:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.862+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe301722a0 msgr2=0x7fbe30172720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.862+0000 7fbe37e00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe301722a0 0x7fbe30172720 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe300375e0 tx=0x7fbe24011cf0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.863+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 shutdown_connections 2024-03-23T06:16:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.863+0000 7fbe37e00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe301722a0 0x7fbe30172720 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.863+0000 7fbe37e00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe1806ac80 0x7fbe1806d140 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.863+0000 7fbe37e00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe3004e630 0x7fbe30053b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.863+0000 7fbe37e00640 1 --2- 172.21.15.73:0/2023016201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1c003a20 0x7fbe300d3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:25.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.863+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 >> 172.21.15.73:0/2023016201 conn(0x7fbe300545e0 msgr2=0x7fbe300060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:25.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.864+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 shutdown_connections 2024-03-23T06:16:25.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:25.864+0000 7fbe37e00640 1 -- 172.21.15.73:0/2023016201 wait complete. 2024-03-23T06:16:25.912 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:16:25.912 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:16:25.912 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:16:25.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.443+0000 7f0d83e00640 1 Processor -- start 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.443+0000 7f0d83e00640 1 -- start start 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.445+0000 7f0d83e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d840cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.445+0000 7f0d83e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d840cc1c0 0x7f0d840c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.445+0000 7f0d83e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840c41f0 con 0x7f0d84153660 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.445+0000 7f0d83e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840cb230 con 0x7f0d840cc1c0 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.445+0000 7f0d83e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840cb7f0 con 0x7f0d840cade0 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.446+0000 7f0d83400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d840cc1c0 0x7f0d840c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.446+0000 7f0d83400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d840cc1c0 0x7f0d840c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40364/0 (socket says 172.21.15.73:40364) 2024-03-23T06:16:26.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.446+0000 7f0d83400640 1 -- 172.21.15.73:0/2473607776 learned_addr learned my addr 172.21.15.73:0/2473607776 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:26.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.446+0000 7f0d82000640 1 --2- 172.21.15.73:0/2473607776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d840cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.447+0000 7f0d82000640 1 -- 172.21.15.73:0/2473607776 >> v2:172.21.15.73:3300/0 conn(0x7f0d840cc1c0 msgr2=0x7f0d840c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:26.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.447+0000 7f0d82000640 1 --2- 172.21.15.73:0/2473607776 >> v2:172.21.15.73:3300/0 conn(0x7f0d840cc1c0 0x7f0d840c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.447+0000 7f0d82000640 1 -- 172.21.15.73:0/2473607776 >> v1:172.21.15.73:6789/0 conn(0x7f0d84153660 legacy=0x7f0d8415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:26.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.450+0000 7f0d82000640 1 -- 172.21.15.73:0/2473607776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8415d0b0 con 0x7f0d840cade0 2024-03-23T06:16:26.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.453+0000 7f0d82000640 1 --2- 172.21.15.73:0/2473607776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d840cbc80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0097a0 tx=0x7f0d6c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f5a8585e28099bc server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.453+0000 7f0d81600640 1 -- 172.21.15.73:0/2473607776 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c02e070 con 0x7f0d840cade0 2024-03-23T06:16:26.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.453+0000 7f0d81600640 1 -- 172.21.15.73:0/2473607776 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0315a0 con 0x7f0d840cade0 2024-03-23T06:16:26.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.453+0000 7f0d81600640 1 -- 172.21.15.73:0/2473607776 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c031930 con 0x7f0d840cade0 2024-03-23T06:16:26.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.454+0000 7f0d83e00640 1 -- 172.21.15.73:0/2473607776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 msgr2=0x7f0d840cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.454+0000 7f0d83e00640 1 --2- 172.21.15.73:0/2473607776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d840cbc80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0097a0 tx=0x7f0d6c02b840 comp rx=0 tx=0).stop 2024-03-23T06:16:26.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.458+0000 7f0d83e00640 1 -- 172.21.15.73:0/2473607776 shutdown_connections 2024-03-23T06:16:26.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.458+0000 7f0d83e00640 1 --2- 172.21.15.73:0/2473607776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d840cbc80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.458+0000 7f0d83e00640 1 --2- 172.21.15.73:0/2473607776 >> v2:172.21.15.73:3300/0 conn(0x7f0d840cc1c0 0x7f0d840c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.458+0000 7f0d83e00640 1 -- 172.21.15.73:0/2473607776 >> 172.21.15.73:0/2473607776 conn(0x7f0d8406bcc0 msgr2=0x7f0d8406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:26.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.461+0000 7f0d83e00640 1 -- 172.21.15.73:0/2473607776 shutdown_connections 2024-03-23T06:16:26.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.464+0000 7f0d83e00640 1 -- 172.21.15.73:0/2473607776 wait complete. 2024-03-23T06:16:26.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.469+0000 7f0d83e00640 1 Processor -- start 2024-03-23T06:16:26.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.469+0000 7f0d83e00640 1 -- start start 2024-03-23T06:16:26.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.472+0000 7f0d83e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d8415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.475+0000 7f0d83e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d840cc1c0 0x7f0d840c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.475+0000 7f0d83e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84153660 0x7f0d840c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.476+0000 7f0d83e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8415c9d0 con 0x7f0d840cc1c0 2024-03-23T06:16:26.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.476+0000 7f0d83e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d841599d0 con 0x7f0d84153660 2024-03-23T06:16:26.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.475+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d8415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.476+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d8415a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:58542/0 (socket says 172.21.15.73:58542) 2024-03-23T06:16:26.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.476+0000 7f0d82a00640 1 -- 172.21.15.73:0/2747452622 learned_addr learned my addr 172.21.15.73:0/2747452622 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:26.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.477+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8415a9f0 con 0x7f0d840cade0 2024-03-23T06:16:26.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.479+0000 7f0d83400640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84153660 0x7f0d840c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.479+0000 7f0d82000640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d840cc1c0 0x7f0d840c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.480+0000 7f0d82000640 1 -- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 msgr2=0x7f0d8415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.480+0000 7f0d82000640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d840cade0 0x7f0d8415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.480+0000 7f0d82000640 1 -- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84153660 msgr2=0x7f0d840c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.480+0000 7f0d82000640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84153660 0x7f0d840c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.480+0000 7f0d82000640 1 -- 172.21.15.73:0/2747452622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c009400 con 0x7f0d840cc1c0 2024-03-23T06:16:26.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.481+0000 7f0d83400640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84153660 0x7f0d840c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:16:26.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.481+0000 7f0d82000640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d840cc1c0 0x7f0d840c74d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c033000 tx=0x7f0d6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.482+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c032840 con 0x7f0d840cc1c0 2024-03-23T06:16:26.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.482+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c031f00 con 0x7f0d840cc1c0 2024-03-23T06:16:26.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.483+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c032840 con 0x7f0d840cc1c0 2024-03-23T06:16:26.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.485+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d840c6e60 con 0x7f0d840cc1c0 2024-03-23T06:16:26.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.487+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84158580 con 0x7f0d840cc1c0 2024-03-23T06:16:26.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.493+0000 7f0d83e00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d84159e40 0x7f0d8415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.493+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d840723f0 con 0x7f0d84159e40 2024-03-23T06:16:26.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.493+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0d6c0329a0 con 0x7f0d840cc1c0 2024-03-23T06:16:26.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.499+0000 7f0d82a00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d84159e40 0x7f0d8415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.503+0000 7f0d82a00640 1 -- 172.21.15.73:0/2747452622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d840cb480 con 0x7f0d84159e40 2024-03-23T06:16:26.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.503+0000 7f0d82a00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d84159e40 0x7f0d8415c410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00fae0 tx=0x7f0d7c0058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.507+0000 7f0d7aa00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d6006ac90 0x7f0d6006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.507+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f0d6c0ab100 con 0x7f0d840cc1c0 2024-03-23T06:16:26.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.507+0000 7f0d83400640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d6006ac90 0x7f0d6006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.507+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c018070 con 0x7f0d84159e40 2024-03-23T06:16:26.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.507+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f0d7c006b50 con 0x7f0d84159e40 2024-03-23T06:16:26.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.507+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d84159e40 msgr2=0x7f0d8415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.507+0000 7f0d7aa00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d84159e40 0x7f0d8415c410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00fae0 tx=0x7f0d7c0058f0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.508+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d84159e40 msgr2=0x7f0d8415c410 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:26.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.508+0000 7f0d7aa00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d84159e40 0x7f0d8415c410 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00fae0 tx=0x7f0d7c0058f0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.518+0000 7f0d83400640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d6006ac90 0x7f0d6006d150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009a40 tx=0x7f0d74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.529+0000 7f0d83e00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841571c0 0x7f0d841575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.529+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8415d670 con 0x7f0d841571c0 2024-03-23T06:16:26.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.529+0000 7f0d82a00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841571c0 0x7f0d841575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.530+0000 7f0d82a00640 1 -- 172.21.15.73:0/2747452622 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0d84153a40 con 0x7f0d841571c0 2024-03-23T06:16:26.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.531+0000 7f0d82a00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841571c0 0x7f0d841575a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00fae0 tx=0x7f0d7c003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.532+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c022070 con 0x7f0d841571c0 2024-03-23T06:16:26.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.532+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4781 (secure 0 0 0) 0x7f0d7c026450 con 0x7f0d841571c0 2024-03-23T06:16:26.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.532+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841571c0 msgr2=0x7f0d841575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.537 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:16:26.537 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:26.537 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:26.537 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:16:26.537 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 68, 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 15, 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:26.538 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:26.539 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:16:26.540 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:26.543 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.544 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:26.545 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:26.546 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.547 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:16:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:16:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:26.549 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.550 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:16:26.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.534+0000 7f0d7aa00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841571c0 0x7f0d841575a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00fae0 tx=0x7f0d7c003ae0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.534+0000 7f0d7aa00640 1 -- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841571c0 msgr2=0x7f0d841575a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.534+0000 7f0d7aa00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d841571c0 0x7f0d841575a0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00fae0 tx=0x7f0d7c003ae0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.536+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d6006ac90 msgr2=0x7f0d6006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.536+0000 7f0d83e00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0d6006ac90 0x7f0d6006d150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009a40 tx=0x7f0d74008040 comp rx=0 tx=0).stop 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.536+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d840cc1c0 msgr2=0x7f0d840c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.536+0000 7f0d83e00640 1 --2- 172.21.15.73:0/2747452622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d840cc1c0 0x7f0d840c74d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c033000 tx=0x7f0d6c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.536+0000 7f0d83400640 1 -- 172.21.15.73:0/2747452622 reap_dead start 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.537+0000 7f0d83400640 1 -- 172.21.15.73:0/2747452622 reap_dead start 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.537+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 shutdown_connections 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.537+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 >> 172.21.15.73:0/2747452622 conn(0x7f0d8406bcc0 msgr2=0x7f0d840c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.537+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 shutdown_connections 2024-03-23T06:16:26.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.537+0000 7f0d83e00640 1 -- 172.21.15.73:0/2747452622 wait complete. 2024-03-23T06:16:26.565 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:16:26.565 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:16:26.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:16:26.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.858+0000 7ff248000640 1 Processor -- start 2024-03-23T06:16:26.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.858+0000 7ff248000640 1 -- start start 2024-03-23T06:16:26.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.860+0000 7ff248000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2400c3f60 0x7ff24006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.861+0000 7ff248000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2400ca790 con 0x7ff24006b530 2024-03-23T06:16:26.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.861+0000 7ff248000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2400cb610 con 0x7ff24015cda0 2024-03-23T06:16:26.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.861+0000 7ff248000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2400ca1d0 con 0x7ff2400c3f60 2024-03-23T06:16:26.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.862+0000 7ff245600640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff24015cda0 0x7ff24015d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:34662/0 (socket says 172.21.15.73:34662) 2024-03-23T06:16:26.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.862+0000 7ff245600640 1 -- 172.21.15.73:0/2718711480 learned_addr learned my addr 172.21.15.73:0/2718711480 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:16:26.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.862+0000 7ff244c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2400c3f60 0x7ff24006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.864+0000 7ff23fe00640 1 -- 172.21.15.73:0/2718711480 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772117171 0 0) 0x7ff2400cb610 con 0x7ff24015cda0 2024-03-23T06:16:26.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.865+0000 7ff23fe00640 1 -- 172.21.15.73:0/2718711480 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff228003520 con 0x7ff24015cda0 2024-03-23T06:16:26.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.865+0000 7ff23fe00640 1 -- 172.21.15.73:0/2718711480 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931429148 0 0) 0x7ff2400ca790 con 0x7ff24006b530 2024-03-23T06:16:26.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.865+0000 7ff23fe00640 1 -- 172.21.15.73:0/2718711480 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2400cb610 con 0x7ff24006b530 2024-03-23T06:16:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.865+0000 7ff244c00640 1 -- 172.21.15.73:0/2718711480 >> v1:172.21.15.110:6789/0 conn(0x7ff24015cda0 legacy=0x7ff24015d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.865+0000 7ff244c00640 1 -- 172.21.15.73:0/2718711480 >> v1:172.21.15.73:6789/0 conn(0x7ff24006b530 legacy=0x7ff240153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.865+0000 7ff244c00640 1 -- 172.21.15.73:0/2718711480 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2400ca4b0 con 0x7ff2400c3f60 2024-03-23T06:16:26.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.867+0000 7ff244c00640 1 --2- 172.21.15.73:0/2718711480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400c3f60 0x7ff24006aff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2340097a0 tx=0x7ff23402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f5b79589f8b699c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.868+0000 7ff23fe00640 1 -- 172.21.15.73:0/2718711480 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234031830 con 0x7ff2400c3f60 2024-03-23T06:16:26.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.868+0000 7ff23fe00640 1 -- 172.21.15.73:0/2718711480 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff234031990 con 0x7ff2400c3f60 2024-03-23T06:16:26.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.868+0000 7ff23fe00640 1 -- 172.21.15.73:0/2718711480 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff234031d20 con 0x7ff2400c3f60 2024-03-23T06:16:26.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.869+0000 7ff248000640 1 -- 172.21.15.73:0/2718711480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400c3f60 msgr2=0x7ff24006aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.869+0000 7ff248000640 1 --2- 172.21.15.73:0/2718711480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400c3f60 0x7ff24006aff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2340097a0 tx=0x7ff23402b8d0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.869+0000 7ff248000640 1 -- 172.21.15.73:0/2718711480 shutdown_connections 2024-03-23T06:16:26.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.869+0000 7ff248000640 1 --2- 172.21.15.73:0/2718711480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400c3f60 0x7ff24006aff0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.869+0000 7ff248000640 1 -- 172.21.15.73:0/2718711480 >> 172.21.15.73:0/2718711480 conn(0x7ff2400cf3d0 msgr2=0x7ff2400cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:26.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.870+0000 7ff248000640 1 -- 172.21.15.73:0/2718711480 shutdown_connections 2024-03-23T06:16:26.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.870+0000 7ff248000640 1 -- 172.21.15.73:0/2718711480 wait complete. 2024-03-23T06:16:26.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.873+0000 7ff248000640 1 Processor -- start 2024-03-23T06:16:26.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.873+0000 7ff248000640 1 -- start start 2024-03-23T06:16:26.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.875+0000 7ff248000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff24006b530 0x7ff2401ea540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.875+0000 7ff248000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2400c3f60 0x7ff2400b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.875+0000 7ff248000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015cda0 0x7ff2401ee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.876+0000 7ff245600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff24006b530 0x7ff2401ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.876+0000 7ff245600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff24006b530 0x7ff2401ea540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:40390/0 (socket says 172.21.15.73:40390) 2024-03-23T06:16:26.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.877+0000 7ff244c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2400c3f60 0x7ff2400b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.877+0000 7ff244c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2400c3f60 0x7ff2400b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:58556/0 (socket says 172.21.15.73:58556) 2024-03-23T06:16:26.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.877+0000 7ff246000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015cda0 0x7ff2401ee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.877+0000 7ff246000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015cda0 0x7ff2401ee1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37400/0 (socket says 172.21.15.73:37400) 2024-03-23T06:16:26.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.877+0000 7ff245600640 1 -- 172.21.15.73:0/573600839 learned_addr learned my addr 172.21.15.73:0/573600839 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:26.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.877+0000 7ff248000640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2401ec740 con 0x7ff24006b530 2024-03-23T06:16:26.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.877+0000 7ff248000640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400b39a0 con 0x7ff24015cda0 2024-03-23T06:16:26.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.878+0000 7ff248000640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2400b4320 con 0x7ff2400c3f60 2024-03-23T06:16:26.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.879+0000 7ff246000640 1 -- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2400c3f60 msgr2=0x7ff2400b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.879+0000 7ff246000640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2400c3f60 0x7ff2400b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.879+0000 7ff246000640 1 -- 172.21.15.73:0/573600839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff24006b530 msgr2=0x7ff2401ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.879+0000 7ff246000640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff24006b530 0x7ff2401ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.879+0000 7ff246000640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234009400 con 0x7ff24015cda0 2024-03-23T06:16:26.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.880+0000 7ff246000640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015cda0 0x7ff2401ee1d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff238001460 tx=0x7ff23800cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.880+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238003da0 con 0x7ff24015cda0 2024-03-23T06:16:26.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.880+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23800ce30 con 0x7ff24015cda0 2024-03-23T06:16:26.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.881+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238005290 con 0x7ff24015cda0 2024-03-23T06:16:26.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.882+0000 7ff248000640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2401eb0d0 con 0x7ff24015cda0 2024-03-23T06:16:26.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.882+0000 7ff248000640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2400b36c0 con 0x7ff24015cda0 2024-03-23T06:16:26.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.885+0000 7ff232a00640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2401eaa80 0x7ff2401ee710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.885+0000 7ff232a00640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24006aad0 con 0x7ff2401eaa80 2024-03-23T06:16:26.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.887+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff2380053f0 con 0x7ff24015cda0 2024-03-23T06:16:26.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.887+0000 7ff245600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2401eaa80 0x7ff2401ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.889+0000 7ff245600640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff24006a7f0 con 0x7ff2401eaa80 2024-03-23T06:16:26.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.889+0000 7ff245600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2401eaa80 0x7ff2401ee710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff22c005880 tx=0x7ff22c00eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.890+0000 7ff23d600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff22006acd0 0x7ff22006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.891+0000 7ff244c00640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff22006acd0 0x7ff22006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.891+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff238089010 con 0x7ff24015cda0 2024-03-23T06:16:26.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.892+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0058b0 con 0x7ff2401eaa80 2024-03-23T06:16:26.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.892+0000 7ff244c00640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff22006acd0 0x7ff22006d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff234036000 tx=0x7ff23403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.892+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7ff22c005a10 con 0x7ff2401eaa80 2024-03-23T06:16:26.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.892+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2401eaa80 msgr2=0x7ff2401ee710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.892+0000 7ff23d600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2401eaa80 0x7ff2401ee710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff22c005880 tx=0x7ff22c00eb90 comp rx=0 tx=0).stop 2024-03-23T06:16:26.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.893+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2401eaa80 msgr2=0x7ff2401ee710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:26.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.893+0000 7ff23d600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2401eaa80 0x7ff2401ee710 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff22c005880 tx=0x7ff22c00eb90 comp rx=0 tx=0).stop 2024-03-23T06:16:26.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.905+0000 7ff232a00640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400ce950 0x7ff240060ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:26.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.905+0000 7ff232a00640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff24015d890 con 0x7ff2400ce950 2024-03-23T06:16:26.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.905+0000 7ff245600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400ce950 0x7ff240060ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:26.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.906+0000 7ff245600640 1 -- 172.21.15.73:0/573600839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff2400b4460 con 0x7ff2400ce950 2024-03-23T06:16:26.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.906+0000 7ff245600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400ce950 0x7ff240060ec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff22c005880 tx=0x7ff22c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:26.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.907+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c022070 con 0x7ff2400ce950 2024-03-23T06:16:26.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.907+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7ff22c007630 con 0x7ff2400ce950 2024-03-23T06:16:26.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.907+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400ce950 msgr2=0x7ff240060ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 68, 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:16:26.909 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 15, 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:26.910 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:26.911 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:16:26.912 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:26.913 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:16:26.914 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.915 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:16:26.916 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.917 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:26.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:26.920 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:16:26.920 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:16:26.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.908+0000 7ff23d600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400ce950 0x7ff240060ec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff22c005880 tx=0x7ff22c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.908+0000 7ff23d600640 1 -- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400ce950 msgr2=0x7ff240060ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.908+0000 7ff23d600640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2400ce950 0x7ff240060ec0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff22c005880 tx=0x7ff22c0057f0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.909+0000 7ff232a00640 1 -- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff22006acd0 msgr2=0x7ff22006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.909+0000 7ff232a00640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff22006acd0 0x7ff22006d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff234036000 tx=0x7ff23403c040 comp rx=0 tx=0).stop 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.909+0000 7ff232a00640 1 -- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015cda0 msgr2=0x7ff2401ee1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.909+0000 7ff232a00640 1 --2- 172.21.15.73:0/573600839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015cda0 0x7ff2401ee1d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff238001460 tx=0x7ff23800cbe0 comp rx=0 tx=0).stop 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.909+0000 7ff246000640 1 -- 172.21.15.73:0/573600839 reap_dead start 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.909+0000 7ff246000640 1 -- 172.21.15.73:0/573600839 reap_dead start 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.909+0000 7ff232a00640 1 -- 172.21.15.73:0/573600839 shutdown_connections 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.909+0000 7ff232a00640 1 -- 172.21.15.73:0/573600839 >> 172.21.15.73:0/573600839 conn(0x7ff2400cf3d0 msgr2=0x7ff240153110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.910+0000 7ff232a00640 1 -- 172.21.15.73:0/573600839 shutdown_connections 2024-03-23T06:16:26.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:26.910+0000 7ff232a00640 1 -- 172.21.15.73:0/573600839 wait complete. 2024-03-23T06:16:26.944 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:16:26.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:16:26.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:16:27.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.377+0000 7fd961600640 1 Processor -- start 2024-03-23T06:16:27.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.377+0000 7fd961600640 1 -- start start 2024-03-23T06:16:27.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.379+0000 7fd961600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 0x7fd95c159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:27.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.379+0000 7fd961600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd95c0c8eb0 0x7fd95c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:27.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.379+0000 7fd961600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c15d920 con 0x7fd95c0ca4d0 2024-03-23T06:16:27.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.379+0000 7fd961600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0703e0 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.379+0000 7fd961600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c15cac0 con 0x7fd95c1536c0 2024-03-23T06:16:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.381+0000 7fd95aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 0x7fd95c159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.381+0000 7fd95b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd95c0c8eb0 0x7fd95c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:27.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.381+0000 7fd95b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd95c0c8eb0 0x7fd95c070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37418/0 (socket says 172.21.15.73:37418) 2024-03-23T06:16:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.381+0000 7fd95b400640 1 -- 172.21.15.73:0/970005025 learned_addr learned my addr 172.21.15.73:0/970005025 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.381+0000 7fd95b400640 1 -- 172.21.15.73:0/970005025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 msgr2=0x7fd95c159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.381+0000 7fd95b400640 1 --2- 172.21.15.73:0/970005025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 0x7fd95c159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.381+0000 7fd95b400640 1 -- 172.21.15.73:0/970005025 >> v1:172.21.15.73:6789/0 conn(0x7fd95c0ca4d0 legacy=0x7fd95c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.381+0000 7fd95b400640 1 -- 172.21.15.73:0/970005025 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c15cd10 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.384+0000 7fd95b400640 1 --2- 172.21.15.73:0/970005025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 0x7fd95c070e70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd948009870 tx=0x7fd94802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361d26f38f5c97b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.384+0000 7fd959600640 1 -- 172.21.15.73:0/970005025 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948031640 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.384+0000 7fd959600640 1 -- 172.21.15.73:0/970005025 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9480317a0 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.385+0000 7fd959600640 1 -- 172.21.15.73:0/970005025 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948031b30 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.385+0000 7fd961600640 1 -- 172.21.15.73:0/970005025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 msgr2=0x7fd95c070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:27.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.385+0000 7fd961600640 1 --2- 172.21.15.73:0/970005025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 0x7fd95c070e70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd948009870 tx=0x7fd94802b8f0 comp rx=0 tx=0).stop 2024-03-23T06:16:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.387+0000 7fd961600640 1 -- 172.21.15.73:0/970005025 shutdown_connections 2024-03-23T06:16:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.387+0000 7fd961600640 1 --2- 172.21.15.73:0/970005025 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 0x7fd95c070e70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.387+0000 7fd961600640 1 --2- 172.21.15.73:0/970005025 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 0x7fd95c159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.387+0000 7fd961600640 1 -- 172.21.15.73:0/970005025 >> 172.21.15.73:0/970005025 conn(0x7fd95c069cb0 msgr2=0x7fd95c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.387+0000 7fd961600640 1 -- 172.21.15.73:0/970005025 shutdown_connections 2024-03-23T06:16:27.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.387+0000 7fd961600640 1 -- 172.21.15.73:0/970005025 wait complete. 2024-03-23T06:16:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.390+0000 7fd961600640 1 Processor -- start 2024-03-23T06:16:27.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.390+0000 7fd961600640 1 -- start start 2024-03-23T06:16:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.393+0000 7fd961600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 0x7fd95c151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.395+0000 7fd961600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95c0ca4d0 0x7fd95c0ae390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.395+0000 7fd961600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 0x7fd95c1f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.395+0000 7fd961600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c152460 con 0x7fd95c0ca4d0 2024-03-23T06:16:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.395+0000 7fd961600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c28a0 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.395+0000 7fd961600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c1f2ff0 con 0x7fd95c1536c0 2024-03-23T06:16:27.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.396+0000 7fd95aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 0x7fd95c151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:27.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.396+0000 7fd95aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 0x7fd95c151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37424/0 (socket says 172.21.15.73:37424) 2024-03-23T06:16:27.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.396+0000 7fd95aa00640 1 -- 172.21.15.73:0/2007286515 learned_addr learned my addr 172.21.15.73:0/2007286515 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:27.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.396+0000 7fd95b400640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 0x7fd95c1f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:27.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.397+0000 7fd95a000640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95c0ca4d0 0x7fd95c0ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:27.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.400+0000 7fd95aa00640 1 -- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 msgr2=0x7fd95c1f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:27.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.400+0000 7fd95aa00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c1536c0 0x7fd95c1f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:27.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.400+0000 7fd95aa00640 1 -- 172.21.15.73:0/2007286515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95c0ca4d0 msgr2=0x7fd95c0ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:27.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.401+0000 7fd95aa00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95c0ca4d0 0x7fd95c0ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:27.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.401+0000 7fd95aa00640 1 -- 172.21.15.73:0/2007286515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9480094d0 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.401+0000 7fd95a000640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd95c0ca4d0 0x7fd95c0ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:16:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.402+0000 7fd95aa00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 0x7fd95c151f20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd95400ccd0 tx=0x7fd95400a5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.402+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954003990 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.402+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd954003af0 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.402+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd954004020 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.404+0000 7fd961600640 1 -- 172.21.15.73:0/2007286515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c153e60 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.404+0000 7fd961600640 1 -- 172.21.15.73:0/2007286515 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c0ae8d0 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.408+0000 7fd947e00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c153ff0 0x7fd95c1f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:27.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.408+0000 7fd947e00640 1 -- 172.21.15.73:0/2007286515 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c073bf0 con 0x7fd95c153ff0 2024-03-23T06:16:27.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.409+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd954004180 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.409+0000 7fd95a000640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c153ff0 0x7fd95c1f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:27.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.411+0000 7fd952a00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd93c06ac00 0x7fd93c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:27.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.411+0000 7fd95a000640 1 -- 172.21.15.73:0/2007286515 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd95c15d5b0 con 0x7fd95c153ff0 2024-03-23T06:16:27.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.411+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd954089a90 con 0x7fd95c0c8eb0 2024-03-23T06:16:27.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.413+0000 7fd95b400640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd93c06ac00 0x7fd93c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:27.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.414+0000 7fd95b400640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd93c06ac00 0x7fd93c06d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd948036000 tx=0x7fd94803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:27.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.415+0000 7fd95a000640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c153ff0 0x7fd95c1f2970 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0c8160 tx=0x7fd94c00ff70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:27.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.415+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0053a0 con 0x7fd95c153ff0 2024-03-23T06:16:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.416+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd94c00d770 con 0x7fd95c153ff0 2024-03-23T06:16:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.416+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c153ff0 msgr2=0x7fd95c1f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.416+0000 7fd952a00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c153ff0 0x7fd95c1f2970 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0c8160 tx=0x7fd94c00ff70 comp rx=0 tx=0).stop 2024-03-23T06:16:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.416+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c153ff0 msgr2=0x7fd95c1f2970 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:27.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.416+0000 7fd952a00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c153ff0 0x7fd95c1f2970 secure :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0c8160 tx=0x7fd94c00ff70 comp rx=0 tx=0).stop 2024-03-23T06:16:27.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.433+0000 7fd947e00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c0c34d0 0x7fd95c1eee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:27.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.433+0000 7fd947e00640 1 -- 172.21.15.73:0/2007286515 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c15d2d0 con 0x7fd95c0c34d0 2024-03-23T06:16:27.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.435+0000 7fd95a000640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c0c34d0 0x7fd95c1eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:27.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.436+0000 7fd95a000640 1 -- 172.21.15.73:0/2007286515 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd95c153aa0 con 0x7fd95c0c34d0 2024-03-23T06:16:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.440+0000 7fd95a000640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c0c34d0 0x7fd95c1eee80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd94c017000 tx=0x7fd94c001020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.441+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c024070 con 0x7fd95c0c34d0 2024-03-23T06:16:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.441+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7fd94c003e50 con 0x7fd95c0c34d0 2024-03-23T06:16:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.441+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c0c34d0 msgr2=0x7fd95c1eee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.441+0000 7fd952a00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c0c34d0 0x7fd95c1eee80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd94c017000 tx=0x7fd94c001020 comp rx=0 tx=0).stop 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 68, 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 15, 2024-03-23T06:16:27.443 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:27.444 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:16:27.445 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:27.446 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:27.447 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:16:27.448 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:27.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:27.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.451 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.452 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:16:27.453 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:27.454 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:16:27.455 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:16:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.441+0000 7fd952a00640 1 -- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c0c34d0 msgr2=0x7fd95c1eee80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.441+0000 7fd952a00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd95c0c34d0 0x7fd95c1eee80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd947e00640 1 -- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd93c06ac00 msgr2=0x7fd93c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd947e00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd93c06ac00 0x7fd93c06d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd948036000 tx=0x7fd94803c040 comp rx=0 tx=0).stop 2024-03-23T06:16:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd947e00640 1 -- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 msgr2=0x7fd95c151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd947e00640 1 --2- 172.21.15.73:0/2007286515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd95c0c8eb0 0x7fd95c151f20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd95400ccd0 tx=0x7fd95400a5c0 comp rx=0 tx=0).stop 2024-03-23T06:16:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd95b400640 1 -- 172.21.15.73:0/2007286515 reap_dead start 2024-03-23T06:16:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd95b400640 1 -- 172.21.15.73:0/2007286515 reap_dead start 2024-03-23T06:16:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd947e00640 1 -- 172.21.15.73:0/2007286515 shutdown_connections 2024-03-23T06:16:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd947e00640 1 -- 172.21.15.73:0/2007286515 >> 172.21.15.73:0/2007286515 conn(0x7fd95c069cb0 msgr2=0x7fd95c0720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd947e00640 1 -- 172.21.15.73:0/2007286515 shutdown_connections 2024-03-23T06:16:27.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:27.443+0000 7fd947e00640 1 -- 172.21.15.73:0/2007286515 wait complete. 2024-03-23T06:16:27.470 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:16:27.471 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-03-23T06:16:27.471 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-03-23T06:16:27.471 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-03-23T06:16:27.471 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T06:16:27.471 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-23T06:16:27.471 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:16:27.487 INFO:tasks.ceph.mon.c:Stopped 2024-03-23T06:16:27.487 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-03-23T06:16:27.488 INFO:tasks.ceph.mon.a:Sent signal 19 2024-03-23T06:16:27.488 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T06:16:41.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:16:41.939 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:16:42.489 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-03-23T06:16:42.489 INFO:tasks.ceph.mon.a:Sent signal 18 2024-03-23T06:16:42.489 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:16:42.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:16:42.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.840+0000 7f56e6800640 1 Processor -- start 2024-03-23T06:16:42.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.841+0000 7f56e6800640 1 -- start start 2024-03-23T06:16:42.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.843+0000 7f56e6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 0x7f56e0159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:42.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.843+0000 7f56e6800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00c9fb0 con 0x7f56e01533b0 2024-03-23T06:16:42.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.843+0000 7f56e6800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00cf4d0 con 0x7f56e00c3de0 2024-03-23T06:16:42.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.843+0000 7f56e6800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00cfd10 con 0x7f56e00ca440 2024-03-23T06:16:42.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.844+0000 7f56d7e00640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 msgr2=0x7f56e0159f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:42.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.844+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 0x7f56e0159f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:42.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.844+0000 7f56dfe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f56e00c3de0 0x7f56e00713e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:52436/0 (socket says 172.21.15.73:52436) 2024-03-23T06:16:42.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:42.844+0000 7f56dfe00640 1 -- 172.21.15.73:0/4109243035 learned_addr learned my addr 172.21.15.73:0/4109243035 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:16:43.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:43.045+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 msgr2=0x7f56e0159f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:43.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:43.045+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 0x7f56e0159f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:16:43.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:43.446+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 msgr2=0x7f56e0159f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:43.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:43.446+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 0x7f56e0159f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:16:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:44.250+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 msgr2=0x7f56e0159f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:44.250+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 0x7f56e0159f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:16:45.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.843+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 msgr2=0x7f56e0159f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:45.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.843+0000 7f56dd600640 1 --2- 172.21.15.73:0/4109243035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e00ca440 0x7f56e0159f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.843+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 >> v1:172.21.15.110:6789/0 conn(0x7f56e00c3de0 legacy=0x7f56e00713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.843+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 >> v1:172.21.15.73:6789/0 conn(0x7f56e01533b0 legacy=0x7f56e00cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.843+0000 7f56dd600640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.843+0000 7f56dd600640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.843+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00cfd10 con 0x7f56bc0061e0 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.843+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc008d40 con 0x7f56bc003710 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.844+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.844+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.845+0000 7f56df400640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.845+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.845+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.845+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:45.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.845+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:45.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.845+0000 7f56df400640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:45.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.845+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:45.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:45.845+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:46.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.046+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:46.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.046+0000 7f56df400640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:16:46.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.046+0000 7f56df400640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:46.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.046+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:46.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.046+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:16:46.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.047+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:46.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.047+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:46.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.047+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:46.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.047+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:46.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.047+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:16:46.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.447+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:46.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.447+0000 7f56df400640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:46.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.447+0000 7f56df400640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:46.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.447+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:46.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.447+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:16:46.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.449+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.449+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.449+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.449+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:46.449+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:16:47.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.248+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:47.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.249+0000 7f56df400640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:47.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.249+0000 7f56df400640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:47.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.249+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:47.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.249+0000 7f56df400640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:16:47.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.250+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.251+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:16:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.251+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:16:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.251+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:16:47.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:47.251+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc005b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 msgr2=0x7f56bc008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc0061e0 0x7f56bc008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dfe00640 1 -- 172.21.15.73:0/4109243035 reap_dead start 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc015090 0x7f56bc0174e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc017b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00cf770 con 0x7f56e01533b0 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00cfd10 con 0x7f56bc015090 2024-03-23T06:16:48.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.844+0000 7f56dd600640 1 -- 172.21.15.73:0/4109243035 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc008d40 con 0x7f56bc003710 2024-03-23T06:16:48.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.845+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.73:3300/0 conn(0x7f56bc015090 0x7f56bc0174e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.846+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 msgr2=0x7f56bc017b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.846+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc017b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.846+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 >> v1:172.21.15.73:6789/0 conn(0x7f56e01533b0 legacy=0x7f56bc013970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.846+0000 7f56d7e00640 1 -- 172.21.15.73:0/4109243035 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc005d10 con 0x7f56bc015090 2024-03-23T06:16:48.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.848+0000 7f56d7e00640 1 --2- 172.21.15.73:0/4109243035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56bc0174e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f56bc017b40 tx=0x7f56c8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c7f1ca7087408d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:48.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.849+0000 7f56dea00640 1 -- 172.21.15.73:0/4109243035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c802d750 con 0x7f56bc015090 2024-03-23T06:16:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.851+0000 7f56dea00640 1 -- 172.21.15.73:0/4109243035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8031070 con 0x7f56bc015090 2024-03-23T06:16:48.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.851+0000 7f56dea00640 1 -- 172.21.15.73:0/4109243035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c802daf0 con 0x7f56bc015090 2024-03-23T06:16:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.852+0000 7f56e6800640 1 -- 172.21.15.73:0/4109243035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 msgr2=0x7f56bc0174e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.852+0000 7f56e6800640 1 --2- 172.21.15.73:0/4109243035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56bc0174e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f56bc017b40 tx=0x7f56c8005040 comp rx=0 tx=0).stop 2024-03-23T06:16:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.854+0000 7f56e6800640 1 -- 172.21.15.73:0/4109243035 shutdown_connections 2024-03-23T06:16:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.854+0000 7f56e6800640 1 --2- 172.21.15.73:0/4109243035 >> v2:172.21.15.110:3300/0 conn(0x7f56bc003710 0x7f56bc017b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.854+0000 7f56e6800640 1 --2- 172.21.15.73:0/4109243035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56bc0174e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:48.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.854+0000 7f56e6800640 1 -- 172.21.15.73:0/4109243035 >> 172.21.15.73:0/4109243035 conn(0x7f56e006c4a0 msgr2=0x7f56e00cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.854+0000 7f56e6800640 1 -- 172.21.15.73:0/4109243035 shutdown_connections 2024-03-23T06:16:48.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.854+0000 7f56e6800640 1 -- 172.21.15.73:0/4109243035 wait complete. 2024-03-23T06:16:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.860+0000 7f56e6800640 1 Processor -- start 2024-03-23T06:16:48.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.860+0000 7f56e6800640 1 -- start start 2024-03-23T06:16:48.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.863+0000 7f56e6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56bc003710 0x7f56e00b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.864+0000 7f56e6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56e00b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.864+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56e00b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.865+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56e00b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51836/0 (socket says 172.21.15.73:51836) 2024-03-23T06:16:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.865+0000 7f56d7e00640 1 -- 172.21.15.73:0/321336461 learned_addr learned my addr 172.21.15.73:0/321336461 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.865+0000 7f56e6800640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e01533b0 0x7f56e00cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:48.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.865+0000 7f56df400640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56bc003710 0x7f56e00b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.866+0000 7f56dfe00640 1 -- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e01533b0 msgr2=0x7f56e00cdb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.866+0000 7f56dfe00640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e01533b0 0x7f56e00cdb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.866+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e01ebc50 con 0x7f56bc015090 2024-03-23T06:16:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.866+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00b3b40 con 0x7f56bc003710 2024-03-23T06:16:48.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.866+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00cd690 con 0x7f56e01533b0 2024-03-23T06:16:48.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.867+0000 7f56df400640 1 -- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e01533b0 msgr2=0x7f56e00cdb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:16:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.868+0000 7f56df400640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e01533b0 0x7f56e00cdb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.868+0000 7f56df400640 1 -- 172.21.15.73:0/321336461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 msgr2=0x7f56e00b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.868+0000 7f56df400640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56e00b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.868+0000 7f56df400640 1 -- 172.21.15.73:0/321336461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c8009a60 con 0x7f56bc003710 2024-03-23T06:16:48.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.868+0000 7f56d7e00640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56e00b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:16:48.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.869+0000 7f56df400640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56bc003710 0x7f56e00b3600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56d0003fb0 tx=0x7f56d0001660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:48.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.869+0000 7f56d7400640 1 -- 172.21.15.73:0/321336461 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0001d70 con 0x7f56bc003710 2024-03-23T06:16:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.869+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e01ec110 con 0x7f56bc003710 2024-03-23T06:16:48.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.869+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e00ccd60 con 0x7f56bc003710 2024-03-23T06:16:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.870+0000 7f56d7400640 1 -- 172.21.15.73:0/321336461 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d0001d70 con 0x7f56bc003710 2024-03-23T06:16:48.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.870+0000 7f56d7400640 1 -- 172.21.15.73:0/321336461 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d00155c0 con 0x7f56bc003710 2024-03-23T06:16:48.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.874+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b8005250 con 0x7f56bc003710 2024-03-23T06:16:48.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.875+0000 7f56d7400640 1 -- 172.21.15.73:0/321336461 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f56d0015720 con 0x7f56bc003710 2024-03-23T06:16:48.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.877+0000 7f56d7400640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f56bc074880 0x7f56bc076d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:48.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.877+0000 7f56d7400640 1 -- 172.21.15.73:0/321336461 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f56d00897d0 con 0x7f56bc003710 2024-03-23T06:16:48.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.878+0000 7f56d7e00640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f56bc074880 0x7f56bc076d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:48.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.879+0000 7f56d7e00640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f56bc074880 0x7f56bc076d40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f56e01583b0 tx=0x7f56c8033000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:48.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:48.887+0000 7f56d7400640 1 -- 172.21.15.73:0/321336461 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f56d0054630 con 0x7f56bc003710 2024-03-23T06:16:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.439+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f56b8005a80 con 0x7f56bc003710 2024-03-23T06:16:49.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.447+0000 7f56d7400640 1 -- 172.21.15.73:0/321336461 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f56d0057c50 con 0x7f56bc003710 2024-03-23T06:16:49.448 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":72,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:16:49.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.463+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f56bc074880 msgr2=0x7f56bc076d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.463+0000 7f56e6800640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f56bc074880 0x7f56bc076d40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f56e01583b0 tx=0x7f56c8033000 comp rx=0 tx=0).stop 2024-03-23T06:16:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.463+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56bc003710 msgr2=0x7f56e00b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.463+0000 7f56e6800640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56bc003710 0x7f56e00b3600 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56d0003fb0 tx=0x7f56d0001660 comp rx=0 tx=0).stop 2024-03-23T06:16:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.464+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 shutdown_connections 2024-03-23T06:16:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.464+0000 7f56e6800640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f56bc074880 0x7f56bc076d40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.464+0000 7f56e6800640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56e01533b0 0x7f56e00cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:49.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.464+0000 7f56e6800640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56bc015090 0x7f56e00b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:49.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.464+0000 7f56e6800640 1 --2- 172.21.15.73:0/321336461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56bc003710 0x7f56e00b3600 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:49.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.464+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 >> 172.21.15.73:0/321336461 conn(0x7f56e006c4a0 msgr2=0x7f56e00c5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:49.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.465+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 shutdown_connections 2024-03-23T06:16:49.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.465+0000 7f56e6800640 1 -- 172.21.15.73:0/321336461 wait complete. 2024-03-23T06:16:49.502 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:16:49.503 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T06:16:49.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:16:49.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.941+0000 7f0edf200640 1 Processor -- start 2024-03-23T06:16:49.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.942+0000 7f0edf200640 1 -- start start 2024-03-23T06:16:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.949+0000 7f0edf200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0ee00b0ba0 0x7f0ee0069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:49.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.950+0000 7f0edf200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee00c6fd0 con 0x7f0ee014f710 2024-03-23T06:16:49.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.950+0000 7f0ede800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0ee00c5eb0 0x7f0ee015fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:52992/0 (socket says 172.21.15.73:52992) 2024-03-23T06:16:49.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.952+0000 7f0ede800640 1 -- 172.21.15.73:0/1677971356 learned_addr learned my addr 172.21.15.73:0/1677971356 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:16:49.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.952+0000 7f0edf200640 1 -- 172.21.15.73:0/1677971356 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee0158ea0 con 0x7f0ee00c5eb0 2024-03-23T06:16:49.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.952+0000 7f0edf200640 1 -- 172.21.15.73:0/1677971356 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee0070040 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.951+0000 7f0edde00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0ee014f710 0x7f0ee0159330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54622/0 (socket says 172.21.15.73:54622) 2024-03-23T06:16:49.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.952+0000 7f0edd400640 1 --2- 172.21.15.73:0/1677971356 >> v2:172.21.15.110:3300/0 conn(0x7f0ee00b0ba0 0x7f0ee0069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:49.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.952+0000 7f0edca00640 1 -- 172.21.15.73:0/1677971356 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864363116 0 0) 0x7f0ee0158ea0 con 0x7f0ee00c5eb0 2024-03-23T06:16:49.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.952+0000 7f0edca00640 1 -- 172.21.15.73:0/1677971356 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4003520 con 0x7f0ee00c5eb0 2024-03-23T06:16:49.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.953+0000 7f0edd400640 1 -- 172.21.15.73:0/1677971356 >> v1:172.21.15.110:6789/0 conn(0x7f0ee00c5eb0 legacy=0x7f0ee015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:49.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.953+0000 7f0edd400640 1 -- 172.21.15.73:0/1677971356 >> v1:172.21.15.73:6789/0 conn(0x7f0ee014f710 legacy=0x7f0ee0159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:49.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.955+0000 7f0edd400640 1 -- 172.21.15.73:0/1677971356 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee006e1a0 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.959+0000 7f0edd400640 1 --2- 172.21.15.73:0/1677971356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 0x7f0ee0069cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00ba40 tx=0x7f0ecc02e140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=965214e2746c56b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:49.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.959+0000 7f0edca00640 1 -- 172.21.15.73:0/1677971356 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc036440 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.959+0000 7f0edca00640 1 -- 172.21.15.73:0/1677971356 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc0365a0 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.959+0000 7f0edca00640 1 -- 172.21.15.73:0/1677971356 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc036910 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.964+0000 7f0edf200640 1 -- 172.21.15.73:0/1677971356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 msgr2=0x7f0ee0069cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:49.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.964+0000 7f0edf200640 1 --2- 172.21.15.73:0/1677971356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 0x7f0ee0069cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00ba40 tx=0x7f0ecc02e140 comp rx=0 tx=0).stop 2024-03-23T06:16:49.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.964+0000 7f0edf200640 1 -- 172.21.15.73:0/1677971356 shutdown_connections 2024-03-23T06:16:49.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.964+0000 7f0edf200640 1 --2- 172.21.15.73:0/1677971356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 0x7f0ee0069cb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:49.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.964+0000 7f0edf200640 1 -- 172.21.15.73:0/1677971356 >> 172.21.15.73:0/1677971356 conn(0x7f0ee00cadb0 msgr2=0x7f0ee00cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:49.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.964+0000 7f0edf200640 1 -- 172.21.15.73:0/1677971356 shutdown_connections 2024-03-23T06:16:49.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.964+0000 7f0edf200640 1 -- 172.21.15.73:0/1677971356 wait complete. 2024-03-23T06:16:49.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.970+0000 7f0edf200640 1 Processor -- start 2024-03-23T06:16:49.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.970+0000 7f0edf200640 1 -- start start 2024-03-23T06:16:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.975+0000 7f0edf200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 0x7f0ee0156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:49.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.976+0000 7f0edf200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee00c5eb0 0x7f0ee0147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:49.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.976+0000 7f0edde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 0x7f0ee0156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:49.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.976+0000 7f0edde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 0x7f0ee0156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:44296/0 (socket says 172.21.15.73:44296) 2024-03-23T06:16:49.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.976+0000 7f0edde00640 1 -- 172.21.15.73:0/3855118724 learned_addr learned my addr 172.21.15.73:0/3855118724 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:49.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.976+0000 7f0edf200640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee014f710 0x7f0ee01f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.980+0000 7f0edd400640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee00c5eb0 msgr2=0x7f0ee0147ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.980+0000 7f0edd400640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee00c5eb0 0x7f0ee0147ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.980+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01469f0 con 0x7f0ee014f710 2024-03-23T06:16:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.980+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0147850 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.980+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00c9060 con 0x7f0ee00c5eb0 2024-03-23T06:16:49.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.980+0000 7f0ede800640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee014f710 0x7f0ee01f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.981+0000 7f0edde00640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee00c5eb0 msgr2=0x7f0ee0147ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:16:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.981+0000 7f0edde00640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ee00c5eb0 0x7f0ee0147ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:49.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.981+0000 7f0edde00640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee014f710 msgr2=0x7f0ee01f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:49.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.982+0000 7f0edde00640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee014f710 0x7f0ee01f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:49.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.982+0000 7f0edde00640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc00b6a0 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.982+0000 7f0ede800640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee014f710 0x7f0ee01f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:16:49.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.982+0000 7f0edde00640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 0x7f0ee0156030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c3e0 tx=0x7f0ed000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:49.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.983+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00074e0 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.983+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed0007640 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.983+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00074e0 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.984+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee0146c40 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.984+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee0147200 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.987+0000 7f0edf200640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee0070480 0x7f0ee01f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:49.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.988+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0073db0 con 0x7f0ee0070480 2024-03-23T06:16:49.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.989+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0ed00047e0 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.990+0000 7f0edd400640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee0070480 0x7f0ee01f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:49.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.995+0000 7f0ed6000640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0ec006ac10 0x7f0ec006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:49.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.995+0000 7f0edd400640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0ee0158b30 con 0x7f0ee0070480 2024-03-23T06:16:49.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.996+0000 7f0edd400640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee0070480 0x7f0ee01f65c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00c88c0 tx=0x7f0ecc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:49.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.998+0000 7f0ede800640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0ec006ac10 0x7f0ec006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:49.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.998+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f0ed00889c0 con 0x7f0ee00b0ba0 2024-03-23T06:16:49.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.999+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc036440 con 0x7f0ee0070480 2024-03-23T06:16:49.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.999+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f0ecc004250 con 0x7f0ee0070480 2024-03-23T06:16:50.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.999+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee0070480 msgr2=0x7f0ee01f65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.999+0000 7f0ed6000640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee0070480 0x7f0ee01f65c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00c88c0 tx=0x7f0ecc004730 comp rx=0 tx=0).stop 2024-03-23T06:16:50.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.999+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee0070480 msgr2=0x7f0ee01f65c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:50.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:49.999+0000 7f0ed6000640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee0070480 0x7f0ee01f65c0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00c88c0 tx=0x7f0ecc004730 comp rx=0 tx=0).stop 2024-03-23T06:16:50.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.005+0000 7f0ede800640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0ec006ac10 0x7f0ec006d0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8001560 tx=0x7f0ed8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.018+0000 7f0edf200640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee01473f0 0x7f0ee01f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.018+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00c6cf0 con 0x7f0ee01473f0 2024-03-23T06:16:50.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.018+0000 7f0edd400640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee01473f0 0x7f0ee01f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:50.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.019+0000 7f0edd400640 1 -- 172.21.15.73:0/3855118724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f0ee00c75b0 con 0x7f0ee01473f0 2024-03-23T06:16:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.020+0000 7f0edd400640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee01473f0 0x7f0ee01f2b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000c00 tx=0x7f0ecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:50.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.021+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc003e50 con 0x7f0ee01473f0 2024-03-23T06:16:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.021+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4939 (secure 0 0 0) 0x7f0ecc04e070 con 0x7f0ee01473f0 2024-03-23T06:16:50.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.021+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee01473f0 msgr2=0x7f0ee01f2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.022+0000 7f0ed6000640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee01473f0 0x7f0ee01f2b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000c00 tx=0x7f0ecc0046c0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.022+0000 7f0ed6000640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee01473f0 msgr2=0x7f0ee01f2b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:50.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.022+0000 7f0ed6000640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ee01473f0 0x7f0ee01f2b10 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc000c00 tx=0x7f0ecc0046c0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 72, 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: 1 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.023 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:50.024 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:50.025 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:50.026 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:50.027 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:50.028 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:16:50.029 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:50.030 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.031 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.032 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:50.033 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:16:50.034 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.035 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:50.036 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:16:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.037 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.038 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:16:50.038 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:16:50.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.023+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0ec006ac10 msgr2=0x7f0ec006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0edf200640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0ec006ac10 0x7f0ec006d0d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8001560 tx=0x7f0ed8009040 comp rx=0 tx=0).stop 2024-03-23T06:16:50.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 msgr2=0x7f0ee0156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0edf200640 1 --2- 172.21.15.73:0/3855118724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ee00b0ba0 0x7f0ee0156030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000c3e0 tx=0x7f0ed000c8a0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0ede800640 1 -- 172.21.15.73:0/3855118724 reap_dead start 2024-03-23T06:16:50.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0ede800640 1 -- 172.21.15.73:0/3855118724 reap_dead start 2024-03-23T06:16:50.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 shutdown_connections 2024-03-23T06:16:50.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 >> 172.21.15.73:0/3855118724 conn(0x7f0ee00cadb0 msgr2=0x7f0ee00bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:50.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 shutdown_connections 2024-03-23T06:16:50.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.024+0000 7f0edf200640 1 -- 172.21.15.73:0/3855118724 wait complete. 2024-03-23T06:16:50.048 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:16:50.048 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T06:16:50.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:16:50.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.424+0000 7faf89a00640 1 Processor -- start 2024-03-23T06:16:50.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.424+0000 7faf89a00640 1 -- start start 2024-03-23T06:16:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.428+0000 7faf89a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf840c7710 0x7faf840be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.428+0000 7faf89a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf840bef30 0x7faf840c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.428+0000 7faf83e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7faf8414f510 0x7faf84155e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:53000/0 (socket says 172.21.15.73:53000) 2024-03-23T06:16:50.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.428+0000 7faf83e00640 1 -- 172.21.15.73:0/308400151 learned_addr learned my addr 172.21.15.73:0/308400151 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:16:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.428+0000 7faf89a00640 1 -- 172.21.15.73:0/308400151 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf84158980 con 0x7faf8414f510 2024-03-23T06:16:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.428+0000 7faf89a00640 1 -- 172.21.15.73:0/308400151 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf84159990 con 0x7faf840c7710 2024-03-23T06:16:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.428+0000 7faf89a00640 1 -- 172.21.15.73:0/308400151 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8414f8f0 con 0x7faf840bef30 2024-03-23T06:16:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.428+0000 7faf89000640 1 -- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf840bef30 msgr2=0x7faf840c5980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:50.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.429+0000 7faf89000640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf840bef30 0x7faf840c5980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:50.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.429+0000 7faf83400640 1 --2- 172.21.15.73:0/308400151 >> v2:172.21.15.110:3300/0 conn(0x7faf840c7710 0x7faf840be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:50.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.431+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553270993 0 0) 0x7faf84158980 con 0x7faf8414f510 2024-03-23T06:16:50.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.431+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf68003520 con 0x7faf8414f510 2024-03-23T06:16:50.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007560531 0 0) 0x7faf68003520 con 0x7faf8414f510 2024-03-23T06:16:50.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf840bef30 msgr2=0x7faf840c5980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:50.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf840bef30 0x7faf840c5980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 >> v2:172.21.15.110:3300/0 conn(0x7faf840c7710 msgr2=0x7faf840be9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 --2- 172.21.15.73:0/308400151 >> v2:172.21.15.110:3300/0 conn(0x7faf840c7710 0x7faf840be9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84159500 con 0x7faf8414f510 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7faf7c0019f0 con 0x7faf8414f510 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 >> v1:172.21.15.110:6789/0 conn(0x7faf8414f510 legacy=0x7faf84155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf68003970 0x7faf68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf68004360 0x7faf68004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf680050e0 0x7faf6800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84159990 con 0x7faf680050e0 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8414f8f0 con 0x7faf68004360 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.432+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6800c070 con 0x7faf68003970 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.433+0000 7faf89000640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf680050e0 0x7faf6800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.434+0000 7faf83e00640 1 -- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf68003970 msgr2=0x7faf68003d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:50.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.434+0000 7faf83e00640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf68003970 0x7faf68003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:50.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.435+0000 7faf89000640 1 -- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf68003970 msgr2=0x7faf68003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:16:50.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.435+0000 7faf89000640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf68003970 0x7faf68003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.435+0000 7faf89000640 1 -- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf68004360 msgr2=0x7faf68004840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:16:50.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.435+0000 7faf89000640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf68004360 0x7faf68004840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.435+0000 7faf89000640 1 -- 172.21.15.73:0/308400151 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf68003520 con 0x7faf680050e0 2024-03-23T06:16:50.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.437+0000 7faf89000640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf680050e0 0x7faf6800b980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf8406c460 tx=0x7faf680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2a4edd6097783a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:50.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.438+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74003b60 con 0x7faf680050e0 2024-03-23T06:16:50.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.439+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74003cc0 con 0x7faf680050e0 2024-03-23T06:16:50.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.440+0000 7faf82a00640 1 -- 172.21.15.73:0/308400151 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740052b0 con 0x7faf680050e0 2024-03-23T06:16:50.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.440+0000 7faf89a00640 1 -- 172.21.15.73:0/308400151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf680050e0 msgr2=0x7faf6800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.440+0000 7faf89a00640 1 --2- 172.21.15.73:0/308400151 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf680050e0 0x7faf6800b980 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faf8406c460 tx=0x7faf680057f0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.440+0000 7faf89000640 1 -- 172.21.15.73:0/308400151 reap_dead start 2024-03-23T06:16:50.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.441+0000 7faf89a00640 1 -- 172.21.15.73:0/308400151 shutdown_connections 2024-03-23T06:16:50.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.441+0000 7faf89a00640 1 -- 172.21.15.73:0/308400151 >> 172.21.15.73:0/308400151 conn(0x7faf84069cb0 msgr2=0x7faf8406a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:50.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.441+0000 7faf89a00640 1 -- 172.21.15.73:0/308400151 shutdown_connections 2024-03-23T06:16:50.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.442+0000 7faf89a00640 1 -- 172.21.15.73:0/308400151 wait complete. 2024-03-23T06:16:50.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.445+0000 7faf89a00640 1 Processor -- start 2024-03-23T06:16:50.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.446+0000 7faf89a00640 1 -- start start 2024-03-23T06:16:50.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.448+0000 7faf89a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf680050e0 0x7faf840ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.448+0000 7faf83e00640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf680050e0 msgr2=0x7faf840ca650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:16:50.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.448+0000 7faf83e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf680050e0 0x7faf840ca650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:16:50.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.449+0000 7faf89a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf8414d330 0x7faf840cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.449+0000 7faf89a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf84149780 0x7faf841f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.449+0000 7faf83400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf8414d330 0x7faf840cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:50.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.449+0000 7faf83400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf8414d330 0x7faf840cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:44314/0 (socket says 172.21.15.73:44314) 2024-03-23T06:16:50.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.450+0000 7faf89000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf84149780 0x7faf841f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.450+0000 7faf89a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840c5110 con 0x7faf84149780 2024-03-23T06:16:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.450+0000 7faf89a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84072670 con 0x7faf8414d330 2024-03-23T06:16:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.450+0000 7faf89a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840c5340 con 0x7faf680050e0 2024-03-23T06:16:50.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.450+0000 7faf83400640 1 -- 172.21.15.73:0/3614913538 learned_addr learned my addr 172.21.15.73:0/3614913538 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:16:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.451+0000 7faf83400640 1 -- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf680050e0 msgr2=0x7faf840ca650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:16:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.451+0000 7faf83400640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf680050e0 0x7faf840ca650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.451+0000 7faf83400640 1 -- 172.21.15.73:0/3614913538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf84149780 msgr2=0x7faf841f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.451+0000 7faf83400640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf84149780 0x7faf841f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.451+0000 7faf83400640 1 -- 172.21.15.73:0/3614913538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf841f6f80 con 0x7faf8414d330 2024-03-23T06:16:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.451+0000 7faf89000640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf84149780 0x7faf841f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:16:50.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.452+0000 7faf83400640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf8414d330 0x7faf840cab90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf70003690 tx=0x7faf70003b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.452+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7000dbd0 con 0x7faf8414d330 2024-03-23T06:16:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.452+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7000dd30 con 0x7faf8414d330 2024-03-23T06:16:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.453+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8406ff90 con 0x7faf8414d330 2024-03-23T06:16:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.453+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7000dea0 con 0x7faf8414d330 2024-03-23T06:16:50.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.453+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf840ca130 con 0x7faf8414d330 2024-03-23T06:16:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.455+0000 7faf89a00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf840c62d0 0x7faf841f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.455+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840c54b0 con 0x7faf840c62d0 2024-03-23T06:16:50.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.455+0000 7faf83e00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf840c62d0 0x7faf841f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:50.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.456+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faf70005990 con 0x7faf8414d330 2024-03-23T06:16:50.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.457+0000 7faf83e00640 1 -- 172.21.15.73:0/3614913538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf84158eb0 con 0x7faf840c62d0 2024-03-23T06:16:50.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.457+0000 7faf83e00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf840c62d0 0x7faf841f6750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00ca60 tx=0x7faf7c00cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:50.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.457+0000 7faf7be00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faf6406abb0 0x7faf6406d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.458+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7faf7000b050 con 0x7faf8414d330 2024-03-23T06:16:50.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.458+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00a990 con 0x7faf840c62d0 2024-03-23T06:16:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.458+0000 7faf89000640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faf6406abb0 0x7faf6406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.458+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7faf7c004e30 con 0x7faf840c62d0 2024-03-23T06:16:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.458+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf840c62d0 msgr2=0x7faf841f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.458+0000 7faf7be00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf840c62d0 0x7faf841f6750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00ca60 tx=0x7faf7c00cf20 comp rx=0 tx=0).stop 2024-03-23T06:16:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.458+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf840c62d0 msgr2=0x7faf841f6750 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:50.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.458+0000 7faf7be00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf840c62d0 0x7faf841f6750 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00ca60 tx=0x7faf7c00cf20 comp rx=0 tx=0).stop 2024-03-23T06:16:50.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.459+0000 7faf89000640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faf6406abb0 0x7faf6406d070 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf74038000 tx=0x7faf74008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:50.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.479+0000 7faf89a00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf841f2ca0 0x7faf841f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:16:50.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.479+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84073980 con 0x7faf841f2ca0 2024-03-23T06:16:50.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.481+0000 7faf83e00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf841f2ca0 0x7faf841f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:16:50.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.482+0000 7faf83e00640 1 -- 172.21.15.73:0/3614913538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7faf84158bd0 con 0x7faf841f2ca0 2024-03-23T06:16:50.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.482+0000 7faf83e00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf841f2ca0 0x7faf841f30b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf7c014000 tx=0x7faf840c1fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:16:50.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.482+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c01b610 con 0x7faf841f2ca0 2024-03-23T06:16:50.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.483+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4964 (secure 0 0 0) 0x7faf7c01b770 con 0x7faf841f2ca0 2024-03-23T06:16:50.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.483+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf841f2ca0 msgr2=0x7faf841f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.483+0000 7faf7be00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf841f2ca0 0x7faf841f30b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf7c014000 tx=0x7faf840c1fe0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.483+0000 7faf7be00640 1 -- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf841f2ca0 msgr2=0x7faf841f30b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:16:50.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.483+0000 7faf7be00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf841f2ca0 0x7faf841f30b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 72, 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: 1 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:50.484 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:16:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:16:50.486 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:50.486 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:50.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:50.486 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:50.486 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:50.486 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:16:50.487 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:16:50.488 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:16:50.489 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:50.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:50.492 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:50.493 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:16:50.495 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.496 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.497 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:16:50.498 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:16:50.499 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:16:50.499 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:16:50.499 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:16:50.499 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:16:50.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.483+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faf6406abb0 msgr2=0x7faf6406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89a00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7faf6406abb0 0x7faf6406d070 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faf74038000 tx=0x7faf74008030 comp rx=0 tx=0).stop 2024-03-23T06:16:50.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf8414d330 msgr2=0x7faf840cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:16:50.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89a00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf8414d330 0x7faf840cab90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf70003690 tx=0x7faf70003b50 comp rx=0 tx=0).stop 2024-03-23T06:16:50.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89000640 1 -- 172.21.15.73:0/3614913538 reap_dead start 2024-03-23T06:16:50.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 shutdown_connections 2024-03-23T06:16:50.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89a00640 1 --2- 172.21.15.73:0/3614913538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf8414d330 0x7faf840cab90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:16:50.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 >> 172.21.15.73:0/3614913538 conn(0x7faf84069cb0 msgr2=0x7faf841579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:16:50.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 shutdown_connections 2024-03-23T06:16:50.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:16:50.484+0000 7faf89a00640 1 -- 172.21.15.73:0/3614913538 wait complete. 2024-03-23T06:16:50.510 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:16:50.510 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:17:10.510 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T06:17:10.511 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-03-23T06:17:10.511 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T06:17:10.511 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T06:17:10.514 INFO:tasks.ceph.mon.c:Started 2024-03-23T06:17:10.514 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-03-23T06:17:10.514 INFO:tasks.ceph.mon.a:Sent signal 19 2024-03-23T06:17:10.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T06:17:13.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:17:13.168 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:17:25.515 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-03-23T06:17:25.516 INFO:tasks.ceph.mon.a:Sent signal 18 2024-03-23T06:17:25.516 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:17:25.516 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:17:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.121+0000 7f2949000640 1 Processor -- start 2024-03-23T06:17:29.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.121+0000 7f2949000640 1 -- start start 2024-03-23T06:17:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.123+0000 7f2949000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153550 0x7f2944159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.123+0000 7f2949000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29440ca090 con 0x7f29440cade0 2024-03-23T06:17:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.123+0000 7f2949000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294415d2b0 con 0x7f29440ceb00 2024-03-23T06:17:29.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.123+0000 7f2949000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294415d740 con 0x7f2944153550 2024-03-23T06:17:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.123+0000 7f2943400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153550 0x7f2944159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.123+0000 7f2943400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153550 0x7f2944159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:46854/0 (socket says 172.21.15.73:46854) 2024-03-23T06:17:29.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.123+0000 7f2943400640 1 -- 172.21.15.73:0/741547659 learned_addr learned my addr 172.21.15.73:0/741547659 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.125+0000 7f2943400640 1 -- 172.21.15.73:0/741547659 >> v1:172.21.15.110:6789/0 conn(0x7f29440ceb00 legacy=0x7f2944163be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:17:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.125+0000 7f2943400640 1 -- 172.21.15.73:0/741547659 >> v1:172.21.15.73:6789/0 conn(0x7f29440cade0 legacy=0x7f29440c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:29.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.125+0000 7f2943400640 1 -- 172.21.15.73:0/741547659 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440c9db0 con 0x7f2944153550 2024-03-23T06:17:29.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.129+0000 7f2943400640 1 --2- 172.21.15.73:0/741547659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153550 0x7f2944159d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29340098a0 tx=0x7f293402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef2caa3cfe132dd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:29.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.129+0000 7f2942000640 1 -- 172.21.15.73:0/741547659 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934030840 con 0x7f2944153550 2024-03-23T06:17:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.130+0000 7f2942000640 1 -- 172.21.15.73:0/741547659 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29340309a0 con 0x7f2944153550 2024-03-23T06:17:29.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.130+0000 7f2942000640 1 -- 172.21.15.73:0/741547659 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934030840 con 0x7f2944153550 2024-03-23T06:17:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.131+0000 7f2949000640 1 -- 172.21.15.73:0/741547659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153550 msgr2=0x7f2944159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:29.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.131+0000 7f2949000640 1 --2- 172.21.15.73:0/741547659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153550 0x7f2944159d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f29340098a0 tx=0x7f293402b980 comp rx=0 tx=0).stop 2024-03-23T06:17:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.134+0000 7f2949000640 1 -- 172.21.15.73:0/741547659 shutdown_connections 2024-03-23T06:17:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.134+0000 7f2949000640 1 --2- 172.21.15.73:0/741547659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153550 0x7f2944159d70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:29.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.134+0000 7f2949000640 1 -- 172.21.15.73:0/741547659 >> 172.21.15.73:0/741547659 conn(0x7f294406a480 msgr2=0x7f29440713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.137+0000 7f2949000640 1 -- 172.21.15.73:0/741547659 shutdown_connections 2024-03-23T06:17:29.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.137+0000 7f2949000640 1 -- 172.21.15.73:0/741547659 wait complete. 2024-03-23T06:17:29.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.142+0000 7f2949000640 1 Processor -- start 2024-03-23T06:17:29.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.143+0000 7f2949000640 1 -- start start 2024-03-23T06:17:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.146+0000 7f2949000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440cade0 0x7f294414efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.146+0000 7f2949000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29440ceb00 0x7f29441f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.146+0000 7f2949000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2944153550 0x7f2944146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.146+0000 7f2949000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29441434e0 con 0x7f2944153550 2024-03-23T06:17:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.146+0000 7f2949000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294414db30 con 0x7f29440cade0 2024-03-23T06:17:29.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.146+0000 7f2949000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29441f1e00 con 0x7f29440ceb00 2024-03-23T06:17:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.148+0000 7f2943400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440cade0 0x7f294414efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.148+0000 7f2943e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2944153550 0x7f2944146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.148+0000 7f2943e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2944153550 0x7f2944146a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57664/0 (socket says 172.21.15.73:57664) 2024-03-23T06:17:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.148+0000 7f2943e00640 1 -- 172.21.15.73:0/527452932 learned_addr learned my addr 172.21.15.73:0/527452932 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:29.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.148+0000 7f2942a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29440ceb00 0x7f29441f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.149+0000 7f2943e00640 1 -- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29440ceb00 msgr2=0x7f29441f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:29.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.149+0000 7f2943e00640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29440ceb00 0x7f29441f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:29.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.149+0000 7f2943e00640 1 -- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440cade0 msgr2=0x7f294414efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:29.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.149+0000 7f2943e00640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440cade0 0x7f294414efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:29.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.149+0000 7f2943e00640 1 -- 172.21.15.73:0/527452932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340094d0 con 0x7f2944153550 2024-03-23T06:17:29.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.149+0000 7f2943400640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440cade0 0x7f294414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:17:29.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.150+0000 7f2943e00640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2944153550 0x7f2944146a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f293c00b9c0 tx=0x7f293c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:29.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.150+0000 7f293b400640 1 -- 172.21.15.73:0/527452932 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c00cba0 con 0x7f2944153550 2024-03-23T06:17:29.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.150+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294414ddd0 con 0x7f2944153550 2024-03-23T06:17:29.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.150+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29441f20a0 con 0x7f2944153550 2024-03-23T06:17:29.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.151+0000 7f293b400640 1 -- 172.21.15.73:0/527452932 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c00cd00 con 0x7f2944153550 2024-03-23T06:17:29.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.152+0000 7f293b400640 1 -- 172.21.15.73:0/527452932 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c014640 con 0x7f2944153550 2024-03-23T06:17:29.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.153+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29441f2290 con 0x7f2944153550 2024-03-23T06:17:29.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.160+0000 7f293b400640 1 -- 172.21.15.73:0/527452932 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f293c003a10 con 0x7f2944153550 2024-03-23T06:17:29.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.162+0000 7f293b400640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f292406ac90 0x7f292406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:29.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.162+0000 7f293b400640 1 -- 172.21.15.73:0/527452932 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f293c089540 con 0x7f2944153550 2024-03-23T06:17:29.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.165+0000 7f2943400640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f292406ac90 0x7f292406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:29.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.166+0000 7f2943400640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f292406ac90 0x7f292406d150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2934036000 tx=0x7f2934008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:29.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.167+0000 7f293b400640 1 -- 172.21.15.73:0/527452932 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f293c0544f0 con 0x7f2944153550 2024-03-23T06:17:29.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.760+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f294404e030 con 0x7f2944153550 2024-03-23T06:17:29.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.763+0000 7f293b400640 1 -- 172.21.15.73:0/527452932 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f293c019620 con 0x7f2944153550 2024-03-23T06:17:29.764 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:17:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.768+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f292406ac90 msgr2=0x7f292406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:29.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.768+0000 7f2949000640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f292406ac90 0x7f292406d150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2934036000 tx=0x7f2934008030 comp rx=0 tx=0).stop 2024-03-23T06:17:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.768+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2944153550 msgr2=0x7f2944146a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:29.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.768+0000 7f2949000640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2944153550 0x7f2944146a20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f293c00b9c0 tx=0x7f293c00be80 comp rx=0 tx=0).stop 2024-03-23T06:17:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.769+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 shutdown_connections 2024-03-23T06:17:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.769+0000 7f2949000640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2944153550 0x7f2944146a20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.769+0000 7f2949000640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f292406ac90 0x7f292406d150 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.769+0000 7f2949000640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29440ceb00 0x7f29441f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.769+0000 7f2949000640 1 --2- 172.21.15.73:0/527452932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440cade0 0x7f294414efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.769+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 >> 172.21.15.73:0/527452932 conn(0x7f294406a480 msgr2=0x7f29440c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.769+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 shutdown_connections 2024-03-23T06:17:29.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:29.769+0000 7f2949000640 1 -- 172.21.15.73:0/527452932 wait complete. 2024-03-23T06:17:29.801 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:17:29.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:17:29.801 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:17:30.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.170+0000 7fc061a00640 1 Processor -- start 2024-03-23T06:17:30.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.170+0000 7fc061a00640 1 -- start start 2024-03-23T06:17:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.176+0000 7fc061a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc0540dd010 0x7fc05404e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.176+0000 7fc061a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc05404d990 0x7fc0540e3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.177+0000 7fc061a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc054038450 con 0x7fc0540e6620 2024-03-23T06:17:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.177+0000 7fc061a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0540e40a0 con 0x7fc05404d990 2024-03-23T06:17:30.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.177+0000 7fc061a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05404d500 con 0x7fc0540dd010 2024-03-23T06:17:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.178+0000 7fc05b400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc0540e6620 0x7fc054037700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:53962/0 (socket says 172.21.15.73:53962) 2024-03-23T06:17:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.178+0000 7fc05aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc0540dd010 0x7fc05404e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.178+0000 7fc05aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc0540dd010 0x7fc05404e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55294/0 (socket says 172.21.15.73:55294) 2024-03-23T06:17:30.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.178+0000 7fc05aa00640 1 -- 172.21.15.73:0/2238897513 learned_addr learned my addr 172.21.15.73:0/2238897513 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.179+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995934872 0 0) 0x7fc05c068090 con 0x7fc0540e6620 2024-03-23T06:17:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.179+0000 7fc05a000640 1 --2- 172.21.15.73:0/2238897513 >> v2:172.21.15.73:3300/0 conn(0x7fc05404d990 0x7fc0540e3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.179+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc040003520 con 0x7fc0540e6620 2024-03-23T06:17:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.180+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1581663694 0 0) 0x7fc040003520 con 0x7fc0540e6620 2024-03-23T06:17:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.180+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 >> v2:172.21.15.110:3300/0 conn(0x7fc0540dd010 msgr2=0x7fc05404e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.180+0000 7fc059600640 1 --2- 172.21.15.73:0/2238897513 >> v2:172.21.15.110:3300/0 conn(0x7fc0540dd010 0x7fc05404e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.180+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 >> v2:172.21.15.73:3300/0 conn(0x7fc05404d990 msgr2=0x7fc0540e3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:30.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.180+0000 7fc059600640 1 --2- 172.21.15.73:0/2238897513 >> v2:172.21.15.73:3300/0 conn(0x7fc05404d990 0x7fc0540e3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05404e940 con 0x7fc0540e6620 2024-03-23T06:17:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fc05c04e550 con 0x7fc0540e6620 2024-03-23T06:17:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 >> v1:172.21.15.110:6789/0 conn(0x7fc0540e6620 legacy=0x7fc054037700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040003970 0x7fc040003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc040004310 0x7fc0400047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc040004f40 0x7fc04000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05404d500 con 0x7fc040004f40 2024-03-23T06:17:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04000bec0 con 0x7fc040004310 2024-03-23T06:17:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.182+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04000c030 con 0x7fc040003970 2024-03-23T06:17:30.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.183+0000 7fc05b400640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc040004f40 0x7fc04000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.183+0000 7fc05aa00640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040003970 0x7fc040003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.184+0000 7fc05b400640 1 -- 172.21.15.73:0/2238897513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040003970 msgr2=0x7fc040003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.184+0000 7fc05b400640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040003970 0x7fc040003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.184+0000 7fc05b400640 1 -- 172.21.15.73:0/2238897513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc040004310 msgr2=0x7fc0400047e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:17:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.185+0000 7fc05a000640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc040004310 0x7fc0400047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.185+0000 7fc05b400640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc040004310 0x7fc0400047e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.185+0000 7fc05b400640 1 -- 172.21.15.73:0/2238897513 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05404e940 con 0x7fc040004f40 2024-03-23T06:17:30.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.186+0000 7fc05b400640 1 -- 172.21.15.73:0/2238897513 reap_dead start 2024-03-23T06:17:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.186+0000 7fc05b400640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc040004f40 0x7fc04000b980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc05c063b00 tx=0x7fc0400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a199f30a809ca3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.187+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0a7820 con 0x7fc040004f40 2024-03-23T06:17:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.187+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c0a79c0 con 0x7fc040004f40 2024-03-23T06:17:30.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.187+0000 7fc059600640 1 -- 172.21.15.73:0/2238897513 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0a7d70 con 0x7fc040004f40 2024-03-23T06:17:30.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.190+0000 7fc061a00640 1 -- 172.21.15.73:0/2238897513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc040004f40 msgr2=0x7fc04000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.191+0000 7fc061a00640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc040004f40 0x7fc04000b980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc05c063b00 tx=0x7fc0400057f0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.192+0000 7fc061a00640 1 -- 172.21.15.73:0/2238897513 shutdown_connections 2024-03-23T06:17:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.192+0000 7fc061a00640 1 --2- 172.21.15.73:0/2238897513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc040004f40 0x7fc04000b980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.192+0000 7fc061a00640 1 -- 172.21.15.73:0/2238897513 >> 172.21.15.73:0/2238897513 conn(0x7fc05400e0c0 msgr2=0x7fc05400e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.192+0000 7fc061a00640 1 -- 172.21.15.73:0/2238897513 shutdown_connections 2024-03-23T06:17:30.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.192+0000 7fc061a00640 1 -- 172.21.15.73:0/2238897513 wait complete. 2024-03-23T06:17:30.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.203+0000 7fc061a00640 1 Processor -- start 2024-03-23T06:17:30.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.203+0000 7fc061a00640 1 -- start start 2024-03-23T06:17:30.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.206+0000 7fc061a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040004f40 0x7fc0540e2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.206+0000 7fc061a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05404c3d0 0x7fc05404ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.206+0000 7fc061a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05404b140 0x7fc05417bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.207+0000 7fc061a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05404a770 con 0x7fc05404c3d0 2024-03-23T06:17:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.207+0000 7fc061a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05404b5f0 con 0x7fc05404b140 2024-03-23T06:17:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.207+0000 7fc061a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540d5600 con 0x7fc040004f40 2024-03-23T06:17:30.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.208+0000 7fc05b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05404b140 0x7fc05417bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.208+0000 7fc05b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05404b140 0x7fc05417bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55308/0 (socket says 172.21.15.73:55308) 2024-03-23T06:17:30.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.208+0000 7fc05b400640 1 -- 172.21.15.73:0/249044481 learned_addr learned my addr 172.21.15.73:0/249044481 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.207+0000 7fc05aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040004f40 0x7fc0540e2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.208+0000 7fc05aa00640 1 -- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05404b140 msgr2=0x7fc05417bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.208+0000 7fc05aa00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc05404b140 0x7fc05417bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.208+0000 7fc05aa00640 1 -- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05404c3d0 msgr2=0x7fc05404ac00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:17:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.208+0000 7fc05a000640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05404c3d0 0x7fc05404ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.209+0000 7fc05aa00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05404c3d0 0x7fc05404ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.209+0000 7fc05aa00640 1 -- 172.21.15.73:0/249044481 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0540d7380 con 0x7fc040004f40 2024-03-23T06:17:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.211+0000 7fc05aa00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040004f40 0x7fc0540e2ae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc04c011960 tx=0x7fc04c011e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.211+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00f9d0 con 0x7fc040004f40 2024-03-23T06:17:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.211+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00fb30 con 0x7fc040004f40 2024-03-23T06:17:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.211+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00fec0 con 0x7fc040004f40 2024-03-23T06:17:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.213+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0540d58a0 con 0x7fc040004f40 2024-03-23T06:17:30.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.213+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc054050720 con 0x7fc040004f40 2024-03-23T06:17:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.214+0000 7fc061a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05417c260 0x7fc05417c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.214+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540078d0 con 0x7fc05417c260 2024-03-23T06:17:30.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.216+0000 7fc05a000640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05417c260 0x7fc05417c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.226+0000 7fc05a000640 1 -- 172.21.15.73:0/249044481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc05417cbc0 con 0x7fc05417c260 2024-03-23T06:17:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.227+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc04c014440 con 0x7fc040004f40 2024-03-23T06:17:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.228+0000 7fc05a000640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05417c260 0x7fc05417c680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0540d60d0 tx=0x7fc04800f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.228+0000 7fc052a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc03c06ac30 0x7fc03c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.228+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fc04c089dc0 con 0x7fc040004f40 2024-03-23T06:17:30.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.229+0000 7fc05b400640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc03c06ac30 0x7fc03c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.230+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048014890 con 0x7fc05417c260 2024-03-23T06:17:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.230+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fc04800c030 con 0x7fc05417c260 2024-03-23T06:17:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.230+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05417c260 msgr2=0x7fc05417c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.230+0000 7fc052a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05417c260 0x7fc05417c680 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0540d60d0 tx=0x7fc04800f8a0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.230+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05417c260 msgr2=0x7fc05417c680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.230+0000 7fc052a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc05417c260 0x7fc05417c680 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc0540d60d0 tx=0x7fc04800f8a0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.231+0000 7fc05b400640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc03c06ac30 0x7fc03c06d0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc05c063b00 tx=0x7fc05c0b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.245+0000 7fc061a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0540d3f80 0x7fc0540d43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.245+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540d5a30 con 0x7fc0540d3f80 2024-03-23T06:17:30.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.246+0000 7fc05a000640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0540d3f80 0x7fc0540d43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.248+0000 7fc05a000640 1 -- 172.21.15.73:0/249044481 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc0540e3dc0 con 0x7fc0540d3f80 2024-03-23T06:17:30.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.248+0000 7fc05a000640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0540d3f80 0x7fc0540d43f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc048017000 tx=0x7fc048004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.249+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048023070 con 0x7fc0540d3f80 2024-03-23T06:17:30.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.250+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4950 (secure 0 0 0) 0x7fc0480039b0 con 0x7fc0540d3f80 2024-03-23T06:17:30.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.250+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0540d3f80 msgr2=0x7fc0540d43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.250+0000 7fc052a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0540d3f80 0x7fc0540d43f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc048017000 tx=0x7fc048004730 comp rx=0 tx=0).stop 2024-03-23T06:17:30.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.250+0000 7fc052a00640 1 -- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0540d3f80 msgr2=0x7fc0540d43f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:30.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.250+0000 7fc052a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0540d3f80 0x7fc0540d43f0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc048017000 tx=0x7fc048004730 comp rx=0 tx=0).stop 2024-03-23T06:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 76, 2024-03-23T06:17:30.251 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:30.252 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:30.253 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:17:30.254 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:30.255 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:17:30.256 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.257 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.258 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:30.259 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:30.260 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.261 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:30.262 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:17:30.263 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.251+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc03c06ac30 msgr2=0x7fc03c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.251+0000 7fc061a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc03c06ac30 0x7fc03c06d0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc05c063b00 tx=0x7fc05c0b1040 comp rx=0 tx=0).stop 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.251+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040004f40 msgr2=0x7fc0540e2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.251+0000 7fc061a00640 1 --2- 172.21.15.73:0/249044481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc040004f40 0x7fc0540e2ae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc04c011960 tx=0x7fc04c011e20 comp rx=0 tx=0).stop 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.251+0000 7fc05b400640 1 -- 172.21.15.73:0/249044481 reap_dead start 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.251+0000 7fc05b400640 1 -- 172.21.15.73:0/249044481 reap_dead start 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.253+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 shutdown_connections 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.253+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 >> 172.21.15.73:0/249044481 conn(0x7fc05400e0c0 msgr2=0x7fc0540e4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.253+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 shutdown_connections 2024-03-23T06:17:30.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.253+0000 7fc061a00640 1 -- 172.21.15.73:0/249044481 wait complete. 2024-03-23T06:17:30.285 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:17:30.285 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:17:30.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:17:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.650+0000 7febed400640 1 Processor -- start 2024-03-23T06:17:30.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.650+0000 7febed400640 1 -- start start 2024-03-23T06:17:30.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.653+0000 7febed400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7febe80c5930 0x7febe8159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.653+0000 7febed400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febe80c72e0 0x7febe80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.653+0000 7febed400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe80c5d30 con 0x7febe8153600 2024-03-23T06:17:30.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.653+0000 7febed400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80c5fc0 con 0x7febe80c5930 2024-03-23T06:17:30.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.653+0000 7febed400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80bc380 con 0x7febe80c72e0 2024-03-23T06:17:30.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.654+0000 7febe7e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7febe8153600 0x7febe815d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49818/0 (socket says 172.21.15.73:49818) 2024-03-23T06:17:30.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.654+0000 7febe7e00640 1 -- 172.21.15.73:0/410791618 learned_addr learned my addr 172.21.15.73:0/410791618 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:17:30.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.655+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387422187 0 0) 0x7febe80c5d30 con 0x7febe8153600 2024-03-23T06:17:30.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.655+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febcc003520 con 0x7febe8153600 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.656+0000 7febe7400640 1 --2- 172.21.15.73:0/410791618 >> v2:172.21.15.73:3300/0 conn(0x7febe80c5930 0x7febe8159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.656+0000 7febeca00640 1 --2- 172.21.15.73:0/410791618 >> v2:172.21.15.110:3300/0 conn(0x7febe80c72e0 0x7febe80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1950066950 0 0) 0x7febcc003520 con 0x7febe8153600 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 >> v2:172.21.15.110:3300/0 conn(0x7febe80c72e0 msgr2=0x7febe80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 --2- 172.21.15.73:0/410791618 >> v2:172.21.15.110:3300/0 conn(0x7febe80c72e0 0x7febe80c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 >> v2:172.21.15.73:3300/0 conn(0x7febe80c5930 msgr2=0x7febe8159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 --2- 172.21.15.73:0/410791618 >> v2:172.21.15.73:3300/0 conn(0x7febe80c5930 0x7febe8159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80bc660 con 0x7febe8153600 2024-03-23T06:17:30.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7febd8001670 con 0x7febe8153600 2024-03-23T06:17:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 >> v1:172.21.15.73:6789/0 conn(0x7febe8153600 legacy=0x7febe815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc003970 0x7febcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febcc0047c0 0x7febcc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febcc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80c5fc0 con 0x7febcc0047c0 2024-03-23T06:17:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80bc380 con 0x7febcc005180 2024-03-23T06:17:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.657+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc00c080 con 0x7febcc003970 2024-03-23T06:17:30.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.658+0000 7febe7400640 1 --2- 172.21.15.73:0/410791618 >> v2:172.21.15.73:3300/0 conn(0x7febe80c5930 0x7febe8159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:17:30.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.659+0000 7febeca00640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febcc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.659+0000 7febe7e00640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc003970 0x7febcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.659+0000 7febe7400640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febcc0047c0 0x7febcc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.659+0000 7febeca00640 1 -- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc003970 msgr2=0x7febcc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:30.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.659+0000 7febeca00640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febcc003970 0x7febcc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.659+0000 7febeca00640 1 -- 172.21.15.73:0/410791618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febcc0047c0 msgr2=0x7febcc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:30.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.659+0000 7febeca00640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febcc0047c0 0x7febcc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.659+0000 7febeca00640 1 -- 172.21.15.73:0/410791618 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80bc660 con 0x7febcc005180 2024-03-23T06:17:30.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.661+0000 7febeca00640 1 -- 172.21.15.73:0/410791618 reap_dead start 2024-03-23T06:17:30.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.661+0000 7febeca00640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febcc00b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7febe0007360 tx=0x7febcc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f84cb7ad882eb17b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.662+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe002ccf0 con 0x7febcc005180 2024-03-23T06:17:30.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.662+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe002ce90 con 0x7febcc005180 2024-03-23T06:17:30.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.662+0000 7febe6a00640 1 -- 172.21.15.73:0/410791618 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0003bd0 con 0x7febcc005180 2024-03-23T06:17:30.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.663+0000 7febed400640 1 -- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 msgr2=0x7febcc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.663+0000 7febed400640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febcc00b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7febe0007360 tx=0x7febcc0057f0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.663+0000 7febed400640 1 -- 172.21.15.73:0/410791618 shutdown_connections 2024-03-23T06:17:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.663+0000 7febed400640 1 --2- 172.21.15.73:0/410791618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febcc00b980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.663+0000 7febed400640 1 -- 172.21.15.73:0/410791618 >> 172.21.15.73:0/410791618 conn(0x7febe806d3f0 msgr2=0x7febe806d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.663+0000 7febed400640 1 -- 172.21.15.73:0/410791618 shutdown_connections 2024-03-23T06:17:30.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.663+0000 7febed400640 1 -- 172.21.15.73:0/410791618 wait complete. 2024-03-23T06:17:30.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.666+0000 7febed400640 1 Processor -- start 2024-03-23T06:17:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.666+0000 7febed400640 1 -- start start 2024-03-23T06:17:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.668+0000 7febed400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febe8157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.668+0000 7febed400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febe8145b60 0x7febe8071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.668+0000 7febed400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febe8071c80 0x7febe8136ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.668+0000 7febed400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8157f70 con 0x7febe8071c80 2024-03-23T06:17:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.668+0000 7febed400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8134e10 con 0x7febcc005180 2024-03-23T06:17:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.668+0000 7febed400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8158430 con 0x7febe8145b60 2024-03-23T06:17:30.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.668+0000 7febe7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febe8157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.669+0000 7febe7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febe8157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55334/0 (socket says 172.21.15.73:55334) 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.669+0000 7febe7e00640 1 -- 172.21.15.73:0/2180112101 learned_addr learned my addr 172.21.15.73:0/2180112101 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.669+0000 7febe7400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febe8145b60 0x7febe8071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.669+0000 7febeca00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febe8071c80 0x7febe8136ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.669+0000 7febe7e00640 1 -- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febe8145b60 msgr2=0x7febe8071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.669+0000 7febe7e00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febe8145b60 0x7febe8071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.669+0000 7febe7e00640 1 -- 172.21.15.73:0/2180112101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febe8071c80 msgr2=0x7febe8136ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.669+0000 7febe7e00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febe8071c80 0x7febe8136ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.670+0000 7febe7e00640 1 -- 172.21.15.73:0/2180112101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8158710 con 0x7febcc005180 2024-03-23T06:17:30.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.670+0000 7febeca00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febe8071c80 0x7febe8136ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:17:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.670+0000 7febe7e00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febe8157a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febd800e910 tx=0x7febd800edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.671+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd800c8d0 con 0x7febcc005180 2024-03-23T06:17:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.671+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd800ca30 con 0x7febcc005180 2024-03-23T06:17:30.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.672+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd800c8d0 con 0x7febcc005180 2024-03-23T06:17:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.673+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe8158c30 con 0x7febcc005180 2024-03-23T06:17:30.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.673+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe81591f0 con 0x7febcc005180 2024-03-23T06:17:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.675+0000 7febed400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81373e0 0x7febe81377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.675+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8073aa0 con 0x7febe81373e0 2024-03-23T06:17:30.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.676+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7febd800cba0 con 0x7febcc005180 2024-03-23T06:17:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.678+0000 7febdfe00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7febc806ac60 0x7febc806d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.678+0000 7febe7400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81373e0 0x7febe81377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.678+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7febd8089490 con 0x7febcc005180 2024-03-23T06:17:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.679+0000 7febeca00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7febc806ac60 0x7febc806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.679+0000 7febe7400640 1 -- 172.21.15.73:0/2180112101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febe8072060 con 0x7febe81373e0 2024-03-23T06:17:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.680+0000 7febe7400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81373e0 0x7febe81377c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7febd4011520 tx=0x7febd40119e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.681+0000 7febeca00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7febc806ac60 0x7febc806d120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7febcc00c050 tx=0x7febe0030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.681+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4015650 con 0x7febe81373e0 2024-03-23T06:17:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.682+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7febd400c040 con 0x7febe81373e0 2024-03-23T06:17:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.682+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81373e0 msgr2=0x7febe81377c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.682+0000 7febdfe00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81373e0 0x7febe81377c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7febd4011520 tx=0x7febd40119e0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.682+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81373e0 msgr2=0x7febe81377c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:30.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.682+0000 7febdfe00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81373e0 0x7febe81377c0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7febd4011520 tx=0x7febd40119e0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.696+0000 7febed400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81404a0 0x7febe81408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:30.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.696+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8145f40 con 0x7febe81404a0 2024-03-23T06:17:30.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.697+0000 7febe7400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81404a0 0x7febe81408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.698+0000 7febe7400640 1 -- 172.21.15.73:0/2180112101 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7febe81597d0 con 0x7febe81404a0 2024-03-23T06:17:30.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.699+0000 7febe7400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81404a0 0x7febe81408b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febd4011520 tx=0x7febd40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.699+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4029400 con 0x7febe81404a0 2024-03-23T06:17:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.700+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4975 (secure 0 0 0) 0x7febd400d440 con 0x7febe81404a0 2024-03-23T06:17:30.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.700+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81404a0 msgr2=0x7febe81408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.700+0000 7febdfe00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81404a0 0x7febe81408b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febd4011520 tx=0x7febd40046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.700+0000 7febdfe00640 1 -- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81404a0 msgr2=0x7febe81408b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:30.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.700+0000 7febdfe00640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febe81404a0 0x7febe81408b0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febd4011520 tx=0x7febd40046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.702 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:17:30.702 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:17:30.702 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:17:30.702 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:17:30.703 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 76, 2024-03-23T06:17:30.703 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:17:30.703 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:17:30.703 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:17:30.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:17:30.703 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.703 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 5, 2024-03-23T06:17:30.703 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:30.704 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:17:30.704 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:17:30.704 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:30.704 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:30.704 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:30.704 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:30.704 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:30.705 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:17:30.706 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:30.707 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.708 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.709 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.710 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.711 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.712 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.713 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:17:30.714 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:17:30.715 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.702+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7febc806ac60 msgr2=0x7febc806d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.702+0000 7febed400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7febc806ac60 0x7febc806d120 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7febcc00c050 tx=0x7febe0030000 comp rx=0 tx=0).stop 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.702+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 msgr2=0x7febe8157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.702+0000 7febed400640 1 --2- 172.21.15.73:0/2180112101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febcc005180 0x7febe8157a30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7febd800e910 tx=0x7febd800edd0 comp rx=0 tx=0).stop 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.702+0000 7febeca00640 1 -- 172.21.15.73:0/2180112101 reap_dead start 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.702+0000 7febeca00640 1 -- 172.21.15.73:0/2180112101 reap_dead start 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.703+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 shutdown_connections 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.703+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 >> 172.21.15.73:0/2180112101 conn(0x7febe806d3f0 msgr2=0x7febe81527f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.703+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 shutdown_connections 2024-03-23T06:17:30.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:30.703+0000 7febed400640 1 -- 172.21.15.73:0/2180112101 wait complete. 2024-03-23T06:17:30.727 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:17:30.727 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:17:30.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.007+0000 7f1981800640 1 Processor -- start 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.008+0000 7f1981800640 1 -- start start 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.009+0000 7f1981800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f197c08b540 0x7f197c16a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.009+0000 7f1981800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f197c166840 0x7f197c166cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.009+0000 7f1981800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f197c16a6d0 con 0x7f197c072530 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.009+0000 7f1981800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c0703f0 con 0x7f197c08b540 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.009+0000 7f1981800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197c1671f0 con 0x7f197c166840 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.009+0000 7f197b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f197c166840 0x7f197c166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.009+0000 7f197b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f197c166840 0x7f197c166cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55366/0 (socket says 172.21.15.73:55366) 2024-03-23T06:17:31.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.009+0000 7f197b400640 1 -- 172.21.15.73:0/3494042112 learned_addr learned my addr 172.21.15.73:0/3494042112 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:31.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.184+0000 7f197b400640 1 -- 172.21.15.73:0/3494042112 >> v2:172.21.15.73:3300/0 conn(0x7f197c08b540 msgr2=0x7f197c16a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:31.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.010+0000 7f1979600640 1 -- 172.21.15.73:0/3494042112 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444753882 0 0) 0x7f196c001110 con 0x7f197c072530 2024-03-23T06:17:31.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.010+0000 7f197a000640 1 --2- 172.21.15.73:0/3494042112 >> v2:172.21.15.73:3300/0 conn(0x7f197c08b540 0x7f197c16a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.185+0000 7f197b400640 1 --2- 172.21.15.73:0/3494042112 >> v2:172.21.15.73:3300/0 conn(0x7f197c08b540 0x7f197c16a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.185+0000 7f197b400640 1 -- 172.21.15.73:0/3494042112 >> v1:172.21.15.110:6789/0 conn(0x7f197c072530 legacy=0x7f197c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.185+0000 7f197b400640 1 -- 172.21.15.73:0/3494042112 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c072910 con 0x7f197c166840 2024-03-23T06:17:31.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.186+0000 7f197a000640 1 --2- 172.21.15.73:0/3494042112 >> v2:172.21.15.73:3300/0 conn(0x7f197c08b540 0x7f197c16a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:17:31.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.187+0000 7f197b400640 1 --2- 172.21.15.73:0/3494042112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c166840 0x7f197c166cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f197c06cc80 tx=0x7f197402e1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137a5affbdefa3a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:31.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.191+0000 7f1979600640 1 -- 172.21.15.73:0/3494042112 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974036440 con 0x7f197c166840 2024-03-23T06:17:31.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.191+0000 7f1979600640 1 -- 172.21.15.73:0/3494042112 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19740365a0 con 0x7f197c166840 2024-03-23T06:17:31.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.191+0000 7f1979600640 1 -- 172.21.15.73:0/3494042112 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974036970 con 0x7f197c166840 2024-03-23T06:17:31.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.195+0000 7f1981800640 1 -- 172.21.15.73:0/3494042112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c166840 msgr2=0x7f197c166cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.195+0000 7f1981800640 1 --2- 172.21.15.73:0/3494042112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c166840 0x7f197c166cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f197c06cc80 tx=0x7f197402e1d0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.195+0000 7f1981800640 1 -- 172.21.15.73:0/3494042112 shutdown_connections 2024-03-23T06:17:31.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.195+0000 7f1981800640 1 --2- 172.21.15.73:0/3494042112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c166840 0x7f197c166cb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.195+0000 7f1981800640 1 --2- 172.21.15.73:0/3494042112 >> v2:172.21.15.73:3300/0 conn(0x7f197c08b540 0x7f197c16a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.195+0000 7f1981800640 1 -- 172.21.15.73:0/3494042112 >> 172.21.15.73:0/3494042112 conn(0x7f197c069cb0 msgr2=0x7f197c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:31.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.196+0000 7f1981800640 1 -- 172.21.15.73:0/3494042112 shutdown_connections 2024-03-23T06:17:31.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.196+0000 7f1981800640 1 -- 172.21.15.73:0/3494042112 wait complete. 2024-03-23T06:17:31.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.199+0000 7f1981800640 1 Processor -- start 2024-03-23T06:17:31.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.199+0000 7f1981800640 1 -- start start 2024-03-23T06:17:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.200+0000 7f1981800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c072530 0x7f197c204850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.200+0000 7f1981800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c08b540 0x7f197c160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.201+0000 7f1981800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f197c166840 0x7f197c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.201+0000 7f197a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c08b540 0x7f197c160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.201+0000 7f197a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c08b540 0x7f197c160360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55370/0 (socket says 172.21.15.73:55370) 2024-03-23T06:17:31.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.201+0000 7f1981800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0c3700 con 0x7f197c166840 2024-03-23T06:17:31.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.201+0000 7f1981800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197c08abe0 con 0x7f197c08b540 2024-03-23T06:17:31.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.201+0000 7f1981800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c08ae80 con 0x7f197c072530 2024-03-23T06:17:31.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.201+0000 7f197a000640 1 -- 172.21.15.73:0/2769317023 learned_addr learned my addr 172.21.15.73:0/2769317023 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:31.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.202+0000 7f197aa00640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c072530 0x7f197c204850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.202+0000 7f197b400640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f197c166840 0x7f197c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.203+0000 7f197b400640 1 -- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c072530 msgr2=0x7f197c204850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.203+0000 7f197b400640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c072530 0x7f197c204850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.203+0000 7f197b400640 1 -- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c08b540 msgr2=0x7f197c160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.203+0000 7f197b400640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f197c08b540 0x7f197c160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.203+0000 7f197b400640 1 -- 172.21.15.73:0/2769317023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197400a3c0 con 0x7f197c166840 2024-03-23T06:17:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.204+0000 7f197b400640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f197c166840 0x7f197c15f200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f197c08bc90 tx=0x7f1974004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:31.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.205+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974045070 con 0x7f197c166840 2024-03-23T06:17:31.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.205+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1974010290 con 0x7f197c166840 2024-03-23T06:17:31.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.206+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974036440 con 0x7f197c166840 2024-03-23T06:17:31.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.206+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197c0c4910 con 0x7f197c166840 2024-03-23T06:17:31.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.207+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c204330 con 0x7f197c166840 2024-03-23T06:17:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.210+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f197403d070 con 0x7f197c166840 2024-03-23T06:17:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.211+0000 7f1972a00640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195c06ac00 0x7f195c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.211+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f19740abc60 con 0x7f197c166840 2024-03-23T06:17:31.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.212+0000 7f197aa00640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195c06ac00 0x7f195c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.213+0000 7f197aa00640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195c06ac00 0x7f195c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f196c001370 tx=0x7f196c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.213+0000 7f1981800640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c0c4aa0 0x7f197c15f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.213+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c073bf0 con 0x7f197c0c4aa0 2024-03-23T06:17:31.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.213+0000 7f197a000640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c0c4aa0 0x7f197c15f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.214+0000 7f197a000640 1 -- 172.21.15.73:0/2769317023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f197c1663b0 con 0x7f197c0c4aa0 2024-03-23T06:17:31.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.214+0000 7f197a000640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c0c4aa0 0x7f197c15f740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f197c08b490 tx=0x7f196800fdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:31.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.215+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800dcb0 con 0x7f197c0c4aa0 2024-03-23T06:17:31.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.215+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f196800c040 con 0x7f197c0c4aa0 2024-03-23T06:17:31.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.215+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c0c4aa0 msgr2=0x7f197c15f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.215+0000 7f1972a00640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c0c4aa0 0x7f197c15f740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f197c08b490 tx=0x7f196800fdb0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.215+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c0c4aa0 msgr2=0x7f197c15f740 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:31.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.215+0000 7f1972a00640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c0c4aa0 0x7f197c15f740 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f197c08b490 tx=0x7f196800fdb0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.228+0000 7f1981800640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c2074b0 0x7f197c2078c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.228+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197c0ca090 con 0x7f197c2074b0 2024-03-23T06:17:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.228+0000 7f197a000640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c2074b0 0x7f197c2078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.229+0000 7f197a000640 1 -- 172.21.15.73:0/2769317023 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f197c0c8e90 con 0x7f197c2074b0 2024-03-23T06:17:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.230+0000 7f197a000640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c2074b0 0x7f197c2078c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f197c0c50a0 tx=0x7f19680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.230+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800dcb0 con 0x7f197c2074b0 2024-03-23T06:17:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.230+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7f1968006850 con 0x7f197c2074b0 2024-03-23T06:17:31.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.230+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c2074b0 msgr2=0x7f197c2078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 76, 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:17:31.231 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 5, 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:31.232 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:31.233 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:17:31.234 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:31.235 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.236 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:31.237 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:17:31.238 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.239 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.240 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:31.241 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:31.242 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:17:31.242 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.231+0000 7f1972a00640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c2074b0 0x7f197c2078c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f197c0c50a0 tx=0x7f19680046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.231+0000 7f1972a00640 1 -- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c2074b0 msgr2=0x7f197c2078c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.231+0000 7f1972a00640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f197c2074b0 0x7f197c2078c0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f197c0c50a0 tx=0x7f19680046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.234+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195c06ac00 msgr2=0x7f195c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.234+0000 7f1981800640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f195c06ac00 0x7f195c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f196c001370 tx=0x7f196c009040 comp rx=0 tx=0).stop 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.234+0000 7f197b400640 1 -- 172.21.15.73:0/2769317023 reap_dead start 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.235+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f197c166840 msgr2=0x7f197c15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.235+0000 7f1981800640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f197c166840 0x7f197c15f200 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f197c08bc90 tx=0x7f1974004a40 comp rx=0 tx=0).stop 2024-03-23T06:17:31.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.235+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 shutdown_connections 2024-03-23T06:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.235+0000 7f1981800640 1 --2- 172.21.15.73:0/2769317023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f197c166840 0x7f197c15f200 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.236+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 >> 172.21.15.73:0/2769317023 conn(0x7f197c069cb0 msgr2=0x7f197c0bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.236+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 shutdown_connections 2024-03-23T06:17:31.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.237+0000 7f1981800640 1 -- 172.21.15.73:0/2769317023 wait complete. 2024-03-23T06:17:31.284 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:17:31.284 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:17:31.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.623+0000 7fea03000640 1 Processor -- start 2024-03-23T06:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.623+0000 7fea03000640 1 -- start start 2024-03-23T06:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.625+0000 7fea03000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9fc1536a0 0x7fe9fc0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.625+0000 7fea03000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe9fc153a80 0x7fe9fc0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.625+0000 7fea03000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 0x7fe9fc0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.625+0000 7fea03000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc15a520 con 0x7fe9fc153a80 2024-03-23T06:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.625+0000 7fea03000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc0cab20 con 0x7fe9fc1536a0 2024-03-23T06:17:31.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.625+0000 7fea03000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc1599a0 con 0x7fe9fc1594f0 2024-03-23T06:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.626+0000 7fe9fbe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9fc1536a0 0x7fe9fc0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.626+0000 7fe9fbe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9fc1536a0 0x7fe9fc0ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55386/0 (socket says 172.21.15.73:55386) 2024-03-23T06:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.626+0000 7fe9fbe00640 1 -- 172.21.15.73:0/2191890386 learned_addr learned my addr 172.21.15.73:0/2191890386 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.627+0000 7fe9fb400640 1 --2- 172.21.15.73:0/2191890386 >> v2:172.21.15.73:3300/0 conn(0x7fe9fc153a80 0x7fe9fc0cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.627+0000 7fe9fbe00640 1 -- 172.21.15.73:0/2191890386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 msgr2=0x7fe9fc0cc3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:17:31.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.627+0000 7fe9fbe00640 1 --2- 172.21.15.73:0/2191890386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 0x7fe9fc0cc3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.627+0000 7fe9fbe00640 1 -- 172.21.15.73:0/2191890386 >> v2:172.21.15.73:3300/0 conn(0x7fe9fc153a80 msgr2=0x7fe9fc0cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:31.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.627+0000 7fe9fbe00640 1 --2- 172.21.15.73:0/2191890386 >> v2:172.21.15.73:3300/0 conn(0x7fe9fc153a80 0x7fe9fc0cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.627+0000 7fe9fbe00640 1 -- 172.21.15.73:0/2191890386 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc159c80 con 0x7fe9fc1536a0 2024-03-23T06:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.631+0000 7fe9fbe00640 1 --2- 172.21.15.73:0/2191890386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc0ca5e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009870 tx=0x7fe9ec02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd9a2392aec657c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.632+0000 7fe9faa00640 1 -- 172.21.15.73:0/2191890386 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec031870 con 0x7fe9fc1536a0 2024-03-23T06:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.632+0000 7fe9faa00640 1 -- 172.21.15.73:0/2191890386 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec0319d0 con 0x7fe9fc1536a0 2024-03-23T06:17:31.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.632+0000 7fe9faa00640 1 -- 172.21.15.73:0/2191890386 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec031870 con 0x7fe9fc1536a0 2024-03-23T06:17:31.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.635+0000 7fea03000640 1 -- 172.21.15.73:0/2191890386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 msgr2=0x7fe9fc0ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.636+0000 7fea03000640 1 --2- 172.21.15.73:0/2191890386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc0ca5e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009870 tx=0x7fe9ec02b910 comp rx=0 tx=0).stop 2024-03-23T06:17:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.636+0000 7fea03000640 1 -- 172.21.15.73:0/2191890386 shutdown_connections 2024-03-23T06:17:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.636+0000 7fea03000640 1 --2- 172.21.15.73:0/2191890386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 0x7fe9fc0cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.636+0000 7fea03000640 1 --2- 172.21.15.73:0/2191890386 >> v2:172.21.15.73:3300/0 conn(0x7fe9fc153a80 0x7fe9fc0cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.636+0000 7fea03000640 1 --2- 172.21.15.73:0/2191890386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc0ca5e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.637+0000 7fea03000640 1 -- 172.21.15.73:0/2191890386 >> 172.21.15.73:0/2191890386 conn(0x7fe9fc06a060 msgr2=0x7fe9fc06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.637+0000 7fea03000640 1 -- 172.21.15.73:0/2191890386 shutdown_connections 2024-03-23T06:17:31.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.637+0000 7fea03000640 1 -- 172.21.15.73:0/2191890386 wait complete. 2024-03-23T06:17:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.640+0000 7fea03000640 1 Processor -- start 2024-03-23T06:17:31.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.641+0000 7fea03000640 1 -- start start 2024-03-23T06:17:31.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.643+0000 7fea03000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.643+0000 7fea03000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc153a80 0x7fe9fc0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.643+0000 7fea03000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 0x7fe9fc0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.644+0000 7fea03000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc145e30 con 0x7fe9fc153a80 2024-03-23T06:17:31.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.644+0000 7fea03000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc071860 con 0x7fe9fc1536a0 2024-03-23T06:17:31.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.644+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.644+0000 7fe9fbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc145430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:55394/0 (socket says 172.21.15.73:55394) 2024-03-23T06:17:31.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.644+0000 7fe9fbe00640 1 -- 172.21.15.73:0/3760783409 learned_addr learned my addr 172.21.15.73:0/3760783409 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:31.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.644+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc152680 con 0x7fe9fc1594f0 2024-03-23T06:17:31.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.645+0000 7fea01000640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 0x7fe9fc0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.645+0000 7fe9fb400640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc153a80 0x7fe9fc0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.645+0000 7fe9fbe00640 1 -- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 msgr2=0x7fe9fc0b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.645+0000 7fe9fbe00640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 0x7fe9fc0b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.645+0000 7fe9fbe00640 1 -- 172.21.15.73:0/3760783409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc153a80 msgr2=0x7fe9fc0b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.646+0000 7fe9fbe00640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc153a80 0x7fe9fc0b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.646+0000 7fe9fbe00640 1 -- 172.21.15.73:0/3760783409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0094d0 con 0x7fe9fc1536a0 2024-03-23T06:17:31.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.647+0000 7fe9fbe00640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc145430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009870 tx=0x7fe9ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:31.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.647+0000 7fe9f3e00640 1 -- 172.21.15.73:0/3760783409 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec031870 con 0x7fe9fc1536a0 2024-03-23T06:17:31.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.647+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc152940 con 0x7fe9fc1536a0 2024-03-23T06:17:31.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.648+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc071580 con 0x7fe9fc1536a0 2024-03-23T06:17:31.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.648+0000 7fe9f3e00640 1 -- 172.21.15.73:0/3760783409 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec0305d0 con 0x7fe9fc1536a0 2024-03-23T06:17:31.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.648+0000 7fe9f3e00640 1 -- 172.21.15.73:0/3760783409 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec030940 con 0x7fe9fc1536a0 2024-03-23T06:17:31.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.658+0000 7fe9f3e00640 1 -- 172.21.15.73:0/3760783409 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe9ec030aa0 con 0x7fe9fc1536a0 2024-03-23T06:17:31.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.659+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc0c9810 con 0x7fe9fc1536a0 2024-03-23T06:17:31.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.664+0000 7fe9f3e00640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe9dc06ac30 0x7fe9dc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:31.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.664+0000 7fe9f3e00640 1 -- 172.21.15.73:0/3760783409 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe9ec02d040 con 0x7fe9fc1536a0 2024-03-23T06:17:31.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.666+0000 7fe9fb400640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe9dc06ac30 0x7fe9dc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:31.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.670+0000 7fe9f3e00640 1 -- 172.21.15.73:0/3760783409 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe9ec076fc0 con 0x7fe9fc1536a0 2024-03-23T06:17:31.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:31.672+0000 7fe9fb400640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe9dc06ac30 0x7fe9dc06d0f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8006fd0 tx=0x7fe9e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:32.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.297+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fe9fc04e110 con 0x7fe9fc1536a0 2024-03-23T06:17:32.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.305+0000 7fe9f3e00640 1 -- 172.21.15.73:0/3760783409 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fe9ec035080 con 0x7fe9fc1536a0 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.311+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe9dc06ac30 msgr2=0x7fe9dc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.311+0000 7fea03000640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe9dc06ac30 0x7fe9dc06d0f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8006fd0 tx=0x7fe9e8008040 comp rx=0 tx=0).stop 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.311+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 msgr2=0x7fe9fc145430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.311+0000 7fea03000640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc145430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009870 tx=0x7fe9ec0046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.312+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 shutdown_connections 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.312+0000 7fea03000640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe9dc06ac30 0x7fe9dc06d0f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.312+0000 7fea03000640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9fc1594f0 0x7fe9fc0b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.312+0000 7fea03000640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9fc153a80 0x7fe9fc0b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.312+0000 7fea03000640 1 --2- 172.21.15.73:0/3760783409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9fc1536a0 0x7fe9fc145430 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009870 tx=0x7fe9ec0046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:32.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.312+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 >> 172.21.15.73:0/3760783409 conn(0x7fe9fc06a060 msgr2=0x7fe9fc0c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:32.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.312+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 shutdown_connections 2024-03-23T06:17:32.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:32.312+0000 7fea03000640 1 -- 172.21.15.73:0/3760783409 wait complete. 2024-03-23T06:17:32.364 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:17:42.365 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:17:42.366 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:17:42.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.651+0000 7f24edc00640 1 Processor -- start 2024-03-23T06:17:42.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.651+0000 7f24edc00640 1 -- start start 2024-03-23T06:17:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.654+0000 7f24e6a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f24e814fa20 0x7f24e80c7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:39604/0 (socket says 172.21.15.73:39604) 2024-03-23T06:17:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.654+0000 7f24e6000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f24e8072360 0x7f24e806d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58972/0 (socket says 172.21.15.73:58972) 2024-03-23T06:17:42.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.654+0000 7f24e6a00640 1 -- 172.21.15.73:0/528517410 learned_addr learned my addr 172.21.15.73:0/528517410 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:17:42.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.655+0000 7f24edc00640 1 --2- 172.21.15.73:0/528517410 >> v2:172.21.15.110:3300/0 conn(0x7f24e806c630 0x7f24e8156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:42.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.655+0000 7f24edc00640 1 -- 172.21.15.73:0/528517410 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e80c5fe0 con 0x7f24e8072360 2024-03-23T06:17:42.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.655+0000 7f24e7400640 1 --2- 172.21.15.73:0/528517410 >> v2:172.21.15.110:3300/0 conn(0x7f24e806c630 0x7f24e8156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.656+0000 7f24edc00640 1 -- 172.21.15.73:0/528517410 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e80c7350 con 0x7f24e814fa20 2024-03-23T06:17:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.656+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407452116 0 0) 0x7f24e80c5fe0 con 0x7f24e8072360 2024-03-23T06:17:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.656+0000 7f24edc00640 1 -- 172.21.15.73:0/528517410 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e814fe00 con 0x7f24e806c630 2024-03-23T06:17:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.656+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24cc003520 con 0x7f24e8072360 2024-03-23T06:17:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.656+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54133327 0 0) 0x7f24e80c7350 con 0x7f24e814fa20 2024-03-23T06:17:42.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.656+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e80c5fe0 con 0x7f24e814fa20 2024-03-23T06:17:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.656+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2430502979 0 0) 0x7f24e80c5fe0 con 0x7f24e814fa20 2024-03-23T06:17:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.657+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 >> v2:172.21.15.110:3300/0 conn(0x7f24e806c630 msgr2=0x7f24e8156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.657+0000 7f24e5600640 1 --2- 172.21.15.73:0/528517410 >> v2:172.21.15.110:3300/0 conn(0x7f24e806c630 0x7f24e8156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:42.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.657+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 >> v1:172.21.15.73:6789/0 conn(0x7f24e8072360 legacy=0x7f24e806d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:42.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.657+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e8156590 con 0x7f24e814fa20 2024-03-23T06:17:42.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.657+0000 7f24e7400640 1 --2- 172.21.15.73:0/528517410 >> v2:172.21.15.110:3300/0 conn(0x7f24e806c630 0x7f24e8156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:17:42.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.657+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f24d8001670 con 0x7f24e814fa20 2024-03-23T06:17:42.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.658+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 >> v1:172.21.15.110:6789/0 conn(0x7f24e814fa20 legacy=0x7f24e80c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:42.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.658+0000 7f24e5600640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc004b60 0x7f24cc004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:42.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.658+0000 7f24e5600640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc003760 0x7f24cc003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:42.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.658+0000 7f24e5600640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc004120 0x7f24cc00ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:42.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.658+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e814fe00 con 0x7f24cc004b60 2024-03-23T06:17:42.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.658+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc00d1c0 con 0x7f24cc003760 2024-03-23T06:17:42.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.658+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc00d380 con 0x7f24cc004120 2024-03-23T06:17:42.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.659+0000 7f24e6000640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc003760 0x7f24cc003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:42.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.659+0000 7f24e6a00640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc004b60 0x7f24cc004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.659+0000 7f24e7400640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc004120 0x7f24cc00ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.660+0000 7f24e6000640 1 -- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc004120 msgr2=0x7f24cc00ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.660+0000 7f24e6000640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc004120 0x7f24cc00ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:42.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.660+0000 7f24e6000640 1 -- 172.21.15.73:0/528517410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc004b60 msgr2=0x7f24cc004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.660+0000 7f24e6000640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc004b60 0x7f24cc004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.660+0000 7f24e6000640 1 -- 172.21.15.73:0/528517410 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e80c5fe0 con 0x7f24cc003760 2024-03-23T06:17:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.660+0000 7f24e6a00640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc004b60 0x7f24cc004f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:17:42.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.661+0000 7f24e7400640 1 -- 172.21.15.73:0/528517410 reap_dead start 2024-03-23T06:17:42.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.662+0000 7f24e6000640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc003760 0x7f24cc003be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d910 tx=0x7f24cc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df0204e27f18c636 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:42.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.662+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d402cbb0 con 0x7f24cc003760 2024-03-23T06:17:42.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.662+0000 7f24e5600640 1 -- 172.21.15.73:0/528517410 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d402cd10 con 0x7f24cc003760 2024-03-23T06:17:42.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.663+0000 7f24edc00640 1 -- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc003760 msgr2=0x7f24cc003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:42.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.663+0000 7f24edc00640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc003760 0x7f24cc003be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d910 tx=0x7f24cc0057f0 comp rx=0 tx=0).stop 2024-03-23T06:17:42.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.664+0000 7f24edc00640 1 -- 172.21.15.73:0/528517410 shutdown_connections 2024-03-23T06:17:42.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.664+0000 7f24edc00640 1 --2- 172.21.15.73:0/528517410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc003760 0x7f24cc003be0 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f24d400d910 tx=0x7f24cc0057f0 comp rx=0 tx=0).stop 2024-03-23T06:17:42.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.664+0000 7f24edc00640 1 -- 172.21.15.73:0/528517410 >> 172.21.15.73:0/528517410 conn(0x7f24e806bb40 msgr2=0x7f24e806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:42.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.665+0000 7f24edc00640 1 -- 172.21.15.73:0/528517410 shutdown_connections 2024-03-23T06:17:42.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.666+0000 7f24edc00640 1 -- 172.21.15.73:0/528517410 wait complete. 2024-03-23T06:17:42.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.669+0000 7f24edc00640 1 Processor -- start 2024-03-23T06:17:42.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.670+0000 7f24edc00640 1 -- start start 2024-03-23T06:17:42.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.671+0000 7f24edc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24e80c4320 0x7f24e81f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:42.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.671+0000 7f24edc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24e80c4700 0x7f24e81f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:42.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.671+0000 7f24edc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24e81f6ba0 0x7f24e8146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:42.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.671+0000 7f24edc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e80c67d0 con 0x7f24e80c4700 2024-03-23T06:17:42.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.671+0000 7f24edc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e80701c0 con 0x7f24e81f6ba0 2024-03-23T06:17:42.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.671+0000 7f24edc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8147600 con 0x7f24e80c4320 2024-03-23T06:17:42.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.672+0000 7f24e6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24e80c4320 0x7f24e81f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:42.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.672+0000 7f24e6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24e80c4320 0x7f24e81f4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:42036/0 (socket says 172.21.15.73:42036) 2024-03-23T06:17:42.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.672+0000 7f24e6a00640 1 -- 172.21.15.73:0/719627240 learned_addr learned my addr 172.21.15.73:0/719627240 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:42.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.672+0000 7f24e7400640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24e81f6ba0 0x7f24e8146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:42.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.672+0000 7f24e6000640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24e80c4700 0x7f24e81f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:42.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.673+0000 7f24e6a00640 1 -- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24e81f6ba0 msgr2=0x7f24e8146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:42.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.673+0000 7f24e6a00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24e81f6ba0 0x7f24e8146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:42.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.673+0000 7f24e6a00640 1 -- 172.21.15.73:0/719627240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24e80c4700 msgr2=0x7f24e81f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:42.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.673+0000 7f24e6a00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24e80c4700 0x7f24e81f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:42.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.673+0000 7f24e6a00640 1 -- 172.21.15.73:0/719627240 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e8147040 con 0x7f24e80c4320 2024-03-23T06:17:42.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.673+0000 7f24e6000640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24e80c4700 0x7f24e81f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:17:42.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.676+0000 7f24e6a00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24e80c4320 0x7f24e81f4220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24d8001de0 tx=0x7f24d8008560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:42.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.676+0000 7f24dea00640 1 -- 172.21.15.73:0/719627240 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800f8d0 con 0x7f24e80c4320 2024-03-23T06:17:42.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.676+0000 7f24dea00640 1 -- 172.21.15.73:0/719627240 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d800fa30 con 0x7f24e80c4320 2024-03-23T06:17:42.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.676+0000 7f24dea00640 1 -- 172.21.15.73:0/719627240 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800fda0 con 0x7f24e80c4320 2024-03-23T06:17:42.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.678+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e8147320 con 0x7f24e80c4320 2024-03-23T06:17:42.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.678+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e81f3a20 con 0x7f24e80c4320 2024-03-23T06:17:42.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.681+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e80c5600 con 0x7f24e80c4320 2024-03-23T06:17:42.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.684+0000 7f24dea00640 1 -- 172.21.15.73:0/719627240 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f24d80153e0 con 0x7f24e80c4320 2024-03-23T06:17:42.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.685+0000 7f24dea00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24c806acd0 0x7f24c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:42.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.685+0000 7f24dea00640 1 -- 172.21.15.73:0/719627240 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f24d8089930 con 0x7f24e80c4320 2024-03-23T06:17:42.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.686+0000 7f24e6000640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24c806acd0 0x7f24c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:42.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.687+0000 7f24e6000640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24c806acd0 0x7f24c806d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f24d4035000 tx=0x7f24d402f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:42.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:42.691+0000 7f24dea00640 1 -- 172.21.15.73:0/719627240 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f24d8054780 con 0x7f24e80c4320 2024-03-23T06:17:43.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.216+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f24e80b0cc0 con 0x7f24e80c4320 2024-03-23T06:17:43.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.218+0000 7f24dea00640 1 -- 172.21.15.73:0/719627240 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f24d8057da0 con 0x7f24e80c4320 2024-03-23T06:17:43.218 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:17:43.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.222+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24c806acd0 msgr2=0x7f24c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.222+0000 7f24edc00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24c806acd0 0x7f24c806d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f24d4035000 tx=0x7f24d402f000 comp rx=0 tx=0).stop 2024-03-23T06:17:43.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.222+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24e80c4320 msgr2=0x7f24e81f4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.222+0000 7f24edc00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24e80c4320 0x7f24e81f4220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24d8001de0 tx=0x7f24d8008560 comp rx=0 tx=0).stop 2024-03-23T06:17:43.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.223+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 shutdown_connections 2024-03-23T06:17:43.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.223+0000 7f24edc00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24e81f6ba0 0x7f24e8146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.223+0000 7f24edc00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24e80c4700 0x7f24e81f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.223+0000 7f24edc00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24c806acd0 0x7f24c806d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.223+0000 7f24edc00640 1 --2- 172.21.15.73:0/719627240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24e80c4320 0x7f24e81f4220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.223+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 >> 172.21.15.73:0/719627240 conn(0x7f24e806bb40 msgr2=0x7f24e80bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:43.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.224+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 shutdown_connections 2024-03-23T06:17:43.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.224+0000 7f24edc00640 1 -- 172.21.15.73:0/719627240 wait complete. 2024-03-23T06:17:43.269 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:17:43.269 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:17:43.269 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:17:43.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:17:43.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.640+0000 7f8602a00640 1 Processor -- start 2024-03-23T06:17:43.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.640+0000 7f8602a00640 1 -- start start 2024-03-23T06:17:43.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.642+0000 7f8602a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.642+0000 7f8602a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85fc0ca4d0 0x7f85fc0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.642+0000 7f8602a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc15d920 con 0x7f85fc0c8eb0 2024-03-23T06:17:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.642+0000 7f8602a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85fc0703e0 con 0x7f85fc0ca4d0 2024-03-23T06:17:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.642+0000 7f8602a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc15cac0 con 0x7f85fc1536c0 2024-03-23T06:17:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.643+0000 7f85fb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f85fc0ca4d0 0x7f85fc0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.643+0000 7f85fbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.643+0000 7f85fbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:42048/0 (socket says 172.21.15.73:42048) 2024-03-23T06:17:43.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.643+0000 7f85fbe00640 1 -- 172.21.15.73:0/3098662947 learned_addr learned my addr 172.21.15.73:0/3098662947 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:43.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.643+0000 7f8600a00640 1 --1- 172.21.15.73:0/3098662947 >> v1:172.21.15.110:6789/0 conn(0x7f85fc0c8eb0 0x7f85fc070e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:39608/0 (socket says 172.21.15.73:39608) 2024-03-23T06:17:43.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.643+0000 7f85fbe00640 1 -- 172.21.15.73:0/3098662947 >> v2:172.21.15.110:3300/0 conn(0x7f85fc0ca4d0 msgr2=0x7f85fc0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:43.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.643+0000 7f85fbe00640 1 --2- 172.21.15.73:0/3098662947 >> v2:172.21.15.110:3300/0 conn(0x7f85fc0ca4d0 0x7f85fc0caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.644+0000 7f85fbe00640 1 -- 172.21.15.73:0/3098662947 >> v1:172.21.15.110:6789/0 conn(0x7f85fc0c8eb0 legacy=0x7f85fc070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:43.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.644+0000 7f85fbe00640 1 -- 172.21.15.73:0/3098662947 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc15cd10 con 0x7f85fc1536c0 2024-03-23T06:17:43.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.644+0000 7f85fb400640 1 --2- 172.21.15.73:0/3098662947 >> v2:172.21.15.110:3300/0 conn(0x7f85fc0ca4d0 0x7f85fc0caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:17:43.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.648+0000 7f85fbe00640 1 --2- 172.21.15.73:0/3098662947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc159f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009870 tx=0x7f85ec02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cda49cf92dec2e67 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:43.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.649+0000 7f85faa00640 1 -- 172.21.15.73:0/3098662947 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec031640 con 0x7f85fc1536c0 2024-03-23T06:17:43.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.649+0000 7f85faa00640 1 -- 172.21.15.73:0/3098662947 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec0317a0 con 0x7f85fc1536c0 2024-03-23T06:17:43.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.649+0000 7f85faa00640 1 -- 172.21.15.73:0/3098662947 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec031b30 con 0x7f85fc1536c0 2024-03-23T06:17:43.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.650+0000 7f8602a00640 1 -- 172.21.15.73:0/3098662947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 msgr2=0x7f85fc159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.650+0000 7f8602a00640 1 --2- 172.21.15.73:0/3098662947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc159f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009870 tx=0x7f85ec02b8f0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.655+0000 7f8602a00640 1 -- 172.21.15.73:0/3098662947 shutdown_connections 2024-03-23T06:17:43.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.655+0000 7f8602a00640 1 --2- 172.21.15.73:0/3098662947 >> v2:172.21.15.110:3300/0 conn(0x7f85fc0ca4d0 0x7f85fc0caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.655+0000 7f8602a00640 1 --2- 172.21.15.73:0/3098662947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc159f00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.655+0000 7f8602a00640 1 -- 172.21.15.73:0/3098662947 >> 172.21.15.73:0/3098662947 conn(0x7f85fc069cb0 msgr2=0x7f85fc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:43.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.657+0000 7f8602a00640 1 -- 172.21.15.73:0/3098662947 shutdown_connections 2024-03-23T06:17:43.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.659+0000 7f8602a00640 1 -- 172.21.15.73:0/3098662947 wait complete. 2024-03-23T06:17:43.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.666+0000 7f8602a00640 1 Processor -- start 2024-03-23T06:17:43.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.667+0000 7f8602a00640 1 -- start start 2024-03-23T06:17:43.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.673+0000 7f8602a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85fc0c8eb0 0x7f85fc158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.674+0000 7f8602a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85fc0ca4d0 0x7f85fc157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:43.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.675+0000 7f8602a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc14ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:43.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.677+0000 7f8602a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc1f7510 con 0x7f85fc0c8eb0 2024-03-23T06:17:43.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.678+0000 7f8602a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc157ac0 con 0x7f85fc0ca4d0 2024-03-23T06:17:43.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.678+0000 7f8600a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc14ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:43.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.679+0000 7f8600a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc14ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:42052/0 (socket says 172.21.15.73:42052) 2024-03-23T06:17:43.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.679+0000 7f8600a00640 1 -- 172.21.15.73:0/804194623 learned_addr learned my addr 172.21.15.73:0/804194623 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:43.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.678+0000 7f85fbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85fc0c8eb0 0x7f85fc158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:43.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.680+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc0c5ae0 con 0x7f85fc1536c0 2024-03-23T06:17:43.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.680+0000 7f85fb400640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85fc0ca4d0 0x7f85fc157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:43.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.683+0000 7f8600a00640 1 -- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85fc0ca4d0 msgr2=0x7f85fc157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.683+0000 7f8600a00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85fc0ca4d0 0x7f85fc157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.683+0000 7f8600a00640 1 -- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85fc0c8eb0 msgr2=0x7f85fc158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.683+0000 7f8600a00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85fc0c8eb0 0x7f85fc158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.683+0000 7f8600a00640 1 -- 172.21.15.73:0/804194623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0094d0 con 0x7f85fc1536c0 2024-03-23T06:17:43.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.684+0000 7f8600a00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc14ebf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c750 tx=0x7f85f400cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.688+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400ce60 con 0x7f85fc1536c0 2024-03-23T06:17:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.688+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc1f6900 con 0x7f85fc1536c0 2024-03-23T06:17:43.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.688+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc1f6ec0 con 0x7f85fc1536c0 2024-03-23T06:17:43.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.688+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f400a640 con 0x7f85fc1536c0 2024-03-23T06:17:43.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.689+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400a9d0 con 0x7f85fc1536c0 2024-03-23T06:17:43.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.692+0000 7f8602a00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4002a30 0x7f85d4004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:43.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.692+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4007e80 con 0x7f85d4002a30 2024-03-23T06:17:43.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.696+0000 7f85fbe00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4002a30 0x7f85d4004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:43.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.706+0000 7f85fbe00640 1 -- 172.21.15.73:0/804194623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85d4008040 con 0x7f85d4002a30 2024-03-23T06:17:43.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.707+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f85f400ab30 con 0x7f85fc1536c0 2024-03-23T06:17:43.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.707+0000 7f85fbe00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4002a30 0x7f85d4004ef0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f85fc070bc0 tx=0x7f85ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:43.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.708+0000 7f85f3e00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f85dc06ac50 0x7f85dc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:43.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.709+0000 7f85fb400640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f85dc06ac50 0x7f85dc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:43.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.709+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec048070 con 0x7f85d4002a30 2024-03-23T06:17:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.710+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f85ec03a9b0 con 0x7f85d4002a30 2024-03-23T06:17:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.710+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4002a30 msgr2=0x7f85d4004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.710+0000 7f85f3e00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4002a30 0x7f85d4004ef0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f85fc070bc0 tx=0x7f85ec004730 comp rx=0 tx=0).stop 2024-03-23T06:17:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.710+0000 7f85fb400640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f85dc06ac50 0x7f85dc06d110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f85fc14bd60 tx=0x7f85e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.713+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4002a30 msgr2=0x7f85d4004ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:43.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.713+0000 7f85f3e00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4002a30 0x7f85d4004ef0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.713+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f85f4058190 con 0x7f85fc1536c0 2024-03-23T06:17:43.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.731+0000 7f8602a00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4006f60 0x7f85d40073f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:43.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.731+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4007960 con 0x7f85d4006f60 2024-03-23T06:17:43.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.734+0000 7f85fbe00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4006f60 0x7f85d40073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:43.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.737+0000 7f85fbe00640 1 -- 172.21.15.73:0/804194623 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f85d4007b20 con 0x7f85d4006f60 2024-03-23T06:17:43.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.739+0000 7f85fbe00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4006f60 0x7f85d40073f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85ec02b930 tx=0x7f85ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:43.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.742+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec04d640 con 0x7f85d4006f60 2024-03-23T06:17:43.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.742+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4951 (secure 0 0 0) 0x7f85ec051070 con 0x7f85d4006f60 2024-03-23T06:17:43.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.742+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4006f60 msgr2=0x7f85d40073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.742+0000 7f85f3e00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4006f60 0x7f85d40073f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85ec02b930 tx=0x7f85ec0046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.742+0000 7f85f3e00640 1 -- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4006f60 msgr2=0x7f85d40073f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:43.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.742+0000 7f85f3e00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85d4006f60 0x7f85d40073f0 secure :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85ec02b930 tx=0x7f85ec0046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:43.743 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:17:43.743 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:17:43.743 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 76, 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 18, 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:43.744 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:43.745 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:17:43.746 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:43.747 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:43.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:17:43.749 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.751 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:43.753 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:17:43.755 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:17:43.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.744+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f85dc06ac50 msgr2=0x7f85dc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.744+0000 7f8602a00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f85dc06ac50 0x7f85dc06d110 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f85fc14bd60 tx=0x7f85e8008040 comp rx=0 tx=0).stop 2024-03-23T06:17:43.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.744+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 msgr2=0x7f85fc14ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:43.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.744+0000 7f8602a00640 1 --2- 172.21.15.73:0/804194623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85fc1536c0 0x7f85fc14ebf0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85f400c750 tx=0x7f85f400cc10 comp rx=0 tx=0).stop 2024-03-23T06:17:43.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.748+0000 7f8600a00640 1 -- 172.21.15.73:0/804194623 reap_dead start 2024-03-23T06:17:43.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.748+0000 7f8600a00640 1 -- 172.21.15.73:0/804194623 reap_dead start 2024-03-23T06:17:43.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.748+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 shutdown_connections 2024-03-23T06:17:43.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.748+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 >> 172.21.15.73:0/804194623 conn(0x7f85fc069cb0 msgr2=0x7f85fc0caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:43.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.750+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 shutdown_connections 2024-03-23T06:17:43.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:43.750+0000 7f8602a00640 1 -- 172.21.15.73:0/804194623 wait complete. 2024-03-23T06:17:43.812 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:17:43.812 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:17:43.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:17:44.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.211+0000 7f9bf7c00640 1 Processor -- start 2024-03-23T06:17:44.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.211+0000 7f9bf7c00640 1 -- start start 2024-03-23T06:17:44.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.212+0000 7f9bf7c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf00b1c40 0x7f9bf00cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.212+0000 7f9bf7c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf00b2460 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.212+0000 7f9bf7c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf00c9e60 con 0x7f9bf01537b0 2024-03-23T06:17:44.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.212+0000 7f9bf7c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00ca140 con 0x7f9bf00b1c40 2024-03-23T06:17:44.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.213+0000 7f9befe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9bf01537b0 0x7f9bf0161e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:39620/0 (socket says 172.21.15.73:39620) 2024-03-23T06:17:44.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.213+0000 7f9befe00640 1 -- 172.21.15.73:0/643983757 learned_addr learned my addr 172.21.15.73:0/643983757 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:17:44.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.213+0000 7f9bf5c00640 1 --2- 172.21.15.73:0/643983757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf00b1c40 0x7f9bf00cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.213+0000 7f9bf5c00640 1 -- 172.21.15.73:0/643983757 >> v1:172.21.15.110:6789/0 conn(0x7f9bf01537b0 legacy=0x7f9bf0161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.213+0000 7f9bf5c00640 1 -- 172.21.15.73:0/643983757 >> v1:172.21.15.73:6789/0 conn(0x7f9bf00ca7d0 legacy=0x7f9bf006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.213+0000 7f9bf5c00640 1 -- 172.21.15.73:0/643983757 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf01596f0 con 0x7f9bf00b1c40 2024-03-23T06:17:44.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.214+0000 7f9bf5c00640 1 --2- 172.21.15.73:0/643983757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf00b1c40 0x7f9bf00cabb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009dc0 tx=0x7f9be802be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b74e077dea80128 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.215+0000 7f9bef400640 1 -- 172.21.15.73:0/643983757 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be802cc30 con 0x7f9bf00b1c40 2024-03-23T06:17:44.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.215+0000 7f9bef400640 1 -- 172.21.15.73:0/643983757 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be802cd90 con 0x7f9bf00b1c40 2024-03-23T06:17:44.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.215+0000 7f9bef400640 1 -- 172.21.15.73:0/643983757 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8034660 con 0x7f9bf00b1c40 2024-03-23T06:17:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.216+0000 7f9bf7c00640 1 -- 172.21.15.73:0/643983757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf00b1c40 msgr2=0x7f9bf00cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.216+0000 7f9bf7c00640 1 --2- 172.21.15.73:0/643983757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf00b1c40 0x7f9bf00cabb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009dc0 tx=0x7f9be802be80 comp rx=0 tx=0).stop 2024-03-23T06:17:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.216+0000 7f9bf7c00640 1 -- 172.21.15.73:0/643983757 shutdown_connections 2024-03-23T06:17:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.216+0000 7f9bf7c00640 1 --2- 172.21.15.73:0/643983757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf00b1c40 0x7f9bf00cabb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.216+0000 7f9bf7c00640 1 -- 172.21.15.73:0/643983757 >> 172.21.15.73:0/643983757 conn(0x7f9bf0071800 msgr2=0x7f9bf0071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.217+0000 7f9bf7c00640 1 -- 172.21.15.73:0/643983757 shutdown_connections 2024-03-23T06:17:44.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.217+0000 7f9bf7c00640 1 -- 172.21.15.73:0/643983757 wait complete. 2024-03-23T06:17:44.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.220+0000 7f9bf7c00640 1 Processor -- start 2024-03-23T06:17:44.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.221+0000 7f9bf7c00640 1 -- start start 2024-03-23T06:17:44.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.222+0000 7f9bf7c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf00b1c40 0x7f9bf00ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.222+0000 7f9bf7c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf00ca7d0 0x7f9bf00c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.223+0000 7f9bf7c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf01528b0 0x7f9bf01ff370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.223+0000 7f9bf7c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf01fc5f0 con 0x7f9bf00b1c40 2024-03-23T06:17:44.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.223+0000 7f9bf7c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf01e5740 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.223+0000 7f9bf5c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf01528b0 0x7f9bf01ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.223+0000 7f9bf7c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00cf040 con 0x7f9bf01528b0 2024-03-23T06:17:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.223+0000 7f9bf5c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf01528b0 0x7f9bf01ff370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:42064/0 (socket says 172.21.15.73:42064) 2024-03-23T06:17:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.223+0000 7f9bf5c00640 1 -- 172.21.15.73:0/3618815620 learned_addr learned my addr 172.21.15.73:0/3618815620 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.224+0000 7f9bf5200640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf00b1c40 0x7f9bf00ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.224+0000 7f9befe00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf00ca7d0 0x7f9bf00c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.224+0000 7f9befe00640 1 -- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf01528b0 msgr2=0x7f9bf01ff370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.224+0000 7f9befe00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf01528b0 0x7f9bf01ff370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.225+0000 7f9befe00640 1 -- 172.21.15.73:0/3618815620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf00b1c40 msgr2=0x7f9bf00ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.225+0000 7f9befe00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf00b1c40 0x7f9bf00ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.225+0000 7f9befe00640 1 -- 172.21.15.73:0/3618815620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8009a70 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.225+0000 7f9bf5200640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bf00b1c40 0x7f9bf00ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:17:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.225+0000 7f9befe00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf00ca7d0 0x7f9bf00c4f10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9be0000f60 tx=0x7f9be000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.226+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0005ce0 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.226+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf01517e0 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.226+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf01e5460 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.226+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be0005e40 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.226+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be00072d0 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.228+0000 7f9bf7c00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf01537b0 0x7f9bf01fbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.228+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf0072510 con 0x7f9bf01537b0 2024-03-23T06:17:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.228+0000 7f9bf5200640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf01537b0 0x7f9bf01fbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.229+0000 7f9bf5200640 1 -- 172.21.15.73:0/3618815620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bf0159f90 con 0x7f9bf01537b0 2024-03-23T06:17:44.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.231+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9be0007430 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.233+0000 7f9becc00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bd406ac00 0x7f9bd406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.234+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f9be0088b90 con 0x7f9bf00ca7d0 2024-03-23T06:17:44.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.234+0000 7f9bf5c00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bd406ac00 0x7f9bd406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.235+0000 7f9bf5c00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bd406ac00 0x7f9bd406d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0152d00 tx=0x7f9be8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.237+0000 7f9bf5200640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf01537b0 0x7f9bf01fbe00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9be400fb10 tx=0x7f9be4001cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.238+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be40052e0 con 0x7f9bf01537b0 2024-03-23T06:17:44.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.238+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f9be4005440 con 0x7f9bf01537b0 2024-03-23T06:17:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.238+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf01537b0 msgr2=0x7f9bf01fbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.238+0000 7f9becc00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf01537b0 0x7f9bf01fbe00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9be400fb10 tx=0x7f9be4001cf0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.238+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf01537b0 msgr2=0x7f9bf01fbe00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:44.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.238+0000 7f9becc00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf01537b0 0x7f9bf01fbe00 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9be400fb10 tx=0x7f9be4001cf0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.250+0000 7f9bf7c00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf014f6e0 0x7f9bf01ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.250+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf00b1530 con 0x7f9bf014f6e0 2024-03-23T06:17:44.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.251+0000 7f9bf5200640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf014f6e0 0x7f9bf01ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.258+0000 7f9bf5200640 1 -- 172.21.15.73:0/3618815620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9bf0159cb0 con 0x7f9bf014f6e0 2024-03-23T06:17:44.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.259+0000 7f9bf5200640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf014f6e0 0x7f9bf01ff8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9be4017000 tx=0x7f9be40010c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.260+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4024070 con 0x7f9bf014f6e0 2024-03-23T06:17:44.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.260+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4976 (secure 0 0 0) 0x7f9be4003d80 con 0x7f9bf014f6e0 2024-03-23T06:17:44.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.260+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf014f6e0 msgr2=0x7f9bf01ff8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 76, 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:17:44.261 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 18, 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:44.262 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:44.263 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:17:44.264 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:44.265 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:44.266 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.267 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.268 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.269 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:44.270 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.271 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:44.272 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:17:44.273 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:17:44.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.260+0000 7f9becc00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf014f6e0 0x7f9bf01ff8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9be4017000 tx=0x7f9be40010c0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.260+0000 7f9becc00640 1 -- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf014f6e0 msgr2=0x7f9bf01ff8b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:44.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.260+0000 7f9becc00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf014f6e0 0x7f9bf01ff8b0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9be4017000 tx=0x7f9be40010c0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bd406ac00 msgr2=0x7f9bd406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf7c00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9bd406ac00 0x7f9bd406d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0152d00 tx=0x7f9be8030000 comp rx=0 tx=0).stop 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf00ca7d0 msgr2=0x7f9bf00c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf7c00640 1 --2- 172.21.15.73:0/3618815620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf00ca7d0 0x7f9bf00c4f10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9be0000f60 tx=0x7f9be000c760 comp rx=0 tx=0).stop 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf5c00640 1 -- 172.21.15.73:0/3618815620 reap_dead start 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf5c00640 1 -- 172.21.15.73:0/3618815620 reap_dead start 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 shutdown_connections 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 >> 172.21.15.73:0/3618815620 conn(0x7f9bf0071800 msgr2=0x7f9bf0150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.272+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 shutdown_connections 2024-03-23T06:17:44.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.273+0000 7f9bf7c00640 1 -- 172.21.15.73:0/3618815620 wait complete. 2024-03-23T06:17:44.328 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:17:44.328 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:17:44.328 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:17:44.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.611+0000 7f846cc00640 1 Processor -- start 2024-03-23T06:17:44.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.611+0000 7f846cc00640 1 -- start start 2024-03-23T06:17:44.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.613+0000 7f846cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cbe20 0x7f84680c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.613+0000 7f846cc00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846815e700 con 0x7f84680cba40 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.613+0000 7f846cc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84680c9e60 con 0x7f84680ca290 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.613+0000 7f846cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680c9c80 con 0x7f84680cbe20 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.613+0000 7f8466800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f84680ca290 0x7f846806a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:39628/0 (socket says 172.21.15.73:39628) 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.613+0000 7f8466800640 1 -- 172.21.15.73:0/4180013020 learned_addr learned my addr 172.21.15.73:0/4180013020 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.613+0000 7f8465400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cbe20 0x7f84680c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.614+0000 7f8465400640 1 -- 172.21.15.73:0/4180013020 >> v1:172.21.15.110:6789/0 conn(0x7f84680ca290 legacy=0x7f846806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.614+0000 7f8465400640 1 -- 172.21.15.73:0/4180013020 >> v1:172.21.15.73:6789/0 conn(0x7f84680cba40 legacy=0x7f8468157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.614+0000 7f8465400640 1 -- 172.21.15.73:0/4180013020 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846815daf0 con 0x7f84680cbe20 2024-03-23T06:17:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.623+0000 7f8465400640 1 --2- 172.21.15.73:0/4180013020 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cbe20 0x7f84680c9740 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84580097d0 tx=0x7f845802b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22264770f59fde58 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.626+0000 7f8464a00640 1 -- 172.21.15.73:0/4180013020 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458031770 con 0x7f84680cbe20 2024-03-23T06:17:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.626+0000 7f8464a00640 1 -- 172.21.15.73:0/4180013020 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84580318d0 con 0x7f84680cbe20 2024-03-23T06:17:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.626+0000 7f8464a00640 1 -- 172.21.15.73:0/4180013020 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8458031c60 con 0x7f84680cbe20 2024-03-23T06:17:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.627+0000 7f846cc00640 1 -- 172.21.15.73:0/4180013020 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cbe20 msgr2=0x7f84680c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.627+0000 7f846cc00640 1 --2- 172.21.15.73:0/4180013020 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cbe20 0x7f84680c9740 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84580097d0 tx=0x7f845802b810 comp rx=0 tx=0).stop 2024-03-23T06:17:44.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.627+0000 7f846cc00640 1 -- 172.21.15.73:0/4180013020 shutdown_connections 2024-03-23T06:17:44.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.627+0000 7f846cc00640 1 --2- 172.21.15.73:0/4180013020 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cbe20 0x7f84680c9740 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.627+0000 7f846cc00640 1 -- 172.21.15.73:0/4180013020 >> 172.21.15.73:0/4180013020 conn(0x7f846806c310 msgr2=0x7f84680713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:44.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.628+0000 7f846cc00640 1 -- 172.21.15.73:0/4180013020 shutdown_connections 2024-03-23T06:17:44.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.629+0000 7f846cc00640 1 -- 172.21.15.73:0/4180013020 wait complete. 2024-03-23T06:17:44.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.632+0000 7f846cc00640 1 Processor -- start 2024-03-23T06:17:44.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.632+0000 7f846cc00640 1 -- start start 2024-03-23T06:17:44.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.633+0000 7f846cc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84680ca290 0x7f8468154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.633+0000 7f846cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cba40 0x7f84681f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.633+0000 7f846cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84680cbe20 0x7f84680c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.634+0000 7f846cc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846814da10 con 0x7f84680ca290 2024-03-23T06:17:44.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.634+0000 7f846cc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8468153790 con 0x7f84680cbe20 2024-03-23T06:17:44.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.634+0000 7f846cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84680b3eb0 con 0x7f84680cba40 2024-03-23T06:17:44.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.634+0000 7f8465400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cba40 0x7f84681f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.634+0000 7f8465400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cba40 0x7f84681f4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:42090/0 (socket says 172.21.15.73:42090) 2024-03-23T06:17:44.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.634+0000 7f8465400640 1 -- 172.21.15.73:0/3199144846 learned_addr learned my addr 172.21.15.73:0/3199144846 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:44.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.634+0000 7f8466800640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84680cbe20 0x7f84680c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.635+0000 7f8465e00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84680ca290 0x7f8468154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.635+0000 7f8466800640 1 -- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cba40 msgr2=0x7f84681f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.635+0000 7f8466800640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84680cba40 0x7f84681f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.635+0000 7f8466800640 1 -- 172.21.15.73:0/3199144846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84680ca290 msgr2=0x7f8468154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.635+0000 7f8466800640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84680ca290 0x7f8468154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.635+0000 7f8466800640 1 -- 172.21.15.73:0/3199144846 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458009400 con 0x7f84680cbe20 2024-03-23T06:17:44.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.635+0000 7f8466800640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84680cbe20 0x7f84680c8930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f845400b410 tx=0x7f845400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.636+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454011830 con 0x7f84680cbe20 2024-03-23T06:17:44.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.636+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84540119b0 con 0x7f84680cbe20 2024-03-23T06:17:44.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.636+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454011d60 con 0x7f84680cbe20 2024-03-23T06:17:44.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.636+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8468152730 con 0x7f84680cbe20 2024-03-23T06:17:44.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.637+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8468152cb0 con 0x7f84680cbe20 2024-03-23T06:17:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.638+0000 7f846cc00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84681f4fb0 0x7f84680c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.638+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8468072510 con 0x7f84681f4fb0 2024-03-23T06:17:44.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.638+0000 7f8465e00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84681f4fb0 0x7f84680c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.639+0000 7f8465e00640 1 -- 172.21.15.73:0/3199144846 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f846815e390 con 0x7f84681f4fb0 2024-03-23T06:17:44.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.639+0000 7f8465e00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84681f4fb0 0x7f84680c8e70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f846000f8e0 tx=0x7f846000fda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.640+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f845401a400 con 0x7f84680cbe20 2024-03-23T06:17:44.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.641+0000 7f845e000640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844806ac80 0x7f844806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.642+0000 7f8465400640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844806ac80 0x7f844806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.642+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f84540895f0 con 0x7f84680cbe20 2024-03-23T06:17:44.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.643+0000 7f8465400640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844806ac80 0x7f844806d140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8468153940 tx=0x7f845803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.643+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460003c40 con 0x7f84681f4fb0 2024-03-23T06:17:44.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.643+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f8460003da0 con 0x7f84681f4fb0 2024-03-23T06:17:44.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.643+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84681f4fb0 msgr2=0x7f84680c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.643+0000 7f845e000640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84681f4fb0 0x7f84680c8e70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f846000f8e0 tx=0x7f846000fda0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.643+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84681f4fb0 msgr2=0x7f84680c8e70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:44.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.643+0000 7f845e000640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84681f4fb0 0x7f84680c8e70 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f846000f8e0 tx=0x7f846000fda0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.655+0000 7f846cc00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8468152ea0 0x7f84681f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.656+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846815e0b0 con 0x7f8468152ea0 2024-03-23T06:17:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.656+0000 7f8465e00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8468152ea0 0x7f84681f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.656+0000 7f8465e00640 1 -- 172.21.15.73:0/3199144846 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f84680ca720 con 0x7f8468152ea0 2024-03-23T06:17:44.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.657+0000 7f8465e00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8468152ea0 0x7f84681f6de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f846000f8e0 tx=0x7f84600013a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.657+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460024070 con 0x7f8468152ea0 2024-03-23T06:17:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.657+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7f8460006de0 con 0x7f8468152ea0 2024-03-23T06:17:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.657+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8468152ea0 msgr2=0x7f84681f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.657+0000 7f845e000640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8468152ea0 0x7f84681f6de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f846000f8e0 tx=0x7f84600013a0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.657+0000 7f845e000640 1 -- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8468152ea0 msgr2=0x7f84681f6de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:17:44.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.657+0000 7f845e000640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8468152ea0 0x7f84681f6de0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f846000f8e0 tx=0x7f84600013a0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 76, 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:17:44.658 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 19, 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:44.659 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:44.660 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:17:44.661 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:17:44.662 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.663 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.664 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.665 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.666 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:17:44.667 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:17:44.668 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.658+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844806ac80 msgr2=0x7f844806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.658+0000 7f846cc00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844806ac80 0x7f844806d140 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8468153940 tx=0x7f845803d040 comp rx=0 tx=0).stop 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.658+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84680cbe20 msgr2=0x7f84680c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:44.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.658+0000 7f846cc00640 1 --2- 172.21.15.73:0/3199144846 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84680cbe20 0x7f84680c8930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f845400b410 tx=0x7f845400b8d0 comp rx=0 tx=0).stop 2024-03-23T06:17:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.659+0000 7f8466800640 1 -- 172.21.15.73:0/3199144846 reap_dead start 2024-03-23T06:17:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.659+0000 7f8466800640 1 -- 172.21.15.73:0/3199144846 reap_dead start 2024-03-23T06:17:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.659+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 shutdown_connections 2024-03-23T06:17:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.659+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 >> 172.21.15.73:0/3199144846 conn(0x7f846806c310 msgr2=0x7f8468159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.659+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 shutdown_connections 2024-03-23T06:17:44.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:44.659+0000 7f846cc00640 1 -- 172.21.15.73:0/3199144846 wait complete. 2024-03-23T06:17:44.687 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:17:44.687 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T06:17:44.687 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T06:17:44.687 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T06:17:44.687 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T06:17:44.687 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T06:17:44.687 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:17:44.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:17:44.725 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:17:44.750 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T06:17:44.750 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:17:44.750 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:17:45.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.115+0000 7f531dc00640 1 Processor -- start 2024-03-23T06:17:45.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.115+0000 7f531dc00640 1 -- start start 2024-03-23T06:17:45.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.117+0000 7f531dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53180c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.117+0000 7f531dc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f531815c950 0x7f5318159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.118+0000 7f5317e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53180c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.118+0000 7f5317e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53180c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:42138/0 (socket says 172.21.15.73:42138) 2024-03-23T06:17:45.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.118+0000 7f531dc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f531815a080 0x7f53180bc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:45.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.118+0000 7f5317e00640 1 -- 172.21.15.73:0/1230539674 learned_addr learned my addr 172.21.15.73:0/1230539674 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:45.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.118+0000 7f531d200640 1 -- 172.21.15.73:0/1230539674 >> v2:172.21.15.73:3300/0 conn(0x7f531815a080 msgr2=0x7f53180bc2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.118+0000 7f531d200640 1 --2- 172.21.15.73:0/1230539674 >> v2:172.21.15.73:3300/0 conn(0x7f531815a080 0x7f53180bc2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:17:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.118+0000 7f531dc00640 1 -- 172.21.15.73:0/1230539674 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5318153b00 con 0x7f531815a080 2024-03-23T06:17:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.119+0000 7f531dc00640 1 -- 172.21.15.73:0/1230539674 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53180bce20 con 0x7f531815c950 2024-03-23T06:17:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.119+0000 7f531dc00640 1 -- 172.21.15.73:0/1230539674 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5318159360 con 0x7f5318153720 2024-03-23T06:17:45.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.120+0000 7f5317400640 1 --2- 172.21.15.73:0/1230539674 >> v2:172.21.15.110:3300/0 conn(0x7f531815c950 0x7f5318159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:45.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.121+0000 7f5317400640 1 -- 172.21.15.73:0/1230539674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 msgr2=0x7f53180c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:45.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.121+0000 7f5317400640 1 --2- 172.21.15.73:0/1230539674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53180c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.121+0000 7f5317400640 1 -- 172.21.15.73:0/1230539674 >> v2:172.21.15.73:3300/0 conn(0x7f531815a080 msgr2=0x7f53180bc2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:17:45.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.121+0000 7f5317400640 1 --2- 172.21.15.73:0/1230539674 >> v2:172.21.15.73:3300/0 conn(0x7f531815a080 0x7f53180bc2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.121+0000 7f5317400640 1 -- 172.21.15.73:0/1230539674 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531815ce90 con 0x7f531815c950 2024-03-23T06:17:45.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.123+0000 7f5317e00640 1 --2- 172.21.15.73:0/1230539674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53180c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:17:45.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.123+0000 7f5317400640 1 --2- 172.21.15.73:0/1230539674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f531815c950 0x7f5318159b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f531806e200 tx=0x7f530802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57b95958b44dbf4f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:45.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.125+0000 7f5316a00640 1 -- 172.21.15.73:0/1230539674 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080317e0 con 0x7f531815c950 2024-03-23T06:17:45.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.125+0000 7f5316a00640 1 -- 172.21.15.73:0/1230539674 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308031940 con 0x7f531815c950 2024-03-23T06:17:45.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.125+0000 7f5316a00640 1 -- 172.21.15.73:0/1230539674 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308031cb0 con 0x7f531815c950 2024-03-23T06:17:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.126+0000 7f531dc00640 1 -- 172.21.15.73:0/1230539674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f531815c950 msgr2=0x7f5318159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:45.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.126+0000 7f531dc00640 1 --2- 172.21.15.73:0/1230539674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f531815c950 0x7f5318159b40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f531806e200 tx=0x7f530802b880 comp rx=0 tx=0).stop 2024-03-23T06:17:45.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.129+0000 7f531dc00640 1 -- 172.21.15.73:0/1230539674 shutdown_connections 2024-03-23T06:17:45.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.129+0000 7f531dc00640 1 --2- 172.21.15.73:0/1230539674 >> v2:172.21.15.73:3300/0 conn(0x7f531815a080 0x7f53180bc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.129+0000 7f531dc00640 1 --2- 172.21.15.73:0/1230539674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f531815c950 0x7f5318159b40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.129+0000 7f531dc00640 1 --2- 172.21.15.73:0/1230539674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53180c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.129+0000 7f531dc00640 1 -- 172.21.15.73:0/1230539674 >> 172.21.15.73:0/1230539674 conn(0x7f5318069cb0 msgr2=0x7f531806a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:45.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.129+0000 7f531dc00640 1 -- 172.21.15.73:0/1230539674 shutdown_connections 2024-03-23T06:17:45.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.129+0000 7f531dc00640 1 -- 172.21.15.73:0/1230539674 wait complete. 2024-03-23T06:17:45.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.134+0000 7f531dc00640 1 Processor -- start 2024-03-23T06:17:45.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.134+0000 7f531dc00640 1 -- start start 2024-03-23T06:17:45.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.136+0000 7f531dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53181444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:45.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.136+0000 7f531dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f531815a080 0x7f531815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.136+0000 7f5317e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53181444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.136+0000 7f5317e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53181444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:42152/0 (socket says 172.21.15.73:42152) 2024-03-23T06:17:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.136+0000 7f5317e00640 1 -- 172.21.15.73:0/2771301732 learned_addr learned my addr 172.21.15.73:0/2771301732 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.137+0000 7f531dc00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f531815c950 0x7f531815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.137+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53181eec60 con 0x7f531815c950 2024-03-23T06:17:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.137+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53181f3140 con 0x7f531815a080 2024-03-23T06:17:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.137+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53181eee70 con 0x7f5318153720 2024-03-23T06:17:45.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.137+0000 7f531d200640 1 -- 172.21.15.73:0/2771301732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f531815c950 msgr2=0x7f531815ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.137+0000 7f531d200640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f531815c950 0x7f531815ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:17:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.138+0000 7f5317e00640 1 -- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f531815a080 msgr2=0x7f531815a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.138+0000 7f5317e00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f531815a080 0x7f531815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.138+0000 7f5317e00640 1 -- 172.21.15.73:0/2771301732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f531815c950 msgr2=0x7f531815ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:17:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.138+0000 7f5317e00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f531815c950 0x7f531815ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.138+0000 7f5317e00640 1 -- 172.21.15.73:0/2771301732 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308009400 con 0x7f5318153720 2024-03-23T06:17:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.138+0000 7f5317e00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53181444d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f531000a950 tx=0x7f531000ae10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.139+0000 7f530fe00640 1 -- 172.21.15.73:0/2771301732 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310015a40 con 0x7f5318153720 2024-03-23T06:17:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.139+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53181ef110 con 0x7f5318153720 2024-03-23T06:17:45.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.139+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53181ef6d0 con 0x7f5318153720 2024-03-23T06:17:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.141+0000 7f530fe00640 1 -- 172.21.15.73:0/2771301732 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310015ba0 con 0x7f5318153720 2024-03-23T06:17:45.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.141+0000 7f530fe00640 1 -- 172.21.15.73:0/2771301732 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531001d440 con 0x7f5318153720 2024-03-23T06:17:45.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.143+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f0005250 con 0x7f5318153720 2024-03-23T06:17:45.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.146+0000 7f530fe00640 1 -- 172.21.15.73:0/2771301732 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f531000b040 con 0x7f5318153720 2024-03-23T06:17:45.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.148+0000 7f530fe00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f52f806abe0 0x7f52f806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:45.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.148+0000 7f530fe00640 1 -- 172.21.15.73:0/2771301732 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5310091f10 con 0x7f5318153720 2024-03-23T06:17:45.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.148+0000 7f5317400640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f52f806abe0 0x7f52f806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:45.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.150+0000 7f5317400640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f52f806abe0 0x7f52f806d0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5308036000 tx=0x7f5308030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:45.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.156+0000 7f530fe00640 1 -- 172.21.15.73:0/2771301732 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f531005cda0 con 0x7f5318153720 2024-03-23T06:17:45.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.747+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f52f0005500 con 0x7f5318153720 2024-03-23T06:17:45.750 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:17:45.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.748+0000 7f530fe00640 1 -- 172.21.15.73:0/2771301732 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f5310022070 con 0x7f5318153720 2024-03-23T06:17:45.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.753+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f52f806abe0 msgr2=0x7f52f806d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:45.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.753+0000 7f531dc00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f52f806abe0 0x7f52f806d0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5308036000 tx=0x7f5308030000 comp rx=0 tx=0).stop 2024-03-23T06:17:45.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.753+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 msgr2=0x7f53181444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.753+0000 7f531dc00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53181444d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f531000a950 tx=0x7f531000ae10 comp rx=0 tx=0).stop 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.754+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 shutdown_connections 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.754+0000 7f531dc00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f531815c950 0x7f531815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.754+0000 7f531dc00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f531815a080 0x7f531815a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.754+0000 7f531dc00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f52f806abe0 0x7f52f806d0a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.754+0000 7f531dc00640 1 --2- 172.21.15.73:0/2771301732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5318153720 0x7f53181444d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.754+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 >> 172.21.15.73:0/2771301732 conn(0x7f5318069cb0 msgr2=0x7f53181581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.758+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 shutdown_connections 2024-03-23T06:17:45.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:45.758+0000 7f531dc00640 1 -- 172.21.15.73:0/2771301732 wait complete. 2024-03-23T06:17:48.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:17:49.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.224+0000 7f46a6600640 1 Processor -- start 2024-03-23T06:17:49.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.224+0000 7f46a6600640 1 -- start start 2024-03-23T06:17:49.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.226+0000 7f46a6600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a0072520 0x7f46a01661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:49.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.226+0000 7f46a6600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f46a00c0450 0x7f46a006da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:49.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.226+0000 7f46a6600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46a00c66f0 0x7f46a00c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:49.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.226+0000 7f46a6600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a01671a0 con 0x7f46a00c0450 2024-03-23T06:17:49.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.226+0000 7f46a6600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a01666e0 con 0x7f46a00c66f0 2024-03-23T06:17:49.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.226+0000 7f46a6600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0072900 con 0x7f46a0072520 2024-03-23T06:17:49.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.228+0000 7f469ea00640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f46a00c0450 msgr2=0x7f46a006da10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:49.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.228+0000 7f469fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46a00c66f0 0x7f46a00c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:49.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.228+0000 7f469fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46a00c66f0 0x7f46a00c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37398/0 (socket says 172.21.15.73:37398) 2024-03-23T06:17:49.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.228+0000 7f469fe00640 1 -- 172.21.15.73:0/1558486330 learned_addr learned my addr 172.21.15.73:0/1558486330 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:49.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.229+0000 7f469fe00640 1 -- 172.21.15.73:0/1558486330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a0072520 msgr2=0x7f46a01661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:17:49.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.229+0000 7f469fe00640 1 --2- 172.21.15.73:0/1558486330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a0072520 0x7f46a01661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.229+0000 7f469fe00640 1 -- 172.21.15.73:0/1558486330 >> v2:172.21.15.73:3300/0 conn(0x7f46a00c0450 msgr2=0x7f46a006da10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:17:49.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.229+0000 7f469ea00640 1 --2- 172.21.15.73:0/1558486330 >> v2:172.21.15.73:3300/0 conn(0x7f46a00c0450 0x7f46a006da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:17:49.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.229+0000 7f469fe00640 1 --2- 172.21.15.73:0/1558486330 >> v2:172.21.15.73:3300/0 conn(0x7f46a00c0450 0x7f46a006da10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.229+0000 7f469fe00640 1 -- 172.21.15.73:0/1558486330 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a0070770 con 0x7f46a00c66f0 2024-03-23T06:17:49.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.233+0000 7f469fe00640 1 --2- 172.21.15.73:0/1558486330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 0x7f46a00c7590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46a00c64a0 tx=0x7f468c02dfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4924aacfe80321c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.234+0000 7f469e000640 1 -- 172.21.15.73:0/1558486330 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c02ed80 con 0x7f46a00c66f0 2024-03-23T06:17:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.234+0000 7f469e000640 1 -- 172.21.15.73:0/1558486330 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c032070 con 0x7f46a00c66f0 2024-03-23T06:17:49.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.234+0000 7f469e000640 1 -- 172.21.15.73:0/1558486330 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c02ed80 con 0x7f46a00c66f0 2024-03-23T06:17:49.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.237+0000 7f46a6600640 1 -- 172.21.15.73:0/1558486330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 msgr2=0x7f46a00c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:49.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.237+0000 7f46a6600640 1 --2- 172.21.15.73:0/1558486330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 0x7f46a00c7590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46a00c64a0 tx=0x7f468c02dfd0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.237+0000 7f46a6600640 1 -- 172.21.15.73:0/1558486330 shutdown_connections 2024-03-23T06:17:49.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.237+0000 7f46a6600640 1 --2- 172.21.15.73:0/1558486330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 0x7f46a00c7590 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.237+0000 7f46a6600640 1 --2- 172.21.15.73:0/1558486330 >> v2:172.21.15.73:3300/0 conn(0x7f46a00c0450 0x7f46a006da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.237+0000 7f46a6600640 1 --2- 172.21.15.73:0/1558486330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a0072520 0x7f46a01661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.237+0000 7f46a6600640 1 -- 172.21.15.73:0/1558486330 >> 172.21.15.73:0/1558486330 conn(0x7f46a006bb40 msgr2=0x7f46a006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:49.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.238+0000 7f46a6600640 1 -- 172.21.15.73:0/1558486330 shutdown_connections 2024-03-23T06:17:49.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.238+0000 7f46a6600640 1 -- 172.21.15.73:0/1558486330 wait complete. 2024-03-23T06:17:49.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.243+0000 7f46a6600640 1 Processor -- start 2024-03-23T06:17:49.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.243+0000 7f46a6600640 1 -- start start 2024-03-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.250+0000 7f46a6600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0072520 0x7f46a0165490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.251+0000 7f469f400640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0072520 msgr2=0x7f46a0165490 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.251+0000 7f469f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0072520 0x7f46a0165490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.251+0000 7f46a6600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a00c0450 0x7f46a01fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:49.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.251+0000 7f46a6600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 0x7f46a01fd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:49.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.252+0000 7f469ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a00c0450 0x7f46a01fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:49.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.252+0000 7f469ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a00c0450 0x7f46a01fcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:42174/0 (socket says 172.21.15.73:42174) 2024-03-23T06:17:49.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.253+0000 7f469fe00640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 0x7f46a01fd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:49.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.253+0000 7f469ea00640 1 -- 172.21.15.73:0/2634892910 learned_addr learned my addr 172.21.15.73:0/2634892910 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:49.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.257+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0163e70 con 0x7f46a0072520 2024-03-23T06:17:49.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.257+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0164110 con 0x7f46a00c66f0 2024-03-23T06:17:49.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.257+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01643d0 con 0x7f46a00c0450 2024-03-23T06:17:49.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.258+0000 7f469ea00640 1 -- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 msgr2=0x7f46a01fd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:49.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.258+0000 7f469ea00640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 0x7f46a01fd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.258+0000 7f469ea00640 1 -- 172.21.15.73:0/2634892910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0072520 msgr2=0x7f46a0165490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:17:49.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.258+0000 7f469ea00640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0072520 0x7f46a0165490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.258+0000 7f469ea00640 1 -- 172.21.15.73:0/2634892910 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c008550 con 0x7f46a00c0450 2024-03-23T06:17:49.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.258+0000 7f469ea00640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a00c0450 0x7f46a01fcb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f469000b9d0 tx=0x7f469000be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:49.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.259+0000 7f4697400640 1 -- 172.21.15.73:0/2634892910 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469000cda0 con 0x7f46a00c0450 2024-03-23T06:17:49.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.259+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a01646b0 con 0x7f46a00c0450 2024-03-23T06:17:49.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.259+0000 7f4697400640 1 -- 172.21.15.73:0/2634892910 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4690016430 con 0x7f46a00c0450 2024-03-23T06:17:49.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.259+0000 7f4697400640 1 -- 172.21.15.73:0/2634892910 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469000cda0 con 0x7f46a00c0450 2024-03-23T06:17:49.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.263+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a0164c70 con 0x7f46a00c0450 2024-03-23T06:17:49.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.267+0000 7f4697400640 1 -- 172.21.15.73:0/2634892910 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f46900153e0 con 0x7f46a00c0450 2024-03-23T06:17:49.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.268+0000 7f4697400640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f468006ac10 0x7f468006d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:49.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.268+0000 7f4697400640 1 -- 172.21.15.73:0/2634892910 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f4690088830 con 0x7f46a00c0450 2024-03-23T06:17:49.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.273+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a01fc880 con 0x7f46a00c0450 2024-03-23T06:17:49.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.273+0000 7f469f400640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f468006ac10 0x7f468006d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:49.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.274+0000 7f469f400640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f468006ac10 0x7f468006d0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4698001280 tx=0x7f4698001620 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:49.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.282+0000 7f4697400640 1 -- 172.21.15.73:0/2634892910 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4690053580 con 0x7f46a00c0450 2024-03-23T06:17:49.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.812+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f46a004e110 con 0x7f46a00c0450 2024-03-23T06:17:49.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.812+0000 7f4697400640 1 -- 172.21.15.73:0/2634892910 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f4690056ba0 con 0x7f46a00c0450 2024-03-23T06:17:49.814 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:17:49.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f468006ac10 msgr2=0x7f468006d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:49.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f468006ac10 0x7f468006d0d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4698001280 tx=0x7f4698001620 comp rx=0 tx=0).stop 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a00c0450 msgr2=0x7f46a01fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a00c0450 0x7f46a01fcb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f469000b9d0 tx=0x7f469000be90 comp rx=0 tx=0).stop 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 shutdown_connections 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a00c66f0 0x7f46a01fd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f468006ac10 0x7f468006d0d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46a00c0450 0x7f46a01fcb60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 --2- 172.21.15.73:0/2634892910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0072520 0x7f46a0165490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 >> 172.21.15.73:0/2634892910 conn(0x7f46a006bb40 msgr2=0x7f46a00715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.815+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 shutdown_connections 2024-03-23T06:17:49.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:49.816+0000 7f46a6600640 1 -- 172.21.15.73:0/2634892910 wait complete. 2024-03-23T06:17:52.839 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:17:53.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.131+0000 7feb21200640 1 Processor -- start 2024-03-23T06:17:53.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.131+0000 7feb21200640 1 -- start start 2024-03-23T06:17:53.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.134+0000 7feb21200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb1c1594f0 0x7feb1c0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:53.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.134+0000 7feb19e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7feb1c1536a0 0x7feb1c0ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47084/0 (socket says 172.21.15.73:47084) 2024-03-23T06:17:53.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.135+0000 7feb19e00640 1 -- 172.21.15.73:0/648800132 learned_addr learned my addr 172.21.15.73:0/648800132 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:17:53.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.135+0000 7feb1a800640 1 --2- 172.21.15.73:0/648800132 >> v2:172.21.15.110:3300/0 conn(0x7feb1c1594f0 0x7feb1c0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:53.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.135+0000 7feb21200640 1 -- 172.21.15.73:0/648800132 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c1599a0 con 0x7feb1c153a80 2024-03-23T06:17:53.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.135+0000 7feb21200640 1 -- 172.21.15.73:0/648800132 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c159c80 con 0x7feb1c1536a0 2024-03-23T06:17:53.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.135+0000 7feb21200640 1 -- 172.21.15.73:0/648800132 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c15a520 con 0x7feb1c1594f0 2024-03-23T06:17:53.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.135+0000 7feb19400640 1 -- 172.21.15.73:0/648800132 >> v1:172.21.15.73:6789/0 conn(0x7feb1c153a80 legacy=0x7feb1c0cbe90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:17:53.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.136+0000 7feb1a800640 1 -- 172.21.15.73:0/648800132 >> v1:172.21.15.110:6789/0 conn(0x7feb1c1536a0 legacy=0x7feb1c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:53.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.136+0000 7feb1a800640 1 -- 172.21.15.73:0/648800132 >> v1:172.21.15.73:6789/0 conn(0x7feb1c153a80 legacy=0x7feb1c0cbe90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:17:53.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.137+0000 7feb1a800640 1 -- 172.21.15.73:0/648800132 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c159f60 con 0x7feb1c1594f0 2024-03-23T06:17:53.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.139+0000 7feb1a800640 1 --2- 172.21.15.73:0/648800132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 0x7feb1c0cf1c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb140097a0 tx=0x7feb1402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=546ddbd01f3e5753 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:53.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.144+0000 7feb18a00640 1 -- 172.21.15.73:0/648800132 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14031830 con 0x7feb1c1594f0 2024-03-23T06:17:53.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.144+0000 7feb18a00640 1 -- 172.21.15.73:0/648800132 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14031990 con 0x7feb1c1594f0 2024-03-23T06:17:53.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.144+0000 7feb18a00640 1 -- 172.21.15.73:0/648800132 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14031d20 con 0x7feb1c1594f0 2024-03-23T06:17:53.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.145+0000 7feb21200640 1 -- 172.21.15.73:0/648800132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 msgr2=0x7feb1c0cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:53.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.145+0000 7feb21200640 1 --2- 172.21.15.73:0/648800132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 0x7feb1c0cf1c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb140097a0 tx=0x7feb1402b8d0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.145+0000 7feb21200640 1 -- 172.21.15.73:0/648800132 shutdown_connections 2024-03-23T06:17:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.145+0000 7feb21200640 1 --2- 172.21.15.73:0/648800132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 0x7feb1c0cf1c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.145+0000 7feb21200640 1 -- 172.21.15.73:0/648800132 >> 172.21.15.73:0/648800132 conn(0x7feb1c06a060 msgr2=0x7feb1c06a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.146+0000 7feb21200640 1 -- 172.21.15.73:0/648800132 shutdown_connections 2024-03-23T06:17:53.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.146+0000 7feb21200640 1 -- 172.21.15.73:0/648800132 wait complete. 2024-03-23T06:17:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.148+0000 7feb21200640 1 Processor -- start 2024-03-23T06:17:53.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.148+0000 7feb21200640 1 -- start start 2024-03-23T06:17:53.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.150+0000 7feb21200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb1c1536a0 0x7feb1c14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.150+0000 7feb21200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1c153a80 0x7feb1c147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.150+0000 7feb21200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 0x7feb1c0b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.150+0000 7feb21200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0b31d0 con 0x7feb1c153a80 2024-03-23T06:17:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.150+0000 7feb21200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c14f380 con 0x7feb1c1594f0 2024-03-23T06:17:53.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.150+0000 7feb21200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c14f0a0 con 0x7feb1c1536a0 2024-03-23T06:17:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.151+0000 7feb19400640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1c153a80 msgr2=0x7feb1c147090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.151+0000 7feb19400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1c153a80 0x7feb1c147090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:17:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.151+0000 7feb19e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb1c1536a0 0x7feb1c14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.151+0000 7feb19e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb1c1536a0 0x7feb1c14c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:48828/0 (socket says 172.21.15.73:48828) 2024-03-23T06:17:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.151+0000 7feb19e00640 1 -- 172.21.15.73:0/2055508856 learned_addr learned my addr 172.21.15.73:0/2055508856 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:53.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.151+0000 7feb1a800640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 0x7feb1c0b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.152+0000 7feb1a800640 1 -- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb1c1536a0 msgr2=0x7feb1c14c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.152+0000 7feb1a800640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb1c1536a0 0x7feb1c14c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.152+0000 7feb1a800640 1 -- 172.21.15.73:0/2055508856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1c153a80 msgr2=0x7feb1c147090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:17:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.152+0000 7feb1a800640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1c153a80 0x7feb1c147090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.152+0000 7feb1a800640 1 -- 172.21.15.73:0/2055508856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14009400 con 0x7feb1c1594f0 2024-03-23T06:17:53.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.153+0000 7feb1a800640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 0x7feb1c0b3970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb14033000 tx=0x7feb140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.153+0000 7feb12000640 1 -- 172.21.15.73:0/2055508856 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1403aae0 con 0x7feb1c1594f0 2024-03-23T06:17:53.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.154+0000 7feb12000640 1 -- 172.21.15.73:0/2055508856 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1403ac40 con 0x7feb1c1594f0 2024-03-23T06:17:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.154+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c1475d0 con 0x7feb1c1594f0 2024-03-23T06:17:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.154+0000 7feb12000640 1 -- 172.21.15.73:0/2055508856 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1403aae0 con 0x7feb1c1594f0 2024-03-23T06:17:53.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.154+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c14f890 con 0x7feb1c1594f0 2024-03-23T06:17:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.157+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c15da10 con 0x7feb1c1594f0 2024-03-23T06:17:53.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.157+0000 7feb12000640 1 -- 172.21.15.73:0/2055508856 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feb14004020 con 0x7feb1c1594f0 2024-03-23T06:17:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.158+0000 7feb12000640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feaf806ac40 0x7feaf806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.158+0000 7feb12000640 1 -- 172.21.15.73:0/2055508856 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7feb140aac80 con 0x7feb1c1594f0 2024-03-23T06:17:53.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.158+0000 7feb19e00640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feaf806ac40 0x7feaf806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:53.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.159+0000 7feb19e00640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feaf806ac40 0x7feaf806d100 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb04005880 tx=0x7feb04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:17:53.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.163+0000 7feb12000640 1 -- 172.21.15.73:0/2055508856 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7feb14075ae0 con 0x7feb1c1594f0 2024-03-23T06:17:53.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.788+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7feb1c0c5540 con 0x7feb1c1594f0 2024-03-23T06:17:53.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.790+0000 7feb12000640 1 -- 172.21.15.73:0/2055508856 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7feb14079100 con 0x7feb1c1594f0 2024-03-23T06:17:53.790 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":76,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":28,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.793+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feaf806ac40 msgr2=0x7feaf806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.793+0000 7feb21200640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feaf806ac40 0x7feaf806d100 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb04005880 tx=0x7feb04009040 comp rx=0 tx=0).stop 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.794+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 msgr2=0x7feb1c0b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.794+0000 7feb21200640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 0x7feb1c0b3970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb14033000 tx=0x7feb140046c0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.794+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 shutdown_connections 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.794+0000 7feb21200640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb1c1594f0 0x7feb1c0b3970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.794+0000 7feb21200640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb1c153a80 0x7feb1c147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.794+0000 7feb21200640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7feaf806ac40 0x7feaf806d100 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.794+0000 7feb21200640 1 --2- 172.21.15.73:0/2055508856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb1c1536a0 0x7feb1c14c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:17:53.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.794+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 >> 172.21.15.73:0/2055508856 conn(0x7feb1c06a060 msgr2=0x7feb1c157f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:17:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.795+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 shutdown_connections 2024-03-23T06:17:53.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:53.795+0000 7feb21200640 1 -- 172.21.15.73:0/2055508856 wait complete. 2024-03-23T06:17:56.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:17:57.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.201+0000 7f2f31200640 1 Processor -- start 2024-03-23T06:17:57.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.201+0000 7f2f31200640 1 -- start start 2024-03-23T06:17:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.206+0000 7f2f31200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:57.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.206+0000 7f2f2b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:57.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.206+0000 7f2f2b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:48830/0 (socket says 172.21.15.73:48830) 2024-03-23T06:17:57.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.206+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 learned_addr learned my addr 172.21.15.73:0/1111812301 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:17:57.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.207+0000 7f2f31200640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:57.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.207+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:57.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.207+0000 7f2f31200640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 0x7f2f2c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:17:57.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.210+0000 7f2f2be00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 msgr2=0x7f2f2c0ca770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:57.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.210+0000 7f2f2be00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 0x7f2f2c0ca770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:17:57.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.210+0000 7f2f31200640 1 -- 172.21.15.73:0/1111812301 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c0c61a0 con 0x7f2f2c0bc2e0 2024-03-23T06:17:57.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.210+0000 7f2f31200640 1 -- 172.21.15.73:0/1111812301 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c153a20 con 0x7f2f2c0bc9a0 2024-03-23T06:17:57.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.210+0000 7f2f31200640 1 -- 172.21.15.73:0/1111812301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0c7790 con 0x7f2f2c153640 2024-03-23T06:17:57.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.212+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:17:57.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.212+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:17:57.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.212+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:17:57.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.212+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:17:57.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.212+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:17:57.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.212+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:17:57.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.212+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:17:57.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.212+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:17:57.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.411+0000 7f2f2be00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 msgr2=0x7f2f2c0ca770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:57.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.411+0000 7f2f2be00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 0x7f2f2c0ca770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:17:57.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.414+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:57.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.415+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:17:57.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.415+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:17:57.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.415+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:17:57.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.415+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:17:57.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.417+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:57.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.418+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:17:57.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.418+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:17:57.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.418+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:17:57.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.418+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:17:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.812+0000 7f2f2be00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 msgr2=0x7f2f2c0ca770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.812+0000 7f2f2be00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 0x7f2f2c0ca770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:17:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.816+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.817+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:17:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.817+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:17:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.817+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:17:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.817+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:17:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.819+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.819+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:17:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.819+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:17:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.819+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:17:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:57.820+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:17:58.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.613+0000 7f2f2be00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 msgr2=0x7f2f2c0ca770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:17:58.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.614+0000 7f2f2be00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 0x7f2f2c0ca770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:17:58.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.618+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:58.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.619+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:17:58.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.619+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:17:58.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.619+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:17:58.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.619+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:17:58.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.621+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:17:58.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.621+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:17:58.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.621+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:17:58.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.621+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:17:58.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:17:58.621+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:18:00.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.206+0000 7f2f28c00640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c0c7c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:00.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.206+0000 7f2f28c00640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f2c0c7c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.206+0000 7f2f28c00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 msgr2=0x7f2f2c159d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:00.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.206+0000 7f2f28c00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.110:3300/0 conn(0x7f2f2c0bc9a0 0x7f2f2c159d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.206+0000 7f2f28c00640 1 -- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 msgr2=0x7f2f2c0ca770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:00.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.206+0000 7f2f28c00640 1 --2- 172.21.15.73:0/1111812301 >> v2:172.21.15.73:3300/0 conn(0x7f2f2c0bc2e0 0x7f2f2c0ca770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.206+0000 7f2f28c00640 1 -- 172.21.15.73:0/1111812301 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c15a250 con 0x7f2f0c0036b0 2024-03-23T06:18:00.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.206+0000 7f2f28c00640 1 -- 172.21.15.73:0/1111812301 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c00c0d0 con 0x7f2f0c007360 2024-03-23T06:18:00.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.208+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> v1:172.21.15.73:6789/0 conn(0x7f2f0c0036b0 legacy=0x7f2f0c005b30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:18:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.210+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414100419 0 0) 0x7f2f0c00c0d0 con 0x7f2f0c007360 2024-03-23T06:18:00.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.210+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f10003520 con 0x7f2f0c007360 2024-03-23T06:18:00.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.211+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2424290909 0 0) 0x7f2f10003520 con 0x7f2f0c007360 2024-03-23T06:18:00.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.211+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 >> v1:172.21.15.73:6789/0 conn(0x7f2f0c0036b0 legacy=0x7f2f0c005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:00.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.211+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c00d390 con 0x7f2f0c007360 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.211+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f2f1800d550 con 0x7f2f0c007360 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.211+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 >> v1:172.21.15.110:6789/0 conn(0x7f2f0c007360 legacy=0x7f2f0c009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.211+0000 7f2f2a000640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f10003970 0x7f2f10003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.211+0000 7f2f2a000640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f100047c0 0x7f2f10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.211+0000 7f2f2a000640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.212+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f100054b0 con 0x7f2f100047c0 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.212+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f10005620 con 0x7f2f10003970 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.212+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1000bec0 con 0x7f2f2c153640 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.215+0000 7f2f2aa00640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f100047c0 msgr2=0x7f2f10004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.215+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f100047c0 0x7f2f10004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.215+0000 7f2f2be00640 1 -- 172.21.15.73:0/1111812301 reap_dead start 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.215+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f10003970 0x7f2f10003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:00.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.215+0000 7f2f2be00640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.216+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 msgr2=0x7f2f1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.216+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f1000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.216+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f100047c0 msgr2=0x7f2f10004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.216+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f100047c0 0x7f2f10004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.216+0000 7f2f2b400640 1 -- 172.21.15.73:0/1111812301 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c00d390 con 0x7f2f10003970 2024-03-23T06:18:00.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.219+0000 7f2f2b400640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f10003970 0x7f2f10003d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c003a90 tx=0x7f2f100057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=996a524640d844ca server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.222+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c035410 con 0x7f2f10003970 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.222+0000 7f2f2a000640 1 -- 172.21.15.73:0/1111812301 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c02f030 con 0x7f2f10003970 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.223+0000 7f2f31200640 1 -- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f10003970 msgr2=0x7f2f10003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.223+0000 7f2f31200640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f10003970 0x7f2f10003d50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c003a90 tx=0x7f2f100057f0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.223+0000 7f2f31200640 1 -- 172.21.15.73:0/1111812301 shutdown_connections 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.223+0000 7f2f31200640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f2c153640 0x7f2f1000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.223+0000 7f2f31200640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f100047c0 0x7f2f10004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.224+0000 7f2f31200640 1 --2- 172.21.15.73:0/1111812301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f10003970 0x7f2f10003d50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.224+0000 7f2f31200640 1 -- 172.21.15.73:0/1111812301 >> 172.21.15.73:0/1111812301 conn(0x7f2f2c06d3a0 msgr2=0x7f2f2c06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.224+0000 7f2f31200640 1 -- 172.21.15.73:0/1111812301 shutdown_connections 2024-03-23T06:18:00.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.224+0000 7f2f31200640 1 -- 172.21.15.73:0/1111812301 wait complete. 2024-03-23T06:18:00.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.230+0000 7f2f31200640 1 Processor -- start 2024-03-23T06:18:00.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.230+0000 7f2f31200640 1 -- start start 2024-03-23T06:18:00.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.234+0000 7f2f31200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f10003970 0x7f2f2c1f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:00.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.235+0000 7f2f31200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f100047c0 0x7f2f2c158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.236+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f100047c0 0x7f2f2c158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.236+0000 7f2f2aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f100047c0 0x7f2f2c158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:34894/0 (socket says 172.21.15.73:34894) 2024-03-23T06:18:00.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.236+0000 7f2f2aa00640 1 -- 172.21.15.73:0/728065150 learned_addr learned my addr 172.21.15.73:0/728065150 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:00.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.236+0000 7f2f2b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f10003970 0x7f2f2c1f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:00.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.237+0000 7f2f31200640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f2c153640 0x7f2f2c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:00.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.237+0000 7f2f2be00640 1 -- 172.21.15.73:0/728065150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c158f90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:18:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.237+0000 7f2f2be00640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f2c153640 0x7f2f2c158f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:00.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.239+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c156a70 con 0x7f2f2c153640 2024-03-23T06:18:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.239+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1f2700 con 0x7f2f100047c0 2024-03-23T06:18:00.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.239+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1585c0 con 0x7f2f10003970 2024-03-23T06:18:00.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.240+0000 7f2f2b400640 1 -- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f100047c0 msgr2=0x7f2f2c158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.240+0000 7f2f2b400640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f100047c0 0x7f2f2c158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.240+0000 7f2f2b400640 1 -- 172.21.15.73:0/728065150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f2c153640 msgr2=0x7f2f2c158f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.240+0000 7f2f2b400640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f2c153640 0x7f2f2c158f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.241+0000 7f2f2b400640 1 -- 172.21.15.73:0/728065150 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c072690 con 0x7f2f10003970 2024-03-23T06:18:00.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.241+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f100047c0 0x7f2f2c158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:18:00.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.244+0000 7f2f2b400640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f10003970 0x7f2f2c1f1db0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f10005760 tx=0x7f2f1c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:00.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.245+0000 7f2f23400640 1 -- 172.21.15.73:0/728065150 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c033d20 con 0x7f2f10003970 2024-03-23T06:18:00.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.245+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c158290 con 0x7f2f10003970 2024-03-23T06:18:00.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.245+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c0723b0 con 0x7f2f10003970 2024-03-23T06:18:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.250+0000 7f2f23400640 1 -- 172.21.15.73:0/728065150 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00c040 con 0x7f2f10003970 2024-03-23T06:18:00.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.250+0000 7f2f23400640 1 -- 172.21.15.73:0/728065150 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c033d20 con 0x7f2f10003970 2024-03-23T06:18:00.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.258+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f04005250 con 0x7f2f10003970 2024-03-23T06:18:00.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.258+0000 7f2f23400640 1 -- 172.21.15.73:0/728065150 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2f1c03c040 con 0x7f2f10003970 2024-03-23T06:18:00.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.261+0000 7f2f23400640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2f0c06b7b0 0x7f2f0c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.261+0000 7f2f23400640 1 -- 172.21.15.73:0/728065150 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f2f1c0ab830 con 0x7f2f10003970 2024-03-23T06:18:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.262+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2f0c06b7b0 0x7f2f0c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.264+0000 7f2f2aa00640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2f0c06b7b0 0x7f2f0c06dc70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0be5a0 tx=0x7f2f18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.269+0000 7f2f23400640 1 -- 172.21.15.73:0/728065150 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2f1c0766b0 con 0x7f2f10003970 2024-03-23T06:18:00.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.781+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2f04005a80 con 0x7f2f10003970 2024-03-23T06:18:00.782 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":78,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.782+0000 7f2f23400640 1 -- 172.21.15.73:0/728065150 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f2f1c079cd0 con 0x7f2f10003970 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2f0c06b7b0 msgr2=0x7f2f0c06dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2f0c06b7b0 0x7f2f0c06dc70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0be5a0 tx=0x7f2f18008040 comp rx=0 tx=0).stop 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f10003970 msgr2=0x7f2f2c1f1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f10003970 0x7f2f2c1f1db0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2f10005760 tx=0x7f2f1c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 shutdown_connections 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f2c153640 0x7f2f2c158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2f100047c0 0x7f2f2c158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2f0c06b7b0 0x7f2f0c06dc70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 --2- 172.21.15.73:0/728065150 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2f10003970 0x7f2f2c1f1db0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 >> 172.21.15.73:0/728065150 conn(0x7f2f2c06d3a0 msgr2=0x7f2f2c1509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.784+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 shutdown_connections 2024-03-23T06:18:00.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:00.785+0000 7f2f31200640 1 -- 172.21.15.73:0/728065150 wait complete. 2024-03-23T06:18:00.856 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:18:00.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T06:18:00.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:18:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.164+0000 7f24d4400640 1 Processor -- start 2024-03-23T06:18:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.165+0000 7f24d4400640 1 -- start start 2024-03-23T06:18:01.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.166+0000 7f24d4400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc153760 0x7f24cc159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.166+0000 7f24d4400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc06a2d0 con 0x7f24cc0c9740 2024-03-23T06:18:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.166+0000 7f24d4400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc06a5b0 con 0x7f24cc0ca940 2024-03-23T06:18:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.166+0000 7f24d4400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc06a890 con 0x7f24cc153760 2024-03-23T06:18:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.167+0000 7f24d1000640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7f24cc0c9740 legacy=0x7f24cc0cb7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:18:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.167+0000 7f24d1a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc153760 0x7f24cc159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.167+0000 7f24d1a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc153760 0x7f24cc159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:35168/0 (socket says 172.21.15.73:35168) 2024-03-23T06:18:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.167+0000 7f24d1a00640 1 -- 172.21.15.73:0/2304741456 learned_addr learned my addr 172.21.15.73:0/2304741456 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.167+0000 7f24d1a00640 1 -- 172.21.15.73:0/2304741456 >> v1:172.21.15.110:6789/0 conn(0x7f24cc0ca940 legacy=0x7f24cc0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.167+0000 7f24d1a00640 1 -- 172.21.15.73:0/2304741456 >> v1:172.21.15.73:6789/0 conn(0x7f24cc0c9740 legacy=0x7f24cc0cb7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.167+0000 7f24d1a00640 1 -- 172.21.15.73:0/2304741456 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc06ab70 con 0x7f24cc153760 2024-03-23T06:18:01.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.169+0000 7f24d1a00640 1 --2- 172.21.15.73:0/2304741456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc153760 0x7f24cc159420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f24b80098d0 tx=0x7f24b802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb0a9120797d281 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.172+0000 7f24cbe00640 1 -- 172.21.15.73:0/2304741456 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8030610 con 0x7f24cc153760 2024-03-23T06:18:01.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.174+0000 7f24cbe00640 1 -- 172.21.15.73:0/2304741456 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8030770 con 0x7f24cc153760 2024-03-23T06:18:01.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.175+0000 7f24d4400640 1 -- 172.21.15.73:0/2304741456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc153760 msgr2=0x7f24cc159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.175+0000 7f24d4400640 1 --2- 172.21.15.73:0/2304741456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc153760 0x7f24cc159420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f24b80098d0 tx=0x7f24b802b960 comp rx=0 tx=0).stop 2024-03-23T06:18:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.175+0000 7f24d4400640 1 -- 172.21.15.73:0/2304741456 shutdown_connections 2024-03-23T06:18:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.175+0000 7f24d4400640 1 --2- 172.21.15.73:0/2304741456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc153760 0x7f24cc159420 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.175+0000 7f24d4400640 1 -- 172.21.15.73:0/2304741456 >> 172.21.15.73:0/2304741456 conn(0x7f24cc06c310 msgr2=0x7f24cc0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.176+0000 7f24d4400640 1 -- 172.21.15.73:0/2304741456 shutdown_connections 2024-03-23T06:18:01.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.177+0000 7f24d4400640 1 -- 172.21.15.73:0/2304741456 wait complete. 2024-03-23T06:18:01.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.179+0000 7f24d4400640 1 Processor -- start 2024-03-23T06:18:01.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.179+0000 7f24d4400640 1 -- start start 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.180+0000 7f24d4400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc0c9740 0x7f24cc158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.180+0000 7f24d4400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc0ca940 0x7f24cc14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.180+0000 7f24d4400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc153760 0x7f24cc0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.180+0000 7f24d4400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc159130 con 0x7f24cc153760 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.180+0000 7f24d4400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc145680 con 0x7f24cc0ca940 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.180+0000 7f24d4400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc144d90 con 0x7f24cc0c9740 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d2400640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc153760 msgr2=0x7f24cc0b3a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d2400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc153760 0x7f24cc0b3a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc0c9740 0x7f24cc158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc0c9740 0x7f24cc158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:35172/0 (socket says 172.21.15.73:35172) 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1a00640 1 -- 172.21.15.73:0/365746606 learned_addr learned my addr 172.21.15.73:0/365746606 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:01.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1000640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc0ca940 0x7f24cc14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1a00640 1 -- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc0ca940 msgr2=0x7f24cc14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1a00640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24cc0ca940 0x7f24cc14eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1a00640 1 -- 172.21.15.73:0/365746606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc153760 msgr2=0x7f24cc0b3a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1a00640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24cc153760 0x7f24cc0b3a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.181+0000 7f24d1a00640 1 -- 172.21.15.73:0/365746606 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80094d0 con 0x7f24cc0c9740 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.182+0000 7f24d1a00640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc0c9740 0x7f24cc158bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f24b80099f0 tx=0x7f24b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.182+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b803e070 con 0x7f24cc0c9740 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.182+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8030410 con 0x7f24cc0c9740 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.182+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8042610 con 0x7f24cc0c9740 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.183+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc1ef830 con 0x7f24cc0c9740 2024-03-23T06:18:01.183 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.183+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc145310 con 0x7f24cc0c9740 2024-03-23T06:18:01.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.187+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f24b8041390 con 0x7f24cc0c9740 2024-03-23T06:18:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.188+0000 7f24d4400640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8002a30 0x7f24a8004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.188+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8007e80 con 0x7f24a8002a30 2024-03-23T06:18:01.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.188+0000 7f24d1000640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8002a30 0x7f24a8004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.189+0000 7f24c9600640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24ac06abb0 0x7f24ac06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.189+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f24b80ab1e0 con 0x7f24cc0c9740 2024-03-23T06:18:01.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.189+0000 7f24d2400640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24ac06abb0 0x7f24ac06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.189+0000 7f24d1000640 1 -- 172.21.15.73:0/365746606 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f24a8008040 con 0x7f24a8002a30 2024-03-23T06:18:01.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.190+0000 7f24d1000640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8002a30 0x7f24a8004ef0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24c0003980 tx=0x7f24c0009aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.190+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0005a40 con 0x7f24a8002a30 2024-03-23T06:18:01.190 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.190+0000 7f24d2400640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24ac06abb0 0x7f24ac06d070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24c40013b0 tx=0x7f24c4007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.190+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f24c0005ba0 con 0x7f24a8002a30 2024-03-23T06:18:01.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.190+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8002a30 msgr2=0x7f24a8004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.190+0000 7f24c9600640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8002a30 0x7f24a8004ef0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24c0003980 tx=0x7f24c0009aa0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.191+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8002a30 msgr2=0x7f24a8004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:01.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.191+0000 7f24c9600640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8002a30 0x7f24a8004ef0 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f24c0003980 tx=0x7f24c0009aa0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.204+0000 7f24d4400640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8006de0 0x7f24a8007250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.204+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a8007840 con 0x7f24a8006de0 2024-03-23T06:18:01.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.204+0000 7f24d1000640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8006de0 0x7f24a8007250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.207+0000 7f24d1000640 1 -- 172.21.15.73:0/365746606 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f24a8007a00 con 0x7f24a8006de0 2024-03-23T06:18:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.207+0000 7f24d1000640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8006de0 0x7f24a8007250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24c0017000 tx=0x7f24c00059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.208+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0006800 con 0x7f24a8006de0 2024-03-23T06:18:01.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.208+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5109 (secure 0 0 0) 0x7f24c0012e50 con 0x7f24a8006de0 2024-03-23T06:18:01.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.208+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8006de0 msgr2=0x7f24a8007250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.208+0000 7f24c9600640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8006de0 0x7f24a8007250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24c0017000 tx=0x7f24c00059d0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.208+0000 7f24c9600640 1 -- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8006de0 msgr2=0x7f24a8007250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:01.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.208+0000 7f24c9600640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24a8006de0 0x7f24a8007250 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24c0017000 tx=0x7f24c00059d0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.209 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:01.209 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:01.209 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:01.209 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:18:01.209 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 78, 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:01.210 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:01.211 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:01.212 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:01.213 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.214 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:01.215 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:01.216 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:01.217 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.218 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.219 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 7 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.220 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:01.221 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.210+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24ac06abb0 msgr2=0x7f24ac06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.210+0000 7f24d4400640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f24ac06abb0 0x7f24ac06d070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f24c40013b0 tx=0x7f24c4007d30 comp rx=0 tx=0).stop 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.210+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc0c9740 msgr2=0x7f24cc158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.210+0000 7f24d4400640 1 --2- 172.21.15.73:0/365746606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24cc0c9740 0x7f24cc158bf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f24b80099f0 tx=0x7f24b80046c0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.210+0000 7f24d2400640 1 -- 172.21.15.73:0/365746606 reap_dead start 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.210+0000 7f24d2400640 1 -- 172.21.15.73:0/365746606 reap_dead start 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.211+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 shutdown_connections 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.211+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 >> 172.21.15.73:0/365746606 conn(0x7f24cc06c310 msgr2=0x7f24cc151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.213+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 shutdown_connections 2024-03-23T06:18:01.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.213+0000 7f24d4400640 1 -- 172.21.15.73:0/365746606 wait complete. 2024-03-23T06:18:01.244 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:18:01.245 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T06:18:01.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:18:01.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.578+0000 7fdf9ae00640 1 Processor -- start 2024-03-23T06:18:01.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.578+0000 7fdf9ae00640 1 -- start start 2024-03-23T06:18:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.580+0000 7fdf9ae00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdf9414fd70 0x7fdf940ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.580+0000 7fdf9ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf9406f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.580+0000 7fdf9ae00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940c5490 con 0x7fdf940714f0 2024-03-23T06:18:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.580+0000 7fdf9ae00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9406fe80 con 0x7fdf9414fd70 2024-03-23T06:18:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.580+0000 7fdf9ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940c56e0 con 0x7fdf940c6310 2024-03-23T06:18:01.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.580+0000 7fdf98e00640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fdf940714f0 legacy=0x7fdf94156060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:18:01.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.581+0000 7fdf93e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdf9414fd70 0x7fdf940ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.582+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf9406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.582+0000 7fdf93e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdf9414fd70 0x7fdf940ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:34930/0 (socket says 172.21.15.73:34930) 2024-03-23T06:18:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.582+0000 7fdf93e00640 1 -- 172.21.15.73:0/2829640903 learned_addr learned my addr 172.21.15.73:0/2829640903 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:01.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.582+0000 7fdf93e00640 1 -- 172.21.15.73:0/2829640903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 msgr2=0x7fdf9406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.582+0000 7fdf93e00640 1 --2- 172.21.15.73:0/2829640903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf9406f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.583+0000 7fdf93e00640 1 -- 172.21.15.73:0/2829640903 >> v1:172.21.15.73:6789/0 conn(0x7fdf940714f0 legacy=0x7fdf94156060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.583+0000 7fdf93e00640 1 -- 172.21.15.73:0/2829640903 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf940c59c0 con 0x7fdf9414fd70 2024-03-23T06:18:01.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.583+0000 7fdf8be00640 1 --2- 172.21.15.73:0/2829640903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf9406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:18:01.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.590+0000 7fdf93e00640 1 --2- 172.21.15.73:0/2829640903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf9414fd70 0x7fdf940ca4f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400bb10 tx=0x7fdf8402e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=609da8759ac87dd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.592+0000 7fdf93400640 1 -- 172.21.15.73:0/2829640903 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84036440 con 0x7fdf9414fd70 2024-03-23T06:18:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.592+0000 7fdf93400640 1 -- 172.21.15.73:0/2829640903 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840365a0 con 0x7fdf9414fd70 2024-03-23T06:18:01.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.592+0000 7fdf93400640 1 -- 172.21.15.73:0/2829640903 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84036930 con 0x7fdf9414fd70 2024-03-23T06:18:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.593+0000 7fdf9ae00640 1 -- 172.21.15.73:0/2829640903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf9414fd70 msgr2=0x7fdf940ca4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.593+0000 7fdf9ae00640 1 --2- 172.21.15.73:0/2829640903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf9414fd70 0x7fdf940ca4f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400bb10 tx=0x7fdf8402e150 comp rx=0 tx=0).stop 2024-03-23T06:18:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.596+0000 7fdf9ae00640 1 -- 172.21.15.73:0/2829640903 shutdown_connections 2024-03-23T06:18:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.596+0000 7fdf9ae00640 1 --2- 172.21.15.73:0/2829640903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf9406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.596+0000 7fdf9ae00640 1 --2- 172.21.15.73:0/2829640903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf9414fd70 0x7fdf940ca4f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.596+0000 7fdf9ae00640 1 -- 172.21.15.73:0/2829640903 >> 172.21.15.73:0/2829640903 conn(0x7fdf94069cb0 msgr2=0x7fdf9406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:01.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.600+0000 7fdf9ae00640 1 -- 172.21.15.73:0/2829640903 shutdown_connections 2024-03-23T06:18:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.601+0000 7fdf9ae00640 1 -- 172.21.15.73:0/2829640903 wait complete. 2024-03-23T06:18:01.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.603+0000 7fdf9ae00640 1 Processor -- start 2024-03-23T06:18:01.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.617+0000 7fdf9ae00640 1 -- start start 2024-03-23T06:18:01.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.619+0000 7fdf9ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf940714f0 0x7fdf940c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.619+0000 7fdf9ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf941472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.619+0000 7fdf9ae00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf9414fd70 0x7fdf94147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.619+0000 7fdf9ae00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940c2210 con 0x7fdf9414fd70 2024-03-23T06:18:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.620+0000 7fdf9ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94151570 con 0x7fdf940714f0 2024-03-23T06:18:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.620+0000 7fdf9ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940c1f30 con 0x7fdf940c6310 2024-03-23T06:18:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.620+0000 7fdf98e00640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf9414fd70 msgr2=0x7fdf94147820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:18:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.620+0000 7fdf98e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf9414fd70 0x7fdf94147820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:01.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.620+0000 7fdf93e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf940714f0 0x7fdf940c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.621+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf941472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.622+0000 7fdf8be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf941472e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:35182/0 (socket says 172.21.15.73:35182) 2024-03-23T06:18:01.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.622+0000 7fdf8be00640 1 -- 172.21.15.73:0/1350950307 learned_addr learned my addr 172.21.15.73:0/1350950307 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.624+0000 7fdf93e00640 1 -- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 msgr2=0x7fdf941472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.624+0000 7fdf93e00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf940c6310 0x7fdf941472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.624+0000 7fdf93e00640 1 -- 172.21.15.73:0/1350950307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf9414fd70 msgr2=0x7fdf94147820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.624+0000 7fdf93e00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdf9414fd70 0x7fdf94147820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.624+0000 7fdf93e00640 1 -- 172.21.15.73:0/1350950307 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009400 con 0x7fdf940714f0 2024-03-23T06:18:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.625+0000 7fdf93e00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf940714f0 0x7fdf940c38d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdf84035000 tx=0x7fdf840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.625+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84036440 con 0x7fdf940714f0 2024-03-23T06:18:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.625+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84034ba0 con 0x7fdf940714f0 2024-03-23T06:18:01.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.625+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8403f460 con 0x7fdf940714f0 2024-03-23T06:18:01.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.625+0000 7fdf9ae00640 1 -- 172.21.15.73:0/1350950307 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8400b770 con 0x7fdf940714f0 2024-03-23T06:18:01.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.627+0000 7fdf9ae00640 1 -- 172.21.15.73:0/1350950307 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf94152830 con 0x7fdf940714f0 2024-03-23T06:18:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.629+0000 7fdf9ae00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152a10 0x7fdf940c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.630+0000 7fdf9ae00640 1 -- 172.21.15.73:0/1350950307 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94073bf0 con 0x7fdf94152a10 2024-03-23T06:18:01.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.630+0000 7fdf8be00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152a10 0x7fdf940c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.631+0000 7fdf8be00640 1 -- 172.21.15.73:0/1350950307 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf94155ad0 con 0x7fdf94152a10 2024-03-23T06:18:01.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.631+0000 7fdf8be00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152a10 0x7fdf940c2ba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf94150e70 tx=0x7fdf7c011c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.632+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00fc10 con 0x7fdf94152a10 2024-03-23T06:18:01.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.633+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fdf7c011e70 con 0x7fdf94152a10 2024-03-23T06:18:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.634+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152a10 msgr2=0x7fdf940c2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.634+0000 7fdf90c00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152a10 0x7fdf940c2ba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf94150e70 tx=0x7fdf7c011c20 comp rx=0 tx=0).stop 2024-03-23T06:18:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.634+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152a10 msgr2=0x7fdf940c2ba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.634+0000 7fdf90c00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152a10 0x7fdf940c2ba0 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdf94150e70 tx=0x7fdf7c011c20 comp rx=0 tx=0).stop 2024-03-23T06:18:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.634+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdf8403d070 con 0x7fdf940714f0 2024-03-23T06:18:01.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.635+0000 7fdf90c00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdf7006a9b0 0x7fdf7006ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.635+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fdf84036e40 con 0x7fdf940714f0 2024-03-23T06:18:01.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.641+0000 7fdf8be00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdf7006a9b0 0x7fdf7006ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.644+0000 7fdf8be00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdf7006a9b0 0x7fdf7006ce70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c01c000 tx=0x7fdf7c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.651+0000 7fdf9ae00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152df0 0x7fdf940c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.661+0000 7fdf9ae00640 1 -- 172.21.15.73:0/1350950307 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940c5f80 con 0x7fdf94152df0 2024-03-23T06:18:01.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.662+0000 7fdf98e00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152df0 0x7fdf940c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.664+0000 7fdf98e00640 1 -- 172.21.15.73:0/1350950307 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdf94150150 con 0x7fdf94152df0 2024-03-23T06:18:01.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.665+0000 7fdf98e00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152df0 0x7fdf940c30e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00bca0 tx=0x7fdf8c009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.665+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c014620 con 0x7fdf94152df0 2024-03-23T06:18:01.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.665+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4794 (secure 0 0 0) 0x7fdf8c014780 con 0x7fdf94152df0 2024-03-23T06:18:01.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.666+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152df0 msgr2=0x7fdf940c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.666+0000 7fdf90c00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152df0 0x7fdf940c30e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00bca0 tx=0x7fdf8c009e90 comp rx=0 tx=0).stop 2024-03-23T06:18:01.666 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:01.666 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:01.666 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:01.666 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 78, 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:01.667 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:01.668 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:01.669 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:01.670 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:01.671 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:01.672 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.673 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:01.674 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:01.675 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.676 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:01.677 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:01.678 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:01.678 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:01.678 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:01.678 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:01.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.666+0000 7fdf90c00640 1 -- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152df0 msgr2=0x7fdf940c30e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.666+0000 7fdf90c00640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf94152df0 0x7fdf940c30e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.667+0000 7fdf89600640 1 -- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdf7006a9b0 msgr2=0x7fdf7006ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.667+0000 7fdf89600640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdf7006a9b0 0x7fdf7006ce70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c01c000 tx=0x7fdf7c017000 comp rx=0 tx=0).stop 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.667+0000 7fdf89600640 1 -- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf940714f0 msgr2=0x7fdf940c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.667+0000 7fdf89600640 1 --2- 172.21.15.73:0/1350950307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf940714f0 0x7fdf940c38d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdf84035000 tx=0x7fdf840046c0 comp rx=0 tx=0).stop 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.672+0000 7fdf98e00640 1 -- 172.21.15.73:0/1350950307 reap_dead start 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.672+0000 7fdf89600640 1 -- 172.21.15.73:0/1350950307 shutdown_connections 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.672+0000 7fdf89600640 1 -- 172.21.15.73:0/1350950307 >> 172.21.15.73:0/1350950307 conn(0x7fdf94069cb0 msgr2=0x7fdf940c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.673+0000 7fdf89600640 1 -- 172.21.15.73:0/1350950307 shutdown_connections 2024-03-23T06:18:01.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:01.673+0000 7fdf89600640 1 -- 172.21.15.73:0/1350950307 wait complete. 2024-03-23T06:18:01.702 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:18:01.702 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:18:16.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:18:16.319 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-23T06:18:16.595 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-03-23T06:18:16.594+0000 7fd7356fb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44090) UID: 0 2024-03-23T06:18:16.598 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-03-23T06:18:16.598+0000 7f7630b33640 -1 Fail to open '/proc/44090/cmdline' error = (2) No such file or directory 2024-03-23T06:18:16.598 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-03-23T06:18:16.598+0000 7f7630b33640 -1 received signal: Hangup from (PID: 44090) UID: 0 2024-03-23T06:18:16.741 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-03-23T06:18:16.596+0000 7fafb125e640 -1 Fail to open '/proc/44090/cmdline' error = (2) No such file or directory 2024-03-23T06:18:16.741 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-03-23T06:18:16.596+0000 7fafb125e640 -1 received signal: Hangup from (PID: 44090) UID: 0 2024-03-23T06:18:16.749 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-03-23T06:18:16.596+0000 7f25747c8640 -1 Fail to open '/proc/44090/cmdline' error = (2) No such file or directory 2024-03-23T06:18:16.749 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-03-23T06:18:16.596+0000 7f25747c8640 -1 received signal: Hangup from (PID: 44090) UID: 0 2024-03-23T06:18:17.065 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-23T06:18:17.063+0000 7fe213400640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55264) UID: 0 2024-03-23T06:18:17.065 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-23T06:18:17.065+0000 7ff65fc00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55264) UID: 0 2024-03-23T06:18:17.068 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-23T06:18:17.062+0000 7fa49dc00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55264) UID: 0 2024-03-23T06:18:17.078 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-23T06:18:17.062+0000 7f9817800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 55264) UID: 0 2024-03-23T06:18:21.703 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T06:18:21.703 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T06:18:21.703 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T06:18:21.703 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T06:18:21.710 INFO:tasks.ceph.mon.a:Started 2024-03-23T06:18:21.711 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:18:21.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:18:22.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.051+0000 7fa7f3000640 1 Processor -- start 2024-03-23T06:18:22.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.051+0000 7fa7f3000640 1 -- start start 2024-03-23T06:18:22.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.054+0000 7fa7f3000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa7ec153640 0x7fa7ec0c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:22.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.054+0000 7fa7f3000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec153a20 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.054+0000 7fa7f3000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec0c7790 con 0x7fa7ec0bc9a0 2024-03-23T06:18:22.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.054+0000 7fa7f3000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0c5880 con 0x7fa7ec153640 2024-03-23T06:18:22.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.055+0000 7fa7f2600640 1 -- >> v1:172.21.15.73:6789/0 conn(0x7fa7ec0bc2e0 legacy=0x7fa7ec163c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:18:22.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.056+0000 7fa7f1200640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa7ec0bc9a0 0x7fa7ec0ca730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48732/0 (socket says 172.21.15.73:48732) 2024-03-23T06:18:22.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.056+0000 7fa7f1200640 1 -- 172.21.15.73:0/2104423706 learned_addr learned my addr 172.21.15.73:0/2104423706 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:22.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.056+0000 7fa7f1c00640 1 --2- 172.21.15.73:0/2104423706 >> v2:172.21.15.110:3300/0 conn(0x7fa7ec153640 0x7fa7ec0c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.057+0000 7fa7ebe00640 1 -- 172.21.15.73:0/2104423706 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831176231 0 0) 0x7fa7ec0c7790 con 0x7fa7ec0bc9a0 2024-03-23T06:18:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.057+0000 7fa7f1c00640 1 -- 172.21.15.73:0/2104423706 >> v1:172.21.15.110:6789/0 conn(0x7fa7ec0bc9a0 legacy=0x7fa7ec0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:22.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.057+0000 7fa7f1c00640 1 -- 172.21.15.73:0/2104423706 >> v1:172.21.15.73:6789/0 conn(0x7fa7ec0bc2e0 legacy=0x7fa7ec163c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:22.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.057+0000 7fa7f1c00640 1 -- 172.21.15.73:0/2104423706 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0c5b60 con 0x7fa7ec153640 2024-03-23T06:18:22.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.059+0000 7fa7f1c00640 1 --2- 172.21.15.73:0/2104423706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 0x7fa7ec0c7c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097a0 tx=0x7fa7e002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d6ef49da940a40d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:22.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.059+0000 7fa7ebe00640 1 -- 172.21.15.73:0/2104423706 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0031830 con 0x7fa7ec153640 2024-03-23T06:18:22.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.060+0000 7fa7ebe00640 1 -- 172.21.15.73:0/2104423706 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0031990 con 0x7fa7ec153640 2024-03-23T06:18:22.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.060+0000 7fa7ebe00640 1 -- 172.21.15.73:0/2104423706 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0031d20 con 0x7fa7ec153640 2024-03-23T06:18:22.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.061+0000 7fa7f3000640 1 -- 172.21.15.73:0/2104423706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 msgr2=0x7fa7ec0c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:22.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.061+0000 7fa7f3000640 1 --2- 172.21.15.73:0/2104423706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 0x7fa7ec0c7c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00097a0 tx=0x7fa7e002b8d0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.061+0000 7fa7f3000640 1 -- 172.21.15.73:0/2104423706 shutdown_connections 2024-03-23T06:18:22.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.062+0000 7fa7f3000640 1 --2- 172.21.15.73:0/2104423706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 0x7fa7ec0c7c20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.062+0000 7fa7f3000640 1 -- 172.21.15.73:0/2104423706 >> 172.21.15.73:0/2104423706 conn(0x7fa7ec06d3a0 msgr2=0x7fa7ec06d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:22.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.062+0000 7fa7f3000640 1 -- 172.21.15.73:0/2104423706 shutdown_connections 2024-03-23T06:18:22.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.062+0000 7fa7f3000640 1 -- 172.21.15.73:0/2104423706 wait complete. 2024-03-23T06:18:22.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.065+0000 7fa7f3000640 1 Processor -- start 2024-03-23T06:18:22.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.066+0000 7fa7f3000640 1 -- start start 2024-03-23T06:18:22.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.068+0000 7fa7f3000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7ec0bc2e0 0x7fa7ec14b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:22.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.068+0000 7fa7f3000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0bc9a0 0x7fa7ec14a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:22.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.068+0000 7fa7f3000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 0x7fa7ec14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:22.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.068+0000 7fa7f3000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec1e2f30 con 0x7fa7ec0bc9a0 2024-03-23T06:18:22.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.068+0000 7fa7f3000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec1e5020 con 0x7fa7ec153640 2024-03-23T06:18:22.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.068+0000 7fa7f3000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0c3f90 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.069+0000 7fa7f1200640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0bc9a0 msgr2=0x7fa7ec14a2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:18:22.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.069+0000 7fa7f1200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0bc9a0 0x7fa7ec14a2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:22.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.069+0000 7fa7f1c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7ec0bc2e0 0x7fa7ec14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:22.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.070+0000 7fa7f1c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7ec0bc2e0 0x7fa7ec14b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51596/0 (socket says 172.21.15.73:51596) 2024-03-23T06:18:22.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.070+0000 7fa7f2600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 0x7fa7ec14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:22.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.070+0000 7fa7f2600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 0x7fa7ec14c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:46028/0 (socket says 172.21.15.73:46028) 2024-03-23T06:18:22.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.070+0000 7fa7f2600640 1 -- 172.21.15.73:0/301034078 learned_addr learned my addr 172.21.15.73:0/301034078 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:22.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.071+0000 7fa7f1c00640 1 -- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 msgr2=0x7fa7ec14c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:22.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.071+0000 7fa7f1c00640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 0x7fa7ec14c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.071+0000 7fa7f1c00640 1 -- 172.21.15.73:0/301034078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0bc9a0 msgr2=0x7fa7ec14a2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:22.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.071+0000 7fa7f1c00640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0bc9a0 0x7fa7ec14a2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.071+0000 7fa7f1c00640 1 -- 172.21.15.73:0/301034078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009400 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.072+0000 7fa7f1c00640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7ec0bc2e0 0x7fa7ec14b330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0033000 tx=0x7fa7e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:22.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.072+0000 7fa7e9600640 1 -- 172.21.15.73:0/301034078 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e003bbf0 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.072+0000 7fa7e9600640 1 -- 172.21.15.73:0/301034078 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e003bd70 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.072+0000 7fa7e9600640 1 -- 172.21.15.73:0/301034078 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0045630 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.073+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec1efca0 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.073+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec1e5550 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.075+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec04e030 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.078+0000 7fa7e9600640 1 -- 172.21.15.73:0/301034078 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa7e0004030 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.079+0000 7fa7e9600640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa7cc06ac30 0x7fa7cc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:22.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.080+0000 7fa7e9600640 1 -- 172.21.15.73:0/301034078 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fa7e00abb60 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.080+0000 7fa7f1200640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa7cc06ac30 0x7fa7cc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:22.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.081+0000 7fa7f1200640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa7cc06ac30 0x7fa7cc06d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec14f2b0 tx=0x7fa7d8007950 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:22.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.083+0000 7fa7e9600640 1 -- 172.21.15.73:0/301034078 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa7e0076b40 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.650+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa7ec0c6be0 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.653+0000 7fa7e9600640 1 -- 172.21.15.73:0/301034078 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fa7e007a160 con 0x7fa7ec0bc2e0 2024-03-23T06:18:22.653 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":78,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:18:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa7cc06ac30 msgr2=0x7fa7cc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa7cc06ac30 0x7fa7cc06d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec14f2b0 tx=0x7fa7d8007950 comp rx=0 tx=0).stop 2024-03-23T06:18:22.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7ec0bc2e0 msgr2=0x7fa7ec14b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7ec0bc2e0 0x7fa7ec14b330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0033000 tx=0x7fa7e00046c0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 shutdown_connections 2024-03-23T06:18:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7ec153640 0x7fa7ec14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0bc9a0 0x7fa7ec14a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa7cc06ac30 0x7fa7cc06d0f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 --2- 172.21.15.73:0/301034078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7ec0bc2e0 0x7fa7ec14b330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.663+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 >> 172.21.15.73:0/301034078 conn(0x7fa7ec06d3a0 msgr2=0x7fa7ec14f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:22.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.664+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 shutdown_connections 2024-03-23T06:18:22.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:22.664+0000 7fa7f3000640 1 -- 172.21.15.73:0/301034078 wait complete. 2024-03-23T06:18:25.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:18:26.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.027+0000 7ff3d7200640 1 Processor -- start 2024-03-23T06:18:26.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.027+0000 7ff3d7200640 1 -- start start 2024-03-23T06:18:26.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.029+0000 7ff3d7200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3d014f700 0x7ff3d00bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.029+0000 7ff3d7200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff3d00720f0 0x7ff3d006d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.029+0000 7ff3d7200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d00caaf0 con 0x7ff3d00cb820 2024-03-23T06:18:26.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.029+0000 7ff3d7200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d00c55a0 con 0x7ff3d00720f0 2024-03-23T06:18:26.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.029+0000 7ff3d7200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d0155a80 con 0x7ff3d014f700 2024-03-23T06:18:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.034+0000 7ff3cfe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3d014f700 0x7ff3d00bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.034+0000 7ff3cfe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3d014f700 0x7ff3d00bfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:46066/0 (socket says 172.21.15.73:46066) 2024-03-23T06:18:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.034+0000 7ff3cfe00640 1 -- 172.21.15.73:0/3096191227 learned_addr learned my addr 172.21.15.73:0/3096191227 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.035+0000 7ff3d5200640 1 --2- 172.21.15.73:0/3096191227 >> v2:172.21.15.73:3300/0 conn(0x7ff3d00720f0 0x7ff3d006d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.035+0000 7ff3cfe00640 1 -- 172.21.15.73:0/3096191227 >> v2:172.21.15.73:3300/0 conn(0x7ff3d00720f0 msgr2=0x7ff3d006d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.035+0000 7ff3cfe00640 1 --2- 172.21.15.73:0/3096191227 >> v2:172.21.15.73:3300/0 conn(0x7ff3d00720f0 0x7ff3d006d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.035+0000 7ff3cfe00640 1 -- 172.21.15.73:0/3096191227 >> v1:172.21.15.73:6789/0 conn(0x7ff3d00cb820 legacy=0x7ff3d0155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.036+0000 7ff3cfe00640 1 -- 172.21.15.73:0/3096191227 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d00c0040 con 0x7ff3d014f700 2024-03-23T06:18:26.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.036+0000 7ff3d5200640 1 --2- 172.21.15.73:0/3096191227 >> v2:172.21.15.73:3300/0 conn(0x7ff3d00720f0 0x7ff3d006d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:26.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.039+0000 7ff3cfe00640 1 --2- 172.21.15.73:0/3096191227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 0x7ff3d00bfb00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00c7710 tx=0x7ff3c802e330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75022b2feee69f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:26.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.039+0000 7ff3cea00640 1 -- 172.21.15.73:0/3096191227 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8038600 con 0x7ff3d014f700 2024-03-23T06:18:26.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.039+0000 7ff3cea00640 1 -- 172.21.15.73:0/3096191227 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8032070 con 0x7ff3d014f700 2024-03-23T06:18:26.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.039+0000 7ff3cea00640 1 -- 172.21.15.73:0/3096191227 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8038980 con 0x7ff3d014f700 2024-03-23T06:18:26.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.041+0000 7ff3d7200640 1 -- 172.21.15.73:0/3096191227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 msgr2=0x7ff3d00bfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.041+0000 7ff3d7200640 1 --2- 172.21.15.73:0/3096191227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 0x7ff3d00bfb00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff3d00c7710 tx=0x7ff3c802e330 comp rx=0 tx=0).stop 2024-03-23T06:18:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.044+0000 7ff3d7200640 1 -- 172.21.15.73:0/3096191227 shutdown_connections 2024-03-23T06:18:26.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.044+0000 7ff3d7200640 1 --2- 172.21.15.73:0/3096191227 >> v2:172.21.15.73:3300/0 conn(0x7ff3d00720f0 0x7ff3d006d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.044+0000 7ff3d7200640 1 --2- 172.21.15.73:0/3096191227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 0x7ff3d00bfb00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.044+0000 7ff3d7200640 1 -- 172.21.15.73:0/3096191227 >> 172.21.15.73:0/3096191227 conn(0x7ff3d006baf0 msgr2=0x7ff3d006bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:26.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.045+0000 7ff3d7200640 1 -- 172.21.15.73:0/3096191227 shutdown_connections 2024-03-23T06:18:26.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.047+0000 7ff3d7200640 1 -- 172.21.15.73:0/3096191227 wait complete. 2024-03-23T06:18:26.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.049+0000 7ff3d7200640 1 Processor -- start 2024-03-23T06:18:26.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.050+0000 7ff3d7200640 1 -- start start 2024-03-23T06:18:26.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.052+0000 7ff3d7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3d00720f0 0x7ff3d014da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.053+0000 7ff3d7200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d00cb820 0x7ff3d00c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.053+0000 7ff3d7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 0x7ff3d00c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.053+0000 7ff3cfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3d00720f0 0x7ff3d014da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.053+0000 7ff3cfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3d00720f0 0x7ff3d014da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51630/0 (socket says 172.21.15.73:51630) 2024-03-23T06:18:26.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3cf400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d00cb820 0x7ff3d00c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3cfe00640 1 -- 172.21.15.73:0/2836161103 learned_addr learned my addr 172.21.15.73:0/2836161103 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:26.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0157ff0 con 0x7ff3d00cb820 2024-03-23T06:18:26.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0158290 con 0x7ff3d014f700 2024-03-23T06:18:26.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0157940 con 0x7ff3d00720f0 2024-03-23T06:18:26.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d5200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 0x7ff3d00c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d5200640 1 -- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3d00720f0 msgr2=0x7ff3d014da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d5200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3d00720f0 0x7ff3d014da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d5200640 1 -- 172.21.15.73:0/2836161103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d00cb820 msgr2=0x7ff3d00c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d5200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d00cb820 0x7ff3d00c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.054+0000 7ff3d5200640 1 -- 172.21.15.73:0/2836161103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c800d050 con 0x7ff3d014f700 2024-03-23T06:18:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.055+0000 7ff3d5200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 0x7ff3d00c2350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c5c0 tx=0x7ff3c000ca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:26.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.055+0000 7ff3c7e00640 1 -- 172.21.15.73:0/2836161103 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0011800 con 0x7ff3d014f700 2024-03-23T06:18:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.055+0000 7ff3c7e00640 1 -- 172.21.15.73:0/2836161103 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c0011960 con 0x7ff3d014f700 2024-03-23T06:18:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.055+0000 7ff3c7e00640 1 -- 172.21.15.73:0/2836161103 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0011d50 con 0x7ff3d014f700 2024-03-23T06:18:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.056+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d00c3630 con 0x7ff3d014f700 2024-03-23T06:18:26.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.056+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d0157be0 con 0x7ff3d014f700 2024-03-23T06:18:26.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.058+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d0158400 con 0x7ff3d014f700 2024-03-23T06:18:26.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.061+0000 7ff3c7e00640 1 -- 172.21.15.73:0/2836161103 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff3c001a450 con 0x7ff3d014f700 2024-03-23T06:18:26.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.062+0000 7ff3c7e00640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff3ac06ad00 0x7ff3ac06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.062+0000 7ff3c7e00640 1 -- 172.21.15.73:0/2836161103 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff3c0088f80 con 0x7ff3d014f700 2024-03-23T06:18:26.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.066+0000 7ff3cfe00640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff3ac06ad00 0x7ff3ac06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.067+0000 7ff3c7e00640 1 -- 172.21.15.73:0/2836161103 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff3c0053e80 con 0x7ff3d014f700 2024-03-23T06:18:26.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.071+0000 7ff3cfe00640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff3ac06ad00 0x7ff3ac06d1c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8000f80 tx=0x7ff3c800a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:26.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.626+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff3d004e0d0 con 0x7ff3d014f700 2024-03-23T06:18:26.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.629+0000 7ff3c7e00640 1 -- 172.21.15.73:0/2836161103 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7ff3c00574a0 con 0x7ff3d014f700 2024-03-23T06:18:26.633 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:18:26.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.634+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff3ac06ad00 msgr2=0x7ff3ac06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:26.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.634+0000 7ff3d7200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff3ac06ad00 0x7ff3ac06d1c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8000f80 tx=0x7ff3c800a040 comp rx=0 tx=0).stop 2024-03-23T06:18:26.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.634+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 msgr2=0x7ff3d00c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:26.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.634+0000 7ff3d7200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 0x7ff3d00c2350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c5c0 tx=0x7ff3c000ca80 comp rx=0 tx=0).stop 2024-03-23T06:18:26.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.636+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 shutdown_connections 2024-03-23T06:18:26.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.636+0000 7ff3d7200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3d014f700 0x7ff3d00c2350 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.636+0000 7ff3d7200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3d00cb820 0x7ff3d00c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.636+0000 7ff3d7200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff3ac06ad00 0x7ff3ac06d1c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.636+0000 7ff3d7200640 1 --2- 172.21.15.73:0/2836161103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3d00720f0 0x7ff3d014da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.637+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 >> 172.21.15.73:0/2836161103 conn(0x7ff3d006baf0 msgr2=0x7ff3d00c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:26.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.637+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 shutdown_connections 2024-03-23T06:18:26.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.638+0000 7ff3d7200640 1 -- 172.21.15.73:0/2836161103 wait complete. 2024-03-23T06:18:26.665 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:18:26.665 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:18:26.665 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:18:26.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.949+0000 7f52a0a00640 1 Processor -- start 2024-03-23T06:18:26.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.949+0000 7f52a0a00640 1 -- start start 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f52a0a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f529c070570 0x7f529c0709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f52a0a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c070f00 con 0x7f529c0c56c0 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f52a0a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f529c165fd0 con 0x7f529c0c4900 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f52a0a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f529c166290 con 0x7f529c070570 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f529a800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f529c0c4900 0x7f529c169f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48734/0 (socket says 172.21.15.73:48734) 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f529a800640 1 -- 172.21.15.73:0/3589131059 learned_addr learned my addr 172.21.15.73:0/3589131059 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f5299e00640 1 --1- 172.21.15.73:0/3589131059 >> v1:172.21.15.73:6789/0 conn(0x7f529c0c56c0 0x7f529c06f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46722/0 (socket says 172.21.15.73:46722) 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f529b200640 1 --2- 172.21.15.73:0/3589131059 >> v2:172.21.15.73:3300/0 conn(0x7f529c070570 0x7f529c0709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.950+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427599075 0 0) 0x7f529c165fd0 con 0x7f529c0c4900 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.974+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5280003500 con 0x7f529c0c4900 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.974+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841590048 0 0) 0x7f529c070f00 con 0x7f529c0c56c0 2024-03-23T06:18:26.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.974+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f529c165fd0 con 0x7f529c0c56c0 2024-03-23T06:18:26.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.975+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1739066328 0 0) 0x7f5280003500 con 0x7f529c0c4900 2024-03-23T06:18:26.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.975+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 >> v2:172.21.15.73:3300/0 conn(0x7f529c070570 msgr2=0x7f529c0709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:26.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.975+0000 7f5299400640 1 --2- 172.21.15.73:0/3589131059 >> v2:172.21.15.73:3300/0 conn(0x7f529c070570 0x7f529c0709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.975+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 >> v1:172.21.15.73:6789/0 conn(0x7f529c0c56c0 legacy=0x7f529c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:26.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.975+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c166570 con 0x7f529c0c4900 2024-03-23T06:18:26.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.975+0000 7f529b200640 1 --2- 172.21.15.73:0/3589131059 >> v2:172.21.15.73:3300/0 conn(0x7f529c070570 0x7f529c0709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.976+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f528c001670 con 0x7f529c0c4900 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.976+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 >> v1:172.21.15.110:6789/0 conn(0x7f529c0c4900 legacy=0x7f529c169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.976+0000 7f5299400640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5280006e50 0x7f5280007270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.976+0000 7f5299400640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52800058a0 0x7f5280005d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.976+0000 7f5299400640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280006260 0x7f528000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.976+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c166290 con 0x7f5280006260 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.976+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280006970 con 0x7f5280006e50 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.976+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5280007bf0 con 0x7f52800058a0 2024-03-23T06:18:26.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.977+0000 7f529b200640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280006260 0x7f528000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.978+0000 7f529a800640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5280006e50 0x7f5280007270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.978+0000 7f5299e00640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52800058a0 0x7f5280005d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.979+0000 7f5299e00640 1 -- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5280006e50 msgr2=0x7f5280007270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:26.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.979+0000 7f5299e00640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5280006e50 0x7f5280007270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.979+0000 7f5299e00640 1 -- 172.21.15.73:0/3589131059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280006260 msgr2=0x7f528000ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:26.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.980+0000 7f5299e00640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280006260 0x7f528000ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.980+0000 7f5299e00640 1 -- 172.21.15.73:0/3589131059 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c166570 con 0x7f52800058a0 2024-03-23T06:18:26.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.981+0000 7f529b200640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280006260 0x7f528000ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:26.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.981+0000 7f529b200640 1 -- 172.21.15.73:0/3589131059 reap_dead start 2024-03-23T06:18:26.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.982+0000 7f5299e00640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52800058a0 0x7f5280005d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52880018d0 tx=0x7f52800037b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c61d9145e5e5ea4b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:26.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.983+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288007270 con 0x7f52800058a0 2024-03-23T06:18:26.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.983+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52880073d0 con 0x7f52800058a0 2024-03-23T06:18:26.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.983+0000 7f5299400640 1 -- 172.21.15.73:0/3589131059 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52880047e0 con 0x7f52800058a0 2024-03-23T06:18:26.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.989+0000 7f52a0a00640 1 -- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52800058a0 msgr2=0x7f5280005d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:26.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.990+0000 7f52a0a00640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52800058a0 0x7f5280005d20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52880018d0 tx=0x7f52800037b0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.990+0000 7f52a0a00640 1 -- 172.21.15.73:0/3589131059 shutdown_connections 2024-03-23T06:18:26.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.990+0000 7f52a0a00640 1 --2- 172.21.15.73:0/3589131059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52800058a0 0x7f5280005d20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:26.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.990+0000 7f52a0a00640 1 -- 172.21.15.73:0/3589131059 >> 172.21.15.73:0/3589131059 conn(0x7f529c06d3f0 msgr2=0x7f529c06d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:26.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.991+0000 7f52a0a00640 1 -- 172.21.15.73:0/3589131059 shutdown_connections 2024-03-23T06:18:26.993 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.991+0000 7f52a0a00640 1 -- 172.21.15.73:0/3589131059 wait complete. 2024-03-23T06:18:26.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.996+0000 7f52a0a00640 1 Processor -- start 2024-03-23T06:18:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.996+0000 7f52a0a00640 1 -- start start 2024-03-23T06:18:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f52a0a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52800058a0 0x7f529c1ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f52a0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f529c0c1840 0x7f529c1f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f52a0a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f529c0c3760 0x7f529c1626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:26.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f52a0a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0c0ba0 con 0x7f52800058a0 2024-03-23T06:18:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f52a0a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1ff240 con 0x7f529c0c1840 2024-03-23T06:18:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f52a0a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529c1635f0 con 0x7f529c0c3760 2024-03-23T06:18:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f529b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f529c0c3760 0x7f529c1626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f529b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f529c0c3760 0x7f529c1626e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51654/0 (socket says 172.21.15.73:51654) 2024-03-23T06:18:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.998+0000 7f529b200640 1 -- 172.21.15.73:0/3039422999 learned_addr learned my addr 172.21.15.73:0/3039422999 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:26.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.999+0000 7f529b200640 1 -- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f529c0c1840 msgr2=0x7f529c1f0440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.999+0000 7f529b200640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f529c0c1840 0x7f529c1f0440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.999+0000 7f529b200640 1 -- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52800058a0 msgr2=0x7f529c1ff6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:26.999+0000 7f529a800640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52800058a0 0x7f529c1ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.000+0000 7f529b200640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52800058a0 0x7f529c1ff6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.000+0000 7f529b200640 1 -- 172.21.15.73:0/3039422999 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c163350 con 0x7f529c0c3760 2024-03-23T06:18:27.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.000+0000 7f529a800640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52800058a0 0x7f529c1ff6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:27.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.000+0000 7f529b200640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f529c0c3760 0x7f529c1626e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f529c0c7e60 tx=0x7f529400a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.000+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529400f050 con 0x7f529c0c3760 2024-03-23T06:18:27.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.001+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294010040 con 0x7f529c0c3760 2024-03-23T06:18:27.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.001+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294014a10 con 0x7f529c0c3760 2024-03-23T06:18:27.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.001+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c1f1730 con 0x7f529c0c3760 2024-03-23T06:18:27.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.002+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c1febf0 con 0x7f529c0c3760 2024-03-23T06:18:27.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.008+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5294014b70 con 0x7f529c0c3760 2024-03-23T06:18:27.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.008+0000 7f52a0a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c1fede0 0x7f529c162c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.008+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c073aa0 con 0x7f529c1fede0 2024-03-23T06:18:27.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.009+0000 7f5292a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f527c06acd0 0x7f527c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.009+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f529408a680 con 0x7f529c0c3760 2024-03-23T06:18:27.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.010+0000 7f5299e00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f527c06acd0 0x7f527c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.010+0000 7f529a800640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c1fede0 0x7f529c162c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.011+0000 7f529a800640 1 -- 172.21.15.73:0/3039422999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f529c166e10 con 0x7f529c1fede0 2024-03-23T06:18:27.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.012+0000 7f529a800640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c1fede0 0x7f529c162c20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f528c00f710 tx=0x7f528c00fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.013+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c00d740 con 0x7f529c1fede0 2024-03-23T06:18:27.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.013+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f528c00d8a0 con 0x7f529c1fede0 2024-03-23T06:18:27.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.013+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c1fede0 msgr2=0x7f529c162c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.013+0000 7f5292a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c1fede0 0x7f529c162c20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f528c00f710 tx=0x7f528c00fbd0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.013+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c1fede0 msgr2=0x7f529c162c20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:27.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.013+0000 7f5292a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c1fede0 0x7f529c162c20 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f528c00f710 tx=0x7f528c00fbd0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.024+0000 7f5299e00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f527c06acd0 0x7f527c06d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5288034000 tx=0x7f528802f000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.060+0000 7f52a0a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0bf1a0 0x7f529c02b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.060+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529c0c4ce0 con 0x7f529c0bf1a0 2024-03-23T06:18:27.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.065+0000 7f529a800640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0bf1a0 0x7f529c02b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.067+0000 7f529a800640 1 -- 172.21.15.73:0/3039422999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f529c166b00 con 0x7f529c0bf1a0 2024-03-23T06:18:27.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.069+0000 7f529a800640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0bf1a0 0x7f529c02b170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f528c00f710 tx=0x7f528c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.070+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c023070 con 0x7f529c0bf1a0 2024-03-23T06:18:27.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.073+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f528c01ee70 con 0x7f529c0bf1a0 2024-03-23T06:18:27.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.073+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0bf1a0 msgr2=0x7f529c02b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.073+0000 7f5292a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0bf1a0 0x7f529c02b170 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f528c00f710 tx=0x7f528c000bc0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.073+0000 7f5292a00640 1 -- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0bf1a0 msgr2=0x7f529c02b170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:27.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.073+0000 7f5292a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f529c0bf1a0 0x7f529c02b170 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 82, 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:18:27.079 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.080 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.081 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:27.082 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.083 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:27.085 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.086 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.087 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.088 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.089 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:27.090 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:27.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.080+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f527c06acd0 msgr2=0x7f527c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.080+0000 7f52a0a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f527c06acd0 0x7f527c06d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5288034000 tx=0x7f528802f000 comp rx=0 tx=0).stop 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.080+0000 7f529b200640 1 -- 172.21.15.73:0/3039422999 reap_dead start 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.080+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f529c0c3760 msgr2=0x7f529c1626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.080+0000 7f52a0a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f529c0c3760 0x7f529c1626e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f529c0c7e60 tx=0x7f529400a420 comp rx=0 tx=0).stop 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.081+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 shutdown_connections 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.081+0000 7f52a0a00640 1 --2- 172.21.15.73:0/3039422999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f529c0c3760 0x7f529c1626e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.081+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 >> 172.21.15.73:0/3039422999 conn(0x7f529c06d3f0 msgr2=0x7f529c06f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.085+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 shutdown_connections 2024-03-23T06:18:27.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.085+0000 7f52a0a00640 1 -- 172.21.15.73:0/3039422999 wait complete. 2024-03-23T06:18:27.140 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:18:27.141 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:18:27.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:18:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.438+0000 7fda5b000640 1 Processor -- start 2024-03-23T06:18:27.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.438+0000 7fda5b000640 1 -- start start 2024-03-23T06:18:27.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.440+0000 7fda5b000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda54152e70 0x7fda540c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.440+0000 7fda5b000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda540c9d60 con 0x7fda54152a90 2024-03-23T06:18:27.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.440+0000 7fda5b000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda54155600 con 0x7fda540c90f0 2024-03-23T06:18:27.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.440+0000 7fda5b000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda540ca000 con 0x7fda54152e70 2024-03-23T06:18:27.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.440+0000 7fda59000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fda540c90f0 0x7fda540caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48736/0 (socket says 172.21.15.73:48736) 2024-03-23T06:18:27.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.440+0000 7fda59000640 1 -- 172.21.15.73:0/483975062 learned_addr learned my addr 172.21.15.73:0/483975062 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402857996 0 0) 0x7fda54155600 con 0x7fda540c90f0 2024-03-23T06:18:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda38003520 con 0x7fda540c90f0 2024-03-23T06:18:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4069289819 0 0) 0x7fda38003520 con 0x7fda540c90f0 2024-03-23T06:18:27.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 >> v2:172.21.15.73:3300/0 conn(0x7fda54152e70 msgr2=0x7fda540c5d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 --2- 172.21.15.73:0/483975062 >> v2:172.21.15.73:3300/0 conn(0x7fda54152e70 0x7fda540c5d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 >> v1:172.21.15.73:6789/0 conn(0x7fda54152a90 legacy=0x7fda54159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda540ca2e0 con 0x7fda540c90f0 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fda4c0019f0 con 0x7fda540c90f0 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 >> v1:172.21.15.110:6789/0 conn(0x7fda540c90f0 legacy=0x7fda540caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda38003970 0x7fda38003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda380047c0 0x7fda38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda380052a0 0x7fda38005950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540ca000 con 0x7fda38003970 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38006230 con 0x7fda380052a0 2024-03-23T06:18:27.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.441+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda380063f0 con 0x7fda380047c0 2024-03-23T06:18:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.442+0000 7fda53e00640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda38003970 0x7fda38003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.442+0000 7fda59000640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda380052a0 0x7fda38005950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.443+0000 7fda59000640 1 -- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda380047c0 msgr2=0x7fda38004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:27.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.443+0000 7fda59000640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda380047c0 0x7fda38004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.443+0000 7fda59000640 1 -- 172.21.15.73:0/483975062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda38003970 msgr2=0x7fda38003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.443+0000 7fda59000640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda38003970 0x7fda38003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.443+0000 7fda59000640 1 -- 172.21.15.73:0/483975062 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda38003520 con 0x7fda380052a0 2024-03-23T06:18:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.443+0000 7fda53e00640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda38003970 0x7fda38003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:18:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.444+0000 7fda59000640 1 -- 172.21.15.73:0/483975062 reap_dead start 2024-03-23T06:18:27.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.444+0000 7fda59000640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda380052a0 0x7fda38005950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fda4c005400 tx=0x7fda380057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605708fa62c23154 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.445+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00f2d0 con 0x7fda380052a0 2024-03-23T06:18:27.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.445+0000 7fda52a00640 1 -- 172.21.15.73:0/483975062 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c033070 con 0x7fda380052a0 2024-03-23T06:18:27.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.446+0000 7fda5b000640 1 -- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda380052a0 msgr2=0x7fda38005950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.446+0000 7fda5b000640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda380052a0 0x7fda38005950 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fda4c005400 tx=0x7fda380057f0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.446+0000 7fda5b000640 1 -- 172.21.15.73:0/483975062 shutdown_connections 2024-03-23T06:18:27.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.446+0000 7fda5b000640 1 --2- 172.21.15.73:0/483975062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda380052a0 0x7fda38005950 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.446+0000 7fda5b000640 1 -- 172.21.15.73:0/483975062 >> 172.21.15.73:0/483975062 conn(0x7fda54069cb0 msgr2=0x7fda5406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:27.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.448+0000 7fda5b000640 1 -- 172.21.15.73:0/483975062 shutdown_connections 2024-03-23T06:18:27.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.449+0000 7fda5b000640 1 -- 172.21.15.73:0/483975062 wait complete. 2024-03-23T06:18:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.451+0000 7fda5b000640 1 Processor -- start 2024-03-23T06:18:27.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.452+0000 7fda5b000640 1 -- start start 2024-03-23T06:18:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.453+0000 7fda5b000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda380052a0 0x7fda54149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.453+0000 7fda5b000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541eb050 0x7fda5414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.453+0000 7fda5b000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda54156760 0x7fda54157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.453+0000 7fda5b000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda541573d0 con 0x7fda380052a0 2024-03-23T06:18:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.453+0000 7fda5b000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c6070 con 0x7fda541eb050 2024-03-23T06:18:27.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.453+0000 7fda5b000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda541eb520 con 0x7fda54156760 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda59000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda54156760 0x7fda54157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda59000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda54156760 0x7fda54157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51664/0 (socket says 172.21.15.73:51664) 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda59000640 1 -- 172.21.15.73:0/1927761090 learned_addr learned my addr 172.21.15.73:0/1927761090 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda59000640 1 -- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541eb050 msgr2=0x7fda5414a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda53400640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541eb050 0x7fda5414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda59000640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541eb050 0x7fda5414a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda59000640 1 -- 172.21.15.73:0/1927761090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda380052a0 msgr2=0x7fda54149e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda53e00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda380052a0 0x7fda54149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda59000640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda380052a0 0x7fda54149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda59000640 1 -- 172.21.15.73:0/1927761090 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda540c0fe0 con 0x7fda54156760 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.454+0000 7fda53400640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541eb050 0x7fda5414a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:27.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.455+0000 7fda59000640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda54156760 0x7fda54157de0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda4c030cd0 tx=0x7fda540704e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.455+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c005680 con 0x7fda54156760 2024-03-23T06:18:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.455+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c0057e0 con 0x7fda54156760 2024-03-23T06:18:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.455+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c005b50 con 0x7fda54156760 2024-03-23T06:18:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.455+0000 7fda5b000640 1 -- 172.21.15.73:0/1927761090 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda540c12c0 con 0x7fda54156760 2024-03-23T06:18:27.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.456+0000 7fda5b000640 1 -- 172.21.15.73:0/1927761090 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda541578c0 con 0x7fda54156760 2024-03-23T06:18:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.458+0000 7fda5b000640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda54158320 0x7fda541edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.458+0000 7fda5b000640 1 -- 172.21.15.73:0/1927761090 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda54073bf0 con 0x7fda54158320 2024-03-23T06:18:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.458+0000 7fda53e00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda54158320 0x7fda541edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.458+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fda4c035030 con 0x7fda54156760 2024-03-23T06:18:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.459+0000 7fda53e00640 1 -- 172.21.15.73:0/1927761090 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda54155ba0 con 0x7fda54158320 2024-03-23T06:18:27.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.459+0000 7fda4be00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda3406ac30 0x7fda3406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.460+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fda4c0ae840 con 0x7fda54156760 2024-03-23T06:18:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.460+0000 7fda53400640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda3406ac30 0x7fda3406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.461+0000 7fda53400640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda3406ac30 0x7fda3406d0f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda540b0740 tx=0x7fda44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.462+0000 7fda53e00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda54158320 0x7fda541edb40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda40003dc0 tx=0x7fda40001790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.462+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40001220 con 0x7fda54158320 2024-03-23T06:18:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.464+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fda400124d0 con 0x7fda54158320 2024-03-23T06:18:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.464+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda54158320 msgr2=0x7fda541edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.464+0000 7fda4be00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda54158320 0x7fda541edb40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda40003dc0 tx=0x7fda40001790 comp rx=0 tx=0).stop 2024-03-23T06:18:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.464+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda54158320 msgr2=0x7fda541edb40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:27.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.464+0000 7fda4be00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda54158320 0x7fda541edb40 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fda40003dc0 tx=0x7fda40001790 comp rx=0 tx=0).stop 2024-03-23T06:18:27.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.477+0000 7fda5b000640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541ee080 0x7fda541ee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.477+0000 7fda5b000640 1 -- 172.21.15.73:0/1927761090 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5406f940 con 0x7fda541ee080 2024-03-23T06:18:27.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.478+0000 7fda53e00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541ee080 0x7fda541ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.479+0000 7fda53e00640 1 -- 172.21.15.73:0/1927761090 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fda541ee9d0 con 0x7fda541ee080 2024-03-23T06:18:27.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.480+0000 7fda53e00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541ee080 0x7fda541ee490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fda40003dc0 tx=0x7fda40000fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.480+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40014810 con 0x7fda541ee080 2024-03-23T06:18:27.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.481+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5118 (secure 0 0 0) 0x7fda40014970 con 0x7fda541ee080 2024-03-23T06:18:27.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.481+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541ee080 msgr2=0x7fda541ee490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.481+0000 7fda4be00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541ee080 0x7fda541ee490 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fda40003dc0 tx=0x7fda40000fb0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.481+0000 7fda4be00640 1 -- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541ee080 msgr2=0x7fda541ee490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:27.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.481+0000 7fda4be00640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda541ee080 0x7fda541ee490 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fda40003dc0 tx=0x7fda40000fb0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.481 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:27.481 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:27.481 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:27.481 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 82, 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.482 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:27.484 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.485 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.486 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.487 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.488 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.489 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.491 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.492 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 7 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.493 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.494 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:27.495 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.482+0000 7fda49600640 1 -- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda3406ac30 msgr2=0x7fda3406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.482+0000 7fda49600640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda3406ac30 0x7fda3406d0f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fda540b0740 tx=0x7fda44008040 comp rx=0 tx=0).stop 2024-03-23T06:18:27.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.482+0000 7fda49600640 1 -- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda54156760 msgr2=0x7fda54157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.482+0000 7fda49600640 1 --2- 172.21.15.73:0/1927761090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda54156760 0x7fda54157de0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda4c030cd0 tx=0x7fda540704e0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.482+0000 7fda59000640 1 -- 172.21.15.73:0/1927761090 reap_dead start 2024-03-23T06:18:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.482+0000 7fda59000640 1 -- 172.21.15.73:0/1927761090 reap_dead start 2024-03-23T06:18:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.482+0000 7fda49600640 1 -- 172.21.15.73:0/1927761090 shutdown_connections 2024-03-23T06:18:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.482+0000 7fda49600640 1 -- 172.21.15.73:0/1927761090 >> 172.21.15.73:0/1927761090 conn(0x7fda54069cb0 msgr2=0x7fda540c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.483+0000 7fda49600640 1 -- 172.21.15.73:0/1927761090 shutdown_connections 2024-03-23T06:18:27.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.483+0000 7fda49600640 1 -- 172.21.15.73:0/1927761090 wait complete. 2024-03-23T06:18:27.507 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:18:27.507 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:18:27.507 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.819+0000 7f93b9e00640 1 Processor -- start 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.819+0000 7f93b9e00640 1 -- start start 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.821+0000 7f93b9e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93ac0452a0 0x7f93ac0456d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.821+0000 7f93b9e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac1003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.821+0000 7f93b9e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac007620 con 0x7f93ac0f6c20 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.821+0000 7f93b9e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac04baa0 con 0x7f93ac0452a0 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.821+0000 7f93b9e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac045c10 con 0x7f93ac0fff40 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.821+0000 7f93b8a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f93ac0f6c20 0x7f93ac04b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48748/0 (socket says 172.21.15.73:48748) 2024-03-23T06:18:27.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.821+0000 7f93b3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93ac0452a0 0x7f93ac0456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.821+0000 7f93b8a00640 1 -- 172.21.15.73:0/1265668324 learned_addr learned my addr 172.21.15.73:0/1265668324 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:27.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.822+0000 7f93b9400640 1 --2- 172.21.15.73:0/1265668324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac1003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.823+0000 7f93b3400640 1 -- 172.21.15.73:0/1265668324 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988203995 0 0) 0x7f93ac007620 con 0x7f93ac0f6c20 2024-03-23T06:18:27.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.909+0000 7f93b3400640 1 -- 172.21.15.73:0/1265668324 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f939c003500 con 0x7f93ac0f6c20 2024-03-23T06:18:27.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.914+0000 7f93b3e00640 1 -- 172.21.15.73:0/1265668324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 msgr2=0x7f93ac1003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:27.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.914+0000 7f93b3e00640 1 --2- 172.21.15.73:0/1265668324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac1003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.914+0000 7f93b3e00640 1 -- 172.21.15.73:0/1265668324 >> v1:172.21.15.110:6789/0 conn(0x7f93ac0f6c20 legacy=0x7f93ac04b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.914+0000 7f93b3e00640 1 -- 172.21.15.73:0/1265668324 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac006a10 con 0x7f93ac0452a0 2024-03-23T06:18:27.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.916+0000 7f93b3e00640 1 --2- 172.21.15.73:0/1265668324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0452a0 0x7f93ac0456d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93a000ba40 tx=0x7f93a002e130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afb3854d271db0ac server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.917+0000 7f93b3400640 1 -- 172.21.15.73:0/1265668324 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0036440 con 0x7f93ac0452a0 2024-03-23T06:18:27.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.917+0000 7f93b3400640 1 -- 172.21.15.73:0/1265668324 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a00365a0 con 0x7f93ac0452a0 2024-03-23T06:18:27.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.917+0000 7f93b3400640 1 -- 172.21.15.73:0/1265668324 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0036970 con 0x7f93ac0452a0 2024-03-23T06:18:27.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.918+0000 7f93b9e00640 1 -- 172.21.15.73:0/1265668324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0452a0 msgr2=0x7f93ac0456d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.918+0000 7f93b9e00640 1 --2- 172.21.15.73:0/1265668324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0452a0 0x7f93ac0456d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93a000ba40 tx=0x7f93a002e130 comp rx=0 tx=0).stop 2024-03-23T06:18:27.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.918+0000 7f93b9e00640 1 -- 172.21.15.73:0/1265668324 shutdown_connections 2024-03-23T06:18:27.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.918+0000 7f93b9e00640 1 --2- 172.21.15.73:0/1265668324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac1003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.918+0000 7f93b9e00640 1 --2- 172.21.15.73:0/1265668324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0452a0 0x7f93ac0456d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.918+0000 7f93b9e00640 1 -- 172.21.15.73:0/1265668324 >> 172.21.15.73:0/1265668324 conn(0x7f93ac050150 msgr2=0x7f93ac050560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:27.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.919+0000 7f93b9e00640 1 -- 172.21.15.73:0/1265668324 shutdown_connections 2024-03-23T06:18:27.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.919+0000 7f93b9e00640 1 -- 172.21.15.73:0/1265668324 wait complete. 2024-03-23T06:18:27.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.927+0000 7f93b9e00640 1 Processor -- start 2024-03-23T06:18:27.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.927+0000 7f93b9e00640 1 -- start start 2024-03-23T06:18:27.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.931+0000 7f93b9e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac0452a0 0x7f93ac1951f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.931+0000 7f93b9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0f6c20 0x7f93ac0f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.931+0000 7f93b9e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac0e9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.931+0000 7f93b9e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0ff690 con 0x7f93ac0452a0 2024-03-23T06:18:27.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.931+0000 7f93b9e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0457a0 con 0x7f93ac0f6c20 2024-03-23T06:18:27.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.931+0000 7f93b9e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0ff8e0 con 0x7f93ac0fff40 2024-03-23T06:18:27.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac0e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac0e9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51688/0 (socket says 172.21.15.73:51688) 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b9400640 1 -- 172.21.15.73:0/1000860008 learned_addr learned my addr 172.21.15.73:0/1000860008 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b3e00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0f6c20 0x7f93ac0f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b9400640 1 -- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0f6c20 msgr2=0x7f93ac0f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b9400640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac0f6c20 0x7f93ac0f58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b9400640 1 -- 172.21.15.73:0/1000860008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac0452a0 msgr2=0x7f93ac1951f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b9400640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93ac0452a0 0x7f93ac1951f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.932+0000 7f93b9400640 1 -- 172.21.15.73:0/1000860008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a000b6a0 con 0x7f93ac0fff40 2024-03-23T06:18:27.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.933+0000 7f93b9400640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac0e9520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93b404f810 tx=0x7f93b4067930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.934+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b40723d0 con 0x7f93ac0fff40 2024-03-23T06:18:27.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.934+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b4071050 con 0x7f93ac0fff40 2024-03-23T06:18:27.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.934+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b4072770 con 0x7f93ac0fff40 2024-03-23T06:18:27.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.934+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac0ffbc0 con 0x7f93ac0fff40 2024-03-23T06:18:27.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.935+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac0f7520 con 0x7f93ac0fff40 2024-03-23T06:18:27.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.937+0000 7f93b9e00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0f7d20 0x7f93ac0e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.937+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac008900 con 0x7f93ac0f7d20 2024-03-23T06:18:27.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.940+0000 7f93b8a00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0f7d20 0x7f93ac0e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.942+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f93b4080070 con 0x7f93ac0fff40 2024-03-23T06:18:27.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.943+0000 7f93b8a00640 1 -- 172.21.15.73:0/1000860008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93ac0072b0 con 0x7f93ac0f7d20 2024-03-23T06:18:27.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.943+0000 7f93b8a00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0f7d20 0x7f93ac0e9a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c380 tx=0x7f93a800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.946+0000 7f93b0c00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f939406ac80 0x7f939406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.946+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f93b40f2f10 con 0x7f93ac0fff40 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.947+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8005ce0 con 0x7f93ac0f7d20 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.947+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f93a8005e40 con 0x7f93ac0f7d20 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.947+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0f7d20 msgr2=0x7f93ac0e9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.947+0000 7f93b0c00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0f7d20 0x7f93ac0e9a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c380 tx=0x7f93a800c840 comp rx=0 tx=0).stop 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.947+0000 7f93b3e00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f939406ac80 0x7f939406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.947+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0f7d20 msgr2=0x7f93ac0e9a60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.947+0000 7f93b0c00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0f7d20 0x7f93ac0e9a60 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c380 tx=0x7f93a800c840 comp rx=0 tx=0).stop 2024-03-23T06:18:27.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.947+0000 7f93b3e00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f939406ac80 0x7f939406d140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f93a0038000 tx=0x7f93a0032000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.959+0000 7f93b9e00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0ea0e0 0x7f93ac0f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:27.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.959+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0ffd50 con 0x7f93ac0ea0e0 2024-03-23T06:18:27.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.960+0000 7f93b8a00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0ea0e0 0x7f93ac0f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:27.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.961+0000 7f93b8a00640 1 -- 172.21.15.73:0/1000860008 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f93ac006fd0 con 0x7f93ac0ea0e0 2024-03-23T06:18:27.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.961+0000 7f93b8a00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0ea0e0 0x7f93ac0f9e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93a8014000 tx=0x7f93a8000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:27.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.962+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8013900 con 0x7f93ac0ea0e0 2024-03-23T06:18:27.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.962+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4805 (secure 0 0 0) 0x7f93a8013a60 con 0x7f93ac0ea0e0 2024-03-23T06:18:27.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.962+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0ea0e0 msgr2=0x7f93ac0f9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.962+0000 7f93b0c00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0ea0e0 0x7f93ac0f9e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93a8014000 tx=0x7f93a8000ed0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.963+0000 7f93b0c00640 1 -- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0ea0e0 msgr2=0x7f93ac0f9e00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:27.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.963+0000 7f93b0c00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0ea0e0 0x7f93ac0f9e00 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93a8014000 tx=0x7f93a8000ed0 comp rx=0 tx=0).stop 2024-03-23T06:18:27.963 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:27.963 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 82, 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.965 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:27.966 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:27.967 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.968 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:27.969 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.970 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:27.971 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:27.972 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.973 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.974 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:27.975 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f939406ac80 msgr2=0x7f939406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9e00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f939406ac80 0x7f939406d140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f93a0038000 tx=0x7f93a0032000 comp rx=0 tx=0).stop 2024-03-23T06:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 msgr2=0x7f93ac0e9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9e00640 1 --2- 172.21.15.73:0/1000860008 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93ac0fff40 0x7f93ac0e9520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f93b404f810 tx=0x7f93b4067930 comp rx=0 tx=0).stop 2024-03-23T06:18:27.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9400640 1 -- 172.21.15.73:0/1000860008 reap_dead start 2024-03-23T06:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9400640 1 -- 172.21.15.73:0/1000860008 reap_dead start 2024-03-23T06:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 shutdown_connections 2024-03-23T06:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 >> 172.21.15.73:0/1000860008 conn(0x7f93ac050150 msgr2=0x7f93ac0f2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 shutdown_connections 2024-03-23T06:18:27.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:27.964+0000 7f93b9e00640 1 -- 172.21.15.73:0/1000860008 wait complete. 2024-03-23T06:18:28.002 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:18:28.003 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:18:28.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:18:28.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.385+0000 7fbc8ca00640 1 Processor -- start 2024-03-23T06:18:28.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.385+0000 7fbc8ca00640 1 -- start start 2024-03-23T06:18:28.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.387+0000 7fbc8ca00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc88156070 0x7fbc880c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:28.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.387+0000 7fbc8ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc8806de90 0x7fbc880c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:28.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.387+0000 7fbc8ca00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc880c70e0 con 0x7fbc88152950 2024-03-23T06:18:28.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.387+0000 7fbc8ca00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc880c73c0 con 0x7fbc88156070 2024-03-23T06:18:28.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.387+0000 7fbc8ca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc880c76a0 con 0x7fbc8806de90 2024-03-23T06:18:28.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.388+0000 7fbc86a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc88156070 0x7fbc880c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.388+0000 7fbc87400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbc88152950 0x7fbc880ca730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46748/0 (socket says 172.21.15.73:46748) 2024-03-23T06:18:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.388+0000 7fbc87400640 1 -- 172.21.15.73:0/3374150601 learned_addr learned my addr 172.21.15.73:0/3374150601 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:28.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.389+0000 7fbc87e00640 1 --2- 172.21.15.73:0/3374150601 >> v2:172.21.15.110:3300/0 conn(0x7fbc8806de90 0x7fbc880c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.390+0000 7fbc86a00640 1 -- 172.21.15.73:0/3374150601 >> v2:172.21.15.110:3300/0 conn(0x7fbc8806de90 msgr2=0x7fbc880c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.390+0000 7fbc86000640 1 -- 172.21.15.73:0/3374150601 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088999613 0 0) 0x7fbc880c70e0 con 0x7fbc88152950 2024-03-23T06:18:28.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.390+0000 7fbc86a00640 1 --2- 172.21.15.73:0/3374150601 >> v2:172.21.15.110:3300/0 conn(0x7fbc8806de90 0x7fbc880c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:28.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.390+0000 7fbc86a00640 1 -- 172.21.15.73:0/3374150601 >> v1:172.21.15.73:6789/0 conn(0x7fbc88152950 legacy=0x7fbc880ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:28.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.390+0000 7fbc86a00640 1 -- 172.21.15.73:0/3374150601 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc880c7980 con 0x7fbc88156070 2024-03-23T06:18:28.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.395+0000 7fbc86a00640 1 --2- 172.21.15.73:0/3374150601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88156070 0x7fbc880c5c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc880cb3d0 tx=0x7fbc7802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b667b361cac7c89f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:28.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.395+0000 7fbc86000640 1 -- 172.21.15.73:0/3374150601 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78031640 con 0x7fbc88156070 2024-03-23T06:18:28.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.396+0000 7fbc86000640 1 -- 172.21.15.73:0/3374150601 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc780317a0 con 0x7fbc88156070 2024-03-23T06:18:28.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.396+0000 7fbc86000640 1 -- 172.21.15.73:0/3374150601 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78031640 con 0x7fbc88156070 2024-03-23T06:18:28.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.397+0000 7fbc8ca00640 1 -- 172.21.15.73:0/3374150601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88156070 msgr2=0x7fbc880c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:28.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.397+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/3374150601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88156070 0x7fbc880c5c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbc880cb3d0 tx=0x7fbc7802b8f0 comp rx=0 tx=0).stop 2024-03-23T06:18:28.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.398+0000 7fbc8ca00640 1 -- 172.21.15.73:0/3374150601 shutdown_connections 2024-03-23T06:18:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.398+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/3374150601 >> v2:172.21.15.110:3300/0 conn(0x7fbc8806de90 0x7fbc880c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.398+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/3374150601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88156070 0x7fbc880c5c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.398+0000 7fbc8ca00640 1 -- 172.21.15.73:0/3374150601 >> 172.21.15.73:0/3374150601 conn(0x7fbc8806d3a0 msgr2=0x7fbc8806d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.399+0000 7fbc8ca00640 1 -- 172.21.15.73:0/3374150601 shutdown_connections 2024-03-23T06:18:28.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.399+0000 7fbc8ca00640 1 -- 172.21.15.73:0/3374150601 wait complete. 2024-03-23T06:18:28.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.401+0000 7fbc8ca00640 1 Processor -- start 2024-03-23T06:18:28.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.401+0000 7fbc8ca00640 1 -- start start 2024-03-23T06:18:28.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.402+0000 7fbc8ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc8806de90 0x7fbc880c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:28.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.402+0000 7fbc8ca00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88152950 0x7fbc880c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:28.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.402+0000 7fbc8ca00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc88156070 0x7fbc88158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:28.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.402+0000 7fbc8ca00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880c0040 con 0x7fbc88152950 2024-03-23T06:18:28.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.402+0000 7fbc8ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880c8780 con 0x7fbc8806de90 2024-03-23T06:18:28.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.402+0000 7fbc8ca00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880c1750 con 0x7fbc88156070 2024-03-23T06:18:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.404+0000 7fbc87400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc8806de90 0x7fbc880c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.404+0000 7fbc87400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc8806de90 0x7fbc880c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:46168/0 (socket says 172.21.15.73:46168) 2024-03-23T06:18:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.405+0000 7fbc86a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88152950 0x7fbc880c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.405+0000 7fbc86a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88152950 0x7fbc880c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53636/0 (socket says 172.21.15.73:53636) 2024-03-23T06:18:28.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.405+0000 7fbc86a00640 1 -- 172.21.15.73:0/4109177431 learned_addr learned my addr 172.21.15.73:0/4109177431 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.406+0000 7fbc87400640 1 -- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc88156070 msgr2=0x7fbc88158800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T06:18:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.406+0000 7fbc87400640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc88156070 0x7fbc88158800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:28.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.406+0000 7fbc87400640 1 -- 172.21.15.73:0/4109177431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88152950 msgr2=0x7fbc880c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:28.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.406+0000 7fbc87400640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88152950 0x7fbc880c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:28.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.406+0000 7fbc87400640 1 -- 172.21.15.73:0/4109177431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc780093a0 con 0x7fbc8806de90 2024-03-23T06:18:28.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.406+0000 7fbc86a00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88152950 0x7fbc880c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:18:28.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.408+0000 7fbc87400640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc8806de90 0x7fbc880c8ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000c750 tx=0x7fbc8000cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:28.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.409+0000 7fbc7f400640 1 -- 172.21.15.73:0/4109177431 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000ce60 con 0x7fbc8806de90 2024-03-23T06:18:28.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.410+0000 7fbc7f400640 1 -- 172.21.15.73:0/4109177431 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8000a640 con 0x7fbc8806de90 2024-03-23T06:18:28.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.410+0000 7fbc7f400640 1 -- 172.21.15.73:0/4109177431 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000a9f0 con 0x7fbc8806de90 2024-03-23T06:18:28.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.414+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc880c1190 con 0x7fbc8806de90 2024-03-23T06:18:28.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.414+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc880bf590 con 0x7fbc8806de90 2024-03-23T06:18:28.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.417+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc880c4ed0 con 0x7fbc8806de90 2024-03-23T06:18:28.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.419+0000 7fbc7f400640 1 -- 172.21.15.73:0/4109177431 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbc8000ab50 con 0x7fbc8806de90 2024-03-23T06:18:28.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.421+0000 7fbc7f400640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc6806ac30 0x7fbc6806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:28.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.421+0000 7fbc7f400640 1 -- 172.21.15.73:0/4109177431 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fbc80088a90 con 0x7fbc8806de90 2024-03-23T06:18:28.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.422+0000 7fbc86a00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc6806ac30 0x7fbc6806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:28.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.423+0000 7fbc86a00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc6806ac30 0x7fbc6806d0f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbc881535c0 tx=0x7fbc78008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:28.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:28.426+0000 7fbc7f400640 1 -- 172.21.15.73:0/4109177431 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbc800539a0 con 0x7fbc8806de90 2024-03-23T06:18:29.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.050+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fbc880c1ce0 con 0x7fbc8806de90 2024-03-23T06:18:29.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.066+0000 7fbc7f400640 1 -- 172.21.15.73:0/4109177431 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fbc80018080 con 0x7fbc8806de90 2024-03-23T06:18:29.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.075+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc6806ac30 msgr2=0x7fbc6806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:29.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.075+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc6806ac30 0x7fbc6806d0f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbc881535c0 tx=0x7fbc78008030 comp rx=0 tx=0).stop 2024-03-23T06:18:29.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.075+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc8806de90 msgr2=0x7fbc880c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:29.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.075+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc8806de90 0x7fbc880c8ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000c750 tx=0x7fbc8000cc10 comp rx=0 tx=0).stop 2024-03-23T06:18:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.078+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 shutdown_connections 2024-03-23T06:18:29.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.078+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbc6806ac30 0x7fbc6806d0f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.078+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc88156070 0x7fbc88158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.078+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc88152950 0x7fbc880c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.078+0000 7fbc8ca00640 1 --2- 172.21.15.73:0/4109177431 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc8806de90 0x7fbc880c8ba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:29.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.078+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 >> 172.21.15.73:0/4109177431 conn(0x7fbc8806d3a0 msgr2=0x7fbc8814dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:29.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.080+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 shutdown_connections 2024-03-23T06:18:29.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:29.082+0000 7fbc8ca00640 1 -- 172.21.15.73:0/4109177431 wait complete. 2024-03-23T06:18:29.144 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:18:39.144 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:18:39.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:18:39.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.761+0000 7f3df5400640 1 Processor -- start 2024-03-23T06:18:39.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.761+0000 7f3df5400640 1 -- start start 2024-03-23T06:18:39.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.764+0000 7f3df5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3df01594f0 0x7f3df00cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:39.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.764+0000 7f3df5400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df01599a0 con 0x7f3df0153a80 2024-03-23T06:18:39.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.764+0000 7f3df5400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df0159c80 con 0x7f3df01536a0 2024-03-23T06:18:39.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.764+0000 7f3df5400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df015a520 con 0x7f3df01594f0 2024-03-23T06:18:39.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.764+0000 7f3dee800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3df01536a0 0x7f3df00ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:37592/0 (socket says 172.21.15.73:37592) 2024-03-23T06:18:39.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.764+0000 7f3dee800640 1 -- 172.21.15.73:0/2881313966 learned_addr learned my addr 172.21.15.73:0/2881313966 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:39.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.764+0000 7f3def200640 1 --2- 172.21.15.73:0/2881313966 >> v2:172.21.15.73:3300/0 conn(0x7f3df01594f0 0x7f3df00cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:39.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.764+0000 7f3ded400640 1 -- 172.21.15.73:0/2881313966 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681617307 0 0) 0x7f3df0159c80 con 0x7f3df01536a0 2024-03-23T06:18:39.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.765+0000 7f3ded400640 1 -- 172.21.15.73:0/2881313966 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd4003520 con 0x7f3df01536a0 2024-03-23T06:18:39.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.766+0000 7f3def200640 1 -- 172.21.15.73:0/2881313966 >> v1:172.21.15.110:6789/0 conn(0x7f3df01536a0 legacy=0x7f3df00ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:39.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.766+0000 7f3def200640 1 -- 172.21.15.73:0/2881313966 >> v1:172.21.15.73:6789/0 conn(0x7f3df0153a80 legacy=0x7f3df00cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:39.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.766+0000 7f3def200640 1 -- 172.21.15.73:0/2881313966 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df0159f60 con 0x7f3df01594f0 2024-03-23T06:18:39.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.766+0000 7f3ded400640 1 -- 172.21.15.73:0/2881313966 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4266471453 0 0) 0x7f3dd4003520 con 0x7f3df01536a0 2024-03-23T06:18:39.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.767+0000 7f3def200640 1 --2- 172.21.15.73:0/2881313966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df01594f0 0x7f3df00cf1c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009d90 tx=0x7f3de802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a4ecabb2c8d3ef server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:39.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.768+0000 7f3ded400640 1 -- 172.21.15.73:0/2881313966 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0001670 con 0x7f3df01594f0 2024-03-23T06:18:39.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.768+0000 7f3ded400640 1 -- 172.21.15.73:0/2881313966 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de802c970 con 0x7f3df01594f0 2024-03-23T06:18:39.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.768+0000 7f3ded400640 1 -- 172.21.15.73:0/2881313966 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de802cd00 con 0x7f3df01594f0 2024-03-23T06:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.769+0000 7f3df5400640 1 -- 172.21.15.73:0/2881313966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df01594f0 msgr2=0x7f3df00cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:39.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.769+0000 7f3df5400640 1 --2- 172.21.15.73:0/2881313966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df01594f0 0x7f3df00cf1c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009d90 tx=0x7f3de802be40 comp rx=0 tx=0).stop 2024-03-23T06:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.770+0000 7f3df5400640 1 -- 172.21.15.73:0/2881313966 shutdown_connections 2024-03-23T06:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.770+0000 7f3df5400640 1 --2- 172.21.15.73:0/2881313966 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df01594f0 0x7f3df00cf1c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.770+0000 7f3df5400640 1 -- 172.21.15.73:0/2881313966 >> 172.21.15.73:0/2881313966 conn(0x7f3df006a060 msgr2=0x7f3df006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.773+0000 7f3df5400640 1 -- 172.21.15.73:0/2881313966 shutdown_connections 2024-03-23T06:18:39.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.773+0000 7f3df5400640 1 -- 172.21.15.73:0/2881313966 wait complete. 2024-03-23T06:18:39.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.776+0000 7f3df5400640 1 Processor -- start 2024-03-23T06:18:39.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.776+0000 7f3df5400640 1 -- start start 2024-03-23T06:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.778+0000 7f3df5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df01536a0 0x7f3df01e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:39.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.778+0000 7f3df5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df0153a80 0x7f3df014b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.779+0000 7f3df5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df01594f0 0x7f3df014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.779+0000 7f3df5400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00b38f0 con 0x7f3df0153a80 2024-03-23T06:18:39.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.779+0000 7f3dede00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df0153a80 0x7f3df014b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.779+0000 7f3def200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df01594f0 0x7f3df014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.779+0000 7f3def200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df01594f0 0x7f3df014ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:37672/0 (socket says 172.21.15.73:37672) 2024-03-23T06:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.779+0000 7f3def200640 1 -- 172.21.15.73:0/623627492 learned_addr learned my addr 172.21.15.73:0/623627492 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.779+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df014add0 con 0x7f3df01594f0 2024-03-23T06:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.780+0000 7f3dee800640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df01536a0 0x7f3df01e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:39.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.780+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0149410 con 0x7f3df01536a0 2024-03-23T06:18:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.781+0000 7f3dede00640 1 -- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df01536a0 msgr2=0x7f3df01e5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.781+0000 7f3dede00640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df01536a0 0x7f3df01e5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.781+0000 7f3dede00640 1 -- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df01594f0 msgr2=0x7f3df014ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:39.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.781+0000 7f3dede00640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df01594f0 0x7f3df014ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.781+0000 7f3dede00640 1 -- 172.21.15.73:0/623627492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8009a70 con 0x7f3df0153a80 2024-03-23T06:18:39.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.782+0000 7f3dede00640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df0153a80 0x7f3df014b540 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00c390 tx=0x7f3ddc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.783+0000 7f3de6a00640 1 -- 172.21.15.73:0/623627492 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0052d0 con 0x7f3df0153a80 2024-03-23T06:18:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.783+0000 7f3de6a00640 1 -- 172.21.15.73:0/623627492 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc005430 con 0x7f3df0153a80 2024-03-23T06:18:39.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.783+0000 7f3de6a00640 1 -- 172.21.15.73:0/623627492 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc003830 con 0x7f3df0153a80 2024-03-23T06:18:39.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.783+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df00b18b0 con 0x7f3df0153a80 2024-03-23T06:18:39.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.783+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df014b020 con 0x7f3df0153a80 2024-03-23T06:18:39.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.789+0000 7f3de6a00640 1 -- 172.21.15.73:0/623627492 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3ddc003990 con 0x7f3df0153a80 2024-03-23T06:18:39.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.789+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df014b240 con 0x7f3df0153a80 2024-03-23T06:18:39.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.790+0000 7f3de6a00640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3dd006acd0 0x7f3dd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:39.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.790+0000 7f3de6a00640 1 -- 172.21.15.73:0/623627492 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f3ddc088b40 con 0x7f3df0153a80 2024-03-23T06:18:39.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.795+0000 7f3dee800640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3dd006acd0 0x7f3dd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:39.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.799+0000 7f3dee800640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3dd006acd0 0x7f3dd006d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3de0001b50 tx=0x7f3de0001ae0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:39.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:39.801+0000 7f3de6a00640 1 -- 172.21.15.73:0/623627492 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3ddc053ad0 con 0x7f3df0153a80 2024-03-23T06:18:40.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.369+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3df014d6f0 con 0x7f3df0153a80 2024-03-23T06:18:40.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.380+0000 7f3de6a00640 1 -- 172.21.15.73:0/623627492 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f3ddc017070 con 0x7f3df0153a80 2024-03-23T06:18:40.380 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:18:40.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.384+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3dd006acd0 msgr2=0x7f3dd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.384+0000 7f3df5400640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3dd006acd0 0x7f3dd006d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3de0001b50 tx=0x7f3de0001ae0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.384+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df0153a80 msgr2=0x7f3df014b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.384+0000 7f3df5400640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df0153a80 0x7f3df014b540 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00c390 tx=0x7f3ddc00c850 comp rx=0 tx=0).stop 2024-03-23T06:18:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.384+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 shutdown_connections 2024-03-23T06:18:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.384+0000 7f3df5400640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3df01594f0 0x7f3df014ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.384+0000 7f3df5400640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3df0153a80 0x7f3df014b540 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.385+0000 7f3df5400640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3dd006acd0 0x7f3dd006d190 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3de0001b50 tx=0x7f3de0001ae0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.385+0000 7f3df5400640 1 --2- 172.21.15.73:0/623627492 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3df01536a0 0x7f3df01e5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.385+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 >> 172.21.15.73:0/623627492 conn(0x7f3df006a060 msgr2=0x7f3df00c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.385+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 shutdown_connections 2024-03-23T06:18:40.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.385+0000 7f3df5400640 1 -- 172.21.15.73:0/623627492 wait complete. 2024-03-23T06:18:40.426 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:18:40.426 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:18:40.426 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:18:40.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:18:40.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.759+0000 7f9430200640 1 Processor -- start 2024-03-23T06:18:40.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.760+0000 7f9430200640 1 -- start start 2024-03-23T06:18:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.762+0000 7f9430200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f942814f560 0x7f942806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:40.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.762+0000 7f9430200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94280b0dc0 0x7f9428159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:40.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.763+0000 7f942ce00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f942814f560 0x7f942806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:40.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.763+0000 7f9430200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94280c6cf0 con 0x7f9428070c80 2024-03-23T06:18:40.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.763+0000 7f9430200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942806e0b0 con 0x7f942814f560 2024-03-23T06:18:40.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.763+0000 7f9430200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94280703c0 con 0x7f94280b0dc0 2024-03-23T06:18:40.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.764+0000 7f942d800640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9428070c80 0x7f94280c77f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:53542/0 (socket says 172.21.15.73:53542) 2024-03-23T06:18:40.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.764+0000 7f942d800640 1 -- 172.21.15.73:0/3735335044 learned_addr learned my addr 172.21.15.73:0/3735335044 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.766+0000 7f9427e00640 1 --2- 172.21.15.73:0/3735335044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94280b0dc0 0x7f9428159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.766+0000 7f942ec00640 1 -- 172.21.15.73:0/3735335044 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168210479 0 0) 0x7f94280c6cf0 con 0x7f9428070c80 2024-03-23T06:18:40.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.766+0000 7f942ec00640 1 -- 172.21.15.73:0/3735335044 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9410003520 con 0x7f9428070c80 2024-03-23T06:18:40.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.767+0000 7f9427e00640 1 -- 172.21.15.73:0/3735335044 >> v2:172.21.15.110:3300/0 conn(0x7f942814f560 msgr2=0x7f942806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:40.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.767+0000 7f9427e00640 1 --2- 172.21.15.73:0/3735335044 >> v2:172.21.15.110:3300/0 conn(0x7f942814f560 0x7f942806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.767+0000 7f9427e00640 1 -- 172.21.15.73:0/3735335044 >> v1:172.21.15.73:6789/0 conn(0x7f9428070c80 legacy=0x7f94280c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.768+0000 7f9427e00640 1 -- 172.21.15.73:0/3735335044 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94280c6fd0 con 0x7f94280b0dc0 2024-03-23T06:18:40.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.770+0000 7f942ce00640 1 --2- 172.21.15.73:0/3735335044 >> v2:172.21.15.110:3300/0 conn(0x7f942814f560 0x7f942806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:40.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.771+0000 7f9427e00640 1 --2- 172.21.15.73:0/3735335044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94280b0dc0 0x7f9428159250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f94140097a0 tx=0x7f941402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e88f824f292dd885 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:40.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.772+0000 7f942ec00640 1 -- 172.21.15.73:0/3735335044 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414030800 con 0x7f94280b0dc0 2024-03-23T06:18:40.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.772+0000 7f942ec00640 1 -- 172.21.15.73:0/3735335044 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9414030960 con 0x7f94280b0dc0 2024-03-23T06:18:40.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.773+0000 7f942ec00640 1 -- 172.21.15.73:0/3735335044 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414030800 con 0x7f94280b0dc0 2024-03-23T06:18:40.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.774+0000 7f9430200640 1 -- 172.21.15.73:0/3735335044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94280b0dc0 msgr2=0x7f9428159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.774+0000 7f9430200640 1 --2- 172.21.15.73:0/3735335044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94280b0dc0 0x7f9428159250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f94140097a0 tx=0x7f941402b940 comp rx=0 tx=0).stop 2024-03-23T06:18:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.778+0000 7f9430200640 1 -- 172.21.15.73:0/3735335044 shutdown_connections 2024-03-23T06:18:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.778+0000 7f9430200640 1 --2- 172.21.15.73:0/3735335044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94280b0dc0 0x7f9428159250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.778+0000 7f9430200640 1 --2- 172.21.15.73:0/3735335044 >> v2:172.21.15.110:3300/0 conn(0x7f942814f560 0x7f942806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.778+0000 7f9430200640 1 -- 172.21.15.73:0/3735335044 >> 172.21.15.73:0/3735335044 conn(0x7f942806c1a0 msgr2=0x7f9428069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.778+0000 7f9430200640 1 -- 172.21.15.73:0/3735335044 shutdown_connections 2024-03-23T06:18:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.778+0000 7f9430200640 1 -- 172.21.15.73:0/3735335044 wait complete. 2024-03-23T06:18:40.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.781+0000 7f9430200640 1 Processor -- start 2024-03-23T06:18:40.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.781+0000 7f9430200640 1 -- start start 2024-03-23T06:18:40.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.783+0000 7f9430200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428070c80 0x7f942814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:40.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.783+0000 7f9430200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f942814f560 0x7f9428155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:40.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.786+0000 7f9430200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9428152a90 0x7f94281fefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:40.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.786+0000 7f9430200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94281ffe60 con 0x7f9428070c80 2024-03-23T06:18:40.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.786+0000 7f942d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9428152a90 0x7f94281fefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:40.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.786+0000 7f942d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9428152a90 0x7f94281fefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:34522/0 (socket says 172.21.15.73:34522) 2024-03-23T06:18:40.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.786+0000 7f942d800640 1 -- 172.21.15.73:0/3018497282 learned_addr learned my addr 172.21.15.73:0/3018497282 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:40.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.787+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428150420 con 0x7f942814f560 2024-03-23T06:18:40.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.787+0000 7f942ce00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428070c80 0x7f942814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:40.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.787+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9428071100 con 0x7f9428152a90 2024-03-23T06:18:40.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.787+0000 7f9427e00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f942814f560 0x7f9428155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.789+0000 7f942ce00640 1 -- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9428152a90 msgr2=0x7f94281fefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.789+0000 7f942ce00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9428152a90 0x7f94281fefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.789+0000 7f942ce00640 1 -- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f942814f560 msgr2=0x7f9428155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.790+0000 7f942ce00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f942814f560 0x7f9428155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.790+0000 7f942ce00640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009400 con 0x7f9428070c80 2024-03-23T06:18:40.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.791+0000 7f9427e00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f942814f560 0x7f9428155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:40.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.792+0000 7f942ce00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428070c80 0x7f942814fee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f942000c7f0 tx=0x7f942000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:40.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.793+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420007820 con 0x7f9428070c80 2024-03-23T06:18:40.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.794+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9420007980 con 0x7f9428070c80 2024-03-23T06:18:40.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.794+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94280c5480 con 0x7f9428070c80 2024-03-23T06:18:40.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.795+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420007d10 con 0x7f9428070c80 2024-03-23T06:18:40.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.797+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94280c0f90 con 0x7f9428070c80 2024-03-23T06:18:40.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.805+0000 7f9430200640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94280b0dc0 0x7f94280712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:40.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.805+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428073c60 con 0x7f94280b0dc0 2024-03-23T06:18:40.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.806+0000 7f9427e00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94280b0dc0 0x7f94280712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:40.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.806+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9420011600 con 0x7f9428070c80 2024-03-23T06:18:40.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.808+0000 7f9425600640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f940806ac00 0x7f940806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:40.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.813+0000 7f942d800640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f940806ac00 0x7f940806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:40.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.814+0000 7f9427e00640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9428158d30 con 0x7f94280b0dc0 2024-03-23T06:18:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.814+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f9420089200 con 0x7f9428070c80 2024-03-23T06:18:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.814+0000 7f942d800640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f940806ac00 0x7f940806d0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9428152e90 tx=0x7f941c0016e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:40.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.815+0000 7f9427e00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94280b0dc0 0x7f94280712c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f942806e4a0 tx=0x7f94140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:40.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.816+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414003810 con 0x7f94280b0dc0 2024-03-23T06:18:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.816+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f941403f040 con 0x7f94280b0dc0 2024-03-23T06:18:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.817+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94280b0dc0 msgr2=0x7f94280712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.817+0000 7f9425600640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94280b0dc0 0x7f94280712c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f942806e4a0 tx=0x7f94140046c0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.817+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94280b0dc0 msgr2=0x7f94280712c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:40.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.817+0000 7f9425600640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94280b0dc0 0x7f94280712c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.832+0000 7f9430200640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428159320 0x7f94281ff500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:40.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.833+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9428158a50 con 0x7f9428159320 2024-03-23T06:18:40.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.834+0000 7f9427e00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428159320 0x7f94281ff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.835+0000 7f9427e00640 1 -- 172.21.15.73:0/3018497282 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9428159790 con 0x7f9428159320 2024-03-23T06:18:40.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.836+0000 7f9427e00640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428159320 0x7f94281ff500 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f94140097a0 tx=0x7f9414031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:40.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.836+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941404d410 con 0x7f9428159320 2024-03-23T06:18:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.837+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7f941404d570 con 0x7f9428159320 2024-03-23T06:18:40.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.837+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428159320 msgr2=0x7f94281ff500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.837 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:40.837 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:40.837 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 82, 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 15, 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:40.838 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:40.839 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:40.840 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:40.841 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:40.842 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.843 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:40.844 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:40.845 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.846 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:40.847 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:40.848 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:40.848 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.837+0000 7f9425600640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428159320 0x7f94281ff500 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f94140097a0 tx=0x7f9414031000 comp rx=0 tx=0).stop 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.838+0000 7f9425600640 1 -- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428159320 msgr2=0x7f94281ff500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.838+0000 7f9425600640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428159320 0x7f94281ff500 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f94140097a0 tx=0x7f9414031000 comp rx=0 tx=0).stop 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.839+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f940806ac00 msgr2=0x7f940806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.839+0000 7f9430200640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f940806ac00 0x7f940806d0c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9428152e90 tx=0x7f941c0016e0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.839+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428070c80 msgr2=0x7f942814fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.839+0000 7f9430200640 1 --2- 172.21.15.73:0/3018497282 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9428070c80 0x7f942814fee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f942000c7f0 tx=0x7f942000ccb0 comp rx=0 tx=0).stop 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.842+0000 7f942d800640 1 -- 172.21.15.73:0/3018497282 reap_dead start 2024-03-23T06:18:40.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.842+0000 7f942d800640 1 -- 172.21.15.73:0/3018497282 reap_dead start 2024-03-23T06:18:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.842+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 shutdown_connections 2024-03-23T06:18:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.842+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 >> 172.21.15.73:0/3018497282 conn(0x7f942806c1a0 msgr2=0x7f942814cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.843+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 shutdown_connections 2024-03-23T06:18:40.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:40.844+0000 7f9430200640 1 -- 172.21.15.73:0/3018497282 wait complete. 2024-03-23T06:18:40.869 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:18:40.869 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:18:40.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:18:41.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.289+0000 7f78c3200640 1 Processor -- start 2024-03-23T06:18:41.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.290+0000 7f78c3200640 1 -- start start 2024-03-23T06:18:41.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.292+0000 7f78c3200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78bc0c5b60 0x7f78bc15e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.292+0000 7f78c3200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0c94d0 con 0x7f78bc0caa20 2024-03-23T06:18:41.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.292+0000 7f78c3200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0c9850 con 0x7f78bc157b70 2024-03-23T06:18:41.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.292+0000 7f78c3200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0c76f0 con 0x7f78bc0c5b60 2024-03-23T06:18:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.295+0000 7f78bbe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f78bc157b70 0x7f78bc0c7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48618/0 (socket says 172.21.15.73:48618) 2024-03-23T06:18:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.296+0000 7f78bbe00640 1 -- 172.21.15.73:0/2758676537 learned_addr learned my addr 172.21.15.73:0/2758676537 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:41.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.296+0000 7f78bb400640 1 --2- 172.21.15.73:0/2758676537 >> v2:172.21.15.73:3300/0 conn(0x7f78bc0c5b60 0x7f78bc15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.299+0000 7f78baa00640 1 -- 172.21.15.73:0/2758676537 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116554300 0 0) 0x7f78bc0c9850 con 0x7f78bc157b70 2024-03-23T06:18:41.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.299+0000 7f78baa00640 1 -- 172.21.15.73:0/2758676537 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a0003520 con 0x7f78bc157b70 2024-03-23T06:18:41.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.300+0000 7f78bb400640 1 -- 172.21.15.73:0/2758676537 >> v1:172.21.15.110:6789/0 conn(0x7f78bc157b70 legacy=0x7f78bc0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.300+0000 7f78bb400640 1 -- 172.21.15.73:0/2758676537 >> v1:172.21.15.73:6789/0 conn(0x7f78bc0caa20 legacy=0x7f78bc168240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.300+0000 7f78bb400640 1 -- 172.21.15.73:0/2758676537 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0c9c30 con 0x7f78bc0c5b60 2024-03-23T06:18:41.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.304+0000 7f78bb400640 1 --2- 172.21.15.73:0/2758676537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0c5b60 0x7f78bc15e340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009a00 tx=0x7f78a802bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1f1c2e166ab2f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.305+0000 7f78baa00640 1 -- 172.21.15.73:0/2758676537 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a802c780 con 0x7f78bc0c5b60 2024-03-23T06:18:41.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.305+0000 7f78baa00640 1 -- 172.21.15.73:0/2758676537 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a802c8e0 con 0x7f78bc0c5b60 2024-03-23T06:18:41.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.305+0000 7f78baa00640 1 -- 172.21.15.73:0/2758676537 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a802c780 con 0x7f78bc0c5b60 2024-03-23T06:18:41.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.308+0000 7f78c3200640 1 -- 172.21.15.73:0/2758676537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0c5b60 msgr2=0x7f78bc15e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.308+0000 7f78c3200640 1 --2- 172.21.15.73:0/2758676537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0c5b60 0x7f78bc15e340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009a00 tx=0x7f78a802bbe0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.308+0000 7f78c3200640 1 -- 172.21.15.73:0/2758676537 shutdown_connections 2024-03-23T06:18:41.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.308+0000 7f78c3200640 1 --2- 172.21.15.73:0/2758676537 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0c5b60 0x7f78bc15e340 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.309+0000 7f78c3200640 1 -- 172.21.15.73:0/2758676537 >> 172.21.15.73:0/2758676537 conn(0x7f78bc069cb0 msgr2=0x7f78bc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:41.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.309+0000 7f78c3200640 1 -- 172.21.15.73:0/2758676537 shutdown_connections 2024-03-23T06:18:41.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.310+0000 7f78c3200640 1 -- 172.21.15.73:0/2758676537 wait complete. 2024-03-23T06:18:41.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.317+0000 7f78c3200640 1 Processor -- start 2024-03-23T06:18:41.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.318+0000 7f78c3200640 1 -- start start 2024-03-23T06:18:41.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.326+0000 7f78c3200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78bc0c5b60 0x7f78bc154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.327+0000 7f78bbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78bc0c5b60 0x7f78bc154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.327+0000 7f78bbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78bc0c5b60 0x7f78bc154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:34534/0 (socket says 172.21.15.73:34534) 2024-03-23T06:18:41.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.327+0000 7f78c3200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0caa20 0x7f78bc15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.327+0000 7f78bbe00640 1 -- 172.21.15.73:0/606720508 learned_addr learned my addr 172.21.15.73:0/606720508 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:41.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.328+0000 7f78c3200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc157b70 0x7f78bc15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.328+0000 7f78c1200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc157b70 0x7f78bc15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.332+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc153df0 con 0x7f78bc0caa20 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.332+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1f3530 con 0x7f78bc157b70 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.332+0000 7f78bb400640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0caa20 0x7f78bc15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.332+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1531e0 con 0x7f78bc0c5b60 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.332+0000 7f78c1200640 1 -- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78bc0c5b60 msgr2=0x7f78bc154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.333+0000 7f78c1200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78bc0c5b60 0x7f78bc154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.333+0000 7f78c1200640 1 -- 172.21.15.73:0/606720508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0caa20 msgr2=0x7f78bc15c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.333+0000 7f78c1200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0caa20 0x7f78bc15c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.333+0000 7f78c1200640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8009400 con 0x7f78bc157b70 2024-03-23T06:18:41.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.335+0000 7f78bb400640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78bc0caa20 0x7f78bc15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:41.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.336+0000 7f78c1200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc157b70 0x7f78bc15ec60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c730 tx=0x7f78b400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.338+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4006d50 con 0x7f78bc157b70 2024-03-23T06:18:41.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.338+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b4003970 con 0x7f78bc157b70 2024-03-23T06:18:41.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.338+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4003d60 con 0x7f78bc157b70 2024-03-23T06:18:41.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.343+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc1534c0 con 0x7f78bc157b70 2024-03-23T06:18:41.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.343+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc153a80 con 0x7f78bc157b70 2024-03-23T06:18:41.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.344+0000 7f78c3200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc15e540 0x7f78bc150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.344+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc073bf0 con 0x7f78bc15e540 2024-03-23T06:18:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.349+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f78b40050d0 con 0x7f78bc157b70 2024-03-23T06:18:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.350+0000 7f78bbe00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc15e540 0x7f78bc150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.350+0000 7f78bbe00640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78bc0c91f0 con 0x7f78bc15e540 2024-03-23T06:18:41.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.355+0000 7f78b3e00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f789c06acd0 0x7f789c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.357+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f78b4089200 con 0x7f78bc157b70 2024-03-23T06:18:41.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.358+0000 7f78bb400640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f789c06acd0 0x7f789c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.361+0000 7f78bbe00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc15e540 0x7f78bc150bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001410 tx=0x7f78ac0018d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.361+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac012590 con 0x7f78bc15e540 2024-03-23T06:18:41.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.362+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f78ac0126f0 con 0x7f78bc15e540 2024-03-23T06:18:41.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.362+0000 7f78bb400640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f789c06acd0 0x7f789c06d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f78a8036000 tx=0x7f78a8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.362+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc15e540 msgr2=0x7f78bc150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.362+0000 7f78b3e00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc15e540 0x7f78bc150bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001410 tx=0x7f78ac0018d0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.362+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc15e540 msgr2=0x7f78bc150bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:41.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.363+0000 7f78b3e00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc15e540 0x7f78bc150bb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.376+0000 7f78c3200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc1526f0 0x7f78bc1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.376+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc153650 con 0x7f78bc1526f0 2024-03-23T06:18:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.376+0000 7f78bbe00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc1526f0 0x7f78bc1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.376+0000 7f78bbe00640 1 -- 172.21.15.73:0/606720508 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f78bc0c8f50 con 0x7f78bc1526f0 2024-03-23T06:18:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.381+0000 7f78bbe00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc1526f0 0x7f78bc1510f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001410 tx=0x7f78ac000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.382+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac022070 con 0x7f78bc1526f0 2024-03-23T06:18:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.382+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5119 (secure 0 0 0) 0x7f78ac013420 con 0x7f78bc1526f0 2024-03-23T06:18:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.382+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc1526f0 msgr2=0x7f78bc1510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.382+0000 7f78b3e00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc1526f0 0x7f78bc1510f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001410 tx=0x7f78ac000ed0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.382+0000 7f78b3e00640 1 -- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc1526f0 msgr2=0x7f78bc1510f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 82, 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:41.383 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 15, 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:41.384 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:41.386 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:41.387 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.391 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:41.392 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 7 2024-03-23T06:18:41.393 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.394 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:41.395 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.382+0000 7f78b3e00640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc1526f0 0x7f78bc1510f0 secure :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001410 tx=0x7f78ac000ed0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.383+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f789c06acd0 msgr2=0x7f789c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.383+0000 7f78c3200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f789c06acd0 0x7f789c06d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f78a8036000 tx=0x7f78a8030000 comp rx=0 tx=0).stop 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.383+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc157b70 msgr2=0x7f78bc15ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.383+0000 7f78c3200640 1 --2- 172.21.15.73:0/606720508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78bc157b70 0x7f78bc15ec60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f78b400c730 tx=0x7f78b400cbf0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.383+0000 7f78c1200640 1 -- 172.21.15.73:0/606720508 reap_dead start 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.383+0000 7f78c1200640 1 -- 172.21.15.73:0/606720508 reap_dead start 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.384+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 shutdown_connections 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.384+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 >> 172.21.15.73:0/606720508 conn(0x7f78bc069cb0 msgr2=0x7f78bc0c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.385+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 shutdown_connections 2024-03-23T06:18:41.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.385+0000 7f78c3200640 1 -- 172.21.15.73:0/606720508 wait complete. 2024-03-23T06:18:41.422 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:18:41.423 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:18:41.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:18:41.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.740+0000 7fd808600640 1 Processor -- start 2024-03-23T06:18:41.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.741+0000 7fd808600640 1 -- start start 2024-03-23T06:18:41.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.742+0000 7fd808600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 0x7fd800159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.743+0000 7fd808600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80006a2d0 con 0x7fd8000c9740 2024-03-23T06:18:41.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.743+0000 7fd808600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80006a5b0 con 0x7fd8000ca940 2024-03-23T06:18:41.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.743+0000 7fd808600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80006a890 con 0x7fd800153760 2024-03-23T06:18:41.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.743+0000 7fd805c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 0x7fd800159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.743+0000 7fd805c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 0x7fd800159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:34548/0 (socket says 172.21.15.73:34548) 2024-03-23T06:18:41.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.743+0000 7fd805c00640 1 -- 172.21.15.73:0/2267495091 learned_addr learned my addr 172.21.15.73:0/2267495091 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:41.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.743+0000 7fd805c00640 1 -- 172.21.15.73:0/2267495091 >> v1:172.21.15.110:6789/0 conn(0x7fd8000ca940 legacy=0x7fd8000cadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:18:41.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.744+0000 7fd805c00640 1 -- 172.21.15.73:0/2267495091 >> v1:172.21.15.73:6789/0 conn(0x7fd8000c9740 legacy=0x7fd8000cb7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:41.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.744+0000 7fd805c00640 1 -- 172.21.15.73:0/2267495091 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80006ab70 con 0x7fd800153760 2024-03-23T06:18:41.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.745+0000 7fd805c00640 1 --2- 172.21.15.73:0/2267495091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 0x7fd800159420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009eb0 tx=0x7fd7f402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97936c3941011c25 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.747+0000 7fd7ffe00640 1 -- 172.21.15.73:0/2267495091 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f402ca40 con 0x7fd800153760 2024-03-23T06:18:41.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.747+0000 7fd7ffe00640 1 -- 172.21.15.73:0/2267495091 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f402cba0 con 0x7fd800153760 2024-03-23T06:18:41.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.747+0000 7fd7ffe00640 1 -- 172.21.15.73:0/2267495091 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40343f0 con 0x7fd800153760 2024-03-23T06:18:41.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.748+0000 7fd808600640 1 -- 172.21.15.73:0/2267495091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 msgr2=0x7fd800159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.748+0000 7fd808600640 1 --2- 172.21.15.73:0/2267495091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 0x7fd800159420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009eb0 tx=0x7fd7f402bea0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.749+0000 7fd808600640 1 -- 172.21.15.73:0/2267495091 shutdown_connections 2024-03-23T06:18:41.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.749+0000 7fd808600640 1 --2- 172.21.15.73:0/2267495091 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 0x7fd800159420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.749+0000 7fd808600640 1 -- 172.21.15.73:0/2267495091 >> 172.21.15.73:0/2267495091 conn(0x7fd80006c310 msgr2=0x7fd8000713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:41.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.749+0000 7fd808600640 1 -- 172.21.15.73:0/2267495091 shutdown_connections 2024-03-23T06:18:41.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.749+0000 7fd808600640 1 -- 172.21.15.73:0/2267495091 wait complete. 2024-03-23T06:18:41.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.753+0000 7fd808600640 1 Processor -- start 2024-03-23T06:18:41.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.753+0000 7fd808600640 1 -- start start 2024-03-23T06:18:41.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.756+0000 7fd808600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8000c9740 0x7fd8001506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.756+0000 7fd808600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8000ca940 0x7fd8001439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.756+0000 7fd808600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 0x7fd800143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.756+0000 7fd808600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd800143540 con 0x7fd8000ca940 2024-03-23T06:18:41.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.756+0000 7fd808600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd800152340 con 0x7fd8000c9740 2024-03-23T06:18:41.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.756+0000 7fd808600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd800152060 con 0x7fd800153760 2024-03-23T06:18:41.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.757+0000 7fd805c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8000c9740 0x7fd8001506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.757+0000 7fd805c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8000c9740 0x7fd8001506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:50348/0 (socket says 172.21.15.73:50348) 2024-03-23T06:18:41.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.757+0000 7fd805c00640 1 -- 172.21.15.73:0/885172962 learned_addr learned my addr 172.21.15.73:0/885172962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:41.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.757+0000 7fd805200640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8000ca940 0x7fd8001439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.759+0000 7fd805200640 1 -- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 msgr2=0x7fd800143f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T06:18:41.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.759+0000 7fd805200640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800153760 0x7fd800143f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.759+0000 7fd805200640 1 -- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8000c9740 msgr2=0x7fd8001506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.759+0000 7fd805200640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8000c9740 0x7fd8001506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.759+0000 7fd805200640 1 -- 172.21.15.73:0/885172962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4009b30 con 0x7fd8000ca940 2024-03-23T06:18:41.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.761+0000 7fd805200640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8000ca940 0x7fd8001439d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00c780 tx=0x7fd7ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.763+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec005070 con 0x7fd8000ca940 2024-03-23T06:18:41.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.763+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec0051f0 con 0x7fd8000ca940 2024-03-23T06:18:41.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.763+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec00a640 con 0x7fd8000ca940 2024-03-23T06:18:41.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.763+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd800145920 con 0x7fd8000ca940 2024-03-23T06:18:41.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.763+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd800145ee0 con 0x7fd8000ca940 2024-03-23T06:18:41.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.770+0000 7fd808600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800142cc0 0x7fd8001f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.770+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd800072510 con 0x7fd800142cc0 2024-03-23T06:18:41.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.774+0000 7fd805c00640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800142cc0 0x7fd8001f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.776+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd7ec00a7a0 con 0x7fd8000ca940 2024-03-23T06:18:41.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.777+0000 7fd7fd600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7e006acd0 0x7fd7e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.777+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd7ec088ae0 con 0x7fd8000ca940 2024-03-23T06:18:41.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.778+0000 7fd806600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7e006acd0 0x7fd7e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.778+0000 7fd805c00640 1 -- 172.21.15.73:0/885172962 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8000c9b80 con 0x7fd800142cc0 2024-03-23T06:18:41.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.778+0000 7fd805c00640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800142cc0 0x7fd8001f2670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4000f80 tx=0x7fd7f4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.779+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4049610 con 0x7fd800142cc0 2024-03-23T06:18:41.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.780+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd7f40497b0 con 0x7fd800142cc0 2024-03-23T06:18:41.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.780+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800142cc0 msgr2=0x7fd8001f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.780+0000 7fd7fd600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800142cc0 0x7fd8001f2670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4000f80 tx=0x7fd7f4004a40 comp rx=0 tx=0).stop 2024-03-23T06:18:41.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.780+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800142cc0 msgr2=0x7fd8001f2670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:41.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.780+0000 7fd7fd600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd800142cc0 0x7fd8001f2670 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4000f80 tx=0x7fd7f4004a40 comp rx=0 tx=0).stop 2024-03-23T06:18:41.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.786+0000 7fd806600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7e006acd0 0x7fd7e006d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd800157260 tx=0x7fd7f8006bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.795+0000 7fd808600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8001f2bb0 0x7fd8001eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:41.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.795+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd800153b40 con 0x7fd8001f2bb0 2024-03-23T06:18:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.796+0000 7fd805c00640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8001f2bb0 0x7fd8001eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:41.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.797+0000 7fd805c00640 1 -- 172.21.15.73:0/885172962 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd800143680 con 0x7fd8001f2bb0 2024-03-23T06:18:41.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.797+0000 7fd805c00640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8001f2bb0 0x7fd8001eee90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8000c9ee0 tx=0x7fd7f4009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:41.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.797+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f404e040 con 0x7fd8001f2bb0 2024-03-23T06:18:41.798 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:41.798 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 82, 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 16, 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:41.799 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:41.800 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:41.801 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:41.802 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:41.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:41.804 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.807 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:41.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.810 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:41.811 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.798+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4806 (secure 0 0 0) 0x7fd7f403fe20 con 0x7fd8001f2bb0 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.798+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8001f2bb0 msgr2=0x7fd8001eee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.798+0000 7fd7fd600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8001f2bb0 0x7fd8001eee90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8000c9ee0 tx=0x7fd7f4009810 comp rx=0 tx=0).stop 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.798+0000 7fd7fd600640 1 -- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8001f2bb0 msgr2=0x7fd8001eee90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.798+0000 7fd7fd600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8001f2bb0 0x7fd8001eee90 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8000c9ee0 tx=0x7fd7f4009810 comp rx=0 tx=0).stop 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.799+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7e006acd0 msgr2=0x7fd7e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.799+0000 7fd808600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7e006acd0 0x7fd7e006d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd800157260 tx=0x7fd7f8006bd0 comp rx=0 tx=0).stop 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.799+0000 7fd806600640 1 -- 172.21.15.73:0/885172962 reap_dead start 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.799+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8000ca940 msgr2=0x7fd8001439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:41.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.799+0000 7fd808600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8000ca940 0x7fd8001439d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00c780 tx=0x7fd7ec00cc40 comp rx=0 tx=0).stop 2024-03-23T06:18:41.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.799+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 shutdown_connections 2024-03-23T06:18:41.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.799+0000 7fd808600640 1 --2- 172.21.15.73:0/885172962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8000ca940 0x7fd8001439d0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec00c780 tx=0x7fd7ec00cc40 comp rx=0 tx=0).stop 2024-03-23T06:18:41.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.799+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 >> 172.21.15.73:0/885172962 conn(0x7fd80006c310 msgr2=0x7fd800150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:41.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.800+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 shutdown_connections 2024-03-23T06:18:41.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:41.800+0000 7fd808600640 1 -- 172.21.15.73:0/885172962 wait complete. 2024-03-23T06:18:41.830 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:18:41.830 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-03-23T06:18:41.830 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T06:18:41.830 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-03-23T06:18:41.831 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T06:18:41.831 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-23T06:18:41.831 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:18:41.843 INFO:tasks.ceph.mon.c:Stopped 2024-03-23T06:18:41.843 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:18:41.843 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:18:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.070+0000 7f6447600640 1 Processor -- start 2024-03-23T06:18:42.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.070+0000 7f6447600640 1 -- start start 2024-03-23T06:18:42.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.071+0000 7f6447600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64401537d0 0x7f64401594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:42.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.071+0000 7f6447600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f644015d350 0x7f64400c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:42.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.072+0000 7f6447600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f644015d790 0x7f64400c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:42.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.072+0000 7f6447600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6440153bb0 con 0x7f644015d790 2024-03-23T06:18:42.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.072+0000 7f6447600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6440159b30 con 0x7f64401537d0 2024-03-23T06:18:42.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.072+0000 7f6447600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6440159e10 con 0x7f644015d350 2024-03-23T06:18:42.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.073+0000 7f643fe00640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f644015d350 msgr2=0x7f64400c7810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:42.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.073+0000 7f643fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f644015d350 0x7f64400c7810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:42.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.073+0000 7f6444c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64401537d0 0x7f64401594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:42.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.073+0000 7f6444c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64401537d0 0x7f64401594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:50372/0 (socket says 172.21.15.73:50372) 2024-03-23T06:18:42.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.073+0000 7f6444c00640 1 -- 172.21.15.73:0/1479808069 learned_addr learned my addr 172.21.15.73:0/1479808069 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:42.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.074+0000 7f6444c00640 1 -- 172.21.15.73:0/1479808069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f644015d350 msgr2=0x7f64400c7810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:42.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.074+0000 7f6444c00640 1 --2- 172.21.15.73:0/1479808069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f644015d350 0x7f64400c7810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.074+0000 7f6444c00640 1 -- 172.21.15.73:0/1479808069 >> v2:172.21.15.73:3300/0 conn(0x7f644015d790 msgr2=0x7f64400c7d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:42.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.077+0000 7f6445600640 1 --2- 172.21.15.73:0/1479808069 >> v2:172.21.15.73:3300/0 conn(0x7f644015d790 0x7f64400c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:42.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.077+0000 7f6444c00640 1 --2- 172.21.15.73:0/1479808069 >> v2:172.21.15.73:3300/0 conn(0x7f644015d790 0x7f64400c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.077+0000 7f6444c00640 1 -- 172.21.15.73:0/1479808069 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644015a0f0 con 0x7f64401537d0 2024-03-23T06:18:42.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.079+0000 7f6445600640 1 --2- 172.21.15.73:0/1479808069 >> v2:172.21.15.73:3300/0 conn(0x7f644015d790 0x7f64400c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:42.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.080+0000 7f6444c00640 1 --2- 172.21.15.73:0/1479808069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64401537d0 0x7f64401594c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f64400c8360 tx=0x7f643402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e863971223220af server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:42.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.080+0000 7f643f400640 1 -- 172.21.15.73:0/1479808069 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434030610 con 0x7f64401537d0 2024-03-23T06:18:42.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.080+0000 7f643f400640 1 -- 172.21.15.73:0/1479808069 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6434030770 con 0x7f64401537d0 2024-03-23T06:18:42.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.080+0000 7f643f400640 1 -- 172.21.15.73:0/1479808069 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434030b40 con 0x7f64401537d0 2024-03-23T06:18:42.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 -- 172.21.15.73:0/1479808069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64401537d0 msgr2=0x7f64401594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:42.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 --2- 172.21.15.73:0/1479808069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64401537d0 0x7f64401594c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f64400c8360 tx=0x7f643402b960 comp rx=0 tx=0).stop 2024-03-23T06:18:42.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 -- 172.21.15.73:0/1479808069 shutdown_connections 2024-03-23T06:18:42.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 --2- 172.21.15.73:0/1479808069 >> v2:172.21.15.73:3300/0 conn(0x7f644015d790 0x7f64400c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 --2- 172.21.15.73:0/1479808069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f644015d350 0x7f64400c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 --2- 172.21.15.73:0/1479808069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64401537d0 0x7f64401594c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 -- 172.21.15.73:0/1479808069 >> 172.21.15.73:0/1479808069 conn(0x7f644006bb40 msgr2=0x7f644006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:42.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 -- 172.21.15.73:0/1479808069 shutdown_connections 2024-03-23T06:18:42.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.082+0000 7f6447600640 1 -- 172.21.15.73:0/1479808069 wait complete. 2024-03-23T06:18:42.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.101+0000 7f6447600640 1 Processor -- start 2024-03-23T06:18:42.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.101+0000 7f6447600640 1 -- start start 2024-03-23T06:18:42.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.103+0000 7f6447600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64401537d0 0x7f64401f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:42.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.103+0000 7f6447600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644015d350 0x7f64401e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:42.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.103+0000 7f6447600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f644015d790 0x7f64401e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:42.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.103+0000 7f6447600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64400cb930 con 0x7f644015d790 2024-03-23T06:18:42.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.103+0000 7f6447600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64400ca7b0 con 0x7f644015d350 2024-03-23T06:18:42.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.103+0000 7f6447600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64401e8570 con 0x7f64401537d0 2024-03-23T06:18:42.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.103+0000 7f643fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644015d350 0x7f64401e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:42.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.104+0000 7f643fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644015d350 0x7f64401e8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:50380/0 (socket says 172.21.15.73:50380) 2024-03-23T06:18:42.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.104+0000 7f643fe00640 1 -- 172.21.15.73:0/1018589531 learned_addr learned my addr 172.21.15.73:0/1018589531 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:42.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.104+0000 7f6445600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f644015d790 0x7f64401e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:42.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.104+0000 7f6444c00640 1 -- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64401537d0 msgr2=0x7f64401f42f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:42.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.104+0000 7f6444c00640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64401537d0 0x7f64401f42f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.105+0000 7f6445600640 1 -- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64401537d0 msgr2=0x7f64401f42f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.105+0000 7f6445600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64401537d0 0x7f64401f42f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.105+0000 7f6445600640 1 -- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644015d350 msgr2=0x7f64401e8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.105+0000 7f6445600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644015d350 0x7f64401e8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.105+0000 7f6445600640 1 -- 172.21.15.73:0/1018589531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64340094d0 con 0x7f644015d790 2024-03-23T06:18:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.105+0000 7f6445600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f644015d790 0x7f64401e8f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f643800ce20 tx=0x7f643800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:42.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.107+0000 7f643cc00640 1 -- 172.21.15.73:0/1018589531 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800d840 con 0x7f644015d790 2024-03-23T06:18:42.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.107+0000 7f643cc00640 1 -- 172.21.15.73:0/1018589531 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800d9a0 con 0x7f644015d790 2024-03-23T06:18:42.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.107+0000 7f643cc00640 1 -- 172.21.15.73:0/1018589531 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800dd30 con 0x7f644015d790 2024-03-23T06:18:42.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.107+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64400cb370 con 0x7f644015d790 2024-03-23T06:18:42.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.107+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64401e7f20 con 0x7f644015d790 2024-03-23T06:18:42.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.109+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c005250 con 0x7f644015d790 2024-03-23T06:18:42.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.124+0000 7f643cc00640 1 -- 172.21.15.73:0/1018589531 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6438013340 con 0x7f644015d790 2024-03-23T06:18:42.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.127+0000 7f643cc00640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f642006ac00 0x7f642006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:42.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.128+0000 7f643cc00640 1 -- 172.21.15.73:0/1018589531 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f643808a2d0 con 0x7f644015d790 2024-03-23T06:18:42.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.129+0000 7f6444c00640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f642006ac00 0x7f642006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:42.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.129+0000 7f643cc00640 1 -- 172.21.15.73:0/1018589531 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6438055090 con 0x7f644015d790 2024-03-23T06:18:42.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.131+0000 7f6444c00640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f642006ac00 0x7f642006d0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6434036000 tx=0x7f6434008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:42.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.664+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f641c0057d0 con 0x7f644015d790 2024-03-23T06:18:42.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.667+0000 7f643cc00640 1 -- 172.21.15.73:0/1018589531 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f643801a080 con 0x7f644015d790 2024-03-23T06:18:42.668 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:18:42.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.671+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f642006ac00 msgr2=0x7f642006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:42.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.671+0000 7f6447600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f642006ac00 0x7f642006d0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6434036000 tx=0x7f6434008030 comp rx=0 tx=0).stop 2024-03-23T06:18:42.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.671+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f644015d790 msgr2=0x7f64401e8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:42.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.671+0000 7f6447600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f644015d790 0x7f64401e8f40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f643800ce20 tx=0x7f643800a710 comp rx=0 tx=0).stop 2024-03-23T06:18:42.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.674+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 shutdown_connections 2024-03-23T06:18:42.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.674+0000 7f6447600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f644015d790 0x7f64401e8f40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.674+0000 7f6447600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f644015d350 0x7f64401e8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.674+0000 7f6447600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f642006ac00 0x7f642006d0c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.674+0000 7f6447600640 1 --2- 172.21.15.73:0/1018589531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64401537d0 0x7f64401f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:42.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.674+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 >> 172.21.15.73:0/1018589531 conn(0x7f644006bb40 msgr2=0x7f644015b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:42.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.674+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 shutdown_connections 2024-03-23T06:18:42.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:42.674+0000 7f6447600640 1 -- 172.21.15.73:0/1018589531 wait complete. 2024-03-23T06:18:45.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:18:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.065+0000 7f7a17e00640 1 Processor -- start 2024-03-23T06:18:46.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.065+0000 7f7a17e00640 1 -- start start 2024-03-23T06:18:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.067+0000 7f7a17e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a101536a0 0x7f7a100ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.067+0000 7f7a17e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a101594f0 0x7f7a100cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.067+0000 7f7a17e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a100cab20 con 0x7f7a10153a80 2024-03-23T06:18:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.067+0000 7f7a17e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1015a520 con 0x7f7a101594f0 2024-03-23T06:18:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.067+0000 7f7a17e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a101599a0 con 0x7f7a101536a0 2024-03-23T06:18:46.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.067+0000 7f7a15400640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a101536a0 msgr2=0x7f7a100ca5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:46.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.068+0000 7f7a15400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a101536a0 0x7f7a100ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:46.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.068+0000 7f7a15e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a101594f0 0x7f7a100cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:46.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.068+0000 7f7a14a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7a10153a80 0x7f7a100cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:48638/0 (socket says 172.21.15.73:48638) 2024-03-23T06:18:46.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.068+0000 7f7a15e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a101594f0 0x7f7a100cf1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:50396/0 (socket says 172.21.15.73:50396) 2024-03-23T06:18:46.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.068+0000 7f7a14a00640 1 -- 172.21.15.73:0/403893955 learned_addr learned my addr 172.21.15.73:0/403893955 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:46.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.069+0000 7f7a15e00640 1 -- 172.21.15.73:0/403893955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a101536a0 msgr2=0x7f7a100ca5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:46.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.069+0000 7f7a15e00640 1 --2- 172.21.15.73:0/403893955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a101536a0 0x7f7a100ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.069+0000 7f7a15e00640 1 -- 172.21.15.73:0/403893955 >> v1:172.21.15.110:6789/0 conn(0x7f7a10153a80 legacy=0x7f7a100cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:46.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.069+0000 7f7a15e00640 1 -- 172.21.15.73:0/403893955 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a10159c80 con 0x7f7a101594f0 2024-03-23T06:18:46.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.071+0000 7f7a15e00640 1 --2- 172.21.15.73:0/403893955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a100cf1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009d90 tx=0x7f7a0802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=462c2979e1fe7832 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:46.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.072+0000 7f7a0fe00640 1 -- 172.21.15.73:0/403893955 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0802cc80 con 0x7f7a101594f0 2024-03-23T06:18:46.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.072+0000 7f7a0fe00640 1 -- 172.21.15.73:0/403893955 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0802cde0 con 0x7f7a101594f0 2024-03-23T06:18:46.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.072+0000 7f7a0fe00640 1 -- 172.21.15.73:0/403893955 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08034660 con 0x7f7a101594f0 2024-03-23T06:18:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.073+0000 7f7a17e00640 1 -- 172.21.15.73:0/403893955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 msgr2=0x7f7a100cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.073+0000 7f7a17e00640 1 --2- 172.21.15.73:0/403893955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a100cf1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009d90 tx=0x7f7a0802bed0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.073+0000 7f7a17e00640 1 -- 172.21.15.73:0/403893955 shutdown_connections 2024-03-23T06:18:46.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.073+0000 7f7a17e00640 1 --2- 172.21.15.73:0/403893955 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a100cf1c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.073+0000 7f7a17e00640 1 --2- 172.21.15.73:0/403893955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a101536a0 0x7f7a100ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.073+0000 7f7a17e00640 1 -- 172.21.15.73:0/403893955 >> 172.21.15.73:0/403893955 conn(0x7f7a1006a060 msgr2=0x7f7a1006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:46.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.074+0000 7f7a17e00640 1 -- 172.21.15.73:0/403893955 shutdown_connections 2024-03-23T06:18:46.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.074+0000 7f7a17e00640 1 -- 172.21.15.73:0/403893955 wait complete. 2024-03-23T06:18:46.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.077+0000 7f7a17e00640 1 Processor -- start 2024-03-23T06:18:46.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.077+0000 7f7a17e00640 1 -- start start 2024-03-23T06:18:46.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.078+0000 7f7a17e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a101536a0 0x7f7a10157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:46.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.079+0000 7f7a17e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a10153a80 0x7f7a101f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:46.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.079+0000 7f7a17e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a1006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:46.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.079+0000 7f7a17e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a101f6d80 con 0x7f7a101536a0 2024-03-23T06:18:46.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.079+0000 7f7a17e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1014db80 con 0x7f7a101594f0 2024-03-23T06:18:46.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.079+0000 7f7a15e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a1006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:46.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.079+0000 7f7a15e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a1006bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:50412/0 (socket says 172.21.15.73:50412) 2024-03-23T06:18:46.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.079+0000 7f7a15e00640 1 -- 172.21.15.73:0/2576880211 learned_addr learned my addr 172.21.15.73:0/2576880211 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:46.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.080+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10140790 con 0x7f7a10153a80 2024-03-23T06:18:46.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.079+0000 7f7a14a00640 1 -- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a10153a80 msgr2=0x7f7a101f6840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:46.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.080+0000 7f7a14a00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a10153a80 0x7f7a101f6840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:46.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.080+0000 7f7a15400640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a101536a0 0x7f7a10157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:46.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.080+0000 7f7a15e00640 1 -- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a10153a80 msgr2=0x7f7a101f6840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:46.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.080+0000 7f7a15e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a10153a80 0x7f7a101f6840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.080+0000 7f7a15e00640 1 -- 172.21.15.73:0/2576880211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a101536a0 msgr2=0x7f7a10157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:46.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.080+0000 7f7a15e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a101536a0 0x7f7a10157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.081+0000 7f7a15e00640 1 -- 172.21.15.73:0/2576880211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08009a70 con 0x7f7a101594f0 2024-03-23T06:18:46.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.081+0000 7f7a15400640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a101536a0 0x7f7a10157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:18:46.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.082+0000 7f7a15e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a1006bf10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009d90 tx=0x7f7a08004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:46.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.082+0000 7f7a0d600640 1 -- 172.21.15.73:0/2576880211 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0803f420 con 0x7f7a101594f0 2024-03-23T06:18:46.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.082+0000 7f7a0d600640 1 -- 172.21.15.73:0/2576880211 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0803f580 con 0x7f7a101594f0 2024-03-23T06:18:46.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.082+0000 7f7a0d600640 1 -- 172.21.15.73:0/2576880211 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0803f8f0 con 0x7f7a101594f0 2024-03-23T06:18:46.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.082+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a101f6f80 con 0x7f7a101594f0 2024-03-23T06:18:46.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.082+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a101f7540 con 0x7f7a101594f0 2024-03-23T06:18:46.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.084+0000 7f7a02a00640 1 -- 172.21.15.73:0/2576880211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a10071870 con 0x7f7a101594f0 2024-03-23T06:18:46.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.086+0000 7f7a0d600640 1 -- 172.21.15.73:0/2576880211 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7a0803fa50 con 0x7f7a101594f0 2024-03-23T06:18:46.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.088+0000 7f7a0d600640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f006abb0 0x7f79f006d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.088+0000 7f7a0d600640 1 -- 172.21.15.73:0/2576880211 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f7a080ac410 con 0x7f7a101594f0 2024-03-23T06:18:46.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.088+0000 7f7a15400640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f006abb0 0x7f79f006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:46.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.089+0000 7f7a15400640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f006abb0 0x7f79f006d070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7a04003930 tx=0x7f7a04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:46.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.091+0000 7f7a0d600640 1 -- 172.21.15.73:0/2576880211 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7a08077150 con 0x7f7a101594f0 2024-03-23T06:18:46.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.723+0000 7f7a02a00640 1 -- 172.21.15.73:0/2576880211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f7a100c9810 con 0x7f7a101594f0 2024-03-23T06:18:46.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.727+0000 7f7a0d600640 1 -- 172.21.15.73:0/2576880211 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f7a08043620 con 0x7f7a101594f0 2024-03-23T06:18:46.732 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:18:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.733+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f006abb0 msgr2=0x7f79f006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.733+0000 7f7a17e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f006abb0 0x7f79f006d070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7a04003930 tx=0x7f7a04008040 comp rx=0 tx=0).stop 2024-03-23T06:18:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.733+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 msgr2=0x7f7a1006bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:46.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.733+0000 7f7a17e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a1006bf10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7a08009d90 tx=0x7f7a08004a40 comp rx=0 tx=0).stop 2024-03-23T06:18:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.734+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 shutdown_connections 2024-03-23T06:18:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.734+0000 7f7a17e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a101594f0 0x7f7a1006bf10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.734+0000 7f7a17e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f79f006abb0 0x7f79f006d070 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.734+0000 7f7a17e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a10153a80 0x7f7a101f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.734+0000 7f7a17e00640 1 --2- 172.21.15.73:0/2576880211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a101536a0 0x7f7a10157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:46.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.734+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 >> 172.21.15.73:0/2576880211 conn(0x7f7a1006a060 msgr2=0x7f7a10158260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.736+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 shutdown_connections 2024-03-23T06:18:46.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:46.737+0000 7f7a17e00640 1 -- 172.21.15.73:0/2576880211 wait complete. 2024-03-23T06:18:49.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:18:50.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.246+0000 7f12c1a00640 1 Processor -- start 2024-03-23T06:18:50.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.247+0000 7f12c1a00640 1 -- start start 2024-03-23T06:18:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.253+0000 7f12c1a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc14fa20 0x7f12bc156050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.253+0000 7f12c1a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12bc06d370 0x7f12bc06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.253+0000 7f12c1a00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc0c5fe0 con 0x7f12bc072360 2024-03-23T06:18:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.254+0000 7f12c1a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc14fe00 con 0x7f12bc06d370 2024-03-23T06:18:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.254+0000 7f12ba000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f12bc072360 0x7f12bc0c7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47964/0 (socket says 172.21.15.73:47964) 2024-03-23T06:18:50.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.254+0000 7f12ba000640 1 -- 172.21.15.73:0/1957814377 learned_addr learned my addr 172.21.15.73:0/1957814377 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.254+0000 7f12c1a00640 1 -- 172.21.15.73:0/1957814377 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0c67d0 con 0x7f12bc14fa20 2024-03-23T06:18:50.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.254+0000 7f12baa00640 1 -- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc14fa20 msgr2=0x7f12bc156050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:50.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.254+0000 7f12baa00640 1 --2- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc14fa20 0x7f12bc156050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:50.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.256+0000 7f12bb400640 1 --2- 172.21.15.73:0/1957814377 >> v2:172.21.15.110:3300/0 conn(0x7f12bc06d370 0x7f12bc06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:50.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.256+0000 7f12bb400640 1 -- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc14fa20 msgr2=0x7f12bc156050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:50.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.256+0000 7f12bb400640 1 --2- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc14fa20 0x7f12bc156050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.256+0000 7f12bb400640 1 -- 172.21.15.73:0/1957814377 >> v1:172.21.15.73:6789/0 conn(0x7f12bc072360 legacy=0x7f12bc0c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:50.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.256+0000 7f12bb400640 1 -- 172.21.15.73:0/1957814377 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0c7350 con 0x7f12bc06d370 2024-03-23T06:18:50.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.262+0000 7f12bb400640 1 --2- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc06d370 0x7f12bc06d780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009c80 tx=0x7f12b402d070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1be53cc25e5b75fd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:50.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.264+0000 7f12b9600640 1 -- 172.21.15.73:0/1957814377 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b402de20 con 0x7f12bc06d370 2024-03-23T06:18:50.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.265+0000 7f12b9600640 1 -- 172.21.15.73:0/1957814377 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4035440 con 0x7f12bc06d370 2024-03-23T06:18:50.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.265+0000 7f12b9600640 1 -- 172.21.15.73:0/1957814377 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4035810 con 0x7f12bc06d370 2024-03-23T06:18:50.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.266+0000 7f12c1a00640 1 -- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc06d370 msgr2=0x7f12bc06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:50.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.266+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc06d370 0x7f12bc06d780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009c80 tx=0x7f12b402d070 comp rx=0 tx=0).stop 2024-03-23T06:18:50.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.267+0000 7f12c1a00640 1 -- 172.21.15.73:0/1957814377 shutdown_connections 2024-03-23T06:18:50.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.267+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc06d370 0x7f12bc06d780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.268+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1957814377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc14fa20 0x7f12bc156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.268+0000 7f12c1a00640 1 -- 172.21.15.73:0/1957814377 >> 172.21.15.73:0/1957814377 conn(0x7f12bc06bb40 msgr2=0x7f12bc06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:50.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.268+0000 7f12c1a00640 1 -- 172.21.15.73:0/1957814377 shutdown_connections 2024-03-23T06:18:50.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.268+0000 7f12c1a00640 1 -- 172.21.15.73:0/1957814377 wait complete. 2024-03-23T06:18:50.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.271+0000 7f12c1a00640 1 Processor -- start 2024-03-23T06:18:50.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.274+0000 7f12c1a00640 1 -- start start 2024-03-23T06:18:50.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.276+0000 7f12c1a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc06d370 0x7f12bc0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:50.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.276+0000 7f12baa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc06d370 0x7f12bc0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.277+0000 7f12c1a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc072360 0x7f12bc13f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:50.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.277+0000 7f12c1a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc14fa20 0x7f12bc0c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.277+0000 7f12baa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc06d370 0x7f12bc0c2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:59786/0 (socket says 172.21.15.73:59786) 2024-03-23T06:18:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.277+0000 7f12baa00640 1 -- 172.21.15.73:0/1235017911 learned_addr learned my addr 172.21.15.73:0/1235017911 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:50.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.277+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0701c0 con 0x7f12bc06d370 2024-03-23T06:18:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.277+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc1e0a70 con 0x7f12bc14fa20 2024-03-23T06:18:50.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.277+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc1408e0 con 0x7f12bc072360 2024-03-23T06:18:50.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.277+0000 7f12bb400640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc14fa20 0x7f12bc0c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:50.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.278+0000 7f12baa00640 1 -- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc072360 msgr2=0x7f12bc13f9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:50.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.278+0000 7f12baa00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc072360 0x7f12bc13f9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.278+0000 7f12baa00640 1 -- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc14fa20 msgr2=0x7f12bc0c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.278+0000 7f12baa00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc14fa20 0x7f12bc0c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.278+0000 7f12baa00640 1 -- 172.21.15.73:0/1235017911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b400d040 con 0x7f12bc06d370 2024-03-23T06:18:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.278+0000 7f12baa00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc06d370 0x7f12bc0c2530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f12a400b550 tx=0x7f12a400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.279+0000 7f12b2a00640 1 -- 172.21.15.73:0/1235017911 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4003dc0 con 0x7f12bc06d370 2024-03-23T06:18:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.279+0000 7f12b2a00640 1 -- 172.21.15.73:0/1235017911 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4005070 con 0x7f12bc06d370 2024-03-23T06:18:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.279+0000 7f12b2a00640 1 -- 172.21.15.73:0/1235017911 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4005420 con 0x7f12bc06d370 2024-03-23T06:18:50.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.279+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc140270 con 0x7f12bc06d370 2024-03-23T06:18:50.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.280+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc1e0c80 con 0x7f12bc06d370 2024-03-23T06:18:50.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.283+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1294005250 con 0x7f12bc06d370 2024-03-23T06:18:50.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.287+0000 7f12b2a00640 1 -- 172.21.15.73:0/1235017911 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f12a4005580 con 0x7f12bc06d370 2024-03-23T06:18:50.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.288+0000 7f12b2a00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f129806ad00 0x7f129806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.289+0000 7f12b2a00640 1 -- 172.21.15.73:0/1235017911 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f12a40899e0 con 0x7f12bc06d370 2024-03-23T06:18:50.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.289+0000 7f12ba000640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f129806ad00 0x7f129806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:50.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.291+0000 7f12ba000640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f129806ad00 0x7f129806d1c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0b07d0 tx=0x7f12ac007a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:50.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.293+0000 7f12b2a00640 1 -- 172.21.15.73:0/1235017911 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f12a40548f0 con 0x7f12bc06d370 2024-03-23T06:18:50.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.831+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f12940057d0 con 0x7f12bc06d370 2024-03-23T06:18:50.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.833+0000 7f12b2a00640 1 -- 172.21.15.73:0/1235017911 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7f12a4013620 con 0x7f12bc06d370 2024-03-23T06:18:50.837 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":25,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:18:50.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.841+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f129806ad00 msgr2=0x7f129806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:50.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.841+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f129806ad00 0x7f129806d1c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0b07d0 tx=0x7f12ac007a40 comp rx=0 tx=0).stop 2024-03-23T06:18:50.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.841+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc06d370 msgr2=0x7f12bc0c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:50.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.841+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc06d370 0x7f12bc0c2530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f12a400b550 tx=0x7f12a400ba10 comp rx=0 tx=0).stop 2024-03-23T06:18:50.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.845+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 shutdown_connections 2024-03-23T06:18:50.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.845+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12bc14fa20 0x7f12bc0c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.845+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f129806ad00 0x7f129806d1c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.845+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12bc072360 0x7f12bc13f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.845+0000 7f12c1a00640 1 --2- 172.21.15.73:0/1235017911 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc06d370 0x7f12bc0c2530 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:50.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.845+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 >> 172.21.15.73:0/1235017911 conn(0x7f12bc06bb40 msgr2=0x7f12bc0bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:50.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.845+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 shutdown_connections 2024-03-23T06:18:50.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:50.845+0000 7f12c1a00640 1 -- 172.21.15.73:0/1235017911 wait complete. 2024-03-23T06:18:53.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:18:54.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.223+0000 7fb6c8400640 1 Processor -- start 2024-03-23T06:18:54.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.226+0000 7fb6c8400640 1 -- start start 2024-03-23T06:18:54.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.227+0000 7fb6c8400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:54.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.228+0000 7fb6c8400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 0x7fb6c00c5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:54.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.228+0000 7fb6c8400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c0160ec0 con 0x7fb6c0161bf0 2024-03-23T06:18:54.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.228+0000 7fb6c8400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c00c7370 con 0x7fb6c01579b0 2024-03-23T06:18:54.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.228+0000 7fb6c8400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0157d90 con 0x7fb6c00c66f0 2024-03-23T06:18:54.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.230+0000 7fb6c5000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb6c0161bf0 0x7fb6c015d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:36478/0 (socket says 172.21.15.73:36478) 2024-03-23T06:18:54.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.230+0000 7fb6c5000640 1 -- 172.21.15.73:0/1545556702 learned_addr learned my addr 172.21.15.73:0/1545556702 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:54.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.230+0000 7fb6c6400640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 msgr2=0x7fb6c00c5970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:54.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.231+0000 7fb6c6400640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 0x7fb6c00c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:54.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.231+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:54.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.231+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:18:54.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.231+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:18:54.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.231+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:18:54.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.232+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:54.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.433+0000 7fb6c6400640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 msgr2=0x7fb6c00c5970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:54.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.433+0000 7fb6c6400640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 0x7fb6c00c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:18:54.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.435+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.435+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:18:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.435+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:18:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.436+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:18:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.436+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:18:54.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.834+0000 7fb6c6400640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 msgr2=0x7fb6c00c5970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:54.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.834+0000 7fb6c6400640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 0x7fb6c00c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:18:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.838+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.838+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:18:54.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.839+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:18:54.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.839+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:18:54.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:54.839+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:18:55.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:55.635+0000 7fb6c6400640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 msgr2=0x7fb6c00c5970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:55.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:55.635+0000 7fb6c6400640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 0x7fb6c00c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:18:55.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:55.643+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:55.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:55.643+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:18:55.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:55.643+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:18:55.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:55.643+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:18:55.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:55.643+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:18:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.233+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860250907 0 0) 0x7fb6c0160ec0 con 0x7fb6c0161bf0 2024-03-23T06:18:56.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.233+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a8003520 con 0x7fb6c0161bf0 2024-03-23T06:18:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.274+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3500862806 0 0) 0x7fb6a8003520 con 0x7fb6c0161bf0 2024-03-23T06:18:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.274+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 msgr2=0x7fb6c00c5970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.274+0000 7fb6bfe00640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00c66f0 0x7fb6c00c5970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.274+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 msgr2=0x7fb6c00c0450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.274+0000 7fb6bfe00640 1 --2- 172.21.15.73:0/1545556702 >> v2:172.21.15.73:3300/0 conn(0x7fb6c01579b0 0x7fb6c00c0450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.274+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c015e3f0 con 0x7fb6c0161bf0 2024-03-23T06:18:56.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.274+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fb6ac001610 con 0x7fb6c0161bf0 2024-03-23T06:18:56.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.274+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 >> v1:172.21.15.110:6789/0 conn(0x7fb6c0161bf0 legacy=0x7fb6c015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:56.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.275+0000 7fb6bfe00640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a8003990 0x7fb6a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:56.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.275+0000 7fb6bfe00640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a80047c0 0x7fb6a8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:56.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.275+0000 7fb6bfe00640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6a8005180 0x7fb6a800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:56.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.275+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c00c7370 con 0x7fb6a8003990 2024-03-23T06:18:56.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.275+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c0157d90 con 0x7fb6a80047c0 2024-03-23T06:18:56.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.275+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a800c080 con 0x7fb6a8005180 2024-03-23T06:18:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.275+0000 7fb6c6400640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6a8005180 msgr2=0x7fb6a800b980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.275+0000 7fb6c6400640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6a8005180 0x7fb6a800b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.276+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a8003990 0x7fb6a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.277+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6a8005180 msgr2=0x7fb6a800b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.277+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6a8005180 0x7fb6a800b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.277+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a80047c0 msgr2=0x7fb6a8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:18:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.277+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a80047c0 0x7fb6a8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:56.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.277+0000 7fb6c5a00640 1 -- 172.21.15.73:0/1545556702 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c015e3f0 con 0x7fb6a8003990 2024-03-23T06:18:56.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.280+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a8003990 0x7fb6a8003dd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009f00 tx=0x7fb6a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ced4d8a4b7bbe2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:56.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.281+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80343f0 con 0x7fb6a8003990 2024-03-23T06:18:56.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.285+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b8034550 con 0x7fb6a8003990 2024-03-23T06:18:56.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.286+0000 7fb6bfe00640 1 -- 172.21.15.73:0/1545556702 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8034940 con 0x7fb6a8003990 2024-03-23T06:18:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.286+0000 7fb6c8400640 1 -- 172.21.15.73:0/1545556702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a8003990 msgr2=0x7fb6a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.286+0000 7fb6c8400640 1 --2- 172.21.15.73:0/1545556702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6a8003990 0x7fb6a8003dd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009f00 tx=0x7fb6a80057f0 comp rx=0 tx=0).stop 2024-03-23T06:18:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.286+0000 7fb6c6400640 1 -- 172.21.15.73:0/1545556702 reap_dead start 2024-03-23T06:18:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.286+0000 7fb6c8400640 1 -- 172.21.15.73:0/1545556702 shutdown_connections 2024-03-23T06:18:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.286+0000 7fb6c8400640 1 -- 172.21.15.73:0/1545556702 >> 172.21.15.73:0/1545556702 conn(0x7fb6c006bb40 msgr2=0x7fb6c006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.286+0000 7fb6c8400640 1 -- 172.21.15.73:0/1545556702 shutdown_connections 2024-03-23T06:18:56.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.287+0000 7fb6c8400640 1 -- 172.21.15.73:0/1545556702 wait complete. 2024-03-23T06:18:56.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.293+0000 7fb6c8400640 1 Processor -- start 2024-03-23T06:18:56.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.294+0000 7fb6c8400640 1 -- start start 2024-03-23T06:18:56.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.295+0000 7fb6c8400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a8003990 0x7fb6c015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.295+0000 7fb6c8400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00ca320 0x7fb6c015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.295+0000 7fb6c8400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c00c4080 0x7fb6c00c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.295+0000 7fb6c8400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c015cc00 con 0x7fb6c00c4080 2024-03-23T06:18:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.295+0000 7fb6c8400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c015ea90 con 0x7fb6a8003990 2024-03-23T06:18:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.295+0000 7fb6c8400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c015f540 con 0x7fb6c00ca320 2024-03-23T06:18:56.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.298+0000 7fb6c5000640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00ca320 msgr2=0x7fb6c015ff10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.298+0000 7fb6c5000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00ca320 0x7fb6c015ff10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.298+0000 7fb6c5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a8003990 0x7fb6c015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.298+0000 7fb6c5a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a8003990 0x7fb6c015f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:34136/0 (socket says 172.21.15.73:34136) 2024-03-23T06:18:56.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.298+0000 7fb6c5a00640 1 -- 172.21.15.73:0/15840581 learned_addr learned my addr 172.21.15.73:0/15840581 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.299+0000 7fb6c6400640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c00c4080 0x7fb6c00c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.301+0000 7fb6c5a00640 1 -- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00ca320 msgr2=0x7fb6c015ff10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:56.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.301+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00ca320 0x7fb6c015ff10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.301+0000 7fb6c5a00640 1 -- 172.21.15.73:0/15840581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c00c4080 msgr2=0x7fb6c00c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.302+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c00c4080 0x7fb6c00c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:56.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.302+0000 7fb6c5a00640 1 -- 172.21.15.73:0/15840581 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c013f610 con 0x7fb6a8003990 2024-03-23T06:18:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.302+0000 7fb6c6400640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c00c4080 0x7fb6c00c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:18:56.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.303+0000 7fb6c5a00640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a8003990 0x7fb6c015f9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8007360 tx=0x7fb6b8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:56.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.306+0000 7fb6bd600640 1 -- 172.21.15.73:0/15840581 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b803d800 con 0x7fb6a8003990 2024-03-23T06:18:56.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.308+0000 7fb6bd600640 1 -- 172.21.15.73:0/15840581 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b803d960 con 0x7fb6a8003990 2024-03-23T06:18:56.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.308+0000 7fb6bd600640 1 -- 172.21.15.73:0/15840581 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b803dcf0 con 0x7fb6a8003990 2024-03-23T06:18:56.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.308+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c013f8f0 con 0x7fb6a8003990 2024-03-23T06:18:56.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.311+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c00c4a70 con 0x7fb6a8003990 2024-03-23T06:18:56.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.316+0000 7fb6bd600640 1 -- 172.21.15.73:0/15840581 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb6b8031070 con 0x7fb6a8003990 2024-03-23T06:18:56.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.319+0000 7fb6bd600640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb6a006ac00 0x7fb6a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.319+0000 7fb6bd600640 1 -- 172.21.15.73:0/15840581 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb6b80ac5d0 con 0x7fb6a8003990 2024-03-23T06:18:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.320+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c004e110 con 0x7fb6a8003990 2024-03-23T06:18:56.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.321+0000 7fb6c5000640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb6a006ac00 0x7fb6a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:56.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.323+0000 7fb6c5000640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb6a006ac00 0x7fb6a006d0c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac001eb0 tx=0x7fb6ac0014d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:56.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.331+0000 7fb6bd600640 1 -- 172.21.15.73:0/15840581 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb6b80775b0 con 0x7fb6a8003990 2024-03-23T06:18:56.992 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.990+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb6c00c64d0 con 0x7fb6a8003990 2024-03-23T06:18:56.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:56.994+0000 7fb6bd600640 1 -- 172.21.15.73:0/15840581 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7fb6b8009be0 con 0x7fb6a8003990 2024-03-23T06:18:56.994 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":86,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:18:57.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb6a006ac00 msgr2=0x7fb6a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb6a006ac00 0x7fb6a006d0c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac001eb0 tx=0x7fb6ac0014d0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a8003990 msgr2=0x7fb6c015f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a8003990 0x7fb6c015f9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8007360 tx=0x7fb6b8004ab0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 shutdown_connections 2024-03-23T06:18:57.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6c00c4080 0x7fb6c00c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb6a006ac00 0x7fb6a006d0c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6c00ca320 0x7fb6c015ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 --2- 172.21.15.73:0/15840581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6a8003990 0x7fb6c015f9d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 >> 172.21.15.73:0/15840581 conn(0x7fb6c006bb40 msgr2=0x7fb6c00c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.000+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 shutdown_connections 2024-03-23T06:18:57.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.001+0000 7fb6c8400640 1 -- 172.21.15.73:0/15840581 wait complete. 2024-03-23T06:18:57.039 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:18:57.039 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T06:18:57.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:18:57.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.561+0000 7fd60f400640 1 Processor -- start 2024-03-23T06:18:57.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.561+0000 7fd60f400640 1 -- start start 2024-03-23T06:18:57.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.563+0000 7fd60f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd608153760 0x7fd608159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:57.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.563+0000 7fd60f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 0x7fd6080cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:57.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.563+0000 7fd60f400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080cb310 con 0x7fd6080c9740 2024-03-23T06:18:57.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.563+0000 7fd60f400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60806a2d0 con 0x7fd608153760 2024-03-23T06:18:57.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.563+0000 7fd60f400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60806a5b0 con 0x7fd6080ca940 2024-03-23T06:18:57.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.564+0000 7fd607e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd6080c9740 0x7fd6080cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:36482/0 (socket says 172.21.15.73:36482) 2024-03-23T06:18:57.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.564+0000 7fd607e00640 1 -- 172.21.15.73:0/1446337993 learned_addr learned my addr 172.21.15.73:0/1446337993 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:57.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.564+0000 7fd60ca00640 1 --2- 172.21.15.73:0/1446337993 >> v2:172.21.15.73:3300/0 conn(0x7fd608153760 0x7fd608159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:57.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.564+0000 7fd60d400640 1 -- 172.21.15.73:0/1446337993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 msgr2=0x7fd6080cadd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:57.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.564+0000 7fd60d400640 1 --2- 172.21.15.73:0/1446337993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 0x7fd6080cadd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:57.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.565+0000 7fd60ca00640 1 -- 172.21.15.73:0/1446337993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 msgr2=0x7fd6080cadd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:57.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.565+0000 7fd60ca00640 1 --2- 172.21.15.73:0/1446337993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 0x7fd6080cadd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.565+0000 7fd60ca00640 1 -- 172.21.15.73:0/1446337993 >> v1:172.21.15.110:6789/0 conn(0x7fd6080c9740 legacy=0x7fd6080cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.565+0000 7fd60ca00640 1 -- 172.21.15.73:0/1446337993 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60806a890 con 0x7fd608153760 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.569+0000 7fd60ca00640 1 --2- 172.21.15.73:0/1446337993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 0x7fd608159420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0097a0 tx=0x7fd5fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e1a4176033877e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.569+0000 7fd607400640 1 -- 172.21.15.73:0/1446337993 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc031640 con 0x7fd608153760 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.570+0000 7fd607400640 1 -- 172.21.15.73:0/1446337993 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc0317a0 con 0x7fd608153760 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.570+0000 7fd607400640 1 -- 172.21.15.73:0/1446337993 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc031640 con 0x7fd608153760 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.571+0000 7fd60f400640 1 -- 172.21.15.73:0/1446337993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 msgr2=0x7fd608159420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.571+0000 7fd60f400640 1 --2- 172.21.15.73:0/1446337993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 0x7fd608159420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0097a0 tx=0x7fd5fc02b8f0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.573+0000 7fd60f400640 1 -- 172.21.15.73:0/1446337993 shutdown_connections 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.573+0000 7fd60f400640 1 --2- 172.21.15.73:0/1446337993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 0x7fd6080cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.573+0000 7fd60f400640 1 --2- 172.21.15.73:0/1446337993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 0x7fd608159420 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.573+0000 7fd60f400640 1 -- 172.21.15.73:0/1446337993 >> 172.21.15.73:0/1446337993 conn(0x7fd60806c310 msgr2=0x7fd6080713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:57.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.573+0000 7fd60f400640 1 -- 172.21.15.73:0/1446337993 shutdown_connections 2024-03-23T06:18:57.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.573+0000 7fd60f400640 1 -- 172.21.15.73:0/1446337993 wait complete. 2024-03-23T06:18:57.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.575+0000 7fd60f400640 1 Processor -- start 2024-03-23T06:18:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.576+0000 7fd60f400640 1 -- start start 2024-03-23T06:18:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.577+0000 7fd60f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6080c9740 0x7fd60815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.577+0000 7fd60f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 0x7fd608158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:57.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.577+0000 7fd60ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6080c9740 0x7fd60815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.577+0000 7fd60ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6080c9740 0x7fd60815d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:34142/0 (socket says 172.21.15.73:34142) 2024-03-23T06:18:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.577+0000 7fd607e00640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 msgr2=0x7fd608158af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.578+0000 7fd607e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 0x7fd608158af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.578+0000 7fd60ca00640 1 -- 172.21.15.73:0/1867457965 learned_addr learned my addr 172.21.15.73:0/1867457965 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:57.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.578+0000 7fd60f400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 0x7fd6080c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:57.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.580+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60814a1a0 con 0x7fd608153760 2024-03-23T06:18:57.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.580+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608156b10 con 0x7fd6080c9740 2024-03-23T06:18:57.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.580+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd608154920 con 0x7fd6080ca940 2024-03-23T06:18:57.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.580+0000 7fd60d400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 0x7fd6080c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:57.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.581+0000 7fd60ca00640 1 -- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 msgr2=0x7fd608158af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:57.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.581+0000 7fd60ca00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6080ca940 0x7fd608158af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.581+0000 7fd60ca00640 1 -- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 msgr2=0x7fd6080c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.581+0000 7fd60ca00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 0x7fd6080c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.581+0000 7fd60ca00640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc009400 con 0x7fd6080c9740 2024-03-23T06:18:57.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.581+0000 7fd60d400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd608153760 0x7fd6080c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:18:57.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.582+0000 7fd60ca00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6080c9740 0x7fd60815d500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc000c00 tx=0x7fd5fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:57.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.582+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc031640 con 0x7fd6080c9740 2024-03-23T06:18:57.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.586+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc0305b0 con 0x7fd6080c9740 2024-03-23T06:18:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.586+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc030960 con 0x7fd6080c9740 2024-03-23T06:18:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.586+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd608154be0 con 0x7fd6080c9740 2024-03-23T06:18:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.586+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6081551a0 con 0x7fd6080c9740 2024-03-23T06:18:57.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.589+0000 7fd60f400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6081553c0 0x7fd6080c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:57.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.589+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608072510 con 0x7fd6081553c0 2024-03-23T06:18:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.592+0000 7fd607e00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6081553c0 0x7fd6080c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.593+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd5fc02f050 con 0x7fd6080c9740 2024-03-23T06:18:57.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.593+0000 7fd607e00640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd608153b40 con 0x7fd6081553c0 2024-03-23T06:18:57.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.594+0000 7fd607e00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6081553c0 0x7fd6080c7bb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6080c49d0 tx=0x7fd5f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:57.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.594+0000 7fd604c00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd5e806abb0 0x7fd5e806d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:57.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.594+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd5fc0abb40 con 0x7fd6080c9740 2024-03-23T06:18:57.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.595+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4005ce0 con 0x7fd6081553c0 2024-03-23T06:18:57.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.595+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd5f4005e40 con 0x7fd6081553c0 2024-03-23T06:18:57.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.595+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6081553c0 msgr2=0x7fd6080c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.595+0000 7fd604c00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6081553c0 0x7fd6080c7bb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6080c49d0 tx=0x7fd5f400c8e0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.595+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6081553c0 msgr2=0x7fd6080c7bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:57.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.595+0000 7fd60d400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd5e806abb0 0x7fd5e806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:57.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.596+0000 7fd604c00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6081553c0 0x7fd6080c7bb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.599+0000 7fd60d400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd5e806abb0 0x7fd5e806d070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd600003cb0 tx=0x7fd6000094b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.620+0000 7fd60f400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6080c6120 0x7fd6080c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.621+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60806ae50 con 0x7fd6080c6120 2024-03-23T06:18:57.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.622+0000 7fd607e00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6080c6120 0x7fd6080c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:57.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.626+0000 7fd607e00640 1 -- 172.21.15.73:0/1867457965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd6080c9b80 con 0x7fd6080c6120 2024-03-23T06:18:57.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.626+0000 7fd607e00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6080c6120 0x7fd6080c6530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4000f60 tx=0x7fd5f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:57.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.628+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f401dac0 con 0x7fd6080c6120 2024-03-23T06:18:57.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.628+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4456 (secure 0 0 0) 0x7fd5f401dc20 con 0x7fd6080c6120 2024-03-23T06:18:57.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.628+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6080c6120 msgr2=0x7fd6080c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.628+0000 7fd604c00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6080c6120 0x7fd6080c6530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4000f60 tx=0x7fd5f4000ed0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.628+0000 7fd604c00640 1 -- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6080c6120 msgr2=0x7fd6080c6530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:57.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.628+0000 7fd604c00640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6080c6120 0x7fd6080c6530 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4000f60 tx=0x7fd5f4000ed0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.629 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:18:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 86, 2024-03-23T06:18:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:18:57.629 INFO:teuthology.orchestra.run.smithi073.stdout: 1 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:57.630 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:57.631 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:57.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:57.633 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:57.634 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:57.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:57.636 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:57.637 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:57.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:57.639 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:57.640 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.641 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:57.642 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:57.643 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:57.643 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.633+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd5e806abb0 msgr2=0x7fd5e806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.633+0000 7fd60f400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd5e806abb0 0x7fd5e806d070 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd600003cb0 tx=0x7fd6000094b0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.633+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6080c9740 msgr2=0x7fd60815d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.633+0000 7fd60f400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6080c9740 0x7fd60815d500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc000c00 tx=0x7fd5fc0046c0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.633+0000 7fd60d400640 1 -- 172.21.15.73:0/1867457965 reap_dead start 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.637+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 shutdown_connections 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.637+0000 7fd60f400640 1 --2- 172.21.15.73:0/1867457965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6080c9740 0x7fd60815d500 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.637+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 >> 172.21.15.73:0/1867457965 conn(0x7fd60806c310 msgr2=0x7fd6080c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.639+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 shutdown_connections 2024-03-23T06:18:57.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.639+0000 7fd60f400640 1 -- 172.21.15.73:0/1867457965 wait complete. 2024-03-23T06:18:57.682 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:18:57.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T06:18:57.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:18:57.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.997+0000 7fe907c00640 1 Processor -- start 2024-03-23T06:18:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:57.998+0000 7fe907c00640 1 -- start start 2024-03-23T06:18:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.000+0000 7fe907c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9000c9350 0x7fe9000ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.000+0000 7fe907c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe90006a7d0 0x7fe9000caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.000+0000 7fe907c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9000ca090 con 0x7fe90014f8b0 2024-03-23T06:18:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.000+0000 7fe907c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9000717b0 con 0x7fe9000c9350 2024-03-23T06:18:58.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.000+0000 7fe907c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe900155e90 con 0x7fe90006a7d0 2024-03-23T06:18:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.000+0000 7fe905200640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe90014f8b0 0x7fe9000710a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47970/0 (socket says 172.21.15.73:47970) 2024-03-23T06:18:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.000+0000 7fe905200640 1 -- 172.21.15.73:0/2686187301 learned_addr learned my addr 172.21.15.73:0/2686187301 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:18:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.000+0000 7fe905c00640 1 -- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe90006a7d0 msgr2=0x7fe9000caea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:58.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.001+0000 7fe905c00640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe90006a7d0 0x7fe9000caea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.001+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969967316 0 0) 0x7fe9000ca090 con 0x7fe90014f8b0 2024-03-23T06:18:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.001+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e8005730 con 0x7fe90014f8b0 2024-03-23T06:18:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.002+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096386528 0 0) 0x7fe8e8005730 con 0x7fe90014f8b0 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.002+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe90006a7d0 msgr2=0x7fe9000caea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.002+0000 7fe8ff400640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe90006a7d0 0x7fe9000caea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.002+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 >> v2:172.21.15.110:3300/0 conn(0x7fe9000c9350 msgr2=0x7fe9000ca960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.002+0000 7fe8ff400640 1 --2- 172.21.15.73:0/2686187301 >> v2:172.21.15.110:3300/0 conn(0x7fe9000c9350 0x7fe9000ca960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.002+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000ca2c0 con 0x7fe90014f8b0 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.002+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7fe8f4001650 con 0x7fe90014f8b0 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.002+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 >> v1:172.21.15.73:6789/0 conn(0x7fe90014f8b0 legacy=0x7fe9000710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.003+0000 7fe8ff400640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e8005ba0 0x7fe8e8005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.003+0000 7fe8ff400640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8e8006520 0x7fe8e80069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.003+0000 7fe8ff400640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e8007260 0x7fe8e8014780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.003+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000717b0 con 0x7fe8e8007260 2024-03-23T06:18:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.003+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe900155e90 con 0x7fe8e8006520 2024-03-23T06:18:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.003+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e800bcf0 con 0x7fe8e8005ba0 2024-03-23T06:18:58.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.004+0000 7fe905c00640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e8007260 0x7fe8e8014780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.005+0000 7fe905c00640 1 -- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e8005ba0 msgr2=0x7fe8e8005fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:18:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.005+0000 7fe905c00640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e8005ba0 0x7fe8e8005fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.005+0000 7fe905c00640 1 -- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8e8006520 msgr2=0x7fe8e80069d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:18:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.005+0000 7fe905c00640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8e8006520 0x7fe8e80069d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:58.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.005+0000 7fe905c00640 1 -- 172.21.15.73:0/2686187301 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000ca2c0 con 0x7fe8e8007260 2024-03-23T06:18:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.007+0000 7fe905c00640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e8007260 0x7fe8e8014780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe90006abb0 tx=0x7fe8e8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2e215faa6a35bf server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:58.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.007+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8034630 con 0x7fe8e8007260 2024-03-23T06:18:58.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.008+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f802f070 con 0x7fe8e8007260 2024-03-23T06:18:58.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.008+0000 7fe8ff400640 1 -- 172.21.15.73:0/2686187301 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8034a10 con 0x7fe8e8007260 2024-03-23T06:18:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.009+0000 7fe907c00640 1 -- 172.21.15.73:0/2686187301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e8007260 msgr2=0x7fe8e8014780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.009+0000 7fe907c00640 1 --2- 172.21.15.73:0/2686187301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8e8007260 0x7fe8e8014780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe90006abb0 tx=0x7fe8e8007a00 comp rx=0 tx=0).stop 2024-03-23T06:18:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.009+0000 7fe905c00640 1 -- 172.21.15.73:0/2686187301 reap_dead start 2024-03-23T06:18:58.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.009+0000 7fe907c00640 1 -- 172.21.15.73:0/2686187301 shutdown_connections 2024-03-23T06:18:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.009+0000 7fe907c00640 1 -- 172.21.15.73:0/2686187301 >> 172.21.15.73:0/2686187301 conn(0x7fe900069cb0 msgr2=0x7fe90006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.010+0000 7fe907c00640 1 -- 172.21.15.73:0/2686187301 shutdown_connections 2024-03-23T06:18:58.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.010+0000 7fe907c00640 1 -- 172.21.15.73:0/2686187301 wait complete. 2024-03-23T06:18:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.013+0000 7fe907c00640 1 Processor -- start 2024-03-23T06:18:58.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.013+0000 7fe907c00640 1 -- start start 2024-03-23T06:18:58.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.015+0000 7fe907c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e8007260 0x7fe900152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.015+0000 7fe907c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe900155400 0x7fe9000c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.015+0000 7fe907c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9000c7430 0x7fe9000c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.016+0000 7fe905c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9000c7430 0x7fe9000c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.016+0000 7fe907c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9001eab60 con 0x7fe9000c7430 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.016+0000 7fe907c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90014ae70 con 0x7fe900155400 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.016+0000 7fe8ffe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe900155400 0x7fe9000c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.016+0000 7fe8ffe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe900155400 0x7fe9000c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:34144/0 (socket says 172.21.15.73:34144) 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.016+0000 7fe8ffe00640 1 -- 172.21.15.73:0/1581950617 learned_addr learned my addr 172.21.15.73:0/1581950617 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.017+0000 7fe905200640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e8007260 msgr2=0x7fe900152a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.017+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9001ead50 con 0x7fe8e8007260 2024-03-23T06:18:58.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.017+0000 7fe905200640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e8007260 0x7fe900152a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:18:58.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.018+0000 7fe8ffe00640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e8007260 msgr2=0x7fe900152a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.018+0000 7fe8ffe00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8e8007260 0x7fe900152a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.018+0000 7fe8ffe00640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9000c7430 msgr2=0x7fe9000c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.018+0000 7fe8ffe00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe9000c7430 0x7fe9000c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.018+0000 7fe8ffe00640 1 -- 172.21.15.73:0/1581950617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9001eb030 con 0x7fe900155400 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.018+0000 7fe8ffe00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe900155400 0x7fe9000c7e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00b3f0 tx=0x7fe8ec00b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.019+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec011830 con 0x7fe900155400 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.019+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ec011990 con 0x7fe900155400 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.019+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec011d40 con 0x7fe900155400 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.020+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9001eb310 con 0x7fe900155400 2024-03-23T06:18:58.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.020+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9001eb8d0 con 0x7fe900155400 2024-03-23T06:18:58.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.022+0000 7fe907c00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9000c5cb0 0x7fe9001ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.022+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe900073bf0 con 0x7fe9000c5cb0 2024-03-23T06:18:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.026+0000 7fe905200640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9000c5cb0 0x7fe9001ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.027+0000 7fe905200640 1 -- 172.21.15.73:0/1581950617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe900155840 con 0x7fe9000c5cb0 2024-03-23T06:18:58.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.027+0000 7fe905200640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9000c5cb0 0x7fe9001ee0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe90006ad90 tx=0x7fe8f400cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:58.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.029+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f40072e0 con 0x7fe9000c5cb0 2024-03-23T06:18:58.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.029+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fe8f4007440 con 0x7fe9000c5cb0 2024-03-23T06:18:58.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.029+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9000c5cb0 msgr2=0x7fe9001ee0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:58.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.029+0000 7fe8fcc00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9000c5cb0 0x7fe9001ee0d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe90006ad90 tx=0x7fe8f400cc50 comp rx=0 tx=0).stop 2024-03-23T06:18:58.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.029+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9000c5cb0 msgr2=0x7fe9001ee0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:58.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.029+0000 7fe8fcc00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9000c5cb0 0x7fe9001ee0d0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe90006ad90 tx=0x7fe8f400cc50 comp rx=0 tx=0).stop 2024-03-23T06:18:58.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.037+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe8ec01a410 con 0x7fe900155400 2024-03-23T06:18:58.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.045+0000 7fe8fcc00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe8e006a9b0 0x7fe8e006ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.047+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe8ec0892e0 con 0x7fe900155400 2024-03-23T06:18:58.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.048+0000 7fe907c00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9001ee610 0x7fe9001ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:18:58.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.048+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9001eb4a0 con 0x7fe9001ee610 2024-03-23T06:18:58.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.048+0000 7fe905200640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe8e006a9b0 0x7fe8e006ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:58.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.048+0000 7fe905c00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9001ee610 0x7fe9001ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:18:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.055+0000 7fe905c00640 1 -- 172.21.15.73:0/1581950617 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe9000ca580 con 0x7fe9001ee610 2024-03-23T06:18:58.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.055+0000 7fe905200640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe8e006a9b0 0x7fe8e006ce70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4000c00 tx=0x7fe8f4006000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:58.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.055+0000 7fe905c00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9001ee610 0x7fe9001ee9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9000c8f90 tx=0x7fe8f8005d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:18:58.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.064+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8040720 con 0x7fe9001ee610 2024-03-23T06:18:58.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.064+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5107 (secure 0 0 0) 0x7fe8f8006e90 con 0x7fe9001ee610 2024-03-23T06:18:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.064+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9001ee610 msgr2=0x7fe9001ee9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:58.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.064+0000 7fe8fcc00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9001ee610 0x7fe9001ee9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9000c8f90 tx=0x7fe8f8005d40 comp rx=0 tx=0).stop 2024-03-23T06:18:58.065 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:18:58.065 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:58.065 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 86, 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: 1 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:58.066 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:58.067 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:18:58.068 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:18:58.069 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:58.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:18:58.072 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.073 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:18:58.074 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.075 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:58.076 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:18:58.077 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:18:58.078 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:18:58.078 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:18:58.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.064+0000 7fe8fcc00640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9001ee610 msgr2=0x7fe9001ee9f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.064+0000 7fe8fcc00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe9001ee610 0x7fe9001ee9f0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe9000c8f90 tx=0x7fe8f8005d40 comp rx=0 tx=0).stop 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe8e006a9b0 msgr2=0x7fe8e006ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe907c00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe8e006a9b0 0x7fe8e006ce70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4000c00 tx=0x7fe8f4006000 comp rx=0 tx=0).stop 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe900155400 msgr2=0x7fe9000c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe907c00640 1 --2- 172.21.15.73:0/1581950617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe900155400 0x7fe9000c7e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00b3f0 tx=0x7fe8ec00b8b0 comp rx=0 tx=0).stop 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe905c00640 1 -- 172.21.15.73:0/1581950617 reap_dead start 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 shutdown_connections 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 >> 172.21.15.73:0/1581950617 conn(0x7fe900069cb0 msgr2=0x7fe9000c0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 shutdown_connections 2024-03-23T06:18:58.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:18:58.071+0000 7fe907c00640 1 -- 172.21.15.73:0/1581950617 wait complete. 2024-03-23T06:18:58.110 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:18:58.110 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:19:18.111 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-23T06:19:18.112 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-03-23T06:19:18.112 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-23T06:19:18.112 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-23T06:19:18.115 INFO:tasks.ceph.mon.c:Started 2024-03-23T06:19:18.115 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:19:18.115 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:19:18.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.406+0000 7fd3f9400640 1 Processor -- start 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.407+0000 7fd3f9400640 1 -- start start 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f9400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd3f4166ca0 0x7fd3f406f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c76c0 0x7fd3f40c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f9400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f4166810 con 0x7fd3f40c72e0 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f9400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f40724b0 con 0x7fd3f4166ca0 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f9400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40c5300 con 0x7fd3f40c76c0 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f8a00640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c76c0 msgr2=0x7fd3f40c6a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f8a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c76c0 0x7fd3f40c6a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:19:18.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd3f40c72e0 0x7fd3f416a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:39170/0 (socket says 172.21.15.73:39170) 2024-03-23T06:19:18.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f3e00640 1 -- 172.21.15.73:0/2487236982 learned_addr learned my addr 172.21.15.73:0/2487236982 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:19:18.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f3400640 1 --2- 172.21.15.73:0/2487236982 >> v2:172.21.15.110:3300/0 conn(0x7fd3f4166ca0 0x7fd3f406f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:18.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.408+0000 7fd3f2a00640 1 -- 172.21.15.73:0/2487236982 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833869469 0 0) 0x7fd3f4166810 con 0x7fd3f40c72e0 2024-03-23T06:19:18.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.513+0000 7fd3f2a00640 1 -- 172.21.15.73:0/2487236982 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d8007930 con 0x7fd3f40c72e0 2024-03-23T06:19:18.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.515+0000 7fd3f3400640 1 -- 172.21.15.73:0/2487236982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c76c0 msgr2=0x7fd3f40c6a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:19:18.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.515+0000 7fd3f3400640 1 --2- 172.21.15.73:0/2487236982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c76c0 0x7fd3f40c6a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:18.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.515+0000 7fd3f3400640 1 -- 172.21.15.73:0/2487236982 >> v1:172.21.15.110:6789/0 conn(0x7fd3f40c72e0 legacy=0x7fd3f416a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:18.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.515+0000 7fd3f3400640 1 -- 172.21.15.73:0/2487236982 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40c6000 con 0x7fd3f4166ca0 2024-03-23T06:19:18.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.519+0000 7fd3f3400640 1 --2- 172.21.15.73:0/2487236982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f4166ca0 0x7fd3f406f7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000a840 tx=0x7fd3e000a370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ec76179ecbeb60 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:18.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.520+0000 7fd3f2a00640 1 -- 172.21.15.73:0/2487236982 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e002d8d0 con 0x7fd3f4166ca0 2024-03-23T06:19:18.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.520+0000 7fd3f2a00640 1 -- 172.21.15.73:0/2487236982 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e002da30 con 0x7fd3f4166ca0 2024-03-23T06:19:18.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.520+0000 7fd3f2a00640 1 -- 172.21.15.73:0/2487236982 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e002d8d0 con 0x7fd3f4166ca0 2024-03-23T06:19:18.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.522+0000 7fd3f9400640 1 -- 172.21.15.73:0/2487236982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f4166ca0 msgr2=0x7fd3f406f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:18.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.522+0000 7fd3f9400640 1 --2- 172.21.15.73:0/2487236982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f4166ca0 0x7fd3f406f7d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000a840 tx=0x7fd3e000a370 comp rx=0 tx=0).stop 2024-03-23T06:19:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.528+0000 7fd3f9400640 1 -- 172.21.15.73:0/2487236982 shutdown_connections 2024-03-23T06:19:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.528+0000 7fd3f9400640 1 --2- 172.21.15.73:0/2487236982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c76c0 0x7fd3f40c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.528+0000 7fd3f9400640 1 --2- 172.21.15.73:0/2487236982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f4166ca0 0x7fd3f406f7d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:18.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.528+0000 7fd3f9400640 1 -- 172.21.15.73:0/2487236982 >> 172.21.15.73:0/2487236982 conn(0x7fd3f4069cb0 msgr2=0x7fd3f406a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:18.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.529+0000 7fd3f9400640 1 -- 172.21.15.73:0/2487236982 shutdown_connections 2024-03-23T06:19:18.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.530+0000 7fd3f9400640 1 -- 172.21.15.73:0/2487236982 wait complete. 2024-03-23T06:19:18.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.534+0000 7fd3f9400640 1 Processor -- start 2024-03-23T06:19:18.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.540+0000 7fd3f9400640 1 -- start start 2024-03-23T06:19:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.541+0000 7fd3f9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c72e0 0x7fd3f40b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.541+0000 7fd3f9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f40c76c0 0x7fd3f40bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.541+0000 7fd3f9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f4166ca0 0x7fd3f40c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.541+0000 7fd3f9400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40bbb60 con 0x7fd3f4166ca0 2024-03-23T06:19:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.541+0000 7fd3f9400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40be0d0 con 0x7fd3f40c76c0 2024-03-23T06:19:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.541+0000 7fd3f9400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f40bdb50 con 0x7fd3f40c72e0 2024-03-23T06:19:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.542+0000 7fd3f3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f40c76c0 0x7fd3f40bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:18.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.542+0000 7fd3f3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f40c76c0 0x7fd3f40bcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:39958/0 (socket says 172.21.15.73:39958) 2024-03-23T06:19:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.544+0000 7fd3f3e00640 1 -- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c72e0 msgr2=0x7fd3f40b7ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3301/0 2024-03-23T06:19:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.544+0000 7fd3f3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c72e0 0x7fd3f40b7ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:19:18.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.544+0000 7fd3f8a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f4166ca0 0x7fd3f40c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:18.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.544+0000 7fd3f8a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f4166ca0 0x7fd3f40c09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:49122/0 (socket says 172.21.15.73:49122) 2024-03-23T06:19:18.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.544+0000 7fd3f8a00640 1 -- 172.21.15.73:0/3491550994 learned_addr learned my addr 172.21.15.73:0/3491550994 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:18.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.546+0000 7fd3f8a00640 1 -- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c72e0 msgr2=0x7fd3f40b7ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:19:18.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.546+0000 7fd3f8a00640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c72e0 0x7fd3f40b7ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:18.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.546+0000 7fd3f8a00640 1 -- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f40c76c0 msgr2=0x7fd3f40bcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:18.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.546+0000 7fd3f8a00640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f40c76c0 0x7fd3f40bcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:18.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.546+0000 7fd3f8a00640 1 -- 172.21.15.73:0/3491550994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0006e70 con 0x7fd3f4166ca0 2024-03-23T06:19:18.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.548+0000 7fd3f8a00640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f4166ca0 0x7fd3f40c09a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00b990 tx=0x7fd3ec00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:18.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.549+0000 7fd3f3400640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f40c76c0 0x7fd3f40bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:19:18.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.550+0000 7fd3ebe00640 1 -- 172.21.15.73:0/3491550994 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00cb20 con 0x7fd3f4166ca0 2024-03-23T06:19:18.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.550+0000 7fd3ebe00640 1 -- 172.21.15.73:0/3491550994 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec00cc80 con 0x7fd3f4166ca0 2024-03-23T06:19:18.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.550+0000 7fd3ebe00640 1 -- 172.21.15.73:0/3491550994 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec00cb20 con 0x7fd3f4166ca0 2024-03-23T06:19:18.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.551+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f40bddf0 con 0x7fd3f4166ca0 2024-03-23T06:19:18.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.551+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f40bb780 con 0x7fd3f4166ca0 2024-03-23T06:19:18.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.553+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f40bbca0 con 0x7fd3f4166ca0 2024-03-23T06:19:18.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.567+0000 7fd3ebe00640 1 -- 172.21.15.73:0/3491550994 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd3ec012070 con 0x7fd3f4166ca0 2024-03-23T06:19:18.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.570+0000 7fd3ebe00640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd3d406ac10 0x7fd3d406d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:18.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.570+0000 7fd3ebe00640 1 -- 172.21.15.73:0/3491550994 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd3ec089590 con 0x7fd3f4166ca0 2024-03-23T06:19:18.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.572+0000 7fd3f3e00640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd3d406ac10 0x7fd3d406d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:18.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.574+0000 7fd3ebe00640 1 -- 172.21.15.73:0/3491550994 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd3ec054570 con 0x7fd3f4166ca0 2024-03-23T06:19:18.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:18.581+0000 7fd3f3e00640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd3d406ac10 0x7fd3d406d0d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4007fd0 tx=0x7fd3e4007ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:19.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.221+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd3f40bbca0 con 0x7fd3f4166ca0 2024-03-23T06:19:19.227 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":86,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:19:19.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.227+0000 7fd3ebe00640 1 -- 172.21.15.73:0/3491550994 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7fd3ec01a620 con 0x7fd3f4166ca0 2024-03-23T06:19:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd3d406ac10 msgr2=0x7fd3d406d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd3d406ac10 0x7fd3d406d0d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4007fd0 tx=0x7fd3e4007ac0 comp rx=0 tx=0).stop 2024-03-23T06:19:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f4166ca0 msgr2=0x7fd3f40c09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:19.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f4166ca0 0x7fd3f40c09a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00b990 tx=0x7fd3ec00be50 comp rx=0 tx=0).stop 2024-03-23T06:19:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 shutdown_connections 2024-03-23T06:19:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3f4166ca0 0x7fd3f40c09a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f40c76c0 0x7fd3f40bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd3d406ac10 0x7fd3d406d0d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 --2- 172.21.15.73:0/3491550994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3f40c72e0 0x7fd3f40b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.235+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 >> 172.21.15.73:0/3491550994 conn(0x7fd3f4069cb0 msgr2=0x7fd3f406f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:19.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.236+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 shutdown_connections 2024-03-23T06:19:19.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:19.236+0000 7fd3f9400640 1 -- 172.21.15.73:0/3491550994 wait complete. 2024-03-23T06:19:22.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:19:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.235+0000 7f0895200640 1 Processor -- start 2024-03-23T06:19:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.235+0000 7f0895200640 1 -- start start 2024-03-23T06:19:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f0895200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f0895200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f0895200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08900ca4f0 con 0x7f089006f8b0 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f0895200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08900c35b0 con 0x7f089006fc90 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f0895200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0890159490 con 0x7f08900c7580 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f088d400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f088d400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50390/0 (socket says 172.21.15.73:50390) 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 learned_addr learned my addr 172.21.15.73:0/2800550187 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.237+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:23.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.238+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:19:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.240+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.240+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:19:23.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.240+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:23.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.240+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:23.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.240+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:19:23.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.439+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:23.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.439+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:19:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.439+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.439+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.439+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:19:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.441+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.441+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:19:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.441+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.441+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:23.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.441+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:19:23.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.842+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:23.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.842+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:19:23.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.842+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:23.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.842+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:23.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.842+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:19:23.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.844+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:23.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.844+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:19:23.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.844+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:23.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.844+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:23.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:23.844+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:19:24.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.644+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:24.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.645+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:19:24.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.645+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:24.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.645+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:24.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.645+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:19:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.645+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.646+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:19:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.646+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.646+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:24.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:24.646+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:19:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.237+0000 7f0887400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 msgr2=0x7f089015d340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:19:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.237+0000 7f0887400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.110:3300/0 conn(0x7f08900c7580 0x7f089015d340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.237+0000 7f0887400640 1 -- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 msgr2=0x7f089015ce00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:19:26.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.237+0000 7f0887400640 1 --2- 172.21.15.73:0/2800550187 >> v2:172.21.15.73:3300/0 conn(0x7f089006fc90 0x7f089015ce00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:26.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.237+0000 7f0887400640 1 -- 172.21.15.73:0/2800550187 >> v1:172.21.15.110:6789/0 conn(0x7f089006f8b0 legacy=0x7f08900c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:26.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.237+0000 7f0887400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:26.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.237+0000 7f0887400640 1 -- 172.21.15.73:0/2800550187 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0890159680 con 0x7f08700036b0 2024-03-23T06:19:26.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.237+0000 7f0887400640 1 -- 172.21.15.73:0/2800550187 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c35b0 con 0x7f0870007300 2024-03-23T06:19:26.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.239+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:26.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.241+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 msgr2=0x7f08700097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:19:26.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.241+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 msgr2=0x7f08700097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:26.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.241+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:26.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.241+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:19:26.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.444+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:26.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.445+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 msgr2=0x7f08700097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:19:26.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.445+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 msgr2=0x7f08700097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:26.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.445+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:26.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.445+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:19:26.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.850+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:26.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.850+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 msgr2=0x7f08700097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:19:26.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.850+0000 7f088d400640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 msgr2=0x7f08700097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:19:26.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.850+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:19:26.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:26.850+0000 7f088d400640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:19:27.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.293+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561144946 0 0) 0x7f0890159680 con 0x7f08700036b0 2024-03-23T06:19:27.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.294+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0874003520 con 0x7f08700036b0 2024-03-23T06:19:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3062572125 0 0) 0x7f0874003520 con 0x7f08700036b0 2024-03-23T06:19:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 msgr2=0x7f08700097c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:19:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0870007300 0x7f08700097c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0870013790 con 0x7f08700036b0 2024-03-23T06:19:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f08800016f0 con 0x7f08700036b0 2024-03-23T06:19:27.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 >> v1:172.21.15.73:6789/0 conn(0x7f08700036b0 legacy=0x7f0870005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0874003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08740047c0 0x7f0874004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0874005250 0x7f087400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900c35b0 con 0x7f08740047c0 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087400c120 con 0x7f0874003970 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.296+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087400c2e0 con 0x7f0874005250 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.297+0000 7f088e800640 1 -- 172.21.15.73:0/2800550187 reap_dead start 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.297+0000 7f088e800640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0874005250 0x7f087400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.297+0000 7f088de00640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0874003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:27.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.299+0000 7f088de00640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0874005250 msgr2=0x7f087400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:27.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.299+0000 7f088de00640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0874005250 0x7f087400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.299+0000 7f088de00640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08740047c0 msgr2=0x7f0874004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:27.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.299+0000 7f088de00640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08740047c0 0x7f0874004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.299+0000 7f088de00640 1 -- 172.21.15.73:0/2800550187 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0870013790 con 0x7f0874003970 2024-03-23T06:19:27.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.302+0000 7f088de00640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0874003d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f088000c190 tx=0x7f08740057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b5bd333a5c207d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:27.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.314+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880005270 con 0x7f0874003970 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.315+0000 7f088ca00640 1 -- 172.21.15.73:0/2800550187 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08800053f0 con 0x7f0874003970 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.316+0000 7f0895200640 1 -- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 msgr2=0x7f0874003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.316+0000 7f0895200640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0874003d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f088000c190 tx=0x7f08740057f0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.316+0000 7f0895200640 1 -- 172.21.15.73:0/2800550187 shutdown_connections 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.316+0000 7f0895200640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0874005250 0x7f087400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.316+0000 7f0895200640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08740047c0 0x7f0874004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.316+0000 7f0895200640 1 --2- 172.21.15.73:0/2800550187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0874003d70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.316+0000 7f0895200640 1 -- 172.21.15.73:0/2800550187 >> 172.21.15.73:0/2800550187 conn(0x7f089006a0a0 msgr2=0x7f0890071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.317+0000 7f0895200640 1 -- 172.21.15.73:0/2800550187 shutdown_connections 2024-03-23T06:19:27.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.317+0000 7f0895200640 1 -- 172.21.15.73:0/2800550187 wait complete. 2024-03-23T06:19:27.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.321+0000 7f0895200640 1 Processor -- start 2024-03-23T06:19:27.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.321+0000 7f0895200640 1 -- start start 2024-03-23T06:19:27.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.323+0000 7f0895200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0890154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:27.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.323+0000 7f0895200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08740047c0 0x7f08900ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:27.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.324+0000 7f0895200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0874005250 0x7f0890155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:27.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.324+0000 7f0895200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08900ccac0 con 0x7f0874005250 2024-03-23T06:19:27.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.324+0000 7f0895200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0890154710 con 0x7f0874003970 2024-03-23T06:19:27.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.324+0000 7f0895200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08900cc7e0 con 0x7f08740047c0 2024-03-23T06:19:27.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.324+0000 7f088d400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08740047c0 0x7f08900ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:27.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.324+0000 7f088d400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08740047c0 0x7f08900ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:36778/0 (socket says 172.21.15.73:36778) 2024-03-23T06:19:27.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.324+0000 7f088d400640 1 -- 172.21.15.73:0/176648355 learned_addr learned my addr 172.21.15.73:0/176648355 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:27.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.324+0000 7f088de00640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0890154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:27.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.325+0000 7f088e800640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0874005250 0x7f0890155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:27.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.325+0000 7f088de00640 1 -- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08740047c0 msgr2=0x7f08900ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:27.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.325+0000 7f088de00640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08740047c0 0x7f08900ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.325+0000 7f088de00640 1 -- 172.21.15.73:0/176648355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0874005250 msgr2=0x7f0890155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:27.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.325+0000 7f088de00640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0874005250 0x7f0890155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.325+0000 7f088de00640 1 -- 172.21.15.73:0/176648355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890156a30 con 0x7f0874003970 2024-03-23T06:19:27.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.328+0000 7f088de00640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0890154ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0880031000 tx=0x7f0880001910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:27.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.329+0000 7f0886000640 1 -- 172.21.15.73:0/176648355 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880003a00 con 0x7f0874003970 2024-03-23T06:19:27.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.329+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0890156d10 con 0x7f0874003970 2024-03-23T06:19:27.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.330+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08901563a0 con 0x7f0874003970 2024-03-23T06:19:27.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.330+0000 7f0886000640 1 -- 172.21.15.73:0/176648355 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088003a050 con 0x7f0874003970 2024-03-23T06:19:27.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.330+0000 7f0886000640 1 -- 172.21.15.73:0/176648355 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880003a00 con 0x7f0874003970 2024-03-23T06:19:27.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.331+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0868005250 con 0x7f0874003970 2024-03-23T06:19:27.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.340+0000 7f0886000640 1 -- 172.21.15.73:0/176648355 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0880032070 con 0x7f0874003970 2024-03-23T06:19:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.343+0000 7f0886000640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0870074150 0x7f0870076610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:27.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.343+0000 7f0886000640 1 -- 172.21.15.73:0/176648355 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f08800aac50 con 0x7f0874003970 2024-03-23T06:19:27.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.344+0000 7f088d400640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0870074150 0x7f0870076610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.348+0000 7f088d400640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0870074150 0x7f0870076610 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f087c006e00 tx=0x7f087c006cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:27.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.348+0000 7f0886000640 1 -- 172.21.15.73:0/176648355 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0880075c70 con 0x7f0874003970 2024-03-23T06:19:27.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.913+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f08680057d0 con 0x7f0874003970 2024-03-23T06:19:27.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.924+0000 7f0886000640 1 -- 172.21.15.73:0/176648355 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f0880079290 con 0x7f0874003970 2024-03-23T06:19:27.925 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":90,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:19:27.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0870074150 msgr2=0x7f0870076610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0870074150 0x7f0870076610 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f087c006e00 tx=0x7f087c006cb0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 msgr2=0x7f0890154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0890154ed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0880031000 tx=0x7f0880001910 comp rx=0 tx=0).stop 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 shutdown_connections 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0874005250 0x7f0890155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0870074150 0x7f0870076610 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08740047c0 0x7f08900ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 --2- 172.21.15.73:0/176648355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0874003970 0x7f0890154ed0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 >> 172.21.15.73:0/176648355 conn(0x7f089006a0a0 msgr2=0x7f0890157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 shutdown_connections 2024-03-23T06:19:27.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:27.928+0000 7f0895200640 1 -- 172.21.15.73:0/176648355 wait complete. 2024-03-23T06:19:30.959 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:19:31.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.971+0000 7f9741e00640 1 Processor -- start 2024-03-23T06:19:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.972+0000 7f9741e00640 1 -- start start 2024-03-23T06:19:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.974+0000 7f9741e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f973c153570 0x7f973c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.974+0000 7f9741e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f973c06aad0 0x7f973c069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.974+0000 7f9741e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c15a2b0 con 0x7f973c06a1f0 2024-03-23T06:19:31.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.974+0000 7f9741e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0c8920 con 0x7f973c06aad0 2024-03-23T06:19:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.974+0000 7f9741e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0c9e40 con 0x7f973c153570 2024-03-23T06:19:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.975+0000 7f9740a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f973c153570 0x7f973c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:31.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.975+0000 7f9740a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f973c153570 0x7f973c159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:51978/0 (socket says 172.21.15.73:51978) 2024-03-23T06:19:31.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.975+0000 7f9740a00640 1 -- 172.21.15.73:0/1317749670 learned_addr learned my addr 172.21.15.73:0/1317749670 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:31.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.976+0000 7f9740a00640 1 -- 172.21.15.73:0/1317749670 >> v2:172.21.15.73:3300/0 conn(0x7f973c06aad0 msgr2=0x7f973c069cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:19:31.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.976+0000 7f9740a00640 1 --2- 172.21.15.73:0/1317749670 >> v2:172.21.15.73:3300/0 conn(0x7f973c06aad0 0x7f973c069cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:31.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.976+0000 7f9740a00640 1 -- 172.21.15.73:0/1317749670 >> v1:172.21.15.110:6789/0 conn(0x7f973c06a1f0 legacy=0x7f973c0ca2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:19:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.976+0000 7f9740a00640 1 -- 172.21.15.73:0/1317749670 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0c9580 con 0x7f973c153570 2024-03-23T06:19:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.977+0000 7f9740a00640 1 --2- 172.21.15.73:0/1317749670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c153570 0x7f973c159d70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f973c08cda0 tx=0x7f973002b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970912f04d52f17d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.977+0000 7f973b400640 1 -- 172.21.15.73:0/1317749670 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730031890 con 0x7f973c153570 2024-03-23T06:19:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.978+0000 7f973b400640 1 -- 172.21.15.73:0/1317749670 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97300319f0 con 0x7f973c153570 2024-03-23T06:19:31.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.978+0000 7f9741e00640 1 -- 172.21.15.73:0/1317749670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c153570 msgr2=0x7f973c159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.978+0000 7f973b400640 1 -- 172.21.15.73:0/1317749670 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730031d80 con 0x7f973c153570 2024-03-23T06:19:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.978+0000 7f9741e00640 1 --2- 172.21.15.73:0/1317749670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c153570 0x7f973c159d70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f973c08cda0 tx=0x7f973002b930 comp rx=0 tx=0).stop 2024-03-23T06:19:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.979+0000 7f9741e00640 1 -- 172.21.15.73:0/1317749670 shutdown_connections 2024-03-23T06:19:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.979+0000 7f9741e00640 1 --2- 172.21.15.73:0/1317749670 >> v2:172.21.15.73:3300/0 conn(0x7f973c06aad0 0x7f973c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.979+0000 7f9741e00640 1 --2- 172.21.15.73:0/1317749670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c153570 0x7f973c159d70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:31.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.979+0000 7f9741e00640 1 -- 172.21.15.73:0/1317749670 >> 172.21.15.73:0/1317749670 conn(0x7f973c0ceb60 msgr2=0x7f973c0cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:31.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.980+0000 7f9741e00640 1 -- 172.21.15.73:0/1317749670 shutdown_connections 2024-03-23T06:19:31.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.982+0000 7f9741e00640 1 -- 172.21.15.73:0/1317749670 wait complete. 2024-03-23T06:19:31.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.988+0000 7f9741e00640 1 Processor -- start 2024-03-23T06:19:31.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.988+0000 7f9741e00640 1 -- start start 2024-03-23T06:19:31.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.990+0000 7f9741e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c06a1f0 0x7f973c1f3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:31.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.990+0000 7f9741e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c153570 0x7f973c1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:31.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.990+0000 7f9741e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f973c0c2ae0 0x7f973c159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:31.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.990+0000 7f9741e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0c54c0 con 0x7f973c0c2ae0 2024-03-23T06:19:31.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.990+0000 7f9741e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1f2ff0 con 0x7f973c06a1f0 2024-03-23T06:19:31.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.990+0000 7f9741e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0c56b0 con 0x7f973c153570 2024-03-23T06:19:31.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.991+0000 7f9740a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c06a1f0 0x7f973c1f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.991+0000 7f9740a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c06a1f0 0x7f973c1f3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:51992/0 (socket says 172.21.15.73:51992) 2024-03-23T06:19:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.991+0000 7f9740a00640 1 -- 172.21.15.73:0/1371530974 learned_addr learned my addr 172.21.15.73:0/1371530974 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.991+0000 7f973be00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c153570 0x7f973c1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:31.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.991+0000 7f9741400640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f973c0c2ae0 0x7f973c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.994+0000 7f9740a00640 1 -- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c153570 msgr2=0x7f973c1581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.994+0000 7f9740a00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c153570 0x7f973c1581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.994+0000 7f9740a00640 1 -- 172.21.15.73:0/1371530974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f973c0c2ae0 msgr2=0x7f973c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.994+0000 7f9740a00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f973c0c2ae0 0x7f973c159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:31.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.994+0000 7f9740a00640 1 -- 172.21.15.73:0/1371530974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300094d0 con 0x7f973c06a1f0 2024-03-23T06:19:31.996 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.996+0000 7f9740a00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c06a1f0 0x7f973c1f3480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f97300090b0 tx=0x7f9730004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:31.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.997+0000 7f9738c00640 1 -- 172.21.15.73:0/1371530974 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97300443f0 con 0x7f973c06a1f0 2024-03-23T06:19:31.997 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.997+0000 7f9738c00640 1 -- 172.21.15.73:0/1371530974 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9730044550 con 0x7f973c06a1f0 2024-03-23T06:19:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.997+0000 7f9738c00640 1 -- 172.21.15.73:0/1371530974 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730044900 con 0x7f973c06a1f0 2024-03-23T06:19:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.997+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c0c3ab0 con 0x7f973c06a1f0 2024-03-23T06:19:31.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.997+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c071150 con 0x7f973c06a1f0 2024-03-23T06:19:32.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:31.999+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c04e030 con 0x7f973c06a1f0 2024-03-23T06:19:32.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.001+0000 7f9738c00640 1 -- 172.21.15.73:0/1371530974 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f97300303e0 con 0x7f973c06a1f0 2024-03-23T06:19:32.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.003+0000 7f9738c00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f971c06acd0 0x7f971c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:32.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.003+0000 7f9738c00640 1 -- 172.21.15.73:0/1371530974 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f9730000e40 con 0x7f973c06a1f0 2024-03-23T06:19:32.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.005+0000 7f973be00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f971c06acd0 0x7f971c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:32.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.006+0000 7f973be00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f971c06acd0 0x7f971c06d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9728006fd0 tx=0x7f9728008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:32.023 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.022+0000 7f9738c00640 1 -- 172.21.15.73:0/1371530974 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9730076ca0 con 0x7f973c06a1f0 2024-03-23T06:19:32.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.514+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f973c14f7f0 con 0x7f973c06a1f0 2024-03-23T06:19:32.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.515+0000 7f9738c00640 1 -- 172.21.15.73:0/1371530974 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1547 (secure 0 0 0) 0x7f973007a2c0 con 0x7f973c06a1f0 2024-03-23T06:19:32.516 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":92,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:19:32.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.519+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f971c06acd0 msgr2=0x7f971c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.519+0000 7f9741e00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f971c06acd0 0x7f971c06d190 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9728006fd0 tx=0x7f9728008040 comp rx=0 tx=0).stop 2024-03-23T06:19:32.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.520+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c06a1f0 msgr2=0x7f973c1f3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.520+0000 7f9741e00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c06a1f0 0x7f973c1f3480 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f97300090b0 tx=0x7f9730004730 comp rx=0 tx=0).stop 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.520+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 shutdown_connections 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.520+0000 7f9741e00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f973c0c2ae0 0x7f973c159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.521+0000 7f9741e00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f971c06acd0 0x7f971c06d190 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.521+0000 7f9741e00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c153570 0x7f973c1581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.521+0000 7f9741e00640 1 --2- 172.21.15.73:0/1371530974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c06a1f0 0x7f973c1f3480 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.521+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 >> 172.21.15.73:0/1371530974 conn(0x7f973c0ceb60 msgr2=0x7f973c0cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.521+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 shutdown_connections 2024-03-23T06:19:32.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.521+0000 7f9741e00640 1 -- 172.21.15.73:0/1371530974 wait complete. 2024-03-23T06:19:32.551 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:19:32.551 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:19:32.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:19:32.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.932+0000 7f6f4fe00640 1 Processor -- start 2024-03-23T06:19:32.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.932+0000 7f6f4fe00640 1 -- start start 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.940+0000 7f6f4fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f48007e20 0x7f6f4804e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.944+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4804ccf0 0x7f6f480e3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.944+0000 7f6f4fe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4804eb20 con 0x7f6f480dd740 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.944+0000 7f6f4fe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f48008ff0 con 0x7f6f48007e20 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.944+0000 7f6f4fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4804e840 con 0x7f6f4804ccf0 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.944+0000 7f6f4f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4804ccf0 0x7f6f480e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.944+0000 7f6f4f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4804ccf0 0x7f6f480e3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:48460/0 (socket says 172.21.15.73:48460) 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.944+0000 7f6f4f400640 1 -- 172.21.15.73:0/1066030625 learned_addr learned my addr 172.21.15.73:0/1066030625 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.945+0000 7f6f4e000640 1 --2- 172.21.15.73:0/1066030625 >> v2:172.21.15.110:3300/0 conn(0x7f6f48007e20 0x7f6f4804e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:32.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.944+0000 7f6f4ea00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6f480dd740 0x7f6f4804d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:46464/0 (socket says 172.21.15.73:46464) 2024-03-23T06:19:32.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.946+0000 7f6f4e000640 1 -- 172.21.15.73:0/1066030625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4804ccf0 msgr2=0x7f6f480e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:32.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.946+0000 7f6f4e000640 1 --2- 172.21.15.73:0/1066030625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4804ccf0 0x7f6f480e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.946+0000 7f6f4e000640 1 -- 172.21.15.73:0/1066030625 >> v1:172.21.15.110:6789/0 conn(0x7f6f480dd740 legacy=0x7f6f4804d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:32.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.946+0000 7f6f4e000640 1 -- 172.21.15.73:0/1066030625 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48008650 con 0x7f6f48007e20 2024-03-23T06:19:32.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.949+0000 7f6f4f400640 1 --2- 172.21.15.73:0/1066030625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4804ccf0 0x7f6f480e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:19:32.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.952+0000 7f6f4e000640 1 --2- 172.21.15.73:0/1066030625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f48007e20 0x7f6f4804e190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f400097d0 tx=0x7f6f4002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13e6f16a6e4b9e5a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:32.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.952+0000 7f6f4d600640 1 -- 172.21.15.73:0/1066030625 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400317c0 con 0x7f6f48007e20 2024-03-23T06:19:32.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.952+0000 7f6f4d600640 1 -- 172.21.15.73:0/1066030625 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40031920 con 0x7f6f48007e20 2024-03-23T06:19:32.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.952+0000 7f6f4d600640 1 -- 172.21.15.73:0/1066030625 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40031cf0 con 0x7f6f48007e20 2024-03-23T06:19:32.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.953+0000 7f6f4fe00640 1 -- 172.21.15.73:0/1066030625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f48007e20 msgr2=0x7f6f4804e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:32.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.953+0000 7f6f4fe00640 1 --2- 172.21.15.73:0/1066030625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f48007e20 0x7f6f4804e190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f400097d0 tx=0x7f6f4002b860 comp rx=0 tx=0).stop 2024-03-23T06:19:32.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.955+0000 7f6f4fe00640 1 -- 172.21.15.73:0/1066030625 shutdown_connections 2024-03-23T06:19:32.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.955+0000 7f6f4fe00640 1 --2- 172.21.15.73:0/1066030625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4804ccf0 0x7f6f480e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.955+0000 7f6f4fe00640 1 --2- 172.21.15.73:0/1066030625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f48007e20 0x7f6f4804e190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.955+0000 7f6f4fe00640 1 -- 172.21.15.73:0/1066030625 >> 172.21.15.73:0/1066030625 conn(0x7f6f4800e670 msgr2=0x7f6f48009d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:32.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.956+0000 7f6f4fe00640 1 -- 172.21.15.73:0/1066030625 shutdown_connections 2024-03-23T06:19:32.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.956+0000 7f6f4fe00640 1 -- 172.21.15.73:0/1066030625 wait complete. 2024-03-23T06:19:32.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.960+0000 7f6f4fe00640 1 Processor -- start 2024-03-23T06:19:32.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.960+0000 7f6f4fe00640 1 -- start start 2024-03-23T06:19:32.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.962+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f48007e20 0x7f6f48035950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:32.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.962+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4804ccf0 0x7f6f480e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:32.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.962+0000 7f6f4ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f48007e20 0x7f6f48035950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:32.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.962+0000 7f6f4ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f48007e20 0x7f6f48035950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:48472/0 (socket says 172.21.15.73:48472) 2024-03-23T06:19:32.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.963+0000 7f6f4e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4804ccf0 0x7f6f480e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:32.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.963+0000 7f6f4e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4804ccf0 0x7f6f480e5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52022/0 (socket says 172.21.15.73:52022) 2024-03-23T06:19:32.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.963+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f48036300 0x7f6f480d8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.964+0000 7f6f4f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f48036300 0x7f6f480d8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.964+0000 7f6f4f400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f48036300 0x7f6f480d8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46852/0 (socket says 172.21.15.73:46852) 2024-03-23T06:19:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.964+0000 7f6f4ea00640 1 -- 172.21.15.73:0/3304586094 learned_addr learned my addr 172.21.15.73:0/3304586094 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.964+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480354c0 con 0x7f6f48036300 2024-03-23T06:19:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.964+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481799d0 con 0x7f6f4804ccf0 2024-03-23T06:19:32.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.964+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48179f70 con 0x7f6f48007e20 2024-03-23T06:19:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.965+0000 7f6f4f400640 1 -- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f48007e20 msgr2=0x7f6f48035950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.965+0000 7f6f4f400640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f48007e20 0x7f6f48035950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.965+0000 7f6f4f400640 1 -- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4804ccf0 msgr2=0x7f6f480e5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:32.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.965+0000 7f6f4f400640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4804ccf0 0x7f6f480e5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.965+0000 7f6f4f400640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40009400 con 0x7f6f48036300 2024-03-23T06:19:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.965+0000 7f6f4ea00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f48007e20 0x7f6f48035950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:19:32.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.966+0000 7f6f4f400640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f48036300 0x7f6f480d8440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f50067500 tx=0x7f6f500696e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:32.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.967+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500678b0 con 0x7f6f48036300 2024-03-23T06:19:32.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.967+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f48179c90 con 0x7f6f48036300 2024-03-23T06:19:32.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.967+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f48035150 con 0x7f6f48036300 2024-03-23T06:19:32.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.968+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50067a10 con 0x7f6f48036300 2024-03-23T06:19:32.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.968+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500678b0 con 0x7f6f48036300 2024-03-23T06:19:32.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.971+0000 7f6f4fe00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f480dd740 0x7f6f48003160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:32.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.971+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480078f0 con 0x7f6f480dd740 2024-03-23T06:19:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.974+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6f50072230 con 0x7f6f48036300 2024-03-23T06:19:32.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.975+0000 7f6f4ea00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f480dd740 0x7f6f48003160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:32.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.977+0000 7f6f46a00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f3006ac60 0x7f6f3006d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:32.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.977+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f6f5008f070 con 0x7f6f48036300 2024-03-23T06:19:32.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.978+0000 7f6f4ea00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f48008c10 con 0x7f6f480dd740 2024-03-23T06:19:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.978+0000 7f6f4ea00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f480dd740 0x7f6f48003160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d6f0 tx=0x7f6f3c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.979+0000 7f6f4e000640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f3006ac60 0x7f6f3006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:32.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.979+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c005a10 con 0x7f6f480dd740 2024-03-23T06:19:32.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.980+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f6f3c005b70 con 0x7f6f480dd740 2024-03-23T06:19:32.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.980+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f480dd740 msgr2=0x7f6f48003160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:32.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.980+0000 7f6f46a00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f480dd740 0x7f6f48003160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d6f0 tx=0x7f6f3c00dbb0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.980+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f480dd740 msgr2=0x7f6f48003160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:32.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.980+0000 7f6f46a00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f480dd740 0x7f6f48003160 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d6f0 tx=0x7f6f3c00dbb0 comp rx=0 tx=0).stop 2024-03-23T06:19:32.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:32.982+0000 7f6f4e000640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f3006ac60 0x7f6f3006d120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6f40036000 tx=0x7f6f4003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.030+0000 7f6f4fe00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f4804dbd0 0x7f6f48179060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.030+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48035340 con 0x7f6f4804dbd0 2024-03-23T06:19:33.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.031+0000 7f6f4ea00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f4804dbd0 0x7f6f48179060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.032+0000 7f6f4ea00640 1 -- 172.21.15.73:0/3304586094 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6f480dc760 con 0x7f6f4804dbd0 2024-03-23T06:19:33.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.032+0000 7f6f4ea00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f4804dbd0 0x7f6f48179060 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d6f0 tx=0x7f6f3c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.033+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c022070 con 0x7f6f4804dbd0 2024-03-23T06:19:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4467 (secure 0 0 0) 0x7f6f3c00ba70 con 0x7f6f4804dbd0 2024-03-23T06:19:33.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f4804dbd0 msgr2=0x7f6f48179060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f46a00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f4804dbd0 0x7f6f48179060 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00d6f0 tx=0x7f6f3c001080 comp rx=0 tx=0).stop 2024-03-23T06:19:33.034 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:19:33.034 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:19:33.034 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:19:33.034 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 92, 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 4, 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:33.035 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:33.036 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:33.037 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:33.038 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.039 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:33.040 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:19:33.041 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:33.042 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:19:33.043 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.044 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:19:33.045 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f46a00640 1 -- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f4804dbd0 msgr2=0x7f6f48179060 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f46a00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f4804dbd0 0x7f6f48179060 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f3006ac60 msgr2=0x7f6f3006d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f4fe00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f6f3006ac60 0x7f6f3006d120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6f40036000 tx=0x7f6f4003d040 comp rx=0 tx=0).stop 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f48036300 msgr2=0x7f6f480d8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.034+0000 7f6f4fe00640 1 --2- 172.21.15.73:0/3304586094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f48036300 0x7f6f480d8440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f50067500 tx=0x7f6f500696e0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.035+0000 7f6f4f400640 1 -- 172.21.15.73:0/3304586094 reap_dead start 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.035+0000 7f6f4f400640 1 -- 172.21.15.73:0/3304586094 reap_dead start 2024-03-23T06:19:33.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.035+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 shutdown_connections 2024-03-23T06:19:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.035+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 >> 172.21.15.73:0/3304586094 conn(0x7f6f4800e670 msgr2=0x7f6f480e3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.036+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 shutdown_connections 2024-03-23T06:19:33.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.036+0000 7f6f4fe00640 1 -- 172.21.15.73:0/3304586094 wait complete. 2024-03-23T06:19:33.059 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:19:33.059 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:19:33.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:19:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.377+0000 7fdbdbe00640 1 Processor -- start 2024-03-23T06:19:33.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.378+0000 7fdbdbe00640 1 -- start start 2024-03-23T06:19:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.379+0000 7fdbdbe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdbd404ba20 0x7fdbd404be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.379+0000 7fdbdbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40e3050 0x7fdbd40e34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.379+0000 7fdbdbe00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd4045410 con 0x7fdbd40dd380 2024-03-23T06:19:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.379+0000 7fdbdbe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd4045f90 con 0x7fdbd404ba20 2024-03-23T06:19:33.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.379+0000 7fdbdbe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4046b30 con 0x7fdbd40e3050 2024-03-23T06:19:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.380+0000 7fdbdb400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40e3050 0x7fdbd40e34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.380+0000 7fdbdb400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40e3050 0x7fdbd40e34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:48486/0 (socket says 172.21.15.73:48486) 2024-03-23T06:19:33.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.380+0000 7fdbdb400640 1 -- 172.21.15.73:0/1476806504 learned_addr learned my addr 172.21.15.73:0/1476806504 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:33.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.381+0000 7fdbda000640 1 --2- 172.21.15.73:0/1476806504 >> v2:172.21.15.73:3300/0 conn(0x7fdbd404ba20 0x7fdbd404be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.382+0000 7fdbda000640 1 -- 172.21.15.73:0/1476806504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40e3050 msgr2=0x7fdbd40e34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:33.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.382+0000 7fdbda000640 1 --2- 172.21.15.73:0/1476806504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40e3050 0x7fdbd40e34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.382+0000 7fdbda000640 1 -- 172.21.15.73:0/1476806504 >> v1:172.21.15.73:6789/0 conn(0x7fdbd40dd380 legacy=0x7fdbd4046420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.382+0000 7fdbda000640 1 -- 172.21.15.73:0/1476806504 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40dd760 con 0x7fdbd404ba20 2024-03-23T06:19:33.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.382+0000 7fdbd9600640 1 -- 172.21.15.73:0/1476806504 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897554806 0 0) 0x7fdbd4045410 con 0x7fdbd40dd380 2024-03-23T06:19:33.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.384+0000 7fdbda000640 1 --2- 172.21.15.73:0/1476806504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd404ba20 0x7fdbd404be40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0097a0 tx=0x7fdbcc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691de360ae02600 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.397+0000 7fdbd9600640 1 -- 172.21.15.73:0/1476806504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc02d040 con 0x7fdbd404ba20 2024-03-23T06:19:33.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.398+0000 7fdbd9600640 1 -- 172.21.15.73:0/1476806504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc031810 con 0x7fdbd404ba20 2024-03-23T06:19:33.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.398+0000 7fdbd9600640 1 -- 172.21.15.73:0/1476806504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc031ba0 con 0x7fdbd404ba20 2024-03-23T06:19:33.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.400+0000 7fdbdbe00640 1 -- 172.21.15.73:0/1476806504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd404ba20 msgr2=0x7fdbd404be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.400+0000 7fdbdbe00640 1 --2- 172.21.15.73:0/1476806504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd404ba20 0x7fdbd404be40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0097a0 tx=0x7fdbcc02b8b0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.405+0000 7fdbdbe00640 1 -- 172.21.15.73:0/1476806504 shutdown_connections 2024-03-23T06:19:33.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.405+0000 7fdbdbe00640 1 --2- 172.21.15.73:0/1476806504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40e3050 0x7fdbd40e34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.407+0000 7fdbdbe00640 1 --2- 172.21.15.73:0/1476806504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd404ba20 0x7fdbd404be40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.407+0000 7fdbdbe00640 1 -- 172.21.15.73:0/1476806504 >> 172.21.15.73:0/1476806504 conn(0x7fdbd4050140 msgr2=0x7fdbd4050550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:33.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.409+0000 7fdbdbe00640 1 -- 172.21.15.73:0/1476806504 shutdown_connections 2024-03-23T06:19:33.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.409+0000 7fdbdbe00640 1 -- 172.21.15.73:0/1476806504 wait complete. 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.411+0000 7fdbdbe00640 1 Processor -- start 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.421+0000 7fdbdbe00640 1 -- start start 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.423+0000 7fdbdbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd404ba20 0x7fdbd4173ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.423+0000 7fdbdbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40dd380 0x7fdbd40ddd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.423+0000 7fdbdbe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd40e3050 0x7fdbd40de260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.424+0000 7fdbda000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40dd380 0x7fdbd40ddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.424+0000 7fdbdaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd404ba20 0x7fdbd4173ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.424+0000 7fdbdaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd404ba20 0x7fdbd4173ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52024/0 (socket says 172.21.15.73:52024) 2024-03-23T06:19:33.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.424+0000 7fdbda000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40dd380 0x7fdbd40ddd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:48490/0 (socket says 172.21.15.73:48490) 2024-03-23T06:19:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.424+0000 7fdbdb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd40e3050 0x7fdbd40de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.424+0000 7fdbdb400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd40e3050 0x7fdbd40de260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46882/0 (socket says 172.21.15.73:46882) 2024-03-23T06:19:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.425+0000 7fdbdaa00640 1 -- 172.21.15.73:0/3690638362 learned_addr learned my addr 172.21.15.73:0/3690638362 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.425+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40dbe60 con 0x7fdbd40e3050 2024-03-23T06:19:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.425+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd404a480 con 0x7fdbd404ba20 2024-03-23T06:19:33.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.425+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd404a1a0 con 0x7fdbd40dd380 2024-03-23T06:19:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.426+0000 7fdbdb400640 1 -- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40dd380 msgr2=0x7fdbd40ddd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.426+0000 7fdbdb400640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdbd40dd380 0x7fdbd40ddd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.426+0000 7fdbdb400640 1 -- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd404ba20 msgr2=0x7fdbd4173ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.426+0000 7fdbdb400640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd404ba20 0x7fdbd4173ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.426+0000 7fdbdb400640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc009400 con 0x7fdbd40e3050 2024-03-23T06:19:33.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.427+0000 7fdbdb400640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd40e3050 0x7fdbd40de260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400e890 tx=0x7fdbc400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.427+0000 7fdbdaa00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd404ba20 0x7fdbd4173ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:19:33.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.428+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400c730 con 0x7fdbd40e3050 2024-03-23T06:19:33.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.431+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc400c890 con 0x7fdbd40e3050 2024-03-23T06:19:33.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.431+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd404eb80 con 0x7fdbd40e3050 2024-03-23T06:19:33.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.431+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400cc00 con 0x7fdbd40e3050 2024-03-23T06:19:33.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.443+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd404f140 con 0x7fdbd40e3050 2024-03-23T06:19:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.446+0000 7fdbdbe00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd4005350 0x7fdbd4181500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.446+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd40088f0 con 0x7fdbd4005350 2024-03-23T06:19:33.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.446+0000 7fdbdaa00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd4005350 0x7fdbd4181500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.448+0000 7fdbdaa00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbd4045940 con 0x7fdbd4005350 2024-03-23T06:19:33.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.449+0000 7fdbdaa00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd4005350 0x7fdbd4181500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc068a40 tx=0x7fdbdc067930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.450+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc072640 con 0x7fdbd4005350 2024-03-23T06:19:33.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.452+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdbc4013470 con 0x7fdbd40e3050 2024-03-23T06:19:33.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.454+0000 7fdbd2a00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdbb806acf0 0x7fdbb806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.454+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fdbdc070050 con 0x7fdbd4005350 2024-03-23T06:19:33.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.454+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd4005350 msgr2=0x7fdbd4181500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.454+0000 7fdbd2a00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd4005350 0x7fdbd4181500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc068a40 tx=0x7fdbdc067930 comp rx=0 tx=0).stop 2024-03-23T06:19:33.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.454+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd4005350 msgr2=0x7fdbd4181500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:33.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.454+0000 7fdbd2a00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd4005350 0x7fdbd4181500 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc068a40 tx=0x7fdbdc067930 comp rx=0 tx=0).stop 2024-03-23T06:19:33.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.454+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fdbc4088d30 con 0x7fdbd40e3050 2024-03-23T06:19:33.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.455+0000 7fdbda000640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdbb806acf0 0x7fdbb806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.456+0000 7fdbda000640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdbb806acf0 0x7fdbb806d1b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc036000 tx=0x7fdbcc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.467+0000 7fdbdbe00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd40e04d0 0x7fdbd4181a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.468+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd4045660 con 0x7fdbd40e04d0 2024-03-23T06:19:33.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.468+0000 7fdbdaa00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd40e04d0 0x7fdbd4181a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.476+0000 7fdbdaa00640 1 -- 172.21.15.73:0/3690638362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdbd4045c20 con 0x7fdbd40e04d0 2024-03-23T06:19:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.480+0000 7fdbdaa00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd40e04d0 0x7fdbd4181a40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc07ad90 tx=0x7fdbdc067f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.481+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc09e450 con 0x7fdbd40e04d0 2024-03-23T06:19:33.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.481+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5118 (secure 0 0 0) 0x7fdbdc09e5b0 con 0x7fdbd40e04d0 2024-03-23T06:19:33.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.481+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd40e04d0 msgr2=0x7fdbd4181a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.481+0000 7fdbd2a00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd40e04d0 0x7fdbd4181a40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc07ad90 tx=0x7fdbdc067f80 comp rx=0 tx=0).stop 2024-03-23T06:19:33.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.481+0000 7fdbd2a00640 1 -- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd40e04d0 msgr2=0x7fdbd4181a40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:33.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.481+0000 7fdbd2a00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdbd40e04d0 0x7fdbd4181a40 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc07ad90 tx=0x7fdbdc067f80 comp rx=0 tx=0).stop 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 92, 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 5, 2024-03-23T06:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.483 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.484 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:19:33.485 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:19:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:19:33.487 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:33.488 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:33.489 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:19:33.491 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:33.492 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.493 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:19:33.494 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:19:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.484+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdbb806acf0 msgr2=0x7fdbb806d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.484+0000 7fdbdbe00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdbb806acf0 0x7fdbb806d1b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc036000 tx=0x7fdbcc03c040 comp rx=0 tx=0).stop 2024-03-23T06:19:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.484+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd40e3050 msgr2=0x7fdbd40de260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.484+0000 7fdbdbe00640 1 --2- 172.21.15.73:0/3690638362 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdbd40e3050 0x7fdbd40de260 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400e890 tx=0x7fdbc400ed50 comp rx=0 tx=0).stop 2024-03-23T06:19:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.484+0000 7fdbdb400640 1 -- 172.21.15.73:0/3690638362 reap_dead start 2024-03-23T06:19:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.484+0000 7fdbdb400640 1 -- 172.21.15.73:0/3690638362 reap_dead start 2024-03-23T06:19:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.486+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 shutdown_connections 2024-03-23T06:19:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.486+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 >> 172.21.15.73:0/3690638362 conn(0x7fdbd4050140 msgr2=0x7fdbd4050520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.486+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 shutdown_connections 2024-03-23T06:19:33.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.487+0000 7fdbdbe00640 1 -- 172.21.15.73:0/3690638362 wait complete. 2024-03-23T06:19:33.524 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:19:33.525 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:19:33.525 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:19:33.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.915+0000 7eff99a00640 1 Processor -- start 2024-03-23T06:19:33.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.915+0000 7eff99a00640 1 -- start start 2024-03-23T06:19:33.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.919+0000 7eff99a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 0x7eff94155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.919+0000 7eff99a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff94070c80 0x7eff9406db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.919+0000 7eff93e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 0x7eff94155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.919+0000 7eff93e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 0x7eff94155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:48496/0 (socket says 172.21.15.73:48496) 2024-03-23T06:19:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.920+0000 7eff92a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7eff9406a3c0 0x7eff94158990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:46478/0 (socket says 172.21.15.73:46478) 2024-03-23T06:19:33.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.920+0000 7eff92a00640 1 -- 172.21.15.73:0/3676786474 learned_addr learned my addr 172.21.15.73:0/3676786474 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:19:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.921+0000 7eff99a00640 1 -- 172.21.15.73:0/3676786474 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9414fbf0 con 0x7eff9406a3c0 2024-03-23T06:19:33.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.921+0000 7eff92000640 1 --2- 172.21.15.73:0/3676786474 >> v2:172.21.15.110:3300/0 conn(0x7eff94070c80 0x7eff9406db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.921+0000 7eff99a00640 1 -- 172.21.15.73:0/3676786474 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9406d710 con 0x7eff94070c80 2024-03-23T06:19:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.921+0000 7eff91600640 1 -- 172.21.15.73:0/3676786474 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061124777 0 0) 0x7eff8c002370 con 0x7eff9406a3c0 2024-03-23T06:19:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.922+0000 7eff99a00640 1 -- 172.21.15.73:0/3676786474 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff94155960 con 0x7eff9414f810 2024-03-23T06:19:33.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.922+0000 7eff91600640 1 -- 172.21.15.73:0/3676786474 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff78003520 con 0x7eff9406a3c0 2024-03-23T06:19:33.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.923+0000 7eff92000640 1 -- 172.21.15.73:0/3676786474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 msgr2=0x7eff94155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:33.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.923+0000 7eff92000640 1 --2- 172.21.15.73:0/3676786474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 0x7eff94155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.923+0000 7eff92000640 1 -- 172.21.15.73:0/3676786474 >> v1:172.21.15.110:6789/0 conn(0x7eff9406a3c0 legacy=0x7eff94158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.923+0000 7eff92000640 1 -- 172.21.15.73:0/3676786474 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9406e070 con 0x7eff94070c80 2024-03-23T06:19:33.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.926+0000 7eff92000640 1 --2- 172.21.15.73:0/3676786474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 0x7eff9406db30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff800097a0 tx=0x7eff8002db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15e0593c2083d76f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.926+0000 7eff91600640 1 -- 172.21.15.73:0/3676786474 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8002f920 con 0x7eff94070c80 2024-03-23T06:19:33.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.926+0000 7eff91600640 1 -- 172.21.15.73:0/3676786474 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8002fa80 con 0x7eff94070c80 2024-03-23T06:19:33.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.926+0000 7eff91600640 1 -- 172.21.15.73:0/3676786474 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8002fe10 con 0x7eff94070c80 2024-03-23T06:19:33.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.927+0000 7eff99a00640 1 -- 172.21.15.73:0/3676786474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 msgr2=0x7eff9406db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.927+0000 7eff99a00640 1 --2- 172.21.15.73:0/3676786474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 0x7eff9406db30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7eff800097a0 tx=0x7eff8002db60 comp rx=0 tx=0).stop 2024-03-23T06:19:33.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.928+0000 7eff99a00640 1 -- 172.21.15.73:0/3676786474 shutdown_connections 2024-03-23T06:19:33.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.928+0000 7eff99a00640 1 --2- 172.21.15.73:0/3676786474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 0x7eff9406db30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.928+0000 7eff99a00640 1 --2- 172.21.15.73:0/3676786474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 0x7eff94155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.928+0000 7eff99a00640 1 -- 172.21.15.73:0/3676786474 >> 172.21.15.73:0/3676786474 conn(0x7eff9406bfc0 msgr2=0x7eff94069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:33.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.929+0000 7eff99a00640 1 -- 172.21.15.73:0/3676786474 shutdown_connections 2024-03-23T06:19:33.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.929+0000 7eff99a00640 1 -- 172.21.15.73:0/3676786474 wait complete. 2024-03-23T06:19:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.934+0000 7eff99a00640 1 Processor -- start 2024-03-23T06:19:33.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.934+0000 7eff99a00640 1 -- start start 2024-03-23T06:19:33.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.937+0000 7eff99a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff9406a3c0 0x7eff940cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.938+0000 7eff99a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 0x7eff941ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.939+0000 7eff92000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 0x7eff941ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.939+0000 7eff92000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 0x7eff941ebfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52056/0 (socket says 172.21.15.73:52056) 2024-03-23T06:19:33.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.938+0000 7eff99a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 0x7eff940c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.939+0000 7eff92000640 1 -- 172.21.15.73:0/2757943638 learned_addr learned my addr 172.21.15.73:0/2757943638 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:33.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.940+0000 7eff92a00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 0x7eff940c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.940+0000 7eff99a00640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff941eb5e0 con 0x7eff9406a3c0 2024-03-23T06:19:33.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.940+0000 7eff93e00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff9406a3c0 0x7eff940cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.940+0000 7eff99a00640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff941eb8c0 con 0x7eff94070c80 2024-03-23T06:19:33.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.940+0000 7eff99a00640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff940ca0f0 con 0x7eff9414f810 2024-03-23T06:19:33.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.942+0000 7eff93e00640 1 -- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 msgr2=0x7eff940c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.942+0000 7eff93e00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff9414f810 0x7eff940c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.942+0000 7eff93e00640 1 -- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 msgr2=0x7eff941ebfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.942+0000 7eff93e00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff94070c80 0x7eff941ebfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.942+0000 7eff93e00640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff80009400 con 0x7eff9406a3c0 2024-03-23T06:19:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.946+0000 7eff93e00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff9406a3c0 0x7eff940cabd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff8400da60 tx=0x7eff8400df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.947+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400b950 con 0x7eff9406a3c0 2024-03-23T06:19:33.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.947+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400f040 con 0x7eff9406a3c0 2024-03-23T06:19:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.949+0000 7eff99a00640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff940ca3d0 con 0x7eff9406a3c0 2024-03-23T06:19:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.949+0000 7eff99a00640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff940c4920 con 0x7eff9406a3c0 2024-03-23T06:19:33.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.952+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400bcf0 con 0x7eff9406a3c0 2024-03-23T06:19:33.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.953+0000 7eff7fe00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68002a30 0x7eff68004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.953+0000 7eff7fe00640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff68007e80 con 0x7eff68002a30 2024-03-23T06:19:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.957+0000 7eff92000640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68002a30 0x7eff68004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.958+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7eff840183f0 con 0x7eff9406a3c0 2024-03-23T06:19:33.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.962+0000 7eff92000640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff68008040 con 0x7eff68002a30 2024-03-23T06:19:33.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.962+0000 7eff8aa00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff7406ac50 0x7eff7406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.962+0000 7eff92000640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68002a30 0x7eff68004ef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff800097a0 tx=0x7eff80004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.963+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7eff84089120 con 0x7eff9406a3c0 2024-03-23T06:19:33.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.963+0000 7eff92a00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff7406ac50 0x7eff7406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.966+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80052070 con 0x7eff68002a30 2024-03-23T06:19:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.966+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7eff80037420 con 0x7eff68002a30 2024-03-23T06:19:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.966+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68002a30 msgr2=0x7eff68004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:33.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.966+0000 7eff8aa00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68002a30 0x7eff68004ef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff800097a0 tx=0x7eff80004730 comp rx=0 tx=0).stop 2024-03-23T06:19:33.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.966+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68002a30 msgr2=0x7eff68004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:33.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.966+0000 7eff8aa00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68002a30 0x7eff68004ef0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7eff800097a0 tx=0x7eff80004730 comp rx=0 tx=0).stop 2024-03-23T06:19:33.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.967+0000 7eff92a00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff7406ac50 0x7eff7406d110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0024d0 tx=0x7eff8c00a220 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.996+0000 7eff7fe00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68006f60 0x7eff680073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.996+0000 7eff7fe00640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff68007940 con 0x7eff68006f60 2024-03-23T06:19:33.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:33.998+0000 7eff92000640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68006f60 0x7eff680073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:34.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.001+0000 7eff92000640 1 -- 172.21.15.73:0/2757943638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7eff68007b00 con 0x7eff68006f60 2024-03-23T06:19:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.002+0000 7eff92000640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68006f60 0x7eff680073d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7eff68008010 tx=0x7eff800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:34.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.002+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8004ea90 con 0x7eff68006f60 2024-03-23T06:19:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.003+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4465 (secure 0 0 0) 0x7eff80061430 con 0x7eff68006f60 2024-03-23T06:19:34.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.003+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68006f60 msgr2=0x7eff680073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:34.003 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 92, 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 5, 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:34.004 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:34.005 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:19:34.006 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:34.007 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:34.008 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:34.009 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:34.010 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:34.011 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:34.013 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:19:34.014 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:19:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.003+0000 7eff8aa00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68006f60 0x7eff680073d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7eff68008010 tx=0x7eff800046c0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.004+0000 7eff8aa00640 1 -- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68006f60 msgr2=0x7eff680073d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:34.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.004+0000 7eff8aa00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff68006f60 0x7eff680073d0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7eff68008010 tx=0x7eff800046c0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.006+0000 7eff7fe00640 1 -- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff7406ac50 msgr2=0x7eff7406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.006+0000 7eff7fe00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff7406ac50 0x7eff7406d110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0024d0 tx=0x7eff8c00a220 comp rx=0 tx=0).stop 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.008+0000 7eff92a00640 1 -- 172.21.15.73:0/2757943638 reap_dead start 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.008+0000 7eff7fe00640 1 -- 172.21.15.73:0/2757943638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff9406a3c0 msgr2=0x7eff940cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.008+0000 7eff7fe00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff9406a3c0 0x7eff940cabd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff8400da60 tx=0x7eff8400df20 comp rx=0 tx=0).stop 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.008+0000 7eff7fe00640 1 -- 172.21.15.73:0/2757943638 shutdown_connections 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.008+0000 7eff7fe00640 1 --2- 172.21.15.73:0/2757943638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff9406a3c0 0x7eff940cabd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.008+0000 7eff7fe00640 1 -- 172.21.15.73:0/2757943638 >> 172.21.15.73:0/2757943638 conn(0x7eff9406bfc0 msgr2=0x7eff940c1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.009+0000 7eff7fe00640 1 -- 172.21.15.73:0/2757943638 shutdown_connections 2024-03-23T06:19:34.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.009+0000 7eff7fe00640 1 -- 172.21.15.73:0/2757943638 wait complete. 2024-03-23T06:19:34.037 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:19:34.037 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:19:34.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:19:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.414+0000 7eff44800640 1 Processor -- start 2024-03-23T06:19:34.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.414+0000 7eff44800640 1 -- start start 2024-03-23T06:19:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.416+0000 7eff44800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff380dac50 0x7eff3804b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.416+0000 7eff44800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff38034a30 0x7eff38034ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:34.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.416+0000 7eff41e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7eff3804b4f0 0x7eff38005e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:46490/0 (socket says 172.21.15.73:46490) 2024-03-23T06:19:34.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.422+0000 7eff42800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff38034a30 0x7eff38034ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:34.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.422+0000 7eff42800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff38034a30 0x7eff38034ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:48526/0 (socket says 172.21.15.73:48526) 2024-03-23T06:19:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.422+0000 7eff42800640 1 -- 172.21.15.73:0/3111931930 learned_addr learned my addr 172.21.15.73:0/3111931930 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.422+0000 7eff44800640 1 -- 172.21.15.73:0/3111931930 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff380353e0 con 0x7eff3804b4f0 2024-03-23T06:19:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.422+0000 7eff44800640 1 -- 172.21.15.73:0/3111931930 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3804be10 con 0x7eff380dac50 2024-03-23T06:19:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.422+0000 7eff44800640 1 -- 172.21.15.73:0/3111931930 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff38007700 con 0x7eff38034a30 2024-03-23T06:19:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.423+0000 7eff41400640 1 --2- 172.21.15.73:0/3111931930 >> v2:172.21.15.110:3300/0 conn(0x7eff380dac50 0x7eff3804b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.424+0000 7eff42800640 1 -- 172.21.15.73:0/3111931930 >> v2:172.21.15.110:3300/0 conn(0x7eff380dac50 msgr2=0x7eff3804b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.424+0000 7eff42800640 1 --2- 172.21.15.73:0/3111931930 >> v2:172.21.15.110:3300/0 conn(0x7eff380dac50 0x7eff3804b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.424+0000 7eff42800640 1 -- 172.21.15.73:0/3111931930 >> v1:172.21.15.110:6789/0 conn(0x7eff3804b4f0 legacy=0x7eff38005e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:34.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.424+0000 7eff42800640 1 -- 172.21.15.73:0/3111931930 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff380068a0 con 0x7eff38034a30 2024-03-23T06:19:34.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.426+0000 7eff42800640 1 --2- 172.21.15.73:0/3111931930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff38034a30 0x7eff38034ea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7eff30009870 tx=0x7eff3002cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f4f07a97defed8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.426+0000 7eff40a00640 1 -- 172.21.15.73:0/3111931930 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3002e870 con 0x7eff38034a30 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.427+0000 7eff40a00640 1 -- 172.21.15.73:0/3111931930 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3002e9d0 con 0x7eff38034a30 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.427+0000 7eff40a00640 1 -- 172.21.15.73:0/3111931930 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3002eda0 con 0x7eff38034a30 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.428+0000 7eff44800640 1 -- 172.21.15.73:0/3111931930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff38034a30 msgr2=0x7eff38034ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.428+0000 7eff44800640 1 --2- 172.21.15.73:0/3111931930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff38034a30 0x7eff38034ea0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7eff30009870 tx=0x7eff3002cab0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.430+0000 7eff44800640 1 -- 172.21.15.73:0/3111931930 shutdown_connections 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.430+0000 7eff44800640 1 --2- 172.21.15.73:0/3111931930 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff38034a30 0x7eff38034ea0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.430+0000 7eff44800640 1 --2- 172.21.15.73:0/3111931930 >> v2:172.21.15.110:3300/0 conn(0x7eff380dac50 0x7eff3804b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.430+0000 7eff44800640 1 -- 172.21.15.73:0/3111931930 >> 172.21.15.73:0/3111931930 conn(0x7eff38050170 msgr2=0x7eff38050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.434+0000 7eff44800640 1 -- 172.21.15.73:0/3111931930 shutdown_connections 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.435+0000 7eff44800640 1 -- 172.21.15.73:0/3111931930 wait complete. 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.438+0000 7eff44800640 1 Processor -- start 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.439+0000 7eff44800640 1 -- start start 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.440+0000 7eff44800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff38034a30 0x7eff3819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.440+0000 7eff44800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff3804b4f0 0x7eff380c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.441+0000 7eff44800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff380dac50 0x7eff380cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.441+0000 7eff41400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff3804b4f0 0x7eff380c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.441+0000 7eff41400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff3804b4f0 0x7eff380c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:52084/0 (socket says 172.21.15.73:52084) 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.441+0000 7eff41400640 1 -- 172.21.15.73:0/178304833 learned_addr learned my addr 172.21.15.73:0/178304833 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.442+0000 7eff42800640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff380dac50 0x7eff380cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.442+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3804ff60 con 0x7eff38034a30 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.442+0000 7eff41e00640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff38034a30 0x7eff3819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.442+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3804f6c0 con 0x7eff3804b4f0 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.442+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3804f9a0 con 0x7eff380dac50 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.443+0000 7eff41400640 1 -- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff380dac50 msgr2=0x7eff380cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.443+0000 7eff41400640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff380dac50 0x7eff380cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.443+0000 7eff41400640 1 -- 172.21.15.73:0/178304833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff38034a30 msgr2=0x7eff3819b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.444+0000 7eff41400640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff38034a30 0x7eff3819b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.444+0000 7eff41400640 1 -- 172.21.15.73:0/178304833 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300094d0 con 0x7eff3804b4f0 2024-03-23T06:19:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.445+0000 7eff41400640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff3804b4f0 0x7eff380c79f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00d5f0 tx=0x7eff2c00dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.445+0000 7eff36000640 1 -- 172.21.15.73:0/178304833 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0125f0 con 0x7eff3804b4f0 2024-03-23T06:19:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.445+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3804fc80 con 0x7eff3804b4f0 2024-03-23T06:19:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.445+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3819b150 con 0x7eff3804b4f0 2024-03-23T06:19:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.446+0000 7eff36000640 1 -- 172.21.15.73:0/178304833 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2c012750 con 0x7eff3804b4f0 2024-03-23T06:19:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.446+0000 7eff36000640 1 -- 172.21.15.73:0/178304833 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0125f0 con 0x7eff3804b4f0 2024-03-23T06:19:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.451+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff18005250 con 0x7eff3804b4f0 2024-03-23T06:19:34.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.452+0000 7eff36000640 1 -- 172.21.15.73:0/178304833 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7eff2c0128c0 con 0x7eff3804b4f0 2024-03-23T06:19:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.452+0000 7eff36000640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff2006ac60 0x7eff2006d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.456+0000 7eff41e00640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff2006ac60 0x7eff2006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.457+0000 7eff36000640 1 -- 172.21.15.73:0/178304833 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7eff2c05bfd0 con 0x7eff3804b4f0 2024-03-23T06:19:34.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.457+0000 7eff41e00640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff2006ac60 0x7eff2006d120 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0639b0 tx=0x7eff3c06c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:34.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:34.466+0000 7eff36000640 1 -- 172.21.15.73:0/178304833 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7eff2c058020 con 0x7eff3804b4f0 2024-03-23T06:19:35.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.110+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7eff180057d0 con 0x7eff3804b4f0 2024-03-23T06:19:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.114+0000 7eff36000640 1 -- 172.21.15.73:0/178304833 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7eff2c0591b0 con 0x7eff3804b4f0 2024-03-23T06:19:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff2006ac60 msgr2=0x7eff2006d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff2006ac60 0x7eff2006d120 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0639b0 tx=0x7eff3c06c040 comp rx=0 tx=0).stop 2024-03-23T06:19:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff3804b4f0 msgr2=0x7eff380c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff3804b4f0 0x7eff380c79f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00d5f0 tx=0x7eff2c00dab0 comp rx=0 tx=0).stop 2024-03-23T06:19:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 shutdown_connections 2024-03-23T06:19:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff2006ac60 0x7eff2006d120 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:35.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff380dac50 0x7eff380cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff3804b4f0 0x7eff380c79f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 --2- 172.21.15.73:0/178304833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff38034a30 0x7eff3819b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 >> 172.21.15.73:0/178304833 conn(0x7eff38050170 msgr2=0x7eff380ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 shutdown_connections 2024-03-23T06:19:35.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:35.116+0000 7eff44800640 1 -- 172.21.15.73:0/178304833 wait complete. 2024-03-23T06:19:35.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:19:45.161 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:19:45.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:19:46.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.452+0000 7fa984400640 1 Processor -- start 2024-03-23T06:19:46.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.453+0000 7fa984400640 1 -- start start 2024-03-23T06:19:46.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.454+0000 7fa984400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa97c153800 0x7fa97c0c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:46.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.454+0000 7fa984400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c159470 0x7fa97c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:46.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.454+0000 7fa984400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97c153be0 con 0x7fa97c0c9d30 2024-03-23T06:19:46.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.454+0000 7fa984400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97c15d400 con 0x7fa97c153800 2024-03-23T06:19:46.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.454+0000 7fa984400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c15a000 con 0x7fa97c159470 2024-03-23T06:19:46.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.454+0000 7fa981000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa97c0c9d30 0x7fa97c06bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:43714/0 (socket says 172.21.15.73:43714) 2024-03-23T06:19:46.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.454+0000 7fa981000640 1 -- 172.21.15.73:0/2115741937 learned_addr learned my addr 172.21.15.73:0/2115741937 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:19:46.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.454+0000 7fa982400640 1 --2- 172.21.15.73:0/2115741937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c159470 0x7fa97c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:46.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.455+0000 7fa982400640 1 -- 172.21.15.73:0/2115741937 >> v2:172.21.15.73:3300/0 conn(0x7fa97c153800 msgr2=0x7fa97c0c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:46.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.455+0000 7fa97be00640 1 -- 172.21.15.73:0/2115741937 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980338106 0 0) 0x7fa97c153be0 con 0x7fa97c0c9d30 2024-03-23T06:19:46.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.455+0000 7fa982400640 1 --2- 172.21.15.73:0/2115741937 >> v2:172.21.15.73:3300/0 conn(0x7fa97c153800 0x7fa97c0c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:46.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.455+0000 7fa982400640 1 -- 172.21.15.73:0/2115741937 >> v1:172.21.15.110:6789/0 conn(0x7fa97c0c9d30 legacy=0x7fa97c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:46.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.455+0000 7fa982400640 1 -- 172.21.15.73:0/2115741937 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c15a2e0 con 0x7fa97c159470 2024-03-23T06:19:46.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.456+0000 7fa982400640 1 --2- 172.21.15.73:0/2115741937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c159470 0x7fa97c159900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa974009d90 tx=0x7fa97402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10300ecb45a0c9f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:46.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.457+0000 7fa97be00640 1 -- 172.21.15.73:0/2115741937 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97402cc50 con 0x7fa97c159470 2024-03-23T06:19:46.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.457+0000 7fa97be00640 1 -- 172.21.15.73:0/2115741937 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97402cdb0 con 0x7fa97c159470 2024-03-23T06:19:46.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.457+0000 7fa97be00640 1 -- 172.21.15.73:0/2115741937 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974034660 con 0x7fa97c159470 2024-03-23T06:19:46.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.458+0000 7fa984400640 1 -- 172.21.15.73:0/2115741937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c159470 msgr2=0x7fa97c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:46.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.458+0000 7fa984400640 1 --2- 172.21.15.73:0/2115741937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c159470 0x7fa97c159900 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa974009d90 tx=0x7fa97402bea0 comp rx=0 tx=0).stop 2024-03-23T06:19:46.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.458+0000 7fa984400640 1 -- 172.21.15.73:0/2115741937 shutdown_connections 2024-03-23T06:19:46.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.458+0000 7fa984400640 1 --2- 172.21.15.73:0/2115741937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c159470 0x7fa97c159900 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:46.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.458+0000 7fa984400640 1 --2- 172.21.15.73:0/2115741937 >> v2:172.21.15.73:3300/0 conn(0x7fa97c153800 0x7fa97c0c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:46.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.458+0000 7fa984400640 1 -- 172.21.15.73:0/2115741937 >> 172.21.15.73:0/2115741937 conn(0x7fa97c06a9f0 msgr2=0x7fa97c0ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.458+0000 7fa984400640 1 -- 172.21.15.73:0/2115741937 shutdown_connections 2024-03-23T06:19:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.458+0000 7fa984400640 1 -- 172.21.15.73:0/2115741937 wait complete. 2024-03-23T06:19:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.460+0000 7fa984400640 1 Processor -- start 2024-03-23T06:19:46.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.461+0000 7fa984400640 1 -- start start 2024-03-23T06:19:46.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.462+0000 7fa984400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c0c9d30 0x7fa97c1424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:46.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.462+0000 7fa984400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97c153800 0x7fa97c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:46.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.462+0000 7fa984400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c159470 0x7fa97c158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:46.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.463+0000 7fa982400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c159470 0x7fa97c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:46.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.463+0000 7fa982400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c159470 0x7fa97c158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:43494/0 (socket says 172.21.15.73:43494) 2024-03-23T06:19:46.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.463+0000 7fa982400640 1 -- 172.21.15.73:0/3172301616 learned_addr learned my addr 172.21.15.73:0/3172301616 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:46.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.463+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c141b20 con 0x7fa97c159470 2024-03-23T06:19:46.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.463+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c152f50 con 0x7fa97c153800 2024-03-23T06:19:46.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.463+0000 7fa981000640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97c153800 0x7fa97c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:46.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.463+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c151dc0 con 0x7fa97c0c9d30 2024-03-23T06:19:46.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.464+0000 7fa982400640 1 -- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c0c9d30 msgr2=0x7fa97c1424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:46.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.463+0000 7fa981a00640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c0c9d30 0x7fa97c1424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:46.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.464+0000 7fa982400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c0c9d30 0x7fa97c1424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:46.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.464+0000 7fa982400640 1 -- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97c153800 msgr2=0x7fa97c157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:46.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.464+0000 7fa982400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97c153800 0x7fa97c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:46.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.464+0000 7fa982400640 1 -- 172.21.15.73:0/3172301616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa974009a70 con 0x7fa97c159470 2024-03-23T06:19:46.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.464+0000 7fa981a00640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c0c9d30 0x7fa97c1424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:19:46.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.465+0000 7fa982400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c159470 0x7fa97c158510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa974009eb0 tx=0x7fa974004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:46.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.465+0000 7fa979600640 1 -- 172.21.15.73:0/3172301616 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974034e80 con 0x7fa97c159470 2024-03-23T06:19:46.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.465+0000 7fa979600640 1 -- 172.21.15.73:0/3172301616 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97403f420 con 0x7fa97c159470 2024-03-23T06:19:46.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.465+0000 7fa979600640 1 -- 172.21.15.73:0/3172301616 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97403f790 con 0x7fa97c159470 2024-03-23T06:19:46.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.465+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97c141d50 con 0x7fa97c159470 2024-03-23T06:19:46.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.466+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97c152340 con 0x7fa97c159470 2024-03-23T06:19:46.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.469+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97c04e110 con 0x7fa97c159470 2024-03-23T06:19:46.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.473+0000 7fa979600640 1 -- 172.21.15.73:0/3172301616 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa97403f8f0 con 0x7fa97c159470 2024-03-23T06:19:46.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.475+0000 7fa979600640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa95c06ad00 0x7fa95c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:46.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.475+0000 7fa979600640 1 -- 172.21.15.73:0/3172301616 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fa9740ac220 con 0x7fa97c159470 2024-03-23T06:19:46.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.479+0000 7fa981a00640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa95c06ad00 0x7fa95c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:46.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.482+0000 7fa981a00640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa95c06ad00 0x7fa95c06d1c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa970006fd0 tx=0x7fa970008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:46.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:46.482+0000 7fa979600640 1 -- 172.21.15.73:0/3172301616 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa974077100 con 0x7fa97c159470 2024-03-23T06:19:47.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.050+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa97c15d800 con 0x7fa97c159470 2024-03-23T06:19:47.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.053+0000 7fa979600640 1 -- 172.21.15.73:0/3172301616 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fa974043620 con 0x7fa97c159470 2024-03-23T06:19:47.056 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":92,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:19:47.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.057+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa95c06ad00 msgr2=0x7fa95c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:47.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.057+0000 7fa984400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa95c06ad00 0x7fa95c06d1c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa970006fd0 tx=0x7fa970008040 comp rx=0 tx=0).stop 2024-03-23T06:19:47.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.058+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c159470 msgr2=0x7fa97c158510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:47.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.058+0000 7fa984400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c159470 0x7fa97c158510 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa974009eb0 tx=0x7fa974004a40 comp rx=0 tx=0).stop 2024-03-23T06:19:47.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.058+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 shutdown_connections 2024-03-23T06:19:47.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.058+0000 7fa984400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa97c159470 0x7fa97c158510 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.058+0000 7fa984400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97c153800 0x7fa97c157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.058+0000 7fa984400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa95c06ad00 0x7fa95c06d1c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.058+0000 7fa984400640 1 --2- 172.21.15.73:0/3172301616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97c0c9d30 0x7fa97c1424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.058+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 >> 172.21.15.73:0/3172301616 conn(0x7fa97c06a9f0 msgr2=0x7fa97c0caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:47.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.059+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 shutdown_connections 2024-03-23T06:19:47.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.059+0000 7fa984400640 1 -- 172.21.15.73:0/3172301616 wait complete. 2024-03-23T06:19:47.112 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:19:47.112 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:19:47.112 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:19:47.112 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:19:47.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.488+0000 7f1c6c800640 1 Processor -- start 2024-03-23T06:19:47.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.489+0000 7f1c6c800640 1 -- start start 2024-03-23T06:19:47.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.491+0000 7f1c6c800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1c64150500 0x7f1c64071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:47.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.491+0000 7f1c6c800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c640c57f0 0x7f1c640c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:47.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.491+0000 7f1c6c800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c640728d0 con 0x7f1c640c7c00 2024-03-23T06:19:47.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.491+0000 7f1c6c800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6415a640 con 0x7f1c640c57f0 2024-03-23T06:19:47.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.491+0000 7f1c6c800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c641598c0 con 0x7f1c64150500 2024-03-23T06:19:47.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.492+0000 7f1c69e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1c64150500 0x7f1c64071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:47.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.492+0000 7f1c69400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1c640c7c00 0x7f1c6406f940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:41948/0 (socket says 172.21.15.73:41948) 2024-03-23T06:19:47.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.492+0000 7f1c69400640 1 -- 172.21.15.73:0/1808339708 learned_addr learned my addr 172.21.15.73:0/1808339708 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:19:47.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.492+0000 7f1c69e00640 1 --2- 172.21.15.73:0/1808339708 >> v2:172.21.15.110:3300/0 conn(0x7f1c64150500 0x7f1c64071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33808/0 (socket says 172.21.15.73:33808) 2024-03-23T06:19:47.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.493+0000 7f1c69e00640 1 -- 172.21.15.73:0/1808339708 >> v2:172.21.15.73:3300/0 conn(0x7f1c640c57f0 msgr2=0x7f1c640c5c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:19:47.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.493+0000 7f1c69e00640 1 --2- 172.21.15.73:0/1808339708 >> v2:172.21.15.73:3300/0 conn(0x7f1c640c57f0 0x7f1c640c5c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.493+0000 7f1c69e00640 1 -- 172.21.15.73:0/1808339708 >> v1:172.21.15.73:6789/0 conn(0x7f1c640c7c00 legacy=0x7f1c6406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:47.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.493+0000 7f1c69e00640 1 -- 172.21.15.73:0/1808339708 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c640725f0 con 0x7f1c64150500 2024-03-23T06:19:47.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.497+0000 7f1c69e00640 1 --2- 172.21.15.73:0/1808339708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c64150500 0x7f1c64071dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1c640c7920 tx=0x7f1c6002e110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=807e67f553bebb2a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:47.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.497+0000 7f1c68a00640 1 -- 172.21.15.73:0/1808339708 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6002ea90 con 0x7f1c64150500 2024-03-23T06:19:47.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.498+0000 7f1c68a00640 1 -- 172.21.15.73:0/1808339708 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6002ebf0 con 0x7f1c64150500 2024-03-23T06:19:47.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.498+0000 7f1c68a00640 1 -- 172.21.15.73:0/1808339708 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60009540 con 0x7f1c64150500 2024-03-23T06:19:47.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.499+0000 7f1c6c800640 1 -- 172.21.15.73:0/1808339708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c64150500 msgr2=0x7f1c64071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:47.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.499+0000 7f1c6c800640 1 --2- 172.21.15.73:0/1808339708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c64150500 0x7f1c64071dd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1c640c7920 tx=0x7f1c6002e110 comp rx=0 tx=0).stop 2024-03-23T06:19:47.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.500+0000 7f1c6c800640 1 -- 172.21.15.73:0/1808339708 shutdown_connections 2024-03-23T06:19:47.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.500+0000 7f1c6c800640 1 --2- 172.21.15.73:0/1808339708 >> v2:172.21.15.73:3300/0 conn(0x7f1c640c57f0 0x7f1c640c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.500+0000 7f1c6c800640 1 --2- 172.21.15.73:0/1808339708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c64150500 0x7f1c64071dd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.500+0000 7f1c6c800640 1 -- 172.21.15.73:0/1808339708 >> 172.21.15.73:0/1808339708 conn(0x7f1c64069cb0 msgr2=0x7f1c6406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.501+0000 7f1c6c800640 1 -- 172.21.15.73:0/1808339708 shutdown_connections 2024-03-23T06:19:47.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.501+0000 7f1c6c800640 1 -- 172.21.15.73:0/1808339708 wait complete. 2024-03-23T06:19:47.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.507+0000 7f1c6c800640 1 Processor -- start 2024-03-23T06:19:47.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.508+0000 7f1c6c800640 1 -- start start 2024-03-23T06:19:47.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.511+0000 7f1c6c800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c57f0 0x7f1c640c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:47.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.512+0000 7f1c6c800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c640c7c00 0x7f1c64158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:47.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.512+0000 7f1c6c800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c64150500 0x7f1c640c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:47.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.512+0000 7f1c6c800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641512f0 con 0x7f1c640c57f0 2024-03-23T06:19:47.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.512+0000 7f1c6c800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64152570 con 0x7f1c640c7c00 2024-03-23T06:19:47.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.512+0000 7f1c6c800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640c1e90 con 0x7f1c64150500 2024-03-23T06:19:47.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.513+0000 7f1c69400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c640c7c00 0x7f1c64158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:47.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.513+0000 7f1c69400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c640c7c00 0x7f1c64158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33812/0 (socket says 172.21.15.73:33812) 2024-03-23T06:19:47.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.513+0000 7f1c69400640 1 -- 172.21.15.73:0/3593704693 learned_addr learned my addr 172.21.15.73:0/3593704693 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.514+0000 7f1c69400640 1 -- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c64150500 msgr2=0x7f1c640c25c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:19:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.514+0000 7f1c69400640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c64150500 0x7f1c640c25c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.514+0000 7f1c69400640 1 -- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c57f0 msgr2=0x7f1c640c4a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:19:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.520+0000 7f1c69e00640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c57f0 0x7f1c640c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.520+0000 7f1c69400640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c57f0 0x7f1c640c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:47.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.520+0000 7f1c69400640 1 -- 172.21.15.73:0/3593704693 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6000bc80 con 0x7f1c640c7c00 2024-03-23T06:19:47.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.521+0000 7f1c69400640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c640c7c00 0x7f1c64158770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800c4a0 tx=0x7f1c5800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.522+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58005ce0 con 0x7f1c640c7c00 2024-03-23T06:19:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.523+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c58005e40 con 0x7f1c640c7c00 2024-03-23T06:19:47.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.523+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58007270 con 0x7f1c640c7c00 2024-03-23T06:19:47.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.524+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c640c2130 con 0x7f1c640c7c00 2024-03-23T06:19:47.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.525+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c640c3490 con 0x7f1c640c7c00 2024-03-23T06:19:47.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.527+0000 7f1c6c800640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c641539c0 0x7f1c640c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.527+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64073bf0 con 0x7f1c641539c0 2024-03-23T06:19:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.529+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1c580073d0 con 0x7f1c640c7c00 2024-03-23T06:19:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.531+0000 7f1c5e000640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c4806ad00 0x7f1c4806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:47.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.531+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1c580891d0 con 0x7f1c640c7c00 2024-03-23T06:19:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.534+0000 7f1c69e00640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c641539c0 0x7f1c640c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:47.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.535+0000 7f1c69e00640 1 -- 172.21.15.73:0/3593704693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c6415a120 con 0x7f1c641539c0 2024-03-23T06:19:47.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.539+0000 7f1c6a800640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c4806ad00 0x7f1c4806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:47.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.539+0000 7f1c69e00640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c641539c0 0x7f1c640c37d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c640c7680 tx=0x7f1c60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:47.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.540+0000 7f1c6a800640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c4806ad00 0x7f1c4806d1c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c54006fd0 tx=0x7f1c54006b40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:47.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.542+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6003f440 con 0x7f1c641539c0 2024-03-23T06:19:47.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.542+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f1c6003f5a0 con 0x7f1c641539c0 2024-03-23T06:19:47.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.542+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c641539c0 msgr2=0x7f1c640c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:47.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.542+0000 7f1c5e000640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c641539c0 0x7f1c640c37d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c640c7680 tx=0x7f1c60004a40 comp rx=0 tx=0).stop 2024-03-23T06:19:47.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.542+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c641539c0 msgr2=0x7f1c640c37d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:47.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.542+0000 7f1c5e000640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c641539c0 0x7f1c640c37d0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1c640c7680 tx=0x7f1c60004a40 comp rx=0 tx=0).stop 2024-03-23T06:19:47.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.587+0000 7f1c6c800640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c2b00 0x7f1c641ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:47.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.587+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64159e40 con 0x7f1c640c2b00 2024-03-23T06:19:47.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.588+0000 7f1c69e00640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c2b00 0x7f1c641ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:47.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.589+0000 7f1c69e00640 1 -- 172.21.15.73:0/3593704693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1c64072310 con 0x7f1c640c2b00 2024-03-23T06:19:47.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.592+0000 7f1c69e00640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c2b00 0x7f1c641ee200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000f80 tx=0x7f1c6000b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.594+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60049740 con 0x7f1c640c2b00 2024-03-23T06:19:47.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.594+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7f1c600363f0 con 0x7f1c640c2b00 2024-03-23T06:19:47.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.594+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c2b00 msgr2=0x7f1c641ee200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:47.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.594+0000 7f1c5e000640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c2b00 0x7f1c641ee200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000f80 tx=0x7f1c6000b000 comp rx=0 tx=0).stop 2024-03-23T06:19:47.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.594+0000 7f1c5e000640 1 -- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c2b00 msgr2=0x7f1c641ee200 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:47.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.594+0000 7f1c5e000640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c640c2b00 0x7f1c641ee200 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000f80 tx=0x7f1c6000b000 comp rx=0 tx=0).stop 2024-03-23T06:19:47.597 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 92, 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 19, 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:19:47.598 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:47.599 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:19:47.600 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:47.601 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:19:47.602 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:19:47.603 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.604 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:19:47.605 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.606 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:47.607 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:19:47.608 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.598+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c4806ad00 msgr2=0x7f1c4806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.598+0000 7f1c6c800640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1c4806ad00 0x7f1c4806d1c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c54006fd0 tx=0x7f1c54006b40 comp rx=0 tx=0).stop 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.598+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c640c7c00 msgr2=0x7f1c64158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.598+0000 7f1c6c800640 1 --2- 172.21.15.73:0/3593704693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c640c7c00 0x7f1c64158770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800c4a0 tx=0x7f1c5800c960 comp rx=0 tx=0).stop 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.598+0000 7f1c6a800640 1 -- 172.21.15.73:0/3593704693 reap_dead start 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.598+0000 7f1c6a800640 1 -- 172.21.15.73:0/3593704693 reap_dead start 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.598+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 shutdown_connections 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.598+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 >> 172.21.15.73:0/3593704693 conn(0x7f1c64069cb0 msgr2=0x7f1c640bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.600+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 shutdown_connections 2024-03-23T06:19:47.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:47.601+0000 7f1c6c800640 1 -- 172.21.15.73:0/3593704693 wait complete. 2024-03-23T06:19:47.636 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:19:47.636 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:19:47.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:19:48.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.404+0000 7f53d9600640 1 Processor -- start 2024-03-23T06:19:48.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.404+0000 7f53d9600640 1 -- start start 2024-03-23T06:19:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.406+0000 7f53d9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d4159420 0x7f53d40c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.406+0000 7f53d9600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53d40ca940 0x7f53d40cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.406+0000 7f53d9600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d40c9c80 con 0x7f53d4153760 2024-03-23T06:19:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.406+0000 7f53d9600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d4159860 con 0x7f53d40ca940 2024-03-23T06:19:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.406+0000 7f53d9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40cb310 con 0x7f53d4159420 2024-03-23T06:19:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.407+0000 7f53d3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53d40ca940 0x7f53d40cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.407+0000 7f53d2a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f53d4153760 0x7f53d40cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:43722/0 (socket says 172.21.15.73:43722) 2024-03-23T06:19:48.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.407+0000 7f53d3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53d40ca940 0x7f53d40cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33820/0 (socket says 172.21.15.73:33820) 2024-03-23T06:19:48.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.407+0000 7f53d2a00640 1 -- 172.21.15.73:0/2694518164 learned_addr learned my addr 172.21.15.73:0/2694518164 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:19:48.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.407+0000 7f53d2000640 1 --2- 172.21.15.73:0/2694518164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d4159420 0x7f53d40c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.408+0000 7f53d3400640 1 -- 172.21.15.73:0/2694518164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d4159420 msgr2=0x7f53d40c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.408+0000 7f53d3400640 1 --2- 172.21.15.73:0/2694518164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d4159420 0x7f53d40c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.408+0000 7f53d3400640 1 -- 172.21.15.73:0/2694518164 >> v1:172.21.15.110:6789/0 conn(0x7f53d4153760 legacy=0x7f53d40cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.408+0000 7f53d3400640 1 -- 172.21.15.73:0/2694518164 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d406a2d0 con 0x7f53d40ca940 2024-03-23T06:19:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.409+0000 7f53d3400640 1 --2- 172.21.15.73:0/2694518164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d40ca940 0x7f53d40cadd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009d90 tx=0x7f53cc02bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ec18e646fd1fe58 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.410+0000 7f53d1600640 1 -- 172.21.15.73:0/2694518164 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc02cc70 con 0x7f53d40ca940 2024-03-23T06:19:48.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.410+0000 7f53d1600640 1 -- 172.21.15.73:0/2694518164 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc02cdd0 con 0x7f53d40ca940 2024-03-23T06:19:48.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.410+0000 7f53d1600640 1 -- 172.21.15.73:0/2694518164 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc034660 con 0x7f53d40ca940 2024-03-23T06:19:48.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.411+0000 7f53d9600640 1 -- 172.21.15.73:0/2694518164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d40ca940 msgr2=0x7f53d40cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.411+0000 7f53d9600640 1 --2- 172.21.15.73:0/2694518164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d40ca940 0x7f53d40cadd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009d90 tx=0x7f53cc02bec0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.412+0000 7f53d9600640 1 -- 172.21.15.73:0/2694518164 shutdown_connections 2024-03-23T06:19:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.412+0000 7f53d9600640 1 --2- 172.21.15.73:0/2694518164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d40ca940 0x7f53d40cadd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.412+0000 7f53d9600640 1 --2- 172.21.15.73:0/2694518164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d4159420 0x7f53d40c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.412+0000 7f53d9600640 1 -- 172.21.15.73:0/2694518164 >> 172.21.15.73:0/2694518164 conn(0x7f53d406c310 msgr2=0x7f53d40713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:48.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.413+0000 7f53d9600640 1 -- 172.21.15.73:0/2694518164 shutdown_connections 2024-03-23T06:19:48.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.414+0000 7f53d9600640 1 -- 172.21.15.73:0/2694518164 wait complete. 2024-03-23T06:19:48.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.416+0000 7f53d9600640 1 Processor -- start 2024-03-23T06:19:48.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.417+0000 7f53d9600640 1 -- start start 2024-03-23T06:19:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.418+0000 7f53d9600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53d40ca940 0x7f53d40ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.418+0000 7f53d9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d4153760 0x7f53d40c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.418+0000 7f53d9600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4159420 0x7f53d40c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.418+0000 7f53d9600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4156c50 con 0x7f53d40ca940 2024-03-23T06:19:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.418+0000 7f53d9600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d414e890 con 0x7f53d4159420 2024-03-23T06:19:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.418+0000 7f53d9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d414d9a0 con 0x7f53d4153760 2024-03-23T06:19:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.419+0000 7f53d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4159420 0x7f53d40c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.419+0000 7f53d3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4159420 0x7f53d40c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33832/0 (socket says 172.21.15.73:33832) 2024-03-23T06:19:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.419+0000 7f53d3400640 1 -- 172.21.15.73:0/2683747169 learned_addr learned my addr 172.21.15.73:0/2683747169 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.419+0000 7f53d2a00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53d40ca940 0x7f53d40ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.420+0000 7f53d3400640 1 -- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d4153760 msgr2=0x7f53d40c8710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-23T06:19:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.420+0000 7f53d3400640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d4153760 0x7f53d40c8710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.420+0000 7f53d3400640 1 -- 172.21.15.73:0/2683747169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53d40ca940 msgr2=0x7f53d40ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.420+0000 7f53d3400640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53d40ca940 0x7f53d40ce400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.420+0000 7f53d3400640 1 -- 172.21.15.73:0/2683747169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc009a70 con 0x7f53d4159420 2024-03-23T06:19:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.420+0000 7f53d2a00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53d40ca940 0x7f53d40ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:19:48.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.420+0000 7f53d3400640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4159420 0x7f53d40c8c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009eb0 tx=0x7f53cc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.422+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc03e610 con 0x7f53d4159420 2024-03-23T06:19:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.422+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc03e770 con 0x7f53d4159420 2024-03-23T06:19:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.422+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc03eb00 con 0x7f53d4159420 2024-03-23T06:19:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.423+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d414dc80 con 0x7f53d4159420 2024-03-23T06:19:48.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.423+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d414e240 con 0x7f53d4159420 2024-03-23T06:19:48.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.425+0000 7f53d9600640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4070ff0 0x7f53d40c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.425+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d4072510 con 0x7f53d4070ff0 2024-03-23T06:19:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.426+0000 7f53d2a00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4070ff0 0x7f53d40c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.426+0000 7f53d2a00640 1 -- 172.21.15.73:0/2683747169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53d406ab70 con 0x7f53d4070ff0 2024-03-23T06:19:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.427+0000 7f53d2a00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4070ff0 0x7f53d40c7670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53c400d450 tx=0x7f53c400d910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.427+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c4016070 con 0x7f53d4070ff0 2024-03-23T06:19:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.427+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f53c4005ae0 con 0x7f53d4070ff0 2024-03-23T06:19:48.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.427+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4070ff0 msgr2=0x7f53d40c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.428+0000 7f53caa00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4070ff0 0x7f53d40c7670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53c400d450 tx=0x7f53c400d910 comp rx=0 tx=0).stop 2024-03-23T06:19:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.428+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4070ff0 msgr2=0x7f53d40c7670 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.428+0000 7f53caa00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4070ff0 0x7f53d40c7670 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f53c400d450 tx=0x7f53c400d910 comp rx=0 tx=0).stop 2024-03-23T06:19:48.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.428+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f53cc03b050 con 0x7f53d4159420 2024-03-23T06:19:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.429+0000 7f53caa00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f53b406a9d0 0x7f53b406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.429+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f53cc0abd50 con 0x7f53d4159420 2024-03-23T06:19:48.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.430+0000 7f53d2a00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f53b406a9d0 0x7f53b406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.433+0000 7f53d2a00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f53b406a9d0 0x7f53b406ce90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009010 tx=0x7f53c4011000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.447+0000 7f53d9600640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d41f1eb0 0x7f53d40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.447+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d40c80f0 con 0x7f53d41f1eb0 2024-03-23T06:19:48.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.447+0000 7f53d2000640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d41f1eb0 0x7f53d40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.448+0000 7f53d2000640 1 -- 172.21.15.73:0/2683747169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f53d406a890 con 0x7f53d41f1eb0 2024-03-23T06:19:48.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.448+0000 7f53d2000640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d41f1eb0 0x7f53d40c7bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53d40cb2e0 tx=0x7f53c000ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.449+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c000ee50 con 0x7f53d41f1eb0 2024-03-23T06:19:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.450+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5119 (secure 0 0 0) 0x7f53c0004020 con 0x7f53d41f1eb0 2024-03-23T06:19:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.450+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d41f1eb0 msgr2=0x7f53d40c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.450+0000 7f53caa00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d41f1eb0 0x7f53d40c7bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53d40cb2e0 tx=0x7f53c000ec00 comp rx=0 tx=0).stop 2024-03-23T06:19:48.450 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 92, 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 20, 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:19:48.451 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:19:48.452 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:19:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:19:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:19:48.455 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:19:48.456 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:48.457 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:19:48.458 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.459 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:19:48.460 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:48.461 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:19:48.462 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:19:48.463 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.450+0000 7f53caa00640 1 -- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d41f1eb0 msgr2=0x7f53d40c7bb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.450+0000 7f53caa00640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d41f1eb0 0x7f53d40c7bb0 secure :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53d40cb2e0 tx=0x7f53c000ec00 comp rx=0 tx=0).stop 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.451+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f53b406a9d0 msgr2=0x7f53b406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.451+0000 7f53d9600640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f53b406a9d0 0x7f53b406ce90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f53c4009010 tx=0x7f53c4011000 comp rx=0 tx=0).stop 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.451+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4159420 msgr2=0x7f53d40c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.451+0000 7f53d9600640 1 --2- 172.21.15.73:0/2683747169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d4159420 0x7f53d40c8c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009eb0 tx=0x7f53cc004a40 comp rx=0 tx=0).stop 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.451+0000 7f53d3400640 1 -- 172.21.15.73:0/2683747169 reap_dead start 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.451+0000 7f53d3400640 1 -- 172.21.15.73:0/2683747169 reap_dead start 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.453+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 shutdown_connections 2024-03-23T06:19:48.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.453+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 >> 172.21.15.73:0/2683747169 conn(0x7f53d406c310 msgr2=0x7f53d41574e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.454+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 shutdown_connections 2024-03-23T06:19:48.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.454+0000 7f53d9600640 1 -- 172.21.15.73:0/2683747169 wait complete. 2024-03-23T06:19:48.481 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:19:48.481 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:19:48.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:19:48.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.781+0000 7fce89c00640 1 Processor -- start 2024-03-23T06:19:48.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.781+0000 7fce89c00640 1 -- start start 2024-03-23T06:19:48.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.783+0000 7fce89c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84159420 0x7fce840c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.783+0000 7fce89c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce840ca940 0x7fce840cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.783+0000 7fce89c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840c9c80 con 0x7fce84153760 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.783+0000 7fce89c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce84159860 con 0x7fce840ca940 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.783+0000 7fce89c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce840cb310 con 0x7fce84159420 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.783+0000 7fce82a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fce84153760 0x7fce840cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:43728/0 (socket says 172.21.15.73:43728) 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.783+0000 7fce82a00640 1 -- 172.21.15.73:0/854540304 learned_addr learned my addr 172.21.15.73:0/854540304 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.783+0000 7fce82000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84159420 0x7fce840c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.784+0000 7fce82000640 1 -- 172.21.15.73:0/854540304 >> v2:172.21.15.73:3300/0 conn(0x7fce840ca940 msgr2=0x7fce840cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.784+0000 7fce82000640 1 --2- 172.21.15.73:0/854540304 >> v2:172.21.15.73:3300/0 conn(0x7fce840ca940 0x7fce840cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.784+0000 7fce81600640 1 -- 172.21.15.73:0/854540304 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201642321 0 0) 0x7fce70001110 con 0x7fce84153760 2024-03-23T06:19:48.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.784+0000 7fce82000640 1 -- 172.21.15.73:0/854540304 >> v1:172.21.15.110:6789/0 conn(0x7fce84153760 legacy=0x7fce840cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.784+0000 7fce82000640 1 -- 172.21.15.73:0/854540304 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8406a2d0 con 0x7fce84159420 2024-03-23T06:19:48.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.786+0000 7fce82000640 1 --2- 172.21.15.73:0/854540304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84159420 0x7fce840c9740 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce740097a0 tx=0x7fce7402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f059fc8386dd93 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.787+0000 7fce81600640 1 -- 172.21.15.73:0/854540304 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7402d040 con 0x7fce84159420 2024-03-23T06:19:48.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.787+0000 7fce81600640 1 -- 172.21.15.73:0/854540304 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74031810 con 0x7fce84159420 2024-03-23T06:19:48.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.787+0000 7fce81600640 1 -- 172.21.15.73:0/854540304 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74031ba0 con 0x7fce84159420 2024-03-23T06:19:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.788+0000 7fce89c00640 1 -- 172.21.15.73:0/854540304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84159420 msgr2=0x7fce840c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.788+0000 7fce89c00640 1 --2- 172.21.15.73:0/854540304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84159420 0x7fce840c9740 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce740097a0 tx=0x7fce7402b8b0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.790+0000 7fce89c00640 1 -- 172.21.15.73:0/854540304 shutdown_connections 2024-03-23T06:19:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.790+0000 7fce89c00640 1 --2- 172.21.15.73:0/854540304 >> v2:172.21.15.73:3300/0 conn(0x7fce840ca940 0x7fce840cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.790+0000 7fce89c00640 1 --2- 172.21.15.73:0/854540304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84159420 0x7fce840c9740 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.790+0000 7fce89c00640 1 -- 172.21.15.73:0/854540304 >> 172.21.15.73:0/854540304 conn(0x7fce8406c310 msgr2=0x7fce840713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.791+0000 7fce89c00640 1 -- 172.21.15.73:0/854540304 shutdown_connections 2024-03-23T06:19:48.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.791+0000 7fce89c00640 1 -- 172.21.15.73:0/854540304 wait complete. 2024-03-23T06:19:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.793+0000 7fce89c00640 1 Processor -- start 2024-03-23T06:19:48.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.794+0000 7fce89c00640 1 -- start start 2024-03-23T06:19:48.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.795+0000 7fce89c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce840ca940 0x7fce84155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.795+0000 7fce89c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84153760 0x7fce841563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.795+0000 7fce89c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce84159420 0x7fce8414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.795+0000 7fce82a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce840ca940 0x7fce84155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.795+0000 7fce82a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce840ca940 0x7fce84155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:33850/0 (socket says 172.21.15.73:33850) 2024-03-23T06:19:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.795+0000 7fce82000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84153760 0x7fce841563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce82000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84153760 0x7fce841563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:54346/0 (socket says 172.21.15.73:54346) 2024-03-23T06:19:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce89c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8414dd70 con 0x7fce84159420 2024-03-23T06:19:48.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce89c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce84153f30 con 0x7fce840ca940 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce89c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce84154210 con 0x7fce84153760 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce82a00640 1 -- 172.21.15.73:0/379048957 learned_addr learned my addr 172.21.15.73:0/379048957 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce83400640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce84159420 0x7fce8414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce82000640 1 -- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce840ca940 msgr2=0x7fce84155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce82000640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce840ca940 0x7fce84155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce82000640 1 -- 172.21.15.73:0/379048957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce84159420 msgr2=0x7fce8414e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce82000640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce84159420 0x7fce8414e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce82000640 1 -- 172.21.15.73:0/379048957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce74009400 con 0x7fce84153760 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.796+0000 7fce83400640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce84159420 0x7fce8414e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.797+0000 7fce82000640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84153760 0x7fce841563d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fce74033000 tx=0x7fce740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.797+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740443f0 con 0x7fce84153760 2024-03-23T06:19:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.797+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74044550 con 0x7fce84153760 2024-03-23T06:19:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.797+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740443f0 con 0x7fce84153760 2024-03-23T06:19:48.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.798+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce841544f0 con 0x7fce84153760 2024-03-23T06:19:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.798+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8414f6e0 con 0x7fce84153760 2024-03-23T06:19:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.799+0000 7fce89c00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce840b1a60 0x7fce8414e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.799+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce84072510 con 0x7fce840b1a60 2024-03-23T06:19:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.800+0000 7fce82a00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce840b1a60 0x7fce8414e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.800+0000 7fce82a00640 1 -- 172.21.15.73:0/379048957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce8406ab70 con 0x7fce840b1a60 2024-03-23T06:19:48.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.801+0000 7fce82a00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce840b1a60 0x7fce8414e740 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce70001670 tx=0x7fce70001b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.802+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fce7404d450 con 0x7fce84153760 2024-03-23T06:19:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.804+0000 7fce7aa00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce6406ac60 0x7fce6406d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.804+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fce740ab780 con 0x7fce84153760 2024-03-23T06:19:48.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.805+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7000f820 con 0x7fce840b1a60 2024-03-23T06:19:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.805+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fce7000f980 con 0x7fce840b1a60 2024-03-23T06:19:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.805+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce840b1a60 msgr2=0x7fce8414e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.805+0000 7fce7aa00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce840b1a60 0x7fce8414e740 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fce70001670 tx=0x7fce70001b30 comp rx=0 tx=0).stop 2024-03-23T06:19:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.805+0000 7fce83400640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce6406ac60 0x7fce6406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.806+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce840b1a60 msgr2=0x7fce8414e740 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:48.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.806+0000 7fce7aa00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce840b1a60 0x7fce8414e740 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.808+0000 7fce83400640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce6406ac60 0x7fce6406d120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fce84157260 tx=0x7fce7c0094f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.821+0000 7fce89c00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce841efb60 0x7fce841f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:19:48.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.821+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce84154680 con 0x7fce841efb60 2024-03-23T06:19:48.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.824+0000 7fce82a00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce841efb60 0x7fce841f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:19:48.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.825+0000 7fce82a00640 1 -- 172.21.15.73:0/379048957 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fce8406a890 con 0x7fce841efb60 2024-03-23T06:19:48.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.825+0000 7fce82a00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce841efb60 0x7fce841f2650 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce70001670 tx=0x7fce70001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:19:48.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.825+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70024070 con 0x7fce841efb60 2024-03-23T06:19:48.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.827+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7fce7001f2e0 con 0x7fce841efb60 2024-03-23T06:19:48.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.827+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce841efb60 msgr2=0x7fce841f2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.827+0000 7fce7aa00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce841efb60 0x7fce841f2650 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce70001670 tx=0x7fce70001080 comp rx=0 tx=0).stop 2024-03-23T06:19:48.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.827+0000 7fce7aa00640 1 -- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce841efb60 msgr2=0x7fce841f2650 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:19:48.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.827+0000 7fce7aa00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce841efb60 0x7fce841f2650 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce70001670 tx=0x7fce70001080 comp rx=0 tx=0).stop 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 92, 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 20, 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:19:48.828 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:19:48.829 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:19:48.830 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:19:48.831 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:19:48.832 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.833 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:19:48.834 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.835 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.836 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:19:48.837 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:19:48.838 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:19:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:19:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:19:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:19:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:19:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:19:48.839 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:19:48.839 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.828+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce6406ac60 msgr2=0x7fce6406d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.828+0000 7fce89c00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fce6406ac60 0x7fce6406d120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fce84157260 tx=0x7fce7c0094f0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.828+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84153760 msgr2=0x7fce841563d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.828+0000 7fce89c00640 1 --2- 172.21.15.73:0/379048957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce84153760 0x7fce841563d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fce74033000 tx=0x7fce740046c0 comp rx=0 tx=0).stop 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.828+0000 7fce83400640 1 -- 172.21.15.73:0/379048957 reap_dead start 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.828+0000 7fce83400640 1 -- 172.21.15.73:0/379048957 reap_dead start 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.828+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 shutdown_connections 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.828+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 >> 172.21.15.73:0/379048957 conn(0x7fce8406c310 msgr2=0x7fce840ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.829+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 shutdown_connections 2024-03-23T06:19:48.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:19:48.829+0000 7fce89c00640 1 -- 172.21.15.73:0/379048957 wait complete. 2024-03-23T06:19:48.863 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:19:48.863 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-03-23T06:19:48.863 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b', 'c'] 2024-03-23T06:19:48.863 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-23T06:19:48.864 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T06:19:48.864 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T06:19:48.864 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:19:48.904 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T06:19:48.904 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-03-23T06:19:48.904 INFO:tasks.ceph.mon.b:Sent signal 19 2024-03-23T06:19:48.904 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-03-23T06:19:48.904 INFO:tasks.ceph.mon.c:Sent signal 19 2024-03-23T06:19:48.905 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T06:20:03.905 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-03-23T06:20:03.906 INFO:tasks.ceph.mon.b:Sent signal 18 2024-03-23T06:20:03.906 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-03-23T06:20:03.906 INFO:tasks.ceph.mon.c:Sent signal 18 2024-03-23T06:20:03.906 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:20:03.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:20:04.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.236+0000 7f27cac00640 1 Processor -- start 2024-03-23T06:20:04.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.237+0000 7f27cac00640 1 -- start start 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.238+0000 7f27cac00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27c40c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.238+0000 7f27cac00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.238+0000 7f27cac00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c406d6e0 con 0x7f27c414fb40 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.238+0000 7f27cac00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c40c6900 con 0x7f27c406f9b0 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.238+0000 7f27cac00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c40c6ba0 con 0x7f27c40c5970 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c3400640 1 -- >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 msgr2=0x7f27c40c0750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f27c414fb40 0x7f27c4158b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:51662/0 (socket says 172.21.15.73:51662) 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 learned_addr learned my addr 172.21.15.73:0/2221846844 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c3400640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27c40c0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:04.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:04.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.239+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.440+0000 7f27c3400640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 msgr2=0x7f27c40c0750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.440+0000 7f27c3400640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27c40c0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:20:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.440+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.441+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-23T06:20:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.441+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.441+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:04.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.441+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:20:04.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.841+0000 7f27c3400640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 msgr2=0x7f27c40c0750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:04.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.841+0000 7f27c3400640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27c40c0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:20:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.842+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.843+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.843+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.843+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:04.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:04.843+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:20:05.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:05.642+0000 7f27c3400640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 msgr2=0x7f27c40c0750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:05.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:05.642+0000 7f27c3400640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27c40c0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:20:05.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:05.647+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:05.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:05.647+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:05.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:05.647+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:05.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:05.647+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:05.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:05.647+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:20:07.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 msgr2=0x7f27c406db70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:07.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c1600640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.110:3300/0 conn(0x7f27c40c5970 0x7f27c406db70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:07.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 msgr2=0x7f27c40c0750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:07.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c1600640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27c40c0750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:07.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 >> v1:172.21.15.110:6789/0 conn(0x7f27c414fb40 legacy=0x7f27c4158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:07.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c1600640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:07.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c40c6e80 con 0x7f27a4006190 2024-03-23T06:20:07.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c40c6900 con 0x7f27a40036b0 2024-03-23T06:20:07.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.239+0000 7f27c3400640 1 -- 172.21.15.73:0/2221846844 >> v1:172.21.15.73:6789/0 conn(0x7f27a4006190 legacy=0x7f27a4008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:20:07.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.240+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:07.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.240+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:20:07.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.240+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:07.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.240+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:07.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.240+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:07.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.441+0000 7f27c3400640 1 -- 172.21.15.73:0/2221846844 >> v1:172.21.15.73:6789/0 conn(0x7f27a4006190 legacy=0x7f27a4008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:20:07.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.442+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:07.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.442+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:20:07.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.442+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:07.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.442+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:07.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.442+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:20:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.843+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.843+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:20:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.843+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.843+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.843+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:20:07.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:07.843+0000 7f27c3400640 1 -- 172.21.15.73:0/2221846844 >> v1:172.21.15.73:6789/0 conn(0x7f27a4006190 legacy=0x7f27a4008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:20:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:08.644+0000 7f27c3400640 1 -- 172.21.15.73:0/2221846844 >> v1:172.21.15.73:6789/0 conn(0x7f27a4006190 legacy=0x7f27a4008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:20:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:08.644+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:08.644+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:20:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:08.644+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:08.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:08.644+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:08.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:08.644+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:20:10.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 msgr2=0x7f27a4005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:10.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c1600640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a40036b0 0x7f27a4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 >> v1:172.21.15.73:6789/0 conn(0x7f27a4006190 legacy=0x7f27a4008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:10.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c1600640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a4009ee0 0x7f27a400a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:10.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c1600640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27a4012b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:10.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a400af80 con 0x7f27a400a900 2024-03-23T06:20:10.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c40c6900 con 0x7f27c406f9b0 2024-03-23T06:20:10.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c1600640 1 -- 172.21.15.73:0/2221846844 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c40c6ba0 con 0x7f27a4009ee0 2024-03-23T06:20:10.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 reap_dead start 2024-03-23T06:20:10.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c8c00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 msgr2=0x7f27a4012b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:10.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.239+0000 7f27c8c00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27a4012b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:10.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.240+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a4009ee0 0x7f27a400a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:10.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.240+0000 7f27c3400640 1 -- 172.21.15.73:0/2221846844 >> v1:172.21.15.73:6789/0 conn(0x7f27a400a900 legacy=0x7f27a400f390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:20:10.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.240+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 msgr2=0x7f27a4012b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:10.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.240+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27a4012b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.240+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 >> v1:172.21.15.73:6789/0 conn(0x7f27a400a900 legacy=0x7f27a400f390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:10.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.240+0000 7f27c3e00640 1 -- 172.21.15.73:0/2221846844 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40c6e80 con 0x7f27a4009ee0 2024-03-23T06:20:10.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.246+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a4009ee0 0x7f27a400a300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27c4066570 tx=0x7f27b402c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6acfe2a1c111dcfd server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:10.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.246+0000 7f27c2a00640 1 -- 172.21.15.73:0/2221846844 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b402ce10 con 0x7f27a4009ee0 2024-03-23T06:20:10.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.246+0000 7f27c2a00640 1 -- 172.21.15.73:0/2221846844 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b4030070 con 0x7f27a4009ee0 2024-03-23T06:20:10.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.246+0000 7f27c2a00640 1 -- 172.21.15.73:0/2221846844 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b402ce10 con 0x7f27a4009ee0 2024-03-23T06:20:10.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.247+0000 7f27cac00640 1 -- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a4009ee0 msgr2=0x7f27a400a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:10.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.247+0000 7f27cac00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a4009ee0 0x7f27a400a300 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f27c4066570 tx=0x7f27b402c270 comp rx=0 tx=0).stop 2024-03-23T06:20:10.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.248+0000 7f27cac00640 1 -- 172.21.15.73:0/2221846844 shutdown_connections 2024-03-23T06:20:10.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.248+0000 7f27cac00640 1 --2- 172.21.15.73:0/2221846844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a4009ee0 0x7f27a400a300 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.248+0000 7f27cac00640 1 --2- 172.21.15.73:0/2221846844 >> v2:172.21.15.73:3300/0 conn(0x7f27c406f9b0 0x7f27a4012b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.248+0000 7f27cac00640 1 -- 172.21.15.73:0/2221846844 >> 172.21.15.73:0/2221846844 conn(0x7f27c406bb40 msgr2=0x7f27c406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:10.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.248+0000 7f27cac00640 1 -- 172.21.15.73:0/2221846844 shutdown_connections 2024-03-23T06:20:10.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.248+0000 7f27cac00640 1 -- 172.21.15.73:0/2221846844 wait complete. 2024-03-23T06:20:10.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.251+0000 7f27cac00640 1 Processor -- start 2024-03-23T06:20:10.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.252+0000 7f27cac00640 1 -- start start 2024-03-23T06:20:10.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.253+0000 7f27cac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27a4009ee0 0x7f27c40c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:10.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.253+0000 7f27cac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a400a900 0x7f27c40c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:10.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.253+0000 7f27cac00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27c406f9b0 0x7f27c40c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:10.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.254+0000 7f27c3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27a4009ee0 0x7f27c40c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:10.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.254+0000 7f27c3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27a4009ee0 0x7f27c40c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:34778/0 (socket says 172.21.15.73:34778) 2024-03-23T06:20:10.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.254+0000 7f27c8c00640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27c406f9b0 msgr2=0x7f27c40c3430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:10.254 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.254+0000 7f27c8c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27c406f9b0 0x7f27c40c3430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:10.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.254+0000 7f27cac00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4152e20 con 0x7f27c406f9b0 2024-03-23T06:20:10.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.254+0000 7f27c3e00640 1 -- 172.21.15.73:0/2231919165 learned_addr learned my addr 172.21.15.73:0/2231919165 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:10.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.254+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4151f50 con 0x7f27a4009ee0 2024-03-23T06:20:10.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.254+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c4152a90 con 0x7f27a400a900 2024-03-23T06:20:10.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.255+0000 7f27c3e00640 1 -- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a400a900 msgr2=0x7f27c40c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:10.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.255+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a400a900 0x7f27c40c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.255+0000 7f27c3e00640 1 -- 172.21.15.73:0/2231919165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27c406f9b0 msgr2=0x7f27c40c3430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:20:10.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.255+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27c406f9b0 0x7f27c40c3430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.257+0000 7f27c3e00640 1 -- 172.21.15.73:0/2231919165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b400f040 con 0x7f27a4009ee0 2024-03-23T06:20:10.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.260+0000 7f27c3e00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27a4009ee0 0x7f27c40c9cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000f60 tx=0x7f27b4001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:10.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.260+0000 7f27bbe00640 1 -- 172.21.15.73:0/2231919165 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4041670 con 0x7f27a4009ee0 2024-03-23T06:20:10.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.260+0000 7f27bbe00640 1 -- 172.21.15.73:0/2231919165 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40417f0 con 0x7f27a4009ee0 2024-03-23T06:20:10.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.260+0000 7f27bbe00640 1 -- 172.21.15.73:0/2231919165 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4041ba0 con 0x7f27a4009ee0 2024-03-23T06:20:10.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.260+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c4151500 con 0x7f27a4009ee0 2024-03-23T06:20:10.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.261+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c414ca30 con 0x7f27a4009ee0 2024-03-23T06:20:10.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.262+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c404e110 con 0x7f27a4009ee0 2024-03-23T06:20:10.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.266+0000 7f27bbe00640 1 -- 172.21.15.73:0/2231919165 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f27b4041d00 con 0x7f27a4009ee0 2024-03-23T06:20:10.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.267+0000 7f27bbe00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f27a406c370 0x7f27a406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:10.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.267+0000 7f27bbe00640 1 -- 172.21.15.73:0/2231919165 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f27b40acd20 con 0x7f27a4009ee0 2024-03-23T06:20:10.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.268+0000 7f27c3400640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f27a406c370 0x7f27a406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:10.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.270+0000 7f27bbe00640 1 -- 172.21.15.73:0/2231919165 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f27b4077be0 con 0x7f27a4009ee0 2024-03-23T06:20:10.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.270+0000 7f27c3400640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f27a406c370 0x7f27a406e830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27c412c020 tx=0x7f27b0003cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:10.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.769+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f27c40c6540 con 0x7f27a4009ee0 2024-03-23T06:20:10.776 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":94,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:20:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.773+0000 7f27bbe00640 1 -- 172.21.15.73:0/2231919165 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1541 (secure 0 0 0) 0x7f27b4045020 con 0x7f27a4009ee0 2024-03-23T06:20:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.776+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f27a406c370 msgr2=0x7f27a406e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.776+0000 7f27cac00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f27a406c370 0x7f27a406e830 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27c412c020 tx=0x7f27b0003cb0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.776+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27a4009ee0 msgr2=0x7f27c40c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:10.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.776+0000 7f27cac00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27a4009ee0 0x7f27c40c9cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27b4000f60 tx=0x7f27b4001120 comp rx=0 tx=0).stop 2024-03-23T06:20:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.777+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 shutdown_connections 2024-03-23T06:20:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.777+0000 7f27cac00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27c406f9b0 0x7f27c40c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.777+0000 7f27cac00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f27a406c370 0x7f27a406e830 secure :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27c412c020 tx=0x7f27b0003cb0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.777+0000 7f27cac00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27a400a900 0x7f27c40c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.777+0000 7f27cac00640 1 --2- 172.21.15.73:0/2231919165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27a4009ee0 0x7f27c40c9cf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:10.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.777+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 >> 172.21.15.73:0/2231919165 conn(0x7f27c406bb40 msgr2=0x7f27c40c0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:10.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.781+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 shutdown_connections 2024-03-23T06:20:10.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:10.784+0000 7f27cac00640 1 -- 172.21.15.73:0/2231919165 wait complete. 2024-03-23T06:20:10.817 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:20:10.818 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-03-23T06:20:10.818 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:20:11.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.128+0000 7f319fe00640 1 Processor -- start 2024-03-23T06:20:11.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.128+0000 7f319fe00640 1 -- start start 2024-03-23T06:20:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.133+0000 7f319fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31a006f1a0 0x7f31a006adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.133+0000 7f319ea00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f31a0157a50 0x7f31a01616e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:39026/0 (socket says 172.21.15.73:39026) 2024-03-23T06:20:11.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.133+0000 7f319ea00640 1 -- 172.21.15.73:0/2484956344 learned_addr learned my addr 172.21.15.73:0/2484956344 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:20:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.134+0000 7f319e000640 1 -- 172.21.15.73:0/2484956344 >> v2:172.21.15.73:3300/0 conn(0x7f31a006f1a0 msgr2=0x7f31a006adc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:11.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.134+0000 7f319e000640 1 --2- 172.21.15.73:0/2484956344 >> v2:172.21.15.73:3300/0 conn(0x7f31a006f1a0 0x7f31a006adc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.134+0000 7f319fe00640 1 -- 172.21.15.73:0/2484956344 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a0157e30 con 0x7f31a006f5f0 2024-03-23T06:20:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.134+0000 7f319fe00640 1 -- 172.21.15.73:0/2484956344 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a00c7a00 con 0x7f31a0157a50 2024-03-23T06:20:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.135+0000 7f319fe00640 1 -- 172.21.15.73:0/2484956344 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a015d820 con 0x7f31a006f1a0 2024-03-23T06:20:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.134+0000 7f319f400640 1 -- 172.21.15.73:0/2484956344 >> v1:172.21.15.73:6789/0 conn(0x7f31a006f5f0 legacy=0x7f31a006b300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:20:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.135+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531833006 0 0) 0x7f31a00c7a00 con 0x7f31a0157a50 2024-03-23T06:20:11.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.135+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3184003520 con 0x7f31a0157a50 2024-03-23T06:20:11.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698526568 0 0) 0x7f3184003520 con 0x7f31a0157a50 2024-03-23T06:20:11.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 >> v2:172.21.15.73:3300/0 conn(0x7f31a006f1a0 msgr2=0x7f31a006adc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:11.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 --2- 172.21.15.73:0/2484956344 >> v2:172.21.15.73:3300/0 conn(0x7f31a006f1a0 0x7f31a006adc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 >> v1:172.21.15.73:6789/0 conn(0x7f31a006f5f0 legacy=0x7f31a006b300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:11.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a015db00 con 0x7f31a0157a50 2024-03-23T06:20:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f31980019d0 con 0x7f31a0157a50 2024-03-23T06:20:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 >> v1:172.21.15.110:6789/0 conn(0x7f31a0157a50 legacy=0x7f31a01616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184003970 0x7f3184003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31840047c0 0x7f3184004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3184005280 0x7f318400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a015d820 con 0x7f3184003970 2024-03-23T06:20:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318400c1b0 con 0x7f3184005280 2024-03-23T06:20:11.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318400c370 con 0x7f31840047c0 2024-03-23T06:20:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319ea00640 1 -- 172.21.15.73:0/2484956344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184003970 msgr2=0x7f3184003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.136+0000 7f319ea00640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184003970 0x7f3184003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.137+0000 7f319f400640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3184005280 0x7f318400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.137+0000 7f319e000640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31840047c0 0x7f3184004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.138+0000 7f319f400640 1 -- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31840047c0 msgr2=0x7f3184004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:20:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.138+0000 7f319f400640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31840047c0 0x7f3184004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.138+0000 7f319f400640 1 -- 172.21.15.73:0/2484956344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184003970 msgr2=0x7f3184003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:11.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.138+0000 7f319f400640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3184003970 0x7f3184003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.138+0000 7f319f400640 1 -- 172.21.15.73:0/2484956344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a015db00 con 0x7f3184005280 2024-03-23T06:20:11.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.139+0000 7f319f400640 1 -- 172.21.15.73:0/2484956344 reap_dead start 2024-03-23T06:20:11.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.139+0000 7f319f400640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3184005280 0x7f318400b980 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3190009900 tx=0x7f31840057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82474666a1a31e4e server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.139+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190003b80 con 0x7f3184005280 2024-03-23T06:20:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.140+0000 7f319d600640 1 -- 172.21.15.73:0/2484956344 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319002e070 con 0x7f3184005280 2024-03-23T06:20:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.141+0000 7f319fe00640 1 -- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3184005280 msgr2=0x7f318400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.141+0000 7f319fe00640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3184005280 0x7f318400b980 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3190009900 tx=0x7f31840057f0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.142+0000 7f319fe00640 1 -- 172.21.15.73:0/2484956344 shutdown_connections 2024-03-23T06:20:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.142+0000 7f319fe00640 1 --2- 172.21.15.73:0/2484956344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3184005280 0x7f318400b980 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.142+0000 7f319fe00640 1 -- 172.21.15.73:0/2484956344 >> 172.21.15.73:0/2484956344 conn(0x7f31a00cc930 msgr2=0x7f31a00ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:11.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.144+0000 7f319fe00640 1 -- 172.21.15.73:0/2484956344 shutdown_connections 2024-03-23T06:20:11.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.144+0000 7f319fe00640 1 -- 172.21.15.73:0/2484956344 wait complete. 2024-03-23T06:20:11.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.147+0000 7f319fe00640 1 Processor -- start 2024-03-23T06:20:11.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.147+0000 7f319fe00640 1 -- start start 2024-03-23T06:20:11.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3184005280 0x7f31a00cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31a00c5dc0 0x7f31a00c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a00cc3d0 0x7f31a01f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319e000640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31a00c5dc0 msgr2=0x7f31a00c51f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31a00c5dc0 0x7f31a00c51f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3184005280 0x7f31a00cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3184005280 0x7f31a00cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55684/0 (socket says 172.21.15.73:55684) 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a015f6a0 con 0x7f31a00c5dc0 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a01f2f00 con 0x7f31a00cc3d0 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a015e8d0 con 0x7f3184005280 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319ea00640 1 -- 172.21.15.73:0/1368061504 learned_addr learned my addr 172.21.15.73:0/1368061504 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.149+0000 7f319f400640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a00cc3d0 0x7f31a01f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.151+0000 7f319ea00640 1 -- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a00cc3d0 msgr2=0x7f31a01f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.151+0000 7f319ea00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31a00cc3d0 0x7f31a01f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.151+0000 7f319ea00640 1 -- 172.21.15.73:0/1368061504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31a00c5dc0 msgr2=0x7f31a00c51f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:20:11.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.151+0000 7f319ea00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31a00c5dc0 0x7f31a00c51f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.151+0000 7f319ea00640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a015eb20 con 0x7f3184005280 2024-03-23T06:20:11.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.153+0000 7f319ea00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3184005280 0x7f31a00cb1f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f319800caf0 tx=0x7f319800a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.154+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800a890 con 0x7f3184005280 2024-03-23T06:20:11.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.154+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319800aa10 con 0x7f3184005280 2024-03-23T06:20:11.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.154+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800adc0 con 0x7f3184005280 2024-03-23T06:20:11.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.154+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a015ee00 con 0x7f3184005280 2024-03-23T06:20:11.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.154+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a015f3c0 con 0x7f3184005280 2024-03-23T06:20:11.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.161+0000 7f319fe00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178002a30 0x7f3178004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.161+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3178007e80 con 0x7f3178002a30 2024-03-23T06:20:11.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.162+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f31980070d0 con 0x7f3184005280 2024-03-23T06:20:11.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.163+0000 7f319e000640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178002a30 0x7f3178004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.164+0000 7f319e000640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3178008040 con 0x7f3178002a30 2024-03-23T06:20:11.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.164+0000 7f3196a00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f318006ac30 0x7f318006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.165+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f31980890f0 con 0x7f3184005280 2024-03-23T06:20:11.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.165+0000 7f319e000640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178002a30 0x7f3178004ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f318c003980 tx=0x7f318c00d960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.166+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c003bc0 con 0x7f3178002a30 2024-03-23T06:20:11.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.166+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f318c003d20 con 0x7f3178002a30 2024-03-23T06:20:11.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.166+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178002a30 msgr2=0x7f3178004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.166+0000 7f3196a00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178002a30 0x7f3178004ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f318c003980 tx=0x7f318c00d960 comp rx=0 tx=0).stop 2024-03-23T06:20:11.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.166+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178002a30 msgr2=0x7f3178004ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:11.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.166+0000 7f3196a00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178002a30 0x7f3178004ef0 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f318c003980 tx=0x7f318c00d960 comp rx=0 tx=0).stop 2024-03-23T06:20:11.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.171+0000 7f319f400640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f318006ac30 0x7f318006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.179+0000 7f319f400640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f318006ac30 0x7f318006d0f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f318400c340 tx=0x7f3190008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.194+0000 7f319fe00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178006ed0 0x7f3178007360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.194+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31780078d0 con 0x7f3178006ed0 2024-03-23T06:20:11.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.197+0000 7f319e000640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178006ed0 0x7f3178007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.198+0000 7f319e000640 1 -- 172.21.15.73:0/1368061504 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3178007a90 con 0x7f3178006ed0 2024-03-23T06:20:11.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.199+0000 7f319e000640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178006ed0 0x7f3178007360 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f318c003980 tx=0x7f318c005a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.200+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c01dad0 con 0x7f3178006ed0 2024-03-23T06:20:11.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.200+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5109 (secure 0 0 0) 0x7f318c027460 con 0x7f3178006ed0 2024-03-23T06:20:11.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.200+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178006ed0 msgr2=0x7f3178007360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.200 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 94, 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:11.201 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:11.202 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:11.203 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:11.204 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:11.205 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.206 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.207 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.208 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.209 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.210 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.211 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:20:11.212 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:20:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.201+0000 7f3196a00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178006ed0 0x7f3178007360 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f318c003980 tx=0x7f318c005a80 comp rx=0 tx=0).stop 2024-03-23T06:20:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.201+0000 7f3196a00640 1 -- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178006ed0 msgr2=0x7f3178007360 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.201+0000 7f3196a00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3178006ed0 0x7f3178007360 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f318c003980 tx=0x7f318c005a80 comp rx=0 tx=0).stop 2024-03-23T06:20:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.203+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f318006ac30 msgr2=0x7f318006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.203+0000 7f319fe00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f318006ac30 0x7f318006d0f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f318400c340 tx=0x7f3190008030 comp rx=0 tx=0).stop 2024-03-23T06:20:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.203+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3184005280 msgr2=0x7f31a00cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.203+0000 7f319fe00640 1 --2- 172.21.15.73:0/1368061504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3184005280 0x7f31a00cb1f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f319800caf0 tx=0x7f319800a060 comp rx=0 tx=0).stop 2024-03-23T06:20:11.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.203+0000 7f319f400640 1 -- 172.21.15.73:0/1368061504 reap_dead start 2024-03-23T06:20:11.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.203+0000 7f319f400640 1 -- 172.21.15.73:0/1368061504 reap_dead start 2024-03-23T06:20:11.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.214+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 shutdown_connections 2024-03-23T06:20:11.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.214+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 >> 172.21.15.73:0/1368061504 conn(0x7f31a00cc930 msgr2=0x7f31a015b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:11.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.216+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 shutdown_connections 2024-03-23T06:20:11.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.216+0000 7f319fe00640 1 -- 172.21.15.73:0/1368061504 wait complete. 2024-03-23T06:20:11.249 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:20:11.249 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T06:20:11.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:20:11.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.569+0000 7f9a05200640 1 Processor -- start 2024-03-23T06:20:11.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.569+0000 7f9a05200640 1 -- start start 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.571+0000 7f9a05200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a00157a60 0x7f9a0015e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.571+0000 7f9a05200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a000c74a0 con 0x7f9a0006cd10 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.571+0000 7f9a05200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0015e750 con 0x7f9a000c7930 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.571+0000 7f9a05200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a000c5f10 con 0x7f9a00157a60 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.572+0000 7f99f7e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9a000c7930 0x7f9a000be900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:39034/0 (socket says 172.21.15.73:39034) 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.572+0000 7f99f7e00640 1 -- 172.21.15.73:0/4004179416 learned_addr learned my addr 172.21.15.73:0/4004179416 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.573+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950192517 0 0) 0x7f9a0015e750 con 0x7f9a000c7930 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.573+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e4003520 con 0x7f9a000c7930 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.573+0000 7f99ff400640 1 -- 172.21.15.73:0/4004179416 >> v2:172.21.15.73:3300/0 conn(0x7f9a00157a60 msgr2=0x7f9a0015e210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.573+0000 7f99ff400640 1 --2- 172.21.15.73:0/4004179416 >> v2:172.21.15.73:3300/0 conn(0x7f9a00157a60 0x7f9a0015e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.573+0000 7f99ffe00640 1 -- 172.21.15.73:0/4004179416 >> v1:172.21.15.73:6789/0 conn(0x7f9a0006cd10 legacy=0x7f9a0006d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.73:6789/0 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1317177758 0 0) 0x7f99e4003520 con 0x7f9a000c7930 2024-03-23T06:20:11.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 >> v2:172.21.15.73:3300/0 conn(0x7f9a00157a60 msgr2=0x7f9a0015e210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 --2- 172.21.15.73:0/4004179416 >> v2:172.21.15.73:3300/0 conn(0x7f9a00157a60 0x7f9a0015e210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 >> v1:172.21.15.73:6789/0 conn(0x7f9a0006cd10 legacy=0x7f9a0006d0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000c5c30 con 0x7f9a000c7930 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f99e8001650 con 0x7f9a000c7930 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 >> v1:172.21.15.110:6789/0 conn(0x7f9a000c7930 legacy=0x7f9a000be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99e4003970 0x7f99e4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99e40047c0 0x7f99e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4005280 0x7f99e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000c5f10 con 0x7f99e4005280 2024-03-23T06:20:11.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e400c1b0 con 0x7f99e40047c0 2024-03-23T06:20:11.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.574+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e400c370 con 0x7f99e4003970 2024-03-23T06:20:11.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.575+0000 7f99ffe00640 1 -- 172.21.15.73:0/4004179416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4005280 msgr2=0x7f99e400b980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:11.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.575+0000 7f99ffe00640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4005280 0x7f99e400b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:11.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.575+0000 7f99ff400640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99e4003970 0x7f99e4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.577+0000 7f99f7e00640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99e40047c0 0x7f99e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.578+0000 7f99ff400640 1 -- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99e40047c0 msgr2=0x7f99e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:20:11.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.578+0000 7f99ff400640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99e40047c0 0x7f99e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.578+0000 7f99ff400640 1 -- 172.21.15.73:0/4004179416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4005280 msgr2=0x7f99e400b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:11.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.578+0000 7f99ff400640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4005280 0x7f99e400b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.578+0000 7f99ff400640 1 -- 172.21.15.73:0/4004179416 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000c5c30 con 0x7f99e4003970 2024-03-23T06:20:11.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.579+0000 7f99ffe00640 1 -- 172.21.15.73:0/4004179416 reap_dead start 2024-03-23T06:20:11.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.581+0000 7f99ff400640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99e4003970 0x7f99e4003db0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009900 tx=0x7f99e40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=693502d589c7c660 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.582+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0003bb0 con 0x7f99e4003970 2024-03-23T06:20:11.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.582+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f002e070 con 0x7f99e4003970 2024-03-23T06:20:11.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.583+0000 7f99fea00640 1 -- 172.21.15.73:0/4004179416 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0005070 con 0x7f99e4003970 2024-03-23T06:20:11.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.584+0000 7f9a05200640 1 -- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99e4003970 msgr2=0x7f99e4003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.584+0000 7f9a05200640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99e4003970 0x7f99e4003db0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009900 tx=0x7f99e40057f0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.588+0000 7f9a05200640 1 -- 172.21.15.73:0/4004179416 shutdown_connections 2024-03-23T06:20:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.588+0000 7f9a05200640 1 --2- 172.21.15.73:0/4004179416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99e4003970 0x7f99e4003db0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.588+0000 7f9a05200640 1 -- 172.21.15.73:0/4004179416 >> 172.21.15.73:0/4004179416 conn(0x7f9a00069cb0 msgr2=0x7f9a0006a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:11.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.590+0000 7f9a05200640 1 -- 172.21.15.73:0/4004179416 shutdown_connections 2024-03-23T06:20:11.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.591+0000 7f9a05200640 1 -- 172.21.15.73:0/4004179416 wait complete. 2024-03-23T06:20:11.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.593+0000 7f9a05200640 1 Processor -- start 2024-03-23T06:20:11.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.599+0000 7f9a05200640 1 -- start start 2024-03-23T06:20:11.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.603+0000 7f9a05200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4003970 0x7f9a00140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.603+0000 7f9a05200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a001618e0 0x7f9a00141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.603+0000 7f9a05200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a000bf8f0 0x7f9a000bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.603+0000 7f99ff400640 1 -- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4003970 msgr2=0x7f9a00140440 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.73:3300/0 2024-03-23T06:20:11.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.604+0000 7f99f7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a001618e0 0x7f9a00141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.604+0000 7f99f7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a001618e0 0x7f9a00141370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55704/0 (socket says 172.21.15.73:55704) 2024-03-23T06:20:11.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.604+0000 7f9a05200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a00161620 con 0x7f99e4003970 2024-03-23T06:20:11.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.604+0000 7f9a05200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a001e6c50 con 0x7f9a000bf8f0 2024-03-23T06:20:11.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.605+0000 7f99f7e00640 1 -- 172.21.15.73:0/2667581300 learned_addr learned my addr 172.21.15.73:0/2667581300 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:11.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.605+0000 7f99ff400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4003970 0x7f9a00140440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:11.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.606+0000 7f99ffe00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a000bf8f0 0x7f9a000bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.606+0000 7f9a05200640 1 -- 172.21.15.73:0/2667581300 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0015f360 con 0x7f9a001618e0 2024-03-23T06:20:11.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.607+0000 7f99f7e00640 1 -- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a000bf8f0 msgr2=0x7f9a000bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.607+0000 7f99f7e00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a000bf8f0 0x7f9a000bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.607+0000 7f99f7e00640 1 -- 172.21.15.73:0/2667581300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4003970 msgr2=0x7f9a00140440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:20:11.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.607+0000 7f99f7e00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e4003970 0x7f9a00140440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.607+0000 7f99f7e00640 1 -- 172.21.15.73:0/2667581300 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0015f620 con 0x7f9a001618e0 2024-03-23T06:20:11.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.609+0000 7f99f7e00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a001618e0 0x7f9a00141370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99e801f780 tx=0x7f99e801fb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.610+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e801d660 con 0x7f9a001618e0 2024-03-23T06:20:11.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.610+0000 7f9a05200640 1 -- 172.21.15.73:0/2667581300 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0015f900 con 0x7f9a001618e0 2024-03-23T06:20:11.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.610+0000 7f9a05200640 1 -- 172.21.15.73:0/2667581300 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0015fec0 con 0x7f9a001618e0 2024-03-23T06:20:11.628 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:20:11.628 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:20:11.628 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 94, 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:11.629 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:11.630 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:20:11.631 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:11.632 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.633 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:20:11.634 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.635 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:11.636 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:20:11.637 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.638 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:11.639 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:11.640 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:20:11.640 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:11.640 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:11.640 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:11.640 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:20:11.640 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:20:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.611+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e801d7c0 con 0x7f9a001618e0 2024-03-23T06:20:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.611+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e801d660 con 0x7f9a001618e0 2024-03-23T06:20:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.615+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f99e801d930 con 0x7f9a001618e0 2024-03-23T06:20:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.616+0000 7f99f4c00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8002a30 0x7f99d8004ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.616+0000 7f99f4c00640 1 -- 172.21.15.73:0/2667581300 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d8007e80 con 0x7f99d8002a30 2024-03-23T06:20:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.617+0000 7f99ff400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8002a30 0x7f99d8004ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.617+0000 7f99f7400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99dc06ac10 0x7f99dc06d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.618+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f99e809a040 con 0x7f9a001618e0 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.618+0000 7f99ffe00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99dc06ac10 0x7f99dc06d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.618+0000 7f99ff400640 1 -- 172.21.15.73:0/2667581300 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99d8008040 con 0x7f99d8002a30 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.618+0000 7f99ffe00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99dc06ac10 0x7f99dc06d0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9a000c6870 tx=0x7f99f8009370 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.618+0000 7f99ff400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8002a30 0x7f99d8004ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99f0003980 tx=0x7f99f0005a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.619+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0005450 con 0x7f99d8002a30 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.619+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f99f00055b0 con 0x7f99d8002a30 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.619+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8002a30 msgr2=0x7f99d8004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.619+0000 7f99f7400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8002a30 0x7f99d8004ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f99f0003980 tx=0x7f99f0005a10 comp rx=0 tx=0).stop 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.619+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8002a30 msgr2=0x7f99d8004ef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.619+0000 7f99f7400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8002a30 0x7f99d8004ef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.626+0000 7f99f4c00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8006f10 0x7f99d8007380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.626+0000 7f99f4c00640 1 -- 172.21.15.73:0/2667581300 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d80078f0 con 0x7f99d8006f10 2024-03-23T06:20:11.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.626+0000 7f99ff400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8006f10 0x7f99d8007380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.627+0000 7f99ff400640 1 -- 172.21.15.73:0/2667581300 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f99d8007ab0 con 0x7f99d8006f10 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.627+0000 7f99ff400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8006f10 0x7f99d8007380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009900 tx=0x7f99f002e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.627+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0033900 con 0x7f99d8006f10 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.628+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4624 (secure 0 0 0) 0x7f99f0033a60 con 0x7f99d8006f10 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.628+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8006f10 msgr2=0x7f99d8007380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.628+0000 7f99f7400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8006f10 0x7f99d8007380 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009900 tx=0x7f99f002e000 comp rx=0 tx=0).stop 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.628+0000 7f99f7400640 1 -- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8006f10 msgr2=0x7f99d8007380 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.628+0000 7f99f7400640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99d8006f10 0x7f99d8007380 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009900 tx=0x7f99f002e000 comp rx=0 tx=0).stop 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 -- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99dc06ac10 msgr2=0x7f99dc06d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f99dc06ac10 0x7f99dc06d0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9a000c6870 tx=0x7f99f8009370 comp rx=0 tx=0).stop 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 -- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a001618e0 msgr2=0x7f9a00141370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a001618e0 0x7f9a00141370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99e801f780 tx=0x7f99e801fb80 comp rx=0 tx=0).stop 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99ffe00640 1 -- 172.21.15.73:0/2667581300 reap_dead start 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 -- 172.21.15.73:0/2667581300 shutdown_connections 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 --2- 172.21.15.73:0/2667581300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a001618e0 0x7f9a00141370 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 -- 172.21.15.73:0/2667581300 >> 172.21.15.73:0/2667581300 conn(0x7f9a00069cb0 msgr2=0x7f9a001542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 -- 172.21.15.73:0/2667581300 shutdown_connections 2024-03-23T06:20:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:11.629+0000 7f99f4c00640 1 -- 172.21.15.73:0/2667581300 wait complete. 2024-03-23T06:20:11.709 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:20:11.709 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:20:31.709 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-23T06:20:31.710 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-23T06:20:31.710 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-23T06:20:31.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-23T06:20:31.721 INFO:tasks.ceph.mon.a:Started 2024-03-23T06:20:31.721 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-03-23T06:20:31.721 INFO:tasks.ceph.mon.b:Sent signal 19 2024-03-23T06:20:31.722 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-03-23T06:20:31.722 INFO:tasks.ceph.mon.c:Sent signal 19 2024-03-23T06:20:31.722 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-03-23T06:20:43.736 INFO:tasks.workunit.client.0.smithi073.stdout:Syncing()...114 sec 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout:FFSB benchmark finished at: Sat Mar 23 06:20:43 2024 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout:Results: 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout:Benchmark took 427.94 sec 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout:Total Results 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout:=============== 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout: ======= ============ ========= ======= =========== ========== 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout: write : 7904000 18469.70 100.000% 100.000% 72.1MB/sec 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout:- 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout:18469.70 Transactions per Second 2024-03-23T06:20:43.737 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.738 INFO:tasks.workunit.client.0.smithi073.stdout:Throughput Results 2024-03-23T06:20:43.738 INFO:tasks.workunit.client.0.smithi073.stdout:=================== 2024-03-23T06:20:43.738 INFO:tasks.workunit.client.0.smithi073.stdout:Write Throughput: 72.1MB/sec 2024-03-23T06:20:43.809 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.809 INFO:tasks.workunit.client.0.smithi073.stdout:System Call Latency statistics in millisecs 2024-03-23T06:20:43.809 INFO:tasks.workunit.client.0.smithi073.stdout:===== 2024-03-23T06:20:43.809 INFO:tasks.workunit.client.0.smithi073.stdout: Min Avg Max Total Calls 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: ======== ======== ======== ============ 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout:[ open] 0.019000 0.115707 33.485001 6175 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[7] 20.000000 - 50.000000 : 4 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[8] 10.000000 - 20.000000 : 6 2024-03-23T06:20:43.810 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[9] 5.000000 - 10.000000 : 15 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[10] 2.000000 - 5.000000 : 28 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[11] 1.000000 - 2.000000 : 13 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[12] 0.500000 - 1.000000 : 24 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[13] 0.200000 - 0.500000 : 38 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[14] 0.100000 - 0.200000 : 248 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[15] 0.050000 - 0.100000 : 369 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[16] 0.020000 - 0.050000 : 5428 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[17] 0.010000 - 0.020000 : 2 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout:[ write] 0.003000 1.224891 20239.345703 7904000 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[0] 5000.000000 - 10000.000000 : 345 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[1] 2000.000000 - 5000.000000 : 323 2024-03-23T06:20:43.811 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[2] 1000.000000 - 2000.000000 : 192 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[3] 500.000000 - 1000.000000 : 265 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[4] 200.000000 - 500.000000 : 5509 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[5] 100.000000 - 200.000000 : 7978 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[6] 50.000000 - 100.000000 : 5075 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[7] 20.000000 - 50.000000 : 2128 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[8] 10.000000 - 20.000000 : 1614 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[9] 5.000000 - 10.000000 : 2359 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[10] 2.000000 - 5.000000 : 4826 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[11] 1.000000 - 2.000000 : 3250 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[12] 0.500000 - 1.000000 : 3138 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[13] 0.200000 - 0.500000 : 5009 2024-03-23T06:20:43.812 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[14] 0.100000 - 0.200000 : 8266 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[15] 0.050000 - 0.100000 : 19443 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[16] 0.020000 - 0.050000 : 190099 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[17] 0.010000 - 0.020000 : 2493312 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[18] 0.000000 - 0.010000 : 5150672 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout:[ lseek] 0.000000 0.002038 118.168999 7904000 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[5] 100.000000 - 200.000000 : 2 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[6] 50.000000 - 100.000000 : 7 2024-03-23T06:20:43.813 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[7] 20.000000 - 50.000000 : 70 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[8] 10.000000 - 20.000000 : 128 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[9] 5.000000 - 10.000000 : 160 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[10] 2.000000 - 5.000000 : 447 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[11] 1.000000 - 2.000000 : 293 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[12] 0.500000 - 1.000000 : 286 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[13] 0.200000 - 0.500000 : 423 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[14] 0.100000 - 0.200000 : 516 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[15] 0.050000 - 0.100000 : 894 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[16] 0.020000 - 0.050000 : 3015 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[17] 0.010000 - 0.020000 : 3474 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[18] 0.000000 - 0.010000 : 7894285 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.814 INFO:tasks.workunit.client.0.smithi073.stdout:[ close] 0.004000 0.015098 20.226000 6175 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[7] 20.000000 - 50.000000 : 1 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[10] 2.000000 - 5.000000 : 2 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-03-23T06:20:43.815 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[12] 0.500000 - 1.000000 : 3 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[13] 0.200000 - 0.500000 : 2 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[14] 0.100000 - 0.200000 : 3 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[15] 0.050000 - 0.100000 : 8 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[16] 0.020000 - 0.050000 : 18 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[17] 0.010000 - 0.020000 : 2790 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: msec_range[18] 0.000000 - 0.010000 : 3347 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout: 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout:1.2% User Time 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout:19.8% System Time 2024-03-23T06:20:43.816 INFO:tasks.workunit.client.0.smithi073.stdout:21.1% CPU Utilization 2024-03-23T06:20:46.723 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-03-23T06:20:46.724 INFO:tasks.ceph.mon.b:Sent signal 18 2024-03-23T06:20:46.724 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-03-23T06:20:46.724 INFO:tasks.ceph.mon.c:Sent signal 18 2024-03-23T06:20:46.724 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:20:46.724 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:20:47.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.097+0000 7fc1bb200640 1 Processor -- start 2024-03-23T06:20:47.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.097+0000 7fc1bb200640 1 -- start start 2024-03-23T06:20:47.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.098+0000 7fc1bb200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:47.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1bb200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b4157b60 con 0x7fc1b40c03a0 2024-03-23T06:20:47.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1bb200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b40c0830 con 0x7fc1b41513f0 2024-03-23T06:20:47.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1bb200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b4158dc0 con 0x7fc1b40c5a10 2024-03-23T06:20:47.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1b3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc1b41513f0 0x7fc1b41586b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:60830/0 (socket says 172.21.15.73:60830) 2024-03-23T06:20:47.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 learned_addr learned my addr 172.21.15.73:0/1427942066 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:20:47.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:47.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.099+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:47.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.300+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:47.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.301+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:47.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.301+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:47.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.301+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:47.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.301+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:20:47.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.366+0000 7fc1b9200640 1 -- 172.21.15.73:0/1427942066 >> v1:172.21.15.73:6789/0 conn(0x7fc1b40c03a0 legacy=0x7fc1b4071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-03-23T06:20:47.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.366+0000 7fc1b9200640 1 -- 172.21.15.73:0/1427942066 >> v1:172.21.15.73:6789/0 conn(0x7fc1b40c03a0 legacy=0x7fc1b4071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:20:47.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.366+0000 7fc1b9200640 1 --1- 172.21.15.73:0/1427942066 >> v1:172.21.15.73:6789/0 conn(0x7fc1b40c03a0 0x7fc1b4071bc0 :-1 s=OPENED pgs=8 cs=1 l=1).handle_message read tag failed 2024-03-23T06:20:47.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.366+0000 7fc1b9200640 1 --1- 172.21.15.73:0/1427942066 >> v1:172.21.15.73:6789/0 conn(0x7fc1b40c03a0 0x7fc1b4071bc0 :-1 s=OPENED pgs=8 cs=1 l=1).fault on lossy channel, failing 2024-03-23T06:20:47.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.702+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:47.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.703+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:47.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.703+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:47.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.703+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:47.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:47.703+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:20:48.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:48.504+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:48.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:48.505+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:48.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:48.505+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:48.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:48.505+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:48.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:48.505+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.099+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 msgr2=0x7fc1b40bfe60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.099+0000 7fc1b2000640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc1b40c5a10 0x7fc1b40bfe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.099+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 >> v1:172.21.15.110:6789/0 conn(0x7fc1b41513f0 legacy=0x7fc1b41586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.099+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 >> v1:172.21.15.73:6789/0 conn(0x7fc1b40c03a0 legacy=0x7fc1b4071bc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.099+0000 7fc1b2000640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.099+0000 7fc1b2000640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.099+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b4158dc0 con 0x7fc1900061b0 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.099+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc190008d20 con 0x7fc190003640 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:50.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:20:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:50.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.100+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:20:50.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:50.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:20:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:20:50.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.301+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:20:50.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.702+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.702+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:20:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.702+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.702+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.702+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.703+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:20:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.703+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:50.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.703+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.703+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:50.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:50.703+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:20:51.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.504+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:51.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.504+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:20:51.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.504+0000 7fc1b3e00640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:51.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.504+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:51.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.504+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:20:51.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.504+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:51.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.505+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:20:51.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.505+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:20:51.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.505+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:20:51.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:51.505+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:20:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.099+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 msgr2=0x7fc190005a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.099+0000 7fc1b2000640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003640 0x7fc190005a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.099+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 msgr2=0x7fc190008670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:20:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.099+0000 7fc1b2000640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc1900061b0 0x7fc190008670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.099+0000 7fc1b9200640 1 -- 172.21.15.73:0/1427942066 reap_dead start 2024-03-23T06:20:53.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.100+0000 7fc1b2000640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc190003a80 0x7fc190006660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.100+0000 7fc1b2000640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc190006ba0 0x7fc190007050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.100+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b40c0b10 con 0x7fc190009120 2024-03-23T06:20:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.100+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b4158dc0 con 0x7fc190006ba0 2024-03-23T06:20:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.100+0000 7fc1b2000640 1 -- 172.21.15.73:0/1427942066 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc190008d20 con 0x7fc190003a80 2024-03-23T06:20:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.100+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.110:3300/0 conn(0x7fc190003a80 0x7fc190006660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.100+0000 7fc1b9200640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc190006ba0 0x7fc190007050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.101+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc190006ba0 msgr2=0x7fc190007050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:20:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.101+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc190006ba0 0x7fc190007050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.101+0000 7fc1b3400640 1 -- 172.21.15.73:0/1427942066 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636947470 0 0) 0x7fc1b40c0b10 con 0x7fc190009120 2024-03-23T06:20:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.101+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 >> v1:172.21.15.73:6789/0 conn(0x7fc190009120 legacy=0x7fc19000b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.101+0000 7fc1abe00640 1 -- 172.21.15.73:0/1427942066 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1900086c0 con 0x7fc190003a80 2024-03-23T06:20:53.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.104+0000 7fc1abe00640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190003a80 0x7fc190006660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40c85e0 tx=0x7fc19c02db00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4afaf9aa1a4f7ca6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.105+0000 7fc1b3400640 1 -- 172.21.15.73:0/1427942066 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c02f4b0 con 0x7fc190003a80 2024-03-23T06:20:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.105+0000 7fc1b3400640 1 -- 172.21.15.73:0/1427942066 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c02f630 con 0x7fc190003a80 2024-03-23T06:20:53.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.105+0000 7fc1b3400640 1 -- 172.21.15.73:0/1427942066 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c02f9e0 con 0x7fc190003a80 2024-03-23T06:20:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.106+0000 7fc1bb200640 1 -- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190003a80 msgr2=0x7fc190006660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.106+0000 7fc1bb200640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190003a80 0x7fc190006660 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc1b40c85e0 tx=0x7fc19c02db00 comp rx=0 tx=0).stop 2024-03-23T06:20:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.106+0000 7fc1bb200640 1 -- 172.21.15.73:0/1427942066 shutdown_connections 2024-03-23T06:20:53.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.106+0000 7fc1bb200640 1 --2- 172.21.15.73:0/1427942066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190003a80 0x7fc190006660 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.106+0000 7fc1bb200640 1 --2- 172.21.15.73:0/1427942066 >> v2:172.21.15.73:3300/0 conn(0x7fc190006ba0 0x7fc190007050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.106+0000 7fc1bb200640 1 -- 172.21.15.73:0/1427942066 >> 172.21.15.73:0/1427942066 conn(0x7fc1b406bb40 msgr2=0x7fc1b406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.107+0000 7fc1bb200640 1 -- 172.21.15.73:0/1427942066 shutdown_connections 2024-03-23T06:20:53.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.107+0000 7fc1bb200640 1 -- 172.21.15.73:0/1427942066 wait complete. 2024-03-23T06:20:53.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.109+0000 7fc1bb200640 1 Processor -- start 2024-03-23T06:20:53.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.110+0000 7fc1bb200640 1 -- start start 2024-03-23T06:20:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1bb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003a80 0x7fc1b4151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1bb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc190006ba0 0x7fc1b4155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1bb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190009120 0x7fc1b40c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1bb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4154520 con 0x7fc190006ba0 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1bb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4154aa0 con 0x7fc190009120 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1bb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40c31c0 con 0x7fc190003a80 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1abe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc190006ba0 0x7fc1b4155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1abe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc190006ba0 0x7fc1b4155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51934/0 (socket says 172.21.15.73:51934) 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1abe00640 1 -- 172.21.15.73:0/2887422242 learned_addr learned my addr 172.21.15.73:0/2887422242 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003a80 0x7fc1b4151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.111+0000 7fc1b9200640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190009120 0x7fc1b40c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.112+0000 7fc1abe00640 1 -- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003a80 msgr2=0x7fc1b4151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.112+0000 7fc1abe00640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003a80 0x7fc1b4151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.112+0000 7fc1abe00640 1 -- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190009120 msgr2=0x7fc1b40c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.112+0000 7fc1abe00640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190009120 0x7fc1b40c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.112+0000 7fc1abe00640 1 -- 172.21.15.73:0/2887422242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c00e040 con 0x7fc190006ba0 2024-03-23T06:20:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.112+0000 7fc1abe00640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc190006ba0 0x7fc1b4155680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc19c02db40 tx=0x7fc19c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.113+0000 7fc1b0c00640 1 -- 172.21.15.73:0/2887422242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c02f4b0 con 0x7fc190006ba0 2024-03-23T06:20:53.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.113+0000 7fc1b0c00640 1 -- 172.21.15.73:0/2887422242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c02fde0 con 0x7fc190006ba0 2024-03-23T06:20:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.113+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b41547c0 con 0x7fc190006ba0 2024-03-23T06:20:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.113+0000 7fc1b0c00640 1 -- 172.21.15.73:0/2887422242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c044480 con 0x7fc190006ba0 2024-03-23T06:20:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.113+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b40c2540 con 0x7fc190006ba0 2024-03-23T06:20:53.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.114+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b40c26d0 con 0x7fc190006ba0 2024-03-23T06:20:53.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.115+0000 7fc1b0c00640 1 -- 172.21.15.73:0/2887422242 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc19c0445e0 con 0x7fc190006ba0 2024-03-23T06:20:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.116+0000 7fc1b0c00640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc19006c760 0x7fc19006ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.116+0000 7fc1b0c00640 1 -- 172.21.15.73:0/2887422242 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fc19c0ad7c0 con 0x7fc190006ba0 2024-03-23T06:20:53.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.116+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc19006c760 0x7fc19006ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.117+0000 7fc1b3e00640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc19006c760 0x7fc19006ec20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009010 tx=0x7fc1a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.122+0000 7fc1b0c00640 1 -- 172.21.15.73:0/2887422242 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc19c078500 con 0x7fc190006ba0 2024-03-23T06:20:53.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.397+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc1b404e110 con 0x7fc190006ba0 2024-03-23T06:20:53.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.398+0000 7fc1b0c00640 1 -- 172.21.15.73:0/2887422242 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fc19c07bb20 con 0x7fc190006ba0 2024-03-23T06:20:53.398 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:20:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc19006c760 msgr2=0x7fc19006ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc19006c760 0x7fc19006ec20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009010 tx=0x7fc1a4009040 comp rx=0 tx=0).stop 2024-03-23T06:20:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc190006ba0 msgr2=0x7fc1b4155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc190006ba0 0x7fc1b4155680 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc19c02db40 tx=0x7fc19c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 shutdown_connections 2024-03-23T06:20:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190009120 0x7fc1b40c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc190006ba0 0x7fc1b4155680 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc19006c760 0x7fc19006ec20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 --2- 172.21.15.73:0/2887422242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190003a80 0x7fc1b4151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 >> 172.21.15.73:0/2887422242 conn(0x7fc1b406bb40 msgr2=0x7fc1b4071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 shutdown_connections 2024-03-23T06:20:53.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.401+0000 7fc1bb200640 1 -- 172.21.15.73:0/2887422242 wait complete. 2024-03-23T06:20:53.419 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:20:53.419 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:20:53.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:20:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.622+0000 7fcff4200640 1 Processor -- start 2024-03-23T06:20:53.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.623+0000 7fcff4200640 1 -- start start 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.624+0000 7fcff4200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec1536c0 0x7fcfec159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.624+0000 7fcff4200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfec0ca4d0 0x7fcfec0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.624+0000 7fcff4200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfec15d920 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.624+0000 7fcff4200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfec15cac0 con 0x7fcfec0ca4d0 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.624+0000 7fcff4200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec15cd10 con 0x7fcfec1536c0 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.624+0000 7fcff0e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfec0ca4d0 0x7fcfec0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.625+0000 7fcff0e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcfec0ca4d0 0x7fcfec0caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51942/0 (socket says 172.21.15.73:51942) 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.625+0000 7fcff0e00640 1 -- 172.21.15.73:0/3654946506 learned_addr learned my addr 172.21.15.73:0/3654946506 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:53.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.625+0000 7fcff1800640 1 --2- 172.21.15.73:0/3654946506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec1536c0 0x7fcfec159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.625+0000 7fcff0e00640 1 -- 172.21.15.73:0/3654946506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec1536c0 msgr2=0x7fcfec159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:20:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.625+0000 7fcff0e00640 1 --2- 172.21.15.73:0/3654946506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec1536c0 0x7fcfec159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.625+0000 7fcff0e00640 1 -- 172.21.15.73:0/3654946506 >> v1:172.21.15.110:6789/0 conn(0x7fcfec0c8eb0 legacy=0x7fcfec070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.625+0000 7fcfebe00640 1 -- 172.21.15.73:0/3654946506 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983705490 0 0) 0x7fcfec15d920 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.625+0000 7fcff0e00640 1 -- 172.21.15.73:0/3654946506 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec15cff0 con 0x7fcfec0ca4d0 2024-03-23T06:20:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.626+0000 7fcff0e00640 1 --2- 172.21.15.73:0/3654946506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0ca4d0 0x7fcfec0caa20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009870 tx=0x7fcfd802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac0a524d03415fa server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcfebe00640 1 -- 172.21.15.73:0/3654946506 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8030840 con 0x7fcfec0ca4d0 2024-03-23T06:20:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcfebe00640 1 -- 172.21.15.73:0/3654946506 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd80309a0 con 0x7fcfec0ca4d0 2024-03-23T06:20:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcfebe00640 1 -- 172.21.15.73:0/3654946506 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8030d30 con 0x7fcfec0ca4d0 2024-03-23T06:20:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcff4200640 1 -- 172.21.15.73:0/3654946506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0ca4d0 msgr2=0x7fcfec0caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcff4200640 1 --2- 172.21.15.73:0/3654946506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0ca4d0 0x7fcfec0caa20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009870 tx=0x7fcfd802b980 comp rx=0 tx=0).stop 2024-03-23T06:20:53.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcff4200640 1 -- 172.21.15.73:0/3654946506 shutdown_connections 2024-03-23T06:20:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcff4200640 1 --2- 172.21.15.73:0/3654946506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0ca4d0 0x7fcfec0caa20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcff4200640 1 --2- 172.21.15.73:0/3654946506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec1536c0 0x7fcfec159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcff4200640 1 -- 172.21.15.73:0/3654946506 >> 172.21.15.73:0/3654946506 conn(0x7fcfec069cb0 msgr2=0x7fcfec06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcff4200640 1 -- 172.21.15.73:0/3654946506 shutdown_connections 2024-03-23T06:20:53.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.627+0000 7fcff4200640 1 -- 172.21.15.73:0/3654946506 wait complete. 2024-03-23T06:20:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.629+0000 7fcff4200640 1 Processor -- start 2024-03-23T06:20:53.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.629+0000 7fcff4200640 1 -- start start 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff4200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfec0c8eb0 0x7fcfec0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff4200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec0ca4d0 0x7fcfec14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff4200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec1536c0 0x7fcfec15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff4200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec14ed80 con 0x7fcfec1536c0 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff4200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec0c3f30 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff4200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec157240 con 0x7fcfec0ca4d0 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff2200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec1536c0 0x7fcfec15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfec0c8eb0 0x7fcfec0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.630+0000 7fcff0e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec0ca4d0 0x7fcfec14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfec0c8eb0 0x7fcfec0c38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:53552/0 (socket says 172.21.15.73:53552) 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff1800640 1 -- 172.21.15.73:0/2109910615 learned_addr learned my addr 172.21.15.73:0/2109910615 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff1800640 1 -- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec0ca4d0 msgr2=0x7fcfec14c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff1800640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfec0ca4d0 0x7fcfec14c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff1800640 1 -- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec1536c0 msgr2=0x7fcfec15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff1800640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec1536c0 0x7fcfec15bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff1800640 1 -- 172.21.15.73:0/2109910615 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80094d0 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff2200640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec1536c0 0x7fcfec15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:20:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcff1800640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfec0c8eb0 0x7fcfec0c38f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000e870 tx=0x7fcfe000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.631+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00094f0 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.632+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000c940 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.632+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000ccf0 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.632+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec1574e0 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.632+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec14e9a0 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.633+0000 7fcff4200640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0c48b0 0x7fcfec15c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.633+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec073bf0 con 0x7fcfec0c48b0 2024-03-23T06:20:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.633+0000 7fcff0e00640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0c48b0 0x7fcfec15c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.633+0000 7fcff0e00640 1 -- 172.21.15.73:0/2109910615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfec15d5b0 con 0x7fcfec0c48b0 2024-03-23T06:20:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.634+0000 7fcff0e00640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0c48b0 0x7fcfec15c040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfec06cc80 tx=0x7fcfd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.634+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8039c50 con 0x7fcfec0c48b0 2024-03-23T06:20:53.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.634+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcfe0013470 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.635+0000 7fcfe9600640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfcc06acd0 0x7fcfcc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.635+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fcfe0089660 con 0x7fcfec0c8eb0 2024-03-23T06:20:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.635+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fcfd8039db0 con 0x7fcfec0c48b0 2024-03-23T06:20:53.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.635+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0c48b0 msgr2=0x7fcfec15c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.635+0000 7fcfe9600640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0c48b0 0x7fcfec15c040 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfec06cc80 tx=0x7fcfd80046c0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.635+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0c48b0 msgr2=0x7fcfec15c040 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.635+0000 7fcfe9600640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec0c48b0 0x7fcfec15c040 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcfec06cc80 tx=0x7fcfd80046c0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.635+0000 7fcff2200640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfcc06acd0 0x7fcfcc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.636+0000 7fcff2200640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfcc06acd0 0x7fcfcc06d190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40012e0 tx=0x7fcfe4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.642+0000 7fcff4200640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec14f1a0 0x7fcfec14f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.642+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec14eb90 con 0x7fcfec14f1a0 2024-03-23T06:20:53.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.642+0000 7fcff0e00640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec14f1a0 0x7fcfec14f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.643+0000 7fcff0e00640 1 -- 172.21.15.73:0/2109910615 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcfec0c8460 con 0x7fcfec14f1a0 2024-03-23T06:20:53.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.643+0000 7fcff0e00640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec14f1a0 0x7fcfec14f5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8000c00 tx=0x7fcfd8009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.643+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd804d650 con 0x7fcfec14f1a0 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4468 (secure 0 0 0) 0x7fcfd804d7b0 con 0x7fcfec14f1a0 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec14f1a0 msgr2=0x7fcfec14f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcfe9600640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec14f1a0 0x7fcfec14f5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8000c00 tx=0x7fcfd8009240 comp rx=0 tx=0).stop 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcfe9600640 1 -- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec14f1a0 msgr2=0x7fcfec14f5b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcfe9600640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfec14f1a0 0x7fcfec14f5b0 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8000c00 tx=0x7fcfd8009240 comp rx=0 tx=0).stop 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:20:53.644 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 102, 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 1, 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:53.645 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:53.646 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:53.647 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:53.648 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:20:53.650 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:20:53.651 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:53.652 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.653 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:20:53.654 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:20:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfcc06acd0 msgr2=0x7fcfcc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff4200640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcfcc06acd0 0x7fcfcc06d190 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcfe40012e0 tx=0x7fcfe4009040 comp rx=0 tx=0).stop 2024-03-23T06:20:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfec0c8eb0 msgr2=0x7fcfec0c38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff4200640 1 --2- 172.21.15.73:0/2109910615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfec0c8eb0 0x7fcfec0c38f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000e870 tx=0x7fcfe000ed30 comp rx=0 tx=0).stop 2024-03-23T06:20:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff2200640 1 -- 172.21.15.73:0/2109910615 reap_dead start 2024-03-23T06:20:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff2200640 1 -- 172.21.15.73:0/2109910615 reap_dead start 2024-03-23T06:20:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 shutdown_connections 2024-03-23T06:20:53.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 >> 172.21.15.73:0/2109910615 conn(0x7fcfec069cb0 msgr2=0x7fcfec0c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:53.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 shutdown_connections 2024-03-23T06:20:53.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.644+0000 7fcff4200640 1 -- 172.21.15.73:0/2109910615 wait complete. 2024-03-23T06:20:53.663 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:20:53.663 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:20:53.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.869+0000 7fd818000640 1 Processor -- start 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.869+0000 7fd818000640 1 -- start start 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd818000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd81008b540 0x7fd81016a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd818000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810166840 0x7fd810166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd818000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81016a6d0 con 0x7fd810072530 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd818000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8100703f0 con 0x7fd81008b540 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd818000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd810167210 con 0x7fd810166840 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd814c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd81008b540 0x7fd81016a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd814c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd81008b540 0x7fd81016a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51976/0 (socket says 172.21.15.73:51976) 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd815600640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd810072530 0x7fd8100caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57026/0 (socket says 172.21.15.73:57026) 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd814c00640 1 -- 172.21.15.73:0/1746156758 learned_addr learned my addr 172.21.15.73:0/1746156758 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:53.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.872+0000 7fd80fe00640 1 -- 172.21.15.73:0/1746156758 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105311764 0 0) 0x7fd804001110 con 0x7fd810072530 2024-03-23T06:20:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.912+0000 7fd80fe00640 1 -- 172.21.15.73:0/1746156758 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f8003420 con 0x7fd810072530 2024-03-23T06:20:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.871+0000 7fd816000640 1 --2- 172.21.15.73:0/1746156758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810166840 0x7fd810166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.913+0000 7fd816000640 1 -- 172.21.15.73:0/1746156758 >> v2:172.21.15.73:3300/0 conn(0x7fd81008b540 msgr2=0x7fd81016a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:20:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.913+0000 7fd816000640 1 --2- 172.21.15.73:0/1746156758 >> v2:172.21.15.73:3300/0 conn(0x7fd81008b540 0x7fd81016a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.913+0000 7fd816000640 1 -- 172.21.15.73:0/1746156758 >> v1:172.21.15.73:6789/0 conn(0x7fd810072530 legacy=0x7fd8100caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.913+0000 7fd80fe00640 1 -- 172.21.15.73:0/1746156758 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1290307856 0 0) 0x7fd7f8003420 con 0x7fd810072530 2024-03-23T06:20:53.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.913+0000 7fd816000640 1 -- 172.21.15.73:0/1746156758 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd810072910 con 0x7fd810166840 2024-03-23T06:20:53.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.915+0000 7fd816000640 1 --2- 172.21.15.73:0/1746156758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810166840 0x7fd810166cd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd808009d90 tx=0x7fd80802bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c38684445c0c52 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.915+0000 7fd80fe00640 1 -- 172.21.15.73:0/1746156758 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804001800 con 0x7fd810166840 2024-03-23T06:20:53.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.915+0000 7fd80fe00640 1 -- 172.21.15.73:0/1746156758 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80802c8a0 con 0x7fd810166840 2024-03-23T06:20:53.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.915+0000 7fd80fe00640 1 -- 172.21.15.73:0/1746156758 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80802cc30 con 0x7fd810166840 2024-03-23T06:20:53.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.916+0000 7fd818000640 1 -- 172.21.15.73:0/1746156758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810166840 msgr2=0x7fd810166cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.916+0000 7fd818000640 1 --2- 172.21.15.73:0/1746156758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810166840 0x7fd810166cd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd808009d90 tx=0x7fd80802bd70 comp rx=0 tx=0).stop 2024-03-23T06:20:53.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.916+0000 7fd818000640 1 -- 172.21.15.73:0/1746156758 shutdown_connections 2024-03-23T06:20:53.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.916+0000 7fd818000640 1 --2- 172.21.15.73:0/1746156758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810166840 0x7fd810166cd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.916+0000 7fd818000640 1 --2- 172.21.15.73:0/1746156758 >> v2:172.21.15.73:3300/0 conn(0x7fd81008b540 0x7fd81016a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.916+0000 7fd818000640 1 -- 172.21.15.73:0/1746156758 >> 172.21.15.73:0/1746156758 conn(0x7fd810069cb0 msgr2=0x7fd81006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:53.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.917+0000 7fd818000640 1 -- 172.21.15.73:0/1746156758 shutdown_connections 2024-03-23T06:20:53.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.917+0000 7fd818000640 1 -- 172.21.15.73:0/1746156758 wait complete. 2024-03-23T06:20:53.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.919+0000 7fd818000640 1 Processor -- start 2024-03-23T06:20:53.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.919+0000 7fd818000640 1 -- start start 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd818000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810072530 0x7fd8101ff220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd818000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd81008b540 0x7fd8101ff760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd818000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd810166840 0x7fd810161930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd818000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c45d0 con 0x7fd810166840 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd818000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd810164a00 con 0x7fd81008b540 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd818000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101ffd90 con 0x7fd810072530 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd816000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd810166840 0x7fd810161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd816000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd810166840 0x7fd810161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51990/0 (socket says 172.21.15.73:51990) 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd816000640 1 -- 172.21.15.73:0/998169078 learned_addr learned my addr 172.21.15.73:0/998169078 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd815600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810072530 0x7fd8101ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.920+0000 7fd814c00640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd81008b540 0x7fd8101ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd816000640 1 -- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810072530 msgr2=0x7fd8101ff220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd816000640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810072530 0x7fd8101ff220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd816000640 1 -- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd81008b540 msgr2=0x7fd8101ff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd816000640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd81008b540 0x7fd8101ff760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd816000640 1 -- 172.21.15.73:0/998169078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808009a70 con 0x7fd810166840 2024-03-23T06:20:53.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd815600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd810072530 0x7fd8101ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:20:53.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd816000640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd810166840 0x7fd810161930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd808009d90 tx=0x7fd808004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd808034e50 con 0x7fd810166840 2024-03-23T06:20:53.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80802ce90 con 0x7fd810166840 2024-03-23T06:20:53.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd808040690 con 0x7fd810166840 2024-03-23T06:20:53.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.921+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8100b0810 con 0x7fd810166840 2024-03-23T06:20:53.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.922+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8100c47e0 con 0x7fd810166840 2024-03-23T06:20:53.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.923+0000 7fd818000640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd810160080 0x7fd810161e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.923+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd810073bf0 con 0x7fd810160080 2024-03-23T06:20:53.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.923+0000 7fd815600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd810160080 0x7fd810161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.924+0000 7fd815600640 1 -- 172.21.15.73:0/998169078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8101663b0 con 0x7fd810160080 2024-03-23T06:20:53.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.924+0000 7fd815600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd810160080 0x7fd810161e70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd80400fb90 tx=0x7fd80400d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.924+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80400dc20 con 0x7fd810160080 2024-03-23T06:20:53.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.924+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd8080407f0 con 0x7fd810166840 2024-03-23T06:20:53.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.925+0000 7fd80d600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7f006aca0 0x7fd7f006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.925+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd8080ac0b0 con 0x7fd810166840 2024-03-23T06:20:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.925+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd80400dd80 con 0x7fd810160080 2024-03-23T06:20:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.925+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd810160080 msgr2=0x7fd810161e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.925+0000 7fd80d600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd810160080 0x7fd810161e70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd80400fb90 tx=0x7fd80400d520 comp rx=0 tx=0).stop 2024-03-23T06:20:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.925+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd810160080 msgr2=0x7fd810161e70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.925+0000 7fd80d600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd810160080 0x7fd810161e70 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd80400fb90 tx=0x7fd80400d520 comp rx=0 tx=0).stop 2024-03-23T06:20:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.926+0000 7fd814c00640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7f006aca0 0x7fd7f006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.926+0000 7fd814c00640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7f006aca0 0x7fd7f006d160 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd8100c44a0 tx=0x7fd7fc00c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.933+0000 7fd818000640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8100b0f90 0x7fd810159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:53.933 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.933+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8100c8eb0 con 0x7fd8100b0f90 2024-03-23T06:20:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.934+0000 7fd815600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8100b0f90 0x7fd810159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.934+0000 7fd815600640 1 -- 172.21.15.73:0/998169078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd8100ca090 con 0x7fd8100b0f90 2024-03-23T06:20:53.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.935+0000 7fd815600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8100b0f90 0x7fd810159210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd80400fb90 tx=0x7fd8040013c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.935+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804024070 con 0x7fd8100b0f90 2024-03-23T06:20:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.935+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5119 (secure 0 0 0) 0x7fd8040076b0 con 0x7fd8100b0f90 2024-03-23T06:20:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.935+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8100b0f90 msgr2=0x7fd810159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.935+0000 7fd80d600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8100b0f90 0x7fd810159210 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd80400fb90 tx=0x7fd8040013c0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.935+0000 7fd80d600640 1 -- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8100b0f90 msgr2=0x7fd810159210 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:53.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.935+0000 7fd80d600640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8100b0f90 0x7fd810159210 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 102, 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:20:53.936 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:53.937 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.938 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:53.939 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.940 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:20:53.942 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.944 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:53.945 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:20:53.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:53.947 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:20:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:53.948 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:20:53.948 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7f006aca0 msgr2=0x7fd7f006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd818000640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd7f006aca0 0x7fd7f006d160 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd8100c44a0 tx=0x7fd7fc00c040 comp rx=0 tx=0).stop 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd810166840 msgr2=0x7fd810161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd818000640 1 --2- 172.21.15.73:0/998169078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd810166840 0x7fd810161930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd808009d90 tx=0x7fd808004a40 comp rx=0 tx=0).stop 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd816000640 1 -- 172.21.15.73:0/998169078 reap_dead start 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd816000640 1 -- 172.21.15.73:0/998169078 reap_dead start 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 shutdown_connections 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 >> 172.21.15.73:0/998169078 conn(0x7fd810069cb0 msgr2=0x7fd8100c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 shutdown_connections 2024-03-23T06:20:53.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:53.936+0000 7fd818000640 1 -- 172.21.15.73:0/998169078 wait complete. 2024-03-23T06:20:53.955 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:20:53.955 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:20:53.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:20:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.161+0000 7eff53e00640 1 Processor -- start 2024-03-23T06:20:54.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.161+0000 7eff53e00640 1 -- start start 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff53e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff540c8390 0x7eff540c8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff53e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff54156ac0 0x7eff540c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff53e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff54156000 con 0x7eff541595f0 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff53e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540c8cb0 con 0x7eff54156ac0 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff53e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540cc000 con 0x7eff540c8390 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff52000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7eff541595f0 0x7eff540cb850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57040/0 (socket says 172.21.15.73:57040) 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff52000640 1 -- 172.21.15.73:0/2426502717 learned_addr learned my addr 172.21.15.73:0/2426502717 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff52a00640 1 --2- 172.21.15.73:0/2426502717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff540c8390 0x7eff540c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.163+0000 7eff53400640 1 --2- 172.21.15.73:0/2426502717 >> v2:172.21.15.110:3300/0 conn(0x7eff54156ac0 0x7eff540c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.164+0000 7eff51600640 1 -- 172.21.15.73:0/2426502717 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208171266 0 0) 0x7eff54156000 con 0x7eff541595f0 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.164+0000 7eff51600640 1 -- 172.21.15.73:0/2426502717 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff34005730 con 0x7eff541595f0 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.164+0000 7eff52a00640 1 -- 172.21.15.73:0/2426502717 >> v2:172.21.15.110:3300/0 conn(0x7eff54156ac0 msgr2=0x7eff540c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.164+0000 7eff52a00640 1 --2- 172.21.15.73:0/2426502717 >> v2:172.21.15.110:3300/0 conn(0x7eff54156ac0 0x7eff540c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.164+0000 7eff52a00640 1 -- 172.21.15.73:0/2426502717 >> v1:172.21.15.73:6789/0 conn(0x7eff541595f0 legacy=0x7eff540cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.164+0000 7eff52a00640 1 -- 172.21.15.73:0/2426502717 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540cc2e0 con 0x7eff540c8390 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.164+0000 7eff53400640 1 --2- 172.21.15.73:0/2426502717 >> v2:172.21.15.110:3300/0 conn(0x7eff54156ac0 0x7eff540c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.165+0000 7eff52a00640 1 --2- 172.21.15.73:0/2426502717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff540c8390 0x7eff540c8770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff440097a0 tx=0x7eff4402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98837c96dec5b0a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:54.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.165+0000 7eff51600640 1 -- 172.21.15.73:0/2426502717 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4402d040 con 0x7eff540c8390 2024-03-23T06:20:54.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff51600640 1 -- 172.21.15.73:0/2426502717 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44031810 con 0x7eff540c8390 2024-03-23T06:20:54.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff51600640 1 -- 172.21.15.73:0/2426502717 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44031ba0 con 0x7eff540c8390 2024-03-23T06:20:54.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff53e00640 1 -- 172.21.15.73:0/2426502717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff540c8390 msgr2=0x7eff540c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff53e00640 1 --2- 172.21.15.73:0/2426502717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff540c8390 0x7eff540c8770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff440097a0 tx=0x7eff4402b8b0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff53e00640 1 -- 172.21.15.73:0/2426502717 shutdown_connections 2024-03-23T06:20:54.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff53e00640 1 --2- 172.21.15.73:0/2426502717 >> v2:172.21.15.110:3300/0 conn(0x7eff54156ac0 0x7eff540c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff53e00640 1 --2- 172.21.15.73:0/2426502717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff540c8390 0x7eff540c8770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff53e00640 1 -- 172.21.15.73:0/2426502717 >> 172.21.15.73:0/2426502717 conn(0x7eff5406adc0 msgr2=0x7eff5406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:54.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff53e00640 1 -- 172.21.15.73:0/2426502717 shutdown_connections 2024-03-23T06:20:54.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.166+0000 7eff53e00640 1 -- 172.21.15.73:0/2426502717 wait complete. 2024-03-23T06:20:54.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.168+0000 7eff53e00640 1 Processor -- start 2024-03-23T06:20:54.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.168+0000 7eff53e00640 1 -- start start 2024-03-23T06:20:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff540c8390 0x7eff541ef370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff54156ac0 0x7eff5414a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff541595f0 0x7eff540c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5414e4f0 con 0x7eff541595f0 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540cbe00 con 0x7eff540c8390 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff541ee960 con 0x7eff54156ac0 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff541595f0 0x7eff540c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff541595f0 0x7eff540c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52002/0 (socket says 172.21.15.73:52002) 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff53400640 1 -- 172.21.15.73:0/3811134697 learned_addr learned my addr 172.21.15.73:0/3811134697 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff52a00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff540c8390 0x7eff541ef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.169+0000 7eff52000640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff54156ac0 0x7eff5414a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff53400640 1 -- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff54156ac0 msgr2=0x7eff5414a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff53400640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff54156ac0 0x7eff5414a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff53400640 1 -- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff540c8390 msgr2=0x7eff541ef370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff53400640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff540c8390 0x7eff541ef370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff53400640 1 -- 172.21.15.73:0/3811134697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009400 con 0x7eff541595f0 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff53400640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff541595f0 0x7eff540c9dd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00e850 tx=0x7eff4c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:54.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c009660 con 0x7eff541595f0 2024-03-23T06:20:54.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00c940 con 0x7eff541595f0 2024-03-23T06:20:54.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff44009400 con 0x7eff541595f0 2024-03-23T06:20:54.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.170+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00ccd0 con 0x7eff541595f0 2024-03-23T06:20:54.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.171+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff540cbb20 con 0x7eff541595f0 2024-03-23T06:20:54.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.171+0000 7eff53e00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff5414ecc0 0x7eff540ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.171+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff54073980 con 0x7eff5414ecc0 2024-03-23T06:20:54.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.172+0000 7eff52a00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff5414ecc0 0x7eff540ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.172+0000 7eff52a00640 1 -- 172.21.15.73:0/3811134697 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff541565a0 con 0x7eff5414ecc0 2024-03-23T06:20:54.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.172+0000 7eff52a00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff5414ecc0 0x7eff540ca310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff5406bda0 tx=0x7eff44004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:54.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.173+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44044400 con 0x7eff5414ecc0 2024-03-23T06:20:54.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.173+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7eff4c013470 con 0x7eff541595f0 2024-03-23T06:20:54.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.173+0000 7eff4aa00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff3006aca0 0x7eff3006d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.174+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7eff4c0897d0 con 0x7eff541595f0 2024-03-23T06:20:54.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.174+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7eff440393b0 con 0x7eff5414ecc0 2024-03-23T06:20:54.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.174+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff5414ecc0 msgr2=0x7eff540ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.174+0000 7eff4aa00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff5414ecc0 0x7eff540ca310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff5406bda0 tx=0x7eff44004730 comp rx=0 tx=0).stop 2024-03-23T06:20:54.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.174+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff5414ecc0 msgr2=0x7eff540ca310 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:54.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.174+0000 7eff4aa00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff5414ecc0 0x7eff540ca310 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff5406bda0 tx=0x7eff44004730 comp rx=0 tx=0).stop 2024-03-23T06:20:54.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.174+0000 7eff52000640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff3006aca0 0x7eff3006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.174+0000 7eff52000640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff3006aca0 0x7eff3006d160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7eff540c8360 tx=0x7eff3c001a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.181+0000 7eff53e00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff541eead0 0x7eff5414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.181+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff541562c0 con 0x7eff541eead0 2024-03-23T06:20:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.181+0000 7eff52a00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff541eead0 0x7eff5414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.181+0000 7eff52a00640 1 -- 172.21.15.73:0/3811134697 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7eff54156f40 con 0x7eff541eead0 2024-03-23T06:20:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff52a00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff541eead0 0x7eff5414f340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff440097a0 tx=0x7eff440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44039c00 con 0x7eff541eead0 2024-03-23T06:20:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4636 (secure 0 0 0) 0x7eff44039d60 con 0x7eff541eead0 2024-03-23T06:20:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff541eead0 msgr2=0x7eff5414f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff4aa00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff541eead0 0x7eff5414f340 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff440097a0 tx=0x7eff440046c0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff4aa00640 1 -- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff541eead0 msgr2=0x7eff5414f340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:20:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff4aa00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff541eead0 0x7eff5414f340 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff440097a0 tx=0x7eff440046c0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 102, 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:20:54.183 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:20:54.184 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:20:54.185 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:20:54.186 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.187 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:54.188 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:54.189 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:20:54.190 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:54.191 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:54.192 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:20:54.193 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff3006aca0 msgr2=0x7eff3006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff53e00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7eff3006aca0 0x7eff3006d160 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7eff540c8360 tx=0x7eff3c001a90 comp rx=0 tx=0).stop 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff541595f0 msgr2=0x7eff540c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff53e00640 1 --2- 172.21.15.73:0/3811134697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff541595f0 0x7eff540c9dd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00e850 tx=0x7eff4c00ed10 comp rx=0 tx=0).stop 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff53400640 1 -- 172.21.15.73:0/3811134697 reap_dead start 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.182+0000 7eff53400640 1 -- 172.21.15.73:0/3811134697 reap_dead start 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.183+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 shutdown_connections 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.183+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 >> 172.21.15.73:0/3811134697 conn(0x7eff5406adc0 msgr2=0x7eff540c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.183+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 shutdown_connections 2024-03-23T06:20:54.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.183+0000 7eff53e00640 1 -- 172.21.15.73:0/3811134697 wait complete. 2024-03-23T06:20:54.201 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:20:54.201 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:20:54.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:20:54.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.400+0000 7fab8ee00640 1 Processor -- start 2024-03-23T06:20:54.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.400+0000 7fab8ee00640 1 -- start start 2024-03-23T06:20:54.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.401+0000 7fab8ee00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab88150100 0x7fab880c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.401+0000 7fab8ee00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab880c6fe0 0x7fab88156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.401+0000 7fab8ee00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab880c7e10 0x7fab88071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.401+0000 7fab8ee00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8806f9b0 con 0x7fab88150100 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.401+0000 7fab8ee00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab88070250 con 0x7fab880c6fe0 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.401+0000 7fab8ee00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab880c0150 con 0x7fab880c7e10 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab87e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab88150100 0x7fab880c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab87e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab88150100 0x7fab880c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52016/0 (socket says 172.21.15.73:52016) 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab87e00640 1 -- 172.21.15.73:0/2454985946 learned_addr learned my addr 172.21.15.73:0/2454985946 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab7f400640 1 --2- 172.21.15.73:0/2454985946 >> v2:172.21.15.110:3300/0 conn(0x7fab880c6fe0 0x7fab88156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab8ce00640 1 --2- 172.21.15.73:0/2454985946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab880c7e10 0x7fab88071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab87e00640 1 -- 172.21.15.73:0/2454985946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab880c7e10 msgr2=0x7fab88071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab87e00640 1 --2- 172.21.15.73:0/2454985946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab880c7e10 0x7fab88071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab87e00640 1 -- 172.21.15.73:0/2454985946 >> v2:172.21.15.110:3300/0 conn(0x7fab880c6fe0 msgr2=0x7fab88156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab87e00640 1 --2- 172.21.15.73:0/2454985946 >> v2:172.21.15.110:3300/0 conn(0x7fab880c6fe0 0x7fab88156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.402+0000 7fab87e00640 1 -- 172.21.15.73:0/2454985946 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab880c03f0 con 0x7fab88150100 2024-03-23T06:20:54.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.403+0000 7fab87e00640 1 --2- 172.21.15.73:0/2454985946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab88150100 0x7fab880c6aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fab880b11b0 tx=0x7fab7802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379cfb3d67f299a server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:54.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab87400640 1 -- 172.21.15.73:0/2454985946 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab780317e0 con 0x7fab88150100 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab87400640 1 -- 172.21.15.73:0/2454985946 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78031940 con 0x7fab88150100 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab87400640 1 -- 172.21.15.73:0/2454985946 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78031cd0 con 0x7fab88150100 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab8ee00640 1 -- 172.21.15.73:0/2454985946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab88150100 msgr2=0x7fab880c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2454985946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab88150100 0x7fab880c6aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fab880b11b0 tx=0x7fab7802b880 comp rx=0 tx=0).stop 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab8ee00640 1 -- 172.21.15.73:0/2454985946 shutdown_connections 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2454985946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab880c7e10 0x7fab88071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2454985946 >> v2:172.21.15.110:3300/0 conn(0x7fab880c6fe0 0x7fab88156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2454985946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab88150100 0x7fab880c6aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab8ee00640 1 -- 172.21.15.73:0/2454985946 >> 172.21.15.73:0/2454985946 conn(0x7fab8806bb40 msgr2=0x7fab8806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.404+0000 7fab8ee00640 1 -- 172.21.15.73:0/2454985946 shutdown_connections 2024-03-23T06:20:54.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.405+0000 7fab8ee00640 1 -- 172.21.15.73:0/2454985946 wait complete. 2024-03-23T06:20:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.406+0000 7fab8ee00640 1 Processor -- start 2024-03-23T06:20:54.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.406+0000 7fab8ee00640 1 -- start start 2024-03-23T06:20:54.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.407+0000 7fab8ee00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab880c7e10 0x7fab8806d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.407+0000 7fab8ee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab88150100 0x7fab88154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.407+0000 7fab8ee00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab88155e80 0x7fab881ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.407+0000 7fab8ee00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8814d9c0 con 0x7fab880c7e10 2024-03-23T06:20:54.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.407+0000 7fab8ee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab881f2680 con 0x7fab88150100 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.407+0000 7fab8ee00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab881f28d0 con 0x7fab88155e80 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab880c7e10 0x7fab8806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab880c7e10 0x7fab8806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52028/0 (socket says 172.21.15.73:52028) 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 -- 172.21.15.73:0/2577834654 learned_addr learned my addr 172.21.15.73:0/2577834654 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab7f400640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab88150100 0x7fab88154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab8ce00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab88155e80 0x7fab881ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 -- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab88155e80 msgr2=0x7fab881ef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab88155e80 0x7fab881ef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 -- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab88150100 msgr2=0x7fab88154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab88150100 0x7fab88154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 -- 172.21.15.73:0/2577834654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab780094d0 con 0x7fab880c7e10 2024-03-23T06:20:54.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.408+0000 7fab87e00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab880c7e10 0x7fab8806d910 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:54.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.409+0000 7fab84c00640 1 -- 172.21.15.73:0/2577834654 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78032880 con 0x7fab880c7e10 2024-03-23T06:20:54.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.409+0000 7fab84c00640 1 -- 172.21.15.73:0/2577834654 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab780329e0 con 0x7fab880c7e10 2024-03-23T06:20:54.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.409+0000 7fab84c00640 1 -- 172.21.15.73:0/2577834654 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78032d90 con 0x7fab880c7e10 2024-03-23T06:20:54.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.409+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab881f2bb0 con 0x7fab880c7e10 2024-03-23T06:20:54.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.409+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab881f3170 con 0x7fab880c7e10 2024-03-23T06:20:54.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.410+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab881ef110 con 0x7fab880c7e10 2024-03-23T06:20:54.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.412+0000 7fab84c00640 1 -- 172.21.15.73:0/2577834654 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fab7804e450 con 0x7fab880c7e10 2024-03-23T06:20:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.413+0000 7fab84c00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fab6406ac30 0x7fab6406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:20:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.413+0000 7fab84c00640 1 -- 172.21.15.73:0/2577834654 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fab780ab690 con 0x7fab880c7e10 2024-03-23T06:20:54.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.413+0000 7fab7f400640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fab6406ac30 0x7fab6406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:20:54.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.414+0000 7fab7f400640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fab6406ac30 0x7fab6406d0f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab8806c5b0 tx=0x7fab70009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:20:54.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.417+0000 7fab84c00640 1 -- 172.21.15.73:0/2577834654 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fab78076540 con 0x7fab880c7e10 2024-03-23T06:20:54.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.689+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fab880c74c0 con 0x7fab880c7e10 2024-03-23T06:20:54.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.691+0000 7fab84c00640 1 -- 172.21.15.73:0/2577834654 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fab78079b60 con 0x7fab880c7e10 2024-03-23T06:20:54.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fab6406ac30 msgr2=0x7fab6406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fab6406ac30 0x7fab6406d0f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab8806c5b0 tx=0x7fab70009190 comp rx=0 tx=0).stop 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab880c7e10 msgr2=0x7fab8806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab880c7e10 0x7fab8806d910 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab780046c0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 shutdown_connections 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fab6406ac30 0x7fab6406d0f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab88155e80 0x7fab881ef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab88150100 0x7fab88154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 --2- 172.21.15.73:0/2577834654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab880c7e10 0x7fab8806d910 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.694+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 >> 172.21.15.73:0/2577834654 conn(0x7fab8806bb40 msgr2=0x7fab88071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.695+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 shutdown_connections 2024-03-23T06:20:54.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:20:54.695+0000 7fab8ee00640 1 -- 172.21.15.73:0/2577834654 wait complete. 2024-03-23T06:20:54.806 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:21:04.807 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:21:04.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.121+0000 7fda8fe00640 1 Processor -- start 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.121+0000 7fda8fe00640 1 -- start start 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.123+0000 7fda8fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fda90157ae0 0x7fda900ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.123+0000 7fda8fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda90160d50 0x7fda900c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.123+0000 7fda8fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda900b2be0 0x7fda900c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.123+0000 7fda8fe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda901612b0 con 0x7fda90160d50 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.123+0000 7fda8fe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda90161590 con 0x7fda90157ae0 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.123+0000 7fda8fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda90161870 con 0x7fda900b2be0 2024-03-23T06:21:05.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.124+0000 7fda8f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda900b2be0 0x7fda900c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.124+0000 7fda8f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda900b2be0 0x7fda900c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:38932/0 (socket says 172.21.15.73:38932) 2024-03-23T06:21:05.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.124+0000 7fda8f400640 1 -- 172.21.15.73:0/2571821077 learned_addr learned my addr 172.21.15.73:0/2571821077 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.125+0000 7fda8f400640 1 -- 172.21.15.73:0/2571821077 >> v2:172.21.15.110:3300/0 conn(0x7fda90157ae0 msgr2=0x7fda900ca8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-23T06:21:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.125+0000 7fda8f400640 1 --2- 172.21.15.73:0/2571821077 >> v2:172.21.15.110:3300/0 conn(0x7fda90157ae0 0x7fda900ca8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.125+0000 7fda8f400640 1 -- 172.21.15.73:0/2571821077 >> v2:172.21.15.73:3300/0 conn(0x7fda90160d50 msgr2=0x7fda900c9930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.125+0000 7fda8f400640 1 --2- 172.21.15.73:0/2571821077 >> v2:172.21.15.73:3300/0 conn(0x7fda90160d50 0x7fda900c9930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.125+0000 7fda8f400640 1 -- 172.21.15.73:0/2571821077 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90161b50 con 0x7fda900b2be0 2024-03-23T06:21:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.128+0000 7fda8f400640 1 --2- 172.21.15.73:0/2571821077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda900b2be0 0x7fda900c9e70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda9008c730 tx=0x7fda8802bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e852c22b82826f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:05.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.128+0000 7fda8d600640 1 -- 172.21.15.73:0/2571821077 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8802cb40 con 0x7fda900b2be0 2024-03-23T06:21:05.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.129+0000 7fda8d600640 1 -- 172.21.15.73:0/2571821077 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8802cca0 con 0x7fda900b2be0 2024-03-23T06:21:05.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.129+0000 7fda8d600640 1 -- 172.21.15.73:0/2571821077 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88034610 con 0x7fda900b2be0 2024-03-23T06:21:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.130+0000 7fda8fe00640 1 -- 172.21.15.73:0/2571821077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda900b2be0 msgr2=0x7fda900c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.130+0000 7fda8fe00640 1 --2- 172.21.15.73:0/2571821077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda900b2be0 0x7fda900c9e70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fda9008c730 tx=0x7fda8802bfa0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.132+0000 7fda8fe00640 1 -- 172.21.15.73:0/2571821077 shutdown_connections 2024-03-23T06:21:05.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.132+0000 7fda8fe00640 1 --2- 172.21.15.73:0/2571821077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda900b2be0 0x7fda900c9e70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.132+0000 7fda8fe00640 1 --2- 172.21.15.73:0/2571821077 >> v2:172.21.15.73:3300/0 conn(0x7fda90160d50 0x7fda900c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.132+0000 7fda8fe00640 1 --2- 172.21.15.73:0/2571821077 >> v2:172.21.15.110:3300/0 conn(0x7fda90157ae0 0x7fda900ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.132+0000 7fda8fe00640 1 -- 172.21.15.73:0/2571821077 >> 172.21.15.73:0/2571821077 conn(0x7fda900713e0 msgr2=0x7fda900717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:05.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.132+0000 7fda8fe00640 1 -- 172.21.15.73:0/2571821077 shutdown_connections 2024-03-23T06:21:05.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.133+0000 7fda8fe00640 1 -- 172.21.15.73:0/2571821077 wait complete. 2024-03-23T06:21:05.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.135+0000 7fda8fe00640 1 Processor -- start 2024-03-23T06:21:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.136+0000 7fda8fe00640 1 -- start start 2024-03-23T06:21:05.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.137+0000 7fda8fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900b2be0 0x7fda901f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.138+0000 7fda8fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda90157ae0 0x7fda9015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.138+0000 7fda8fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda90160d50 0x7fda900cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.138+0000 7fda8fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda901505a0 con 0x7fda900b2be0 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.138+0000 7fda8fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda90151d80 con 0x7fda90160d50 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.138+0000 7fda8fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda90152060 con 0x7fda90157ae0 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.138+0000 7fda8f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda90160d50 0x7fda900cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.138+0000 7fda8f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda90160d50 0x7fda900cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:59262/0 (socket says 172.21.15.73:59262) 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.138+0000 7fda8f400640 1 -- 172.21.15.73:0/4254015702 learned_addr learned my addr 172.21.15.73:0/4254015702 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8ea00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900b2be0 0x7fda901f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8f400640 1 -- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda90157ae0 msgr2=0x7fda9015fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8e000640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda90157ae0 0x7fda9015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8f400640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda90157ae0 0x7fda9015fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8f400640 1 -- 172.21.15.73:0/4254015702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900b2be0 msgr2=0x7fda901f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8f400640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900b2be0 0x7fda901f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8f400640 1 -- 172.21.15.73:0/4254015702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88009b30 con 0x7fda90160d50 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8e000640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda90157ae0 0x7fda9015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8ea00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900b2be0 0x7fda901f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-23T06:21:05.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.139+0000 7fda8f400640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda90160d50 0x7fda900cd180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fda88036040 tx=0x7fda88004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:05.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.140+0000 7fda86a00640 1 -- 172.21.15.73:0/4254015702 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8803e450 con 0x7fda90160d50 2024-03-23T06:21:05.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.140+0000 7fda86a00640 1 -- 172.21.15.73:0/4254015702 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8803e5b0 con 0x7fda90160d50 2024-03-23T06:21:05.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.140+0000 7fda86a00640 1 -- 172.21.15.73:0/4254015702 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8803e960 con 0x7fda90160d50 2024-03-23T06:21:05.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.140+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda90152340 con 0x7fda90160d50 2024-03-23T06:21:05.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.140+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda90152900 con 0x7fda90160d50 2024-03-23T06:21:05.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.142+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9004e030 con 0x7fda90160d50 2024-03-23T06:21:05.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.143+0000 7fda86a00640 1 -- 172.21.15.73:0/4254015702 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fda8803eac0 con 0x7fda90160d50 2024-03-23T06:21:05.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.143+0000 7fda86a00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda7006ac00 0x7fda7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.144+0000 7fda86a00640 1 -- 172.21.15.73:0/4254015702 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fda880ac6d0 con 0x7fda90160d50 2024-03-23T06:21:05.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.144+0000 7fda8ea00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda7006ac00 0x7fda7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.146+0000 7fda8ea00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda7006ac00 0x7fda7006d0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda8000a8b0 tx=0x7fda80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:05.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.155+0000 7fda86a00640 1 -- 172.21.15.73:0/4254015702 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fda880774d0 con 0x7fda90160d50 2024-03-23T06:21:05.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.480+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fda900ca470 con 0x7fda90160d50 2024-03-23T06:21:05.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.481+0000 7fda86a00640 1 -- 172.21.15.73:0/4254015702 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7fda88043620 con 0x7fda90160d50 2024-03-23T06:21:05.481 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:21:05.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda7006ac00 msgr2=0x7fda7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda7006ac00 0x7fda7006d0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda8000a8b0 tx=0x7fda80008040 comp rx=0 tx=0).stop 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda90160d50 msgr2=0x7fda900cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda90160d50 0x7fda900cd180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fda88036040 tx=0x7fda88004a40 comp rx=0 tx=0).stop 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 shutdown_connections 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda90160d50 0x7fda900cd180 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fda7006ac00 0x7fda7006d0c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda90157ae0 0x7fda9015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 --2- 172.21.15.73:0/4254015702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda900b2be0 0x7fda901f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 >> 172.21.15.73:0/4254015702 conn(0x7fda900713e0 msgr2=0x7fda900b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 shutdown_connections 2024-03-23T06:21:05.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.483+0000 7fda8fe00640 1 -- 172.21.15.73:0/4254015702 wait complete. 2024-03-23T06:21:05.508 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:21:05.508 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-23T06:21:05.508 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:21:05.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:21:05.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.720+0000 7f326fa00640 1 Processor -- start 2024-03-23T06:21:05.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.721+0000 7f326fa00640 1 -- start start 2024-03-23T06:21:05.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f326fa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3268159420 0x7f32680c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f326fa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32680ca940 0x7f32680cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f326fa00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32680c9c80 con 0x7f3268153760 2024-03-23T06:21:05.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f326fa00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3268159860 con 0x7f32680ca940 2024-03-23T06:21:05.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f326fa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32680cb310 con 0x7f3268159420 2024-03-23T06:21:05.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f326d000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3268153760 0x7f32680cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45012/0 (socket says 172.21.15.73:45012) 2024-03-23T06:21:05.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f326d000640 1 -- 172.21.15.73:0/80046428 learned_addr learned my addr 172.21.15.73:0/80046428 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:05.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f3267e00640 1 --2- 172.21.15.73:0/80046428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3268159420 0x7f32680c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.722+0000 7f326da00640 1 --2- 172.21.15.73:0/80046428 >> v2:172.21.15.110:3300/0 conn(0x7f32680ca940 0x7f32680cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.723+0000 7f3267e00640 1 -- 172.21.15.73:0/80046428 >> v2:172.21.15.110:3300/0 conn(0x7f32680ca940 msgr2=0x7f32680cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.723+0000 7f3267e00640 1 --2- 172.21.15.73:0/80046428 >> v2:172.21.15.110:3300/0 conn(0x7f32680ca940 0x7f32680cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.723+0000 7f3267e00640 1 -- 172.21.15.73:0/80046428 >> v1:172.21.15.73:6789/0 conn(0x7f3268153760 legacy=0x7f32680cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.723+0000 7f3267e00640 1 -- 172.21.15.73:0/80046428 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326806a2d0 con 0x7f3268159420 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.723+0000 7f3267400640 1 -- 172.21.15.73:0/80046428 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371962462 0 0) 0x7f325c001110 con 0x7f3268153760 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.723+0000 7f326da00640 1 --2- 172.21.15.73:0/80046428 >> v2:172.21.15.110:3300/0 conn(0x7f32680ca940 0x7f32680cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.724+0000 7f3267e00640 1 --2- 172.21.15.73:0/80046428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3268159420 0x7f32680c9740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32540097a0 tx=0x7f325402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302077d586b598e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.724+0000 7f3267400640 1 -- 172.21.15.73:0/80046428 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325402d040 con 0x7f3268159420 2024-03-23T06:21:05.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.724+0000 7f3267400640 1 -- 172.21.15.73:0/80046428 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254031810 con 0x7f3268159420 2024-03-23T06:21:05.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.724+0000 7f3267400640 1 -- 172.21.15.73:0/80046428 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254031ba0 con 0x7f3268159420 2024-03-23T06:21:05.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.725+0000 7f326fa00640 1 -- 172.21.15.73:0/80046428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3268159420 msgr2=0x7f32680c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.725+0000 7f326fa00640 1 --2- 172.21.15.73:0/80046428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3268159420 0x7f32680c9740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32540097a0 tx=0x7f325402b8b0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.725+0000 7f326fa00640 1 -- 172.21.15.73:0/80046428 shutdown_connections 2024-03-23T06:21:05.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.725+0000 7f326fa00640 1 --2- 172.21.15.73:0/80046428 >> v2:172.21.15.110:3300/0 conn(0x7f32680ca940 0x7f32680cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.725+0000 7f326fa00640 1 --2- 172.21.15.73:0/80046428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3268159420 0x7f32680c9740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.725+0000 7f326fa00640 1 -- 172.21.15.73:0/80046428 >> 172.21.15.73:0/80046428 conn(0x7f326806c310 msgr2=0x7f32680713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:05.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.725+0000 7f326fa00640 1 -- 172.21.15.73:0/80046428 shutdown_connections 2024-03-23T06:21:05.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.725+0000 7f326fa00640 1 -- 172.21.15.73:0/80046428 wait complete. 2024-03-23T06:21:05.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.726+0000 7f326fa00640 1 Processor -- start 2024-03-23T06:21:05.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.727+0000 7f326fa00640 1 -- start start 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.727+0000 7f326fa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680ca940 0x7f3268152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.727+0000 7f326fa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3268153760 0x7f3268147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326fa00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268159420 0x7f32681561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326fa00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32681efe20 con 0x7f3268159420 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326fa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32681ef2a0 con 0x7f3268153760 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326fa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32681ef580 con 0x7f32680ca940 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326d000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680ca940 0x7f3268152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326da00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268159420 0x7f32681561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326d000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680ca940 0x7f3268152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:38948/0 (socket says 172.21.15.73:38948) 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f3267e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3268153760 0x7f3268147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326d000640 1 -- 172.21.15.73:0/947098319 learned_addr learned my addr 172.21.15.73:0/947098319 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:05.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326d000640 1 -- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3268153760 msgr2=0x7f3268147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326d000640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3268153760 0x7f3268147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326d000640 1 -- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268159420 msgr2=0x7f32681561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326d000640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268159420 0x7f32681561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.728+0000 7f326d000640 1 -- 172.21.15.73:0/947098319 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260009a70 con 0x7f32680ca940 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.729+0000 7f326d000640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680ca940 0x7f3268152c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c780 tx=0x7f325c00cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.729+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0072d0 con 0x7f32680ca940 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.729+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c007450 con 0x7f32680ca940 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.729+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3254009400 con 0x7f32680ca940 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.729+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c0047e0 con 0x7f32680ca940 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.729+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32681efb40 con 0x7f32680ca940 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.730+0000 7f326fa00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32681487e0 0x7f32681456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.730+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3268072510 con 0x7f32681487e0 2024-03-23T06:21:05.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.730+0000 7f3267e00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32681487e0 0x7f32681456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.731+0000 7f3267e00640 1 -- 172.21.15.73:0/947098319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f326806ab70 con 0x7f32681487e0 2024-03-23T06:21:05.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.731+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f325c004960 con 0x7f32680ca940 2024-03-23T06:21:05.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.731+0000 7f3267e00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32681487e0 0x7f32681456f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f32680cfe30 tx=0x7f3254004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f3264c00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f324806ac00 0x7f324806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f325c0889a0 con 0x7f32680ca940 2024-03-23T06:21:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f326da00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f324806ac00 0x7f324806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254048070 con 0x7f32681487e0 2024-03-23T06:21:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f3254031610 con 0x7f32681487e0 2024-03-23T06:21:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32681487e0 msgr2=0x7f32681456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f3264c00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32681487e0 0x7f32681456f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f32680cfe30 tx=0x7f3254004730 comp rx=0 tx=0).stop 2024-03-23T06:21:05.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32681487e0 msgr2=0x7f32681456f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:05.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.733+0000 7f3264c00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32681487e0 0x7f32681456f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.734+0000 7f326da00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f324806ac00 0x7f324806d0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3260011580 tx=0x7f326000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:05.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.740+0000 7f326fa00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268145c30 0x7f3268148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:05.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.740+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326815d000 con 0x7f3268145c30 2024-03-23T06:21:05.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.740+0000 7f3267e00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268145c30 0x7f3268148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:05.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.741+0000 7f3267e00640 1 -- 172.21.15.73:0/947098319 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f326806a890 con 0x7f3268145c30 2024-03-23T06:21:05.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.741+0000 7f3267e00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268145c30 0x7f3268148da0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f32540097a0 tx=0x7f32540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:05.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.741+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254039ab0 con 0x7f3268145c30 2024-03-23T06:21:05.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4469 (secure 0 0 0) 0x7f3254039c10 con 0x7f3268145c30 2024-03-23T06:21:05.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268145c30 msgr2=0x7f3268148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f3264c00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268145c30 0x7f3268148da0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f32540097a0 tx=0x7f32540046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f3264c00640 1 -- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268145c30 msgr2=0x7f3268148da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:05.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f3264c00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3268145c30 0x7f3268148da0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 102, 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 13, 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:21:05.743 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:05.744 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:05.745 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:05.746 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.746 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:21:05.746 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:21:05.746 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:21:05.746 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:21:05.746 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:05.747 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.748 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:05.749 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:21:05.750 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.751 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:21:05.752 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:05.753 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:21:05.754 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:21:05.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f324806ac00 msgr2=0x7f324806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326fa00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f324806ac00 0x7f324806d0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3260011580 tx=0x7f326000b040 comp rx=0 tx=0).stop 2024-03-23T06:21:05.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680ca940 msgr2=0x7f3268152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:05.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326fa00640 1 --2- 172.21.15.73:0/947098319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32680ca940 0x7f3268152c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f325c00c780 tx=0x7f325c00cb80 comp rx=0 tx=0).stop 2024-03-23T06:21:05.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326da00640 1 -- 172.21.15.73:0/947098319 reap_dead start 2024-03-23T06:21:05.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326da00640 1 -- 172.21.15.73:0/947098319 reap_dead start 2024-03-23T06:21:05.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 shutdown_connections 2024-03-23T06:21:05.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 >> 172.21.15.73:0/947098319 conn(0x7f326806c310 msgr2=0x7f32680cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:05.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.742+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 shutdown_connections 2024-03-23T06:21:05.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:05.743+0000 7f326fa00640 1 -- 172.21.15.73:0/947098319 wait complete. 2024-03-23T06:21:05.759 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:21:05.759 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:21:05.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:21:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.057+0000 7fad61200640 1 Processor -- start 2024-03-23T06:21:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.057+0000 7fad61200640 1 -- start start 2024-03-23T06:21:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.059+0000 7fad61200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fad5c14fd70 0x7fad5c0ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.059+0000 7fad61200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c06f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.059+0000 7fad61200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fad5c0714f0 0x7fad5c071980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.059+0000 7fad61200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c06fe80 con 0x7fad5c14fd70 2024-03-23T06:21:06.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.059+0000 7fad61200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c0c5490 con 0x7fad5c0714f0 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.059+0000 7fad61200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0c56e0 con 0x7fad5c0c6310 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad59400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c06f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad5a800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fad5c0714f0 0x7fad5c071980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad5a800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fad5c0714f0 0x7fad5c071980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:59280/0 (socket says 172.21.15.73:59280) 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad5a800640 1 -- 172.21.15.73:0/419184932 learned_addr learned my addr 172.21.15.73:0/419184932 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad59400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c06f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:38956/0 (socket says 172.21.15.73:38956) 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad5a800640 1 -- 172.21.15.73:0/419184932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 msgr2=0x7fad5c06f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad5a800640 1 --2- 172.21.15.73:0/419184932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c06f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad5a800640 1 -- 172.21.15.73:0/419184932 >> v2:172.21.15.73:3300/0 conn(0x7fad5c14fd70 msgr2=0x7fad5c0ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad59e00640 1 --2- 172.21.15.73:0/419184932 >> v2:172.21.15.73:3300/0 conn(0x7fad5c14fd70 0x7fad5c0ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad5a800640 1 --2- 172.21.15.73:0/419184932 >> v2:172.21.15.73:3300/0 conn(0x7fad5c14fd70 0x7fad5c0ca4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.060+0000 7fad5a800640 1 -- 172.21.15.73:0/419184932 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c0c59c0 con 0x7fad5c0714f0 2024-03-23T06:21:06.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.061+0000 7fad59400640 1 --2- 172.21.15.73:0/419184932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c06f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:21:06.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.066+0000 7fad5a800640 1 --2- 172.21.15.73:0/419184932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 0x7fad5c071980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad5c15a100 tx=0x7fad54034a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9993d5268ad0b9b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.073+0000 7fad58a00640 1 -- 172.21.15.73:0/419184932 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540114e0 con 0x7fad5c0714f0 2024-03-23T06:21:06.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.073+0000 7fad58a00640 1 -- 172.21.15.73:0/419184932 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54011640 con 0x7fad5c0714f0 2024-03-23T06:21:06.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.073+0000 7fad58a00640 1 -- 172.21.15.73:0/419184932 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540119d0 con 0x7fad5c0714f0 2024-03-23T06:21:06.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.074+0000 7fad61200640 1 -- 172.21.15.73:0/419184932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 msgr2=0x7fad5c071980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.074+0000 7fad61200640 1 --2- 172.21.15.73:0/419184932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 0x7fad5c071980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad5c15a100 tx=0x7fad54034a90 comp rx=0 tx=0).stop 2024-03-23T06:21:06.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.075+0000 7fad61200640 1 -- 172.21.15.73:0/419184932 shutdown_connections 2024-03-23T06:21:06.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.075+0000 7fad61200640 1 --2- 172.21.15.73:0/419184932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 0x7fad5c071980 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.075+0000 7fad61200640 1 --2- 172.21.15.73:0/419184932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c06f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.075+0000 7fad61200640 1 --2- 172.21.15.73:0/419184932 >> v2:172.21.15.73:3300/0 conn(0x7fad5c14fd70 0x7fad5c0ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.075+0000 7fad61200640 1 -- 172.21.15.73:0/419184932 >> 172.21.15.73:0/419184932 conn(0x7fad5c069cb0 msgr2=0x7fad5c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:06.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.077+0000 7fad61200640 1 -- 172.21.15.73:0/419184932 shutdown_connections 2024-03-23T06:21:06.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.077+0000 7fad61200640 1 -- 172.21.15.73:0/419184932 wait complete. 2024-03-23T06:21:06.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.080+0000 7fad61200640 1 Processor -- start 2024-03-23T06:21:06.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.082+0000 7fad61200640 1 -- start start 2024-03-23T06:21:06.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.083+0000 7fad61200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 0x7fad5c145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.085+0000 7fad61200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.087+0000 7fad61200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad5c14fd70 0x7fad5c1e0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.087+0000 7fad61200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1dfd60 con 0x7fad5c14fd70 2024-03-23T06:21:06.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.087+0000 7fad61200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c14f0e0 con 0x7fad5c0714f0 2024-03-23T06:21:06.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.087+0000 7fad61200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0ca8a0 con 0x7fad5c0c6310 2024-03-23T06:21:06.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.087+0000 7fad59e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 0x7fad5c145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.087+0000 7fad59e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 0x7fad5c145280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:59292/0 (socket says 172.21.15.73:59292) 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.087+0000 7fad59e00640 1 -- 172.21.15.73:0/3967600118 learned_addr learned my addr 172.21.15.73:0/3967600118 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.087+0000 7fad59400640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.088+0000 7fad59e00640 1 -- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 msgr2=0x7fad5c155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.088+0000 7fad59e00640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad5c0c6310 0x7fad5c155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.088+0000 7fad59e00640 1 -- 172.21.15.73:0/3967600118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad5c14fd70 msgr2=0x7fad5c1e0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.088+0000 7fad59e00640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad5c14fd70 0x7fad5c1e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.088+0000 7fad59e00640 1 -- 172.21.15.73:0/3967600118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48009400 con 0x7fad5c0714f0 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.088+0000 7fad59e00640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 0x7fad5c145280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00c7f0 tx=0x7fad4c00ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.089+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c004220 con 0x7fad5c0714f0 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.089+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c004380 con 0x7fad5c0714f0 2024-03-23T06:21:06.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.089+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c007840 con 0x7fad5c0714f0 2024-03-23T06:21:06.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.089+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad54014660 con 0x7fad5c0714f0 2024-03-23T06:21:06.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.089+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c14f3a0 con 0x7fad5c0714f0 2024-03-23T06:21:06.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.094+0000 7fad61200640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c1e06c0 0x7fad5c1df600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.094+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c073bf0 con 0x7fad5c1e06c0 2024-03-23T06:21:06.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.098+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fad4c0079a0 con 0x7fad5c0714f0 2024-03-23T06:21:06.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.104+0000 7fad52000640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fad3c06ac80 0x7fad3c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.104+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fad4c089060 con 0x7fad5c0714f0 2024-03-23T06:21:06.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.101+0000 7fad59400640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c1e06c0 0x7fad5c1df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.110+0000 7fad59400640 1 -- 172.21.15.73:0/3967600118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad5c155ad0 con 0x7fad5c1e06c0 2024-03-23T06:21:06.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.110+0000 7fad59400640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c1e06c0 0x7fad5c1df600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0c7fb0 tx=0x7fad4800f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.114+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48011c90 con 0x7fad5c1e06c0 2024-03-23T06:21:06.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.114+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fad48011df0 con 0x7fad5c1e06c0 2024-03-23T06:21:06.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.114+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c1e06c0 msgr2=0x7fad5c1df600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.114+0000 7fad52000640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c1e06c0 0x7fad5c1df600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0c7fb0 tx=0x7fad4800f610 comp rx=0 tx=0).stop 2024-03-23T06:21:06.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.114+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c1e06c0 msgr2=0x7fad5c1df600 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:06.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.114+0000 7fad52000640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c1e06c0 0x7fad5c1df600 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad5c0c7fb0 tx=0x7fad4800f610 comp rx=0 tx=0).stop 2024-03-23T06:21:06.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.115+0000 7fad5a800640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fad3c06ac80 0x7fad3c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.116+0000 7fad5a800640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fad3c06ac80 0x7fad3c06d140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fad5403e000 tx=0x7fad54039000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.134+0000 7fad61200640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c14d590 0x7fad5c14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.134+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0c5f80 con 0x7fad5c14d590 2024-03-23T06:21:06.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.134+0000 7fad59400640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c14d590 0x7fad5c14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.138+0000 7fad59400640 1 -- 172.21.15.73:0/3967600118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fad5c150150 con 0x7fad5c14d590 2024-03-23T06:21:06.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.139+0000 7fad59400640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c14d590 0x7fad5c14d9a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad4801c000 tx=0x7fad480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.141 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:21:06.141 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:06.141 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 102, 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 14, 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:06.142 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:06.143 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:21:06.144 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:06.145 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:06.146 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:06.146 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.146 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:21:06.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.146 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:21:06.149 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.150 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.151 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:21:06.152 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:06.153 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:21:06.154 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.155 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 8 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:21:06.156 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 6 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:06.157 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.158 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:21:06.158 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.158 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.158 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.158 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:21:06.158 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.140+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48021040 con 0x7fad5c14d590 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.141+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5120 (secure 0 0 0) 0x7fad48029460 con 0x7fad5c14d590 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.141+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c14d590 msgr2=0x7fad5c14d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.141+0000 7fad52000640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c14d590 0x7fad5c14d9a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad4801c000 tx=0x7fad480046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.141+0000 7fad52000640 1 -- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c14d590 msgr2=0x7fad5c14d9a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.141+0000 7fad52000640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c14d590 0x7fad5c14d9a0 secure :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fad4801c000 tx=0x7fad480046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.145+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fad3c06ac80 msgr2=0x7fad3c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.145+0000 7fad61200640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fad3c06ac80 0x7fad3c06d140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fad5403e000 tx=0x7fad54039000 comp rx=0 tx=0).stop 2024-03-23T06:21:06.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.145+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 msgr2=0x7fad5c145280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.145+0000 7fad61200640 1 --2- 172.21.15.73:0/3967600118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad5c0714f0 0x7fad5c145280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00c7f0 tx=0x7fad4c00ccb0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.146+0000 7fad5a800640 1 -- 172.21.15.73:0/3967600118 reap_dead start 2024-03-23T06:21:06.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.146+0000 7fad5a800640 1 -- 172.21.15.73:0/3967600118 reap_dead start 2024-03-23T06:21:06.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.146+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 shutdown_connections 2024-03-23T06:21:06.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.146+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 >> 172.21.15.73:0/3967600118 conn(0x7fad5c069cb0 msgr2=0x7fad5c1496c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:06.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.146+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 shutdown_connections 2024-03-23T06:21:06.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.147+0000 7fad61200640 1 -- 172.21.15.73:0/3967600118 wait complete. 2024-03-23T06:21:06.189 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:21:06.189 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:21:06.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:21:06.309 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-23T06:21:06.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-23T06:21:06.443 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-03-23T06:21:06.443 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-23T06:21:06.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.473+0000 7f6031400640 1 Processor -- start 2024-03-23T06:21:06.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.473+0000 7f6031400640 1 -- start start 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.474+0000 7f6031400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f602c153760 0x7f602c159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.474+0000 7f6031400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f602c0c9740 0x7f602c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.474+0000 7f6031400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c06a2d0 con 0x7f602c0cbd10 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.474+0000 7f6031400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c06a5b0 con 0x7f602c153760 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.474+0000 7f6031400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c06a890 con 0x7f602c0c9740 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.474+0000 7f6029e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f602c0c9740 0x7f602c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.474+0000 7f602a800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f602c153760 0x7f602c159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.475+0000 7f6029e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f602c0c9740 0x7f602c0cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:59322/0 (socket says 172.21.15.73:59322) 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.475+0000 7f602a800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f602c153760 0x7f602c159420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38482/0 (socket says 172.21.15.73:38482) 2024-03-23T06:21:06.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.475+0000 7f6029e00640 1 -- 172.21.15.73:0/1578782218 learned_addr learned my addr 172.21.15.73:0/1578782218 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:06.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.475+0000 7f6029e00640 1 -- 172.21.15.73:0/1578782218 >> v2:172.21.15.73:3300/0 conn(0x7f602c153760 msgr2=0x7f602c159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:06.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.475+0000 7f6029e00640 1 --2- 172.21.15.73:0/1578782218 >> v2:172.21.15.73:3300/0 conn(0x7f602c153760 0x7f602c159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.475+0000 7f6029e00640 1 -- 172.21.15.73:0/1578782218 >> v1:172.21.15.73:6789/0 conn(0x7f602c0cbd10 legacy=0x7f602c0ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.475+0000 7f6029e00640 1 -- 172.21.15.73:0/1578782218 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c06ab70 con 0x7f602c0c9740 2024-03-23T06:21:06.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.476+0000 7f6029e00640 1 --2- 172.21.15.73:0/1578782218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c0c9740 0x7f602c0cb7d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f602c0c5640 tx=0x7f601802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf4d020a3450c7f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.476+0000 7f6029400640 1 -- 172.21.15.73:0/1578782218 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018030860 con 0x7f602c0c9740 2024-03-23T06:21:06.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.476+0000 7f6029400640 1 -- 172.21.15.73:0/1578782218 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60180309c0 con 0x7f602c0c9740 2024-03-23T06:21:06.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.476+0000 7f6029400640 1 -- 172.21.15.73:0/1578782218 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018030d50 con 0x7f602c0c9740 2024-03-23T06:21:06.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.477+0000 7f6031400640 1 -- 172.21.15.73:0/1578782218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c0c9740 msgr2=0x7f602c0cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.477+0000 7f6031400640 1 --2- 172.21.15.73:0/1578782218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c0c9740 0x7f602c0cb7d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f602c0c5640 tx=0x7f601802b9a0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.477+0000 7f6031400640 1 -- 172.21.15.73:0/1578782218 shutdown_connections 2024-03-23T06:21:06.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.477+0000 7f6031400640 1 --2- 172.21.15.73:0/1578782218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c0c9740 0x7f602c0cb7d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.477+0000 7f6031400640 1 --2- 172.21.15.73:0/1578782218 >> v2:172.21.15.73:3300/0 conn(0x7f602c153760 0x7f602c159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.477+0000 7f6031400640 1 -- 172.21.15.73:0/1578782218 >> 172.21.15.73:0/1578782218 conn(0x7f602c06c310 msgr2=0x7f602c0713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:06.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.477+0000 7f6031400640 1 -- 172.21.15.73:0/1578782218 shutdown_connections 2024-03-23T06:21:06.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.477+0000 7f6031400640 1 -- 172.21.15.73:0/1578782218 wait complete. 2024-03-23T06:21:06.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.479+0000 7f6031400640 1 Processor -- start 2024-03-23T06:21:06.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.479+0000 7f6031400640 1 -- start start 2024-03-23T06:21:06.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.480+0000 7f6031400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c0c9740 0x7f602c15be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.480+0000 7f6031400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c0cbd10 0x7f602c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.480+0000 7f6031400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c153760 0x7f602c1f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.480+0000 7f6031400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c158f90 con 0x7f602c0c9740 2024-03-23T06:21:06.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.480+0000 7f6031400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c15ad30 con 0x7f602c153760 2024-03-23T06:21:06.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.480+0000 7f6031400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c1f0010 con 0x7f602c0cbd10 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.480+0000 7f602b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c153760 0x7f602c1f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f6029e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c0cbd10 0x7f602c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c153760 0x7f602c1f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:59336/0 (socket says 172.21.15.73:59336) 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602b200640 1 -- 172.21.15.73:0/3922155389 learned_addr learned my addr 172.21.15.73:0/3922155389 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602a800640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c0c9740 0x7f602c15be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602b200640 1 -- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c0cbd10 msgr2=0x7f602c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602b200640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c0cbd10 0x7f602c1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602b200640 1 -- 172.21.15.73:0/3922155389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c0c9740 msgr2=0x7f602c15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602b200640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c0c9740 0x7f602c15be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602b200640 1 -- 172.21.15.73:0/3922155389 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60180094d0 con 0x7f602c153760 2024-03-23T06:21:06.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602a800640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f602c0c9740 0x7f602c15be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:21:06.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f602b200640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c153760 0x7f602c1f2110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f602400c7d0 tx=0x7f602400cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.481+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024003b70 con 0x7f602c153760 2024-03-23T06:21:06.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.482+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024003cf0 con 0x7f602c153760 2024-03-23T06:21:06.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.482+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400aa90 con 0x7f602c153760 2024-03-23T06:21:06.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.482+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c15b960 con 0x7f602c153760 2024-03-23T06:21:06.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.482+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c154060 con 0x7f602c153760 2024-03-23T06:21:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.483+0000 7f6031400640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c15c360 0x7f602c15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.483+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c072510 con 0x7f602c15c360 2024-03-23T06:21:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.483+0000 7f602a800640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c15c360 0x7f602c15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.484+0000 7f602a800640 1 -- 172.21.15.73:0/3922155389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f602c0c9b80 con 0x7f602c15c360 2024-03-23T06:21:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.484+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f602400abf0 con 0x7f602c153760 2024-03-23T06:21:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.484+0000 7f602a800640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c15c360 0x7f602c15c870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f601c011600 tx=0x7f601c011ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.484+0000 7f6022a00640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f600c06ac00 0x7f600c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.485+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f6024089430 con 0x7f602c153760 2024-03-23T06:21:06.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.485+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00f940 con 0x7f602c15c360 2024-03-23T06:21:06.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.485+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f601c00faa0 con 0x7f602c15c360 2024-03-23T06:21:06.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.485+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c15c360 msgr2=0x7f602c15c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.485+0000 7f6022a00640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c15c360 0x7f602c15c870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f601c011600 tx=0x7f601c011ac0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.485+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c15c360 msgr2=0x7f602c15c870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:06.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.485+0000 7f6022a00640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c15c360 0x7f602c15c870 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f601c011600 tx=0x7f601c011ac0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.485+0000 7f6029e00640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f600c06ac00 0x7f600c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.486+0000 7f6029e00640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f600c06ac00 0x7f600c06d0c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6018036000 tx=0x7f6018008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.492+0000 7f6031400640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c1598f0 0x7f602c1f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.492+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c153b40 con 0x7f602c1598f0 2024-03-23T06:21:06.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.492+0000 7f602a800640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c1598f0 0x7f602c1f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.493+0000 7f602a800640 1 -- 172.21.15.73:0/3922155389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f602c0720f0 con 0x7f602c1598f0 2024-03-23T06:21:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.494+0000 7f602a800640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c1598f0 0x7f602c1f2650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f601c011600 tx=0x7f601c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.494+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c021040 con 0x7f602c1598f0 2024-03-23T06:21:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.494+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4637 (secure 0 0 0) 0x7f601c006810 con 0x7f602c1598f0 2024-03-23T06:21:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.494+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c1598f0 msgr2=0x7f602c1f2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.494+0000 7f6022a00640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c1598f0 0x7f602c1f2650 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f601c011600 tx=0x7f601c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.494 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.494+0000 7f6022a00640 1 -- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c1598f0 msgr2=0x7f602c1f2650 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.494+0000 7f6022a00640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f602c1598f0 0x7f602c1f2650 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f601c011600 tx=0x7f601c0046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 102, 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:21:06.495 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 14, 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:06.496 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.497 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:21:06.498 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.499 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.500 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:21:06.501 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.502 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.503 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.504 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:06.505 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:21:06.506 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:21:06.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f600c06ac00 msgr2=0x7f600c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f6031400640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f600c06ac00 0x7f600c06d0c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6018036000 tx=0x7f6018008030 comp rx=0 tx=0).stop 2024-03-23T06:21:06.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c153760 msgr2=0x7f602c1f2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f6031400640 1 --2- 172.21.15.73:0/3922155389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602c153760 0x7f602c1f2110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f602400c7d0 tx=0x7f602400cc90 comp rx=0 tx=0).stop 2024-03-23T06:21:06.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f602b200640 1 -- 172.21.15.73:0/3922155389 reap_dead start 2024-03-23T06:21:06.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f602b200640 1 -- 172.21.15.73:0/3922155389 reap_dead start 2024-03-23T06:21:06.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 shutdown_connections 2024-03-23T06:21:06.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 >> 172.21.15.73:0/3922155389 conn(0x7f602c06c310 msgr2=0x7f602c150ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:06.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 shutdown_connections 2024-03-23T06:21:06.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.495+0000 7f6031400640 1 -- 172.21.15.73:0/3922155389 wait complete. 2024-03-23T06:21:06.513 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:21:06.513 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-03-23T06:21:06.513 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-23T06:21:06.514 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-03-23T06:21:06.514 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T06:21:06.514 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T06:21:06.514 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:21:06.529 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T06:21:06.529 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-03-23T06:21:06.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:21:06.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.721+0000 7f625e600640 1 Processor -- start 2024-03-23T06:21:06.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.721+0000 7f625e600640 1 -- start start 2024-03-23T06:21:06.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.722+0000 7f625e600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62580ca2d0 0x7f62580ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.722+0000 7f625e600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62580c9e40 con 0x7f6258159d70 2024-03-23T06:21:06.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.722+0000 7f625e600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62580c9580 con 0x7f6258153570 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.722+0000 7f625e600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62580c8920 con 0x7f62580ca2d0 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.722+0000 7f625dc00640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f62580ca2d0 msgr2=0x7f62580ca700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.722+0000 7f625d200640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f6258153570 legacy=0x7f625806aad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.722+0000 7f625dc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62580ca2d0 0x7f62580ca700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.722+0000 7f6257e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6258159d70 0x7f6258069cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45030/0 (socket says 172.21.15.73:45030) 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257e00640 1 -- 172.21.15.73:0/1897680176 learned_addr learned my addr 172.21.15.73:0/1897680176 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969862917 0 0) 0x7f62580c9e40 con 0x7f6258159d70 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6240003520 con 0x7f6258159d70 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880900826 0 0) 0x7f6240003520 con 0x7f6258159d70 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 >> v2:172.21.15.110:3300/0 conn(0x7f62580ca2d0 msgr2=0x7f62580ca700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 --2- 172.21.15.73:0/1897680176 >> v2:172.21.15.110:3300/0 conn(0x7f62580ca2d0 0x7f62580ca700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 >> v1:172.21.15.110:6789/0 conn(0x7f6258153570 legacy=0x7f625806aad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62580cac40 con 0x7f6258159d70 2024-03-23T06:21:06.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f6244001670 con 0x7f6258159d70 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 >> v1:172.21.15.73:6789/0 conn(0x7f6258159d70 legacy=0x7f6258069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6240003970 0x7f6240003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62400047c0 0x7f6240004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62400051d0 0x7f624000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62580c8920 con 0x7f62400051d0 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624000c100 con 0x7f62400047c0 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.723+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624000c2c0 con 0x7f6240003970 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f6257e00640 1 -- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62400047c0 msgr2=0x7f6240004c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f6257e00640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62400047c0 0x7f6240004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f625dc00640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62400051d0 0x7f624000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f625d200640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6240003970 0x7f6240003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f625dc00640 1 -- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6240003970 msgr2=0x7f6240003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f625dc00640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6240003970 0x7f6240003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f625dc00640 1 -- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62400047c0 msgr2=0x7f6240004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:06.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f625dc00640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62400047c0 0x7f6240004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.724+0000 7f625dc00640 1 -- 172.21.15.73:0/1897680176 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6240003520 con 0x7f62400051d0 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.725+0000 7f625dc00640 1 -- 172.21.15.73:0/1897680176 reap_dead start 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.725+0000 7f625dc00640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62400051d0 0x7f624000b980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6250009e30 tx=0x7f62400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9313df09af0b3c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.725+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625002cd30 con 0x7f62400051d0 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.725+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250035470 con 0x7f62400051d0 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.725+0000 7f6257400640 1 -- 172.21.15.73:0/1897680176 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250035820 con 0x7f62400051d0 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.726+0000 7f625e600640 1 -- 172.21.15.73:0/1897680176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62400051d0 msgr2=0x7f624000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.726+0000 7f625e600640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62400051d0 0x7f624000b980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6250009e30 tx=0x7f62400057f0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.726+0000 7f625e600640 1 -- 172.21.15.73:0/1897680176 shutdown_connections 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.726+0000 7f625e600640 1 --2- 172.21.15.73:0/1897680176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62400051d0 0x7f624000b980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.726+0000 7f625e600640 1 -- 172.21.15.73:0/1897680176 >> 172.21.15.73:0/1897680176 conn(0x7f62580ceb60 msgr2=0x7f62580cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:06.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.726+0000 7f625e600640 1 -- 172.21.15.73:0/1897680176 shutdown_connections 2024-03-23T06:21:06.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.726+0000 7f625e600640 1 -- 172.21.15.73:0/1897680176 wait complete. 2024-03-23T06:21:06.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.728+0000 7f625e600640 1 Processor -- start 2024-03-23T06:21:06.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.728+0000 7f625e600640 1 -- start start 2024-03-23T06:21:06.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625e600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400051d0 0x7f6258158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625e600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62580ad770 0x7f62580ab770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625e600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62580b3eb0 0x7f62580abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625e600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62580acc20 con 0x7f62580b3eb0 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625e600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62581f23d0 con 0x7f62580ad770 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625e600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62581f17c0 con 0x7f62400051d0 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f6257e00640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62580ad770 msgr2=0x7f62580ab770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f6257e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62580ad770 0x7f62580ab770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625dc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62580b3eb0 0x7f62580abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625d200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400051d0 0x7f6258158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625d200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400051d0 0x7f6258158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:39050/0 (socket says 172.21.15.73:39050) 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625dc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62580b3eb0 0x7f62580abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:38566/0 (socket says 172.21.15.73:38566) 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625d200640 1 -- 172.21.15.73:0/4292646862 learned_addr learned my addr 172.21.15.73:0/4292646862 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:06.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625dc00640 1 -- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400051d0 msgr2=0x7f6258158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625dc00640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400051d0 0x7f6258158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625dc00640 1 -- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62580ad770 msgr2=0x7f62580ab770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625dc00640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62580ad770 0x7f62580ab770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.729+0000 7f625dc00640 1 -- 172.21.15.73:0/4292646862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62581f1aa0 con 0x7f62580b3eb0 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.730+0000 7f625dc00640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62580b3eb0 0x7f62580abcb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6258066c50 tx=0x7f6250005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.730+0000 7f6254c00640 1 -- 172.21.15.73:0/4292646862 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250040660 con 0x7f62580b3eb0 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.730+0000 7f6254c00640 1 -- 172.21.15.73:0/4292646862 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62500407c0 con 0x7f62580b3eb0 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.730+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62581f1d80 con 0x7f62580b3eb0 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.730+0000 7f6254c00640 1 -- 172.21.15.73:0/4292646862 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6250040b70 con 0x7f62580b3eb0 2024-03-23T06:21:06.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.730+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62580ab1d0 con 0x7f62580b3eb0 2024-03-23T06:21:06.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.731+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62581f2580 con 0x7f62580b3eb0 2024-03-23T06:21:06.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.732+0000 7f6254c00640 1 -- 172.21.15.73:0/4292646862 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6250032070 con 0x7f62580b3eb0 2024-03-23T06:21:06.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.733+0000 7f6254c00640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f623806abe0 0x7f623806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:06.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.734+0000 7f6254c00640 1 -- 172.21.15.73:0/4292646862 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f625003c040 con 0x7f62580b3eb0 2024-03-23T06:21:06.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.734+0000 7f625d200640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f623806abe0 0x7f623806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:06.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.735+0000 7f625d200640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f623806abe0 0x7f623806d0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f624c009a80 tx=0x7f624c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:06.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:06.738+0000 7f6254c00640 1 -- 172.21.15.73:0/4292646862 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f62581f2580 con 0x7f62580b3eb0 2024-03-23T06:21:07.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.303+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f62581f2580 con 0x7f62580b3eb0 2024-03-23T06:21:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.304+0000 7f6254c00640 1 -- 172.21.15.73:0/4292646862 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f62581f2580 con 0x7f62580b3eb0 2024-03-23T06:21:07.304 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:21:07.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.307+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f623806abe0 msgr2=0x7f623806d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:07.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.307+0000 7f625e600640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f623806abe0 0x7f623806d0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f624c009a80 tx=0x7f624c008040 comp rx=0 tx=0).stop 2024-03-23T06:21:07.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.307+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62580b3eb0 msgr2=0x7f62580abcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:07.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.307+0000 7f625e600640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62580b3eb0 0x7f62580abcb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6258066c50 tx=0x7f6250005d90 comp rx=0 tx=0).stop 2024-03-23T06:21:07.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.308+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 shutdown_connections 2024-03-23T06:21:07.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.308+0000 7f625e600640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f62580b3eb0 0x7f62580abcb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:07.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.308+0000 7f625e600640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62580ad770 0x7f62580ab770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:07.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.308+0000 7f625e600640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f623806abe0 0x7f623806d0a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:07.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.308+0000 7f625e600640 1 --2- 172.21.15.73:0/4292646862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62400051d0 0x7f6258158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:07.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.308+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 >> 172.21.15.73:0/4292646862 conn(0x7f62580ceb60 msgr2=0x7f6258069cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.310+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 shutdown_connections 2024-03-23T06:21:07.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:07.310+0000 7f625e600640 1 -- 172.21.15.73:0/4292646862 wait complete. 2024-03-23T06:21:07.886 DEBUG:teuthology.parallel:result is None 2024-03-23T06:21:07.887 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-23T06:21:08.066 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-23T06:21:08.066 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-03-23T06:21:08.076 INFO:tasks.mon_thrash:joining mon_thrasher 2024-03-23T06:21:10.338 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:21:10.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.506+0000 7f08d8800640 1 Processor -- start 2024-03-23T06:21:10.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.506+0000 7f08d8800640 1 -- start start 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d8800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08d01536a0 0x7f08d00ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d8800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08d0153a80 0x7f08d00cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d8800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00cab20 con 0x7f08d01594f0 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d8800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d015a520 con 0x7f08d0153a80 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d8800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d01599a0 con 0x7f08d01536a0 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d5e00640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f08d01536a0 msgr2=0x7f08d00ca5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d6800640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f08d01594f0 legacy=0x7f08d00cf1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d5e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08d01536a0 0x7f08d00ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.507+0000 7f08d5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08d0153a80 0x7f08d00cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:10.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.508+0000 7f08d5400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08d0153a80 0x7f08d00cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52866/0 (socket says 172.21.15.73:52866) 2024-03-23T06:21:10.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.508+0000 7f08d5400640 1 -- 172.21.15.73:0/3439345819 learned_addr learned my addr 172.21.15.73:0/3439345819 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:10.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.508+0000 7f08d5400640 1 -- 172.21.15.73:0/3439345819 >> v2:172.21.15.110:3300/0 conn(0x7f08d01536a0 msgr2=0x7f08d00ca5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:10.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.508+0000 7f08d5400640 1 --2- 172.21.15.73:0/3439345819 >> v2:172.21.15.110:3300/0 conn(0x7f08d01536a0 0x7f08d00ca5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.508+0000 7f08d5400640 1 -- 172.21.15.73:0/3439345819 >> v1:172.21.15.110:6789/0 conn(0x7f08d01594f0 legacy=0x7f08d00cf1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:10.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.508+0000 7f08d5400640 1 -- 172.21.15.73:0/3439345819 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d0159c80 con 0x7f08d0153a80 2024-03-23T06:21:10.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.509+0000 7f08d5400640 1 --2- 172.21.15.73:0/3439345819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00cbe90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009870 tx=0x7f08c002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c945c6a162d36e21 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:10.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d4a00640 1 -- 172.21.15.73:0/3439345819 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0031890 con 0x7f08d0153a80 2024-03-23T06:21:10.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d4a00640 1 -- 172.21.15.73:0/3439345819 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c00319f0 con 0x7f08d0153a80 2024-03-23T06:21:10.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d4a00640 1 -- 172.21.15.73:0/3439345819 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0031d80 con 0x7f08d0153a80 2024-03-23T06:21:10.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d8800640 1 -- 172.21.15.73:0/3439345819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 msgr2=0x7f08d00cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d8800640 1 --2- 172.21.15.73:0/3439345819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00cbe90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009870 tx=0x7f08c002b930 comp rx=0 tx=0).stop 2024-03-23T06:21:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d8800640 1 -- 172.21.15.73:0/3439345819 shutdown_connections 2024-03-23T06:21:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d8800640 1 --2- 172.21.15.73:0/3439345819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00cbe90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d8800640 1 --2- 172.21.15.73:0/3439345819 >> v2:172.21.15.110:3300/0 conn(0x7f08d01536a0 0x7f08d00ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.510+0000 7f08d8800640 1 -- 172.21.15.73:0/3439345819 >> 172.21.15.73:0/3439345819 conn(0x7f08d006a060 msgr2=0x7f08d006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.511+0000 7f08d8800640 1 -- 172.21.15.73:0/3439345819 shutdown_connections 2024-03-23T06:21:10.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.511+0000 7f08d8800640 1 -- 172.21.15.73:0/3439345819 wait complete. 2024-03-23T06:21:10.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.512+0000 7f08d8800640 1 Processor -- start 2024-03-23T06:21:10.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.512+0000 7f08d8800640 1 -- start start 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d8800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d01536a0 0x7f08d01ef790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d8800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d8800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08d01594f0 0x7f08d01f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d8800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00cde90 con 0x7f08d0153a80 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d8800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d01eed80 con 0x7f08d01536a0 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d8800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d01efcd0 con 0x7f08d01594f0 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d5e00640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d01536a0 msgr2=0x7f08d01ef790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d01536a0 0x7f08d01ef790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:10.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d5400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52880/0 (socket says 172.21.15.73:52880) 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d5400640 1 -- 172.21.15.73:0/2420559651 learned_addr learned my addr 172.21.15.73:0/2420559651 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.513+0000 7f08d6800640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08d01594f0 0x7f08d01f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.514+0000 7f08d5400640 1 -- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08d01594f0 msgr2=0x7f08d01f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.514+0000 7f08d5400640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08d01594f0 0x7f08d01f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.514+0000 7f08d5400640 1 -- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d01536a0 msgr2=0x7f08d01ef790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.514+0000 7f08d5400640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d01536a0 0x7f08d01ef790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.514+0000 7f08d5400640 1 -- 172.21.15.73:0/2420559651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c00094d0 con 0x7f08d0153a80 2024-03-23T06:21:10.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.514+0000 7f08d5400640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00ca240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009870 tx=0x7f08c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.514+0000 7f08ca000640 1 -- 172.21.15.73:0/2420559651 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c003ad30 con 0x7f08d0153a80 2024-03-23T06:21:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.515+0000 7f08ca000640 1 -- 172.21.15.73:0/2420559651 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c003ae90 con 0x7f08d0153a80 2024-03-23T06:21:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.515+0000 7f08ca000640 1 -- 172.21.15.73:0/2420559651 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0044610 con 0x7f08d0153a80 2024-03-23T06:21:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.515+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d00cd5f0 con 0x7f08d0153a80 2024-03-23T06:21:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.515+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d00cdbb0 con 0x7f08d0153a80 2024-03-23T06:21:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.516+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d00c9810 con 0x7f08d0153a80 2024-03-23T06:21:10.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.517+0000 7f08ca000640 1 -- 172.21.15.73:0/2420559651 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f08c004d450 con 0x7f08d0153a80 2024-03-23T06:21:10.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.517+0000 7f08ca000640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f08b406abb0 0x7f08b406d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.517+0000 7f08ca000640 1 -- 172.21.15.73:0/2420559651 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f08c00abea0 con 0x7f08d0153a80 2024-03-23T06:21:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.518+0000 7f08d5e00640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f08b406abb0 0x7f08b406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:10.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.518+0000 7f08d5e00640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f08b406abb0 0x7f08b406d070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f08c4006fd0 tx=0x7f08c4006d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:10.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.525+0000 7f08ca000640 1 -- 172.21.15.73:0/2420559651 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f08c0076be0 con 0x7f08d0153a80 2024-03-23T06:21:10.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.807+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f08d004e110 con 0x7f08d0153a80 2024-03-23T06:21:10.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.810+0000 7f08ca000640 1 -- 172.21.15.73:0/2420559651 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f08c007a200 con 0x7f08d0153a80 2024-03-23T06:21:10.815 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":102,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.815+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f08b406abb0 msgr2=0x7f08b406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.815+0000 7f08d8800640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f08b406abb0 0x7f08b406d070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f08c4006fd0 tx=0x7f08c4006d80 comp rx=0 tx=0).stop 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 msgr2=0x7f08d00ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00ca240 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009870 tx=0x7f08c00046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 shutdown_connections 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f08b406abb0 0x7f08b406d070 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08d01594f0 0x7f08d01f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d0153a80 0x7f08d00ca240 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 --2- 172.21.15.73:0/2420559651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08d01536a0 0x7f08d01ef790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:10.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 >> 172.21.15.73:0/2420559651 conn(0x7f08d006a060 msgr2=0x7f08d0157360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:10.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 shutdown_connections 2024-03-23T06:21:10.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:10.816+0000 7f08d8800640 1 -- 172.21.15.73:0/2420559651 wait complete. 2024-03-23T06:21:13.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:21:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.013+0000 7f9df9200640 1 Processor -- start 2024-03-23T06:21:14.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.013+0000 7f9df9200640 1 -- start start 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.014+0000 7f9df9200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9df40cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.014+0000 7f9df9200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df40ca330 con 0x7f9df40cf100 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.014+0000 7f9df9200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df40cbab0 con 0x7f9df40ced20 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.014+0000 7f9df9200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40cb8d0 con 0x7f9df40caed0 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.014+0000 7f9df3400640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f9df40ced20 legacy=0x7f9df40ca7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.014+0000 7f9df3e00640 1 -- >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9df40cb390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.014+0000 7f9df3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9df40cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.015+0000 7f9df2a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9df40cf100 0x7f9df4153150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:37760/0 (socket says 172.21.15.73:37760) 2024-03-23T06:21:14.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.015+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 learned_addr learned my addr 172.21.15.73:0/924585641 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.215+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v1:172.21.15.110:6789/0 conn(0x7f9df40ced20 legacy=0x7f9df40ca7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:21:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.215+0000 7f9df3e00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9df40cb390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.215+0000 7f9df3e00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9df40cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:21:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.616+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v1:172.21.15.110:6789/0 conn(0x7f9df40ced20 legacy=0x7f9df40ca7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:21:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.616+0000 7f9df3e00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9df40cb390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:14.616+0000 7f9df3e00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9df40cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:21:15.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:15.417+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v1:172.21.15.110:6789/0 conn(0x7f9df40ced20 legacy=0x7f9df40ca7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:21:15.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:15.417+0000 7f9df3e00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9df40cb390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:15.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:15.417+0000 7f9df3e00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9df40cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:21:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.014+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9df40cb390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.014+0000 7f9df0c00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9df40cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:17.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.014+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 >> v1:172.21.15.110:6789/0 conn(0x7f9df40ced20 legacy=0x7f9df40ca7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.014+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 >> v1:172.21.15.73:6789/0 conn(0x7f9df40cf100 legacy=0x7f9df4153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.014+0000 7f9df0c00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.014+0000 7f9df0c00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.014+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40cb8d0 con 0x7f9dd40036c0 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.014+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4008da0 con 0x7f9dd40061c0 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.015+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.015+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.015+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:17.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.015+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:17.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.015+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:17.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.015+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:17.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.017+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:21:17.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.017+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:17.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.017+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:17.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.017+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:17.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.216+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:17.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.216+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:17.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.216+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:17.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.216+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:17.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.216+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:21:17.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.218+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:17.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.218+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:17.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.218+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:17.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.218+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:17.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.218+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:21:17.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.617+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:17.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.618+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:17.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.618+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:17.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.618+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:17.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.618+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:21:17.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.619+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:17.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.619+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:17.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.619+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:17.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.619+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:17.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:17.620+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:21:18.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.419+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:18.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.419+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:18.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.420+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:18.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.420+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:18.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.420+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:21:18.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.422+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:18.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.423+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:18.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.423+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:18.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.423+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:18.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:18.423+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 msgr2=0x7f9dd4008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd40061c0 0x7f9dd4008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df3e00640 1 -- 172.21.15.73:0/924585641 reap_dead start 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9dd40139e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df40cbd90 con 0x7f9df40cf100 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40cb8d0 con 0x7f9dd40036c0 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df0c00640 1 -- 172.21.15.73:0/924585641 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd4008da0 con 0x7f9df40caed0 2024-03-23T06:21:20.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9dd40139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9dd40139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.015+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.016+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-23T06:21:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.016+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.016+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:20.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.016+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:20.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.216+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9dd40139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:20.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.216+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9dd40139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:21:20.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.217+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:20.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.218+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:20.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.218+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:20.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.218+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:20.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.218+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-23T06:21:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.617+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9dd40139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:20.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.618+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9dd40139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:21:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.619+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:20.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.619+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.619+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.619+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:20.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:20.619+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-23T06:21:21.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.419+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9dd40139e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:21.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.419+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9dd40139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:21:21.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.421+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:21.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.421+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:21.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.421+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:21.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.421+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:21.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.422+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-23T06:21:21.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.440+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234138109 0 0) 0x7f9df40cbd90 con 0x7f9df40cf100 2024-03-23T06:21:21.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.440+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd8003520 con 0x7f9df40cf100 2024-03-23T06:21:21.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.442+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131466079 0 0) 0x7f9dd8003520 con 0x7f9df40cf100 2024-03-23T06:21:21.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.442+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 msgr2=0x7f9dd40139e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:21.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.442+0000 7f9df2000640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.110:3300/0 conn(0x7f9df40caed0 0x7f9dd40139e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.442+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 msgr2=0x7f9dd4005b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:21.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.442+0000 7f9df2000640 1 --2- 172.21.15.73:0/924585641 >> v2:172.21.15.73:3300/0 conn(0x7f9dd40036c0 0x7f9dd4005b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.442+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df40cbab0 con 0x7f9df40cf100 2024-03-23T06:21:21.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.443+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 765753134 0 0) 0x7f9dec0041f0 con 0x7f9df40cf100 2024-03-23T06:21:21.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.443+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 >> v1:172.21.15.73:6789/0 conn(0x7f9df40cf100 legacy=0x7f9dd4015f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:21.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.443+0000 7f9df2000640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd8003970 0x7f9dd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:21.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.443+0000 7f9df2000640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80047c0 0x7f9dd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:21.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.443+0000 7f9df2000640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9dd80051d0 0x7f9dd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:21.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.443+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40cb8d0 con 0x7f9dd80051d0 2024-03-23T06:21:21.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.443+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4008da0 con 0x7f9dd8003970 2024-03-23T06:21:21.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.443+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd800c1a0 con 0x7f9dd80047c0 2024-03-23T06:21:21.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.445+0000 7f9df3400640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd8003970 msgr2=0x7f9dd8003d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:21.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.445+0000 7f9df3400640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd8003970 0x7f9dd8003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:21.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.445+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80047c0 0x7f9dd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:21.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.446+0000 7f9df3e00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9dd80051d0 0x7f9dd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.447+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd8003970 msgr2=0x7f9dd8003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.447+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd8003970 0x7f9dd8003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.447+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9dd80051d0 msgr2=0x7f9dd800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:21.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.447+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9dd80051d0 0x7f9dd800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.451+0000 7f9df3e00640 1 -- 172.21.15.73:0/924585641 reap_dead start 2024-03-23T06:21:21.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.451+0000 7f9df2a00640 1 -- 172.21.15.73:0/924585641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8003520 con 0x7f9dd80047c0 2024-03-23T06:21:21.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.454+0000 7f9df2a00640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80047c0 0x7f9dd8004c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80055b0 tx=0x7f9dd80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf56bc4bd170b723 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:21.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.456+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0036410 con 0x7f9dd80047c0 2024-03-23T06:21:21.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.456+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de0030030 con 0x7f9dd80047c0 2024-03-23T06:21:21.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.456+0000 7f9df2000640 1 -- 172.21.15.73:0/924585641 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00365b0 con 0x7f9dd80047c0 2024-03-23T06:21:21.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.457+0000 7f9df9200640 1 -- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80047c0 msgr2=0x7f9dd8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:21.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.457+0000 7f9df9200640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80047c0 0x7f9dd8004c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80055b0 tx=0x7f9dd80057f0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.457+0000 7f9df9200640 1 -- 172.21.15.73:0/924585641 shutdown_connections 2024-03-23T06:21:21.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.458+0000 7f9df9200640 1 --2- 172.21.15.73:0/924585641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9dd80047c0 0x7f9dd8004c40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.458+0000 7f9df9200640 1 -- 172.21.15.73:0/924585641 >> 172.21.15.73:0/924585641 conn(0x7f9df40713e0 msgr2=0x7f9df40717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:21.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.459+0000 7f9df9200640 1 -- 172.21.15.73:0/924585641 shutdown_connections 2024-03-23T06:21:21.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.459+0000 7f9df9200640 1 -- 172.21.15.73:0/924585641 wait complete. 2024-03-23T06:21:21.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.466+0000 7f9df9200640 1 Processor -- start 2024-03-23T06:21:21.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.471+0000 7f9df9200640 1 -- start start 2024-03-23T06:21:21.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.473+0000 7f9df9200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80047c0 0x7f9df4158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:21.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.473+0000 7f9df9200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9df41eacf0 0x7f9df4157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:21.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.473+0000 7f9df9200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df40709a0 0x7f9df4159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:21.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.473+0000 7f9df9200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df414fcd0 con 0x7f9df40709a0 2024-03-23T06:21:21.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.473+0000 7f9df9200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df40c57d0 con 0x7f9dd80047c0 2024-03-23T06:21:21.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.473+0000 7f9df9200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df41592b0 con 0x7f9df41eacf0 2024-03-23T06:21:21.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.474+0000 7f9df3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df40709a0 0x7f9df4159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:21.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.474+0000 7f9df3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df40709a0 0x7f9df4159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53522/0 (socket says 172.21.15.73:53522) 2024-03-23T06:21:21.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.474+0000 7f9df3e00640 1 -- 172.21.15.73:0/2881573315 learned_addr learned my addr 172.21.15.73:0/2881573315 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:21.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.475+0000 7f9df3e00640 1 -- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9df41eacf0 msgr2=0x7f9df4157220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:21:21.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.475+0000 7f9df3e00640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9df41eacf0 0x7f9df4157220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.475+0000 7f9df3e00640 1 -- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80047c0 msgr2=0x7f9df4158710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:21:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.475+0000 7f9df3e00640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80047c0 0x7f9df4158710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.475+0000 7f9df3e00640 1 -- 172.21.15.73:0/2881573315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4158cf0 con 0x7f9df40709a0 2024-03-23T06:21:21.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.476+0000 7f9df3e00640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df40709a0 0x7f9df4159b40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9df4072200 tx=0x7f9dec004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.477+0000 7f9deb400640 1 -- 172.21.15.73:0/2881573315 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00f910 con 0x7f9df40709a0 2024-03-23T06:21:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.477+0000 7f9deb400640 1 -- 172.21.15.73:0/2881573315 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00fa70 con 0x7f9df40709a0 2024-03-23T06:21:21.478 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.477+0000 7f9deb400640 1 -- 172.21.15.73:0/2881573315 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00fe20 con 0x7f9df40709a0 2024-03-23T06:21:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.478+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df4158fd0 con 0x7f9df40709a0 2024-03-23T06:21:21.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.479+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df41ea4f0 con 0x7f9df40709a0 2024-03-23T06:21:21.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.484+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df40723f0 con 0x7f9df40709a0 2024-03-23T06:21:21.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.487+0000 7f9deb400640 1 -- 172.21.15.73:0/2881573315 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9dec01d460 con 0x7f9df40709a0 2024-03-23T06:21:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.489+0000 7f9deb400640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9dd40740d0 0x7f9dd4076590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:21.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.489+0000 7f9deb400640 1 -- 172.21.15.73:0/2881573315 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f9dec089860 con 0x7f9df40709a0 2024-03-23T06:21:21.493 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.493+0000 7f9df3400640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9dd40740d0 0x7f9dd4076590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:21.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.497+0000 7f9df3400640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9dd40740d0 0x7f9dd4076590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9de4003930 tx=0x7f9de4005040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:21.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.501+0000 7f9deb400640 1 -- 172.21.15.73:0/2881573315 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9dec0546f0 con 0x7f9df40709a0 2024-03-23T06:21:21.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.909+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f9df404e030 con 0x7f9df40709a0 2024-03-23T06:21:21.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.910+0000 7f9deb400640 1 -- 172.21.15.73:0/2881573315 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1542 (secure 0 0 0) 0x7f9dec057d10 con 0x7f9df40709a0 2024-03-23T06:21:21.911 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":106,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9dd40740d0 msgr2=0x7f9dd4076590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9dd40740d0 0x7f9dd4076590 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9de4003930 tx=0x7f9de4005040 comp rx=0 tx=0).stop 2024-03-23T06:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df40709a0 msgr2=0x7f9df4159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:21.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df40709a0 0x7f9df4159b40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9df4072200 tx=0x7f9dec004e40 comp rx=0 tx=0).stop 2024-03-23T06:21:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 shutdown_connections 2024-03-23T06:21:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9df40709a0 0x7f9df4159b40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9dd40740d0 0x7f9dd4076590 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9df41eacf0 0x7f9df4157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 --2- 172.21.15.73:0/2881573315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dd80047c0 0x7f9df4158710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 >> 172.21.15.73:0/2881573315 conn(0x7f9df40713e0 msgr2=0x7f9df40ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 shutdown_connections 2024-03-23T06:21:21.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:21.912+0000 7f9df9200640 1 -- 172.21.15.73:0/2881573315 wait complete. 2024-03-23T06:21:21.931 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-03-23T06:21:21.931 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-03-23T06:21:21.932 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:21:22.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.115+0000 7f4dbb200640 1 Processor -- start 2024-03-23T06:21:22.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.115+0000 7f4dbb200640 1 -- start start 2024-03-23T06:21:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.116+0000 7f4dbb200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4dbc0c5050 0x7f4dbc1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4dbb200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc15a1f0 con 0x7f4dbc0b4780 2024-03-23T06:21:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4dbb200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc0c5430 con 0x7f4dbc0cb130 2024-03-23T06:21:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4dbb200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc159950 con 0x7f4dbc0c5050 2024-03-23T06:21:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4db9400640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f4dbc0cb130 legacy=0x7f4dbc069cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:21:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4db9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4dbc0c5050 0x7f4dbc1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4db9e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4dbc0c5050 0x7f4dbc1592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53538/0 (socket says 172.21.15.73:53538) 2024-03-23T06:21:22.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4db9e00640 1 -- 172.21.15.73:0/330470438 learned_addr learned my addr 172.21.15.73:0/330470438 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:22.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4db9e00640 1 -- 172.21.15.73:0/330470438 >> v1:172.21.15.110:6789/0 conn(0x7f4dbc0cb130 legacy=0x7f4dbc069cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:22.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4db9e00640 1 -- 172.21.15.73:0/330470438 >> v1:172.21.15.73:6789/0 conn(0x7f4dbc0b4780 legacy=0x7f4dbc0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.117+0000 7f4db9e00640 1 -- 172.21.15.73:0/330470438 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc159c30 con 0x7f4dbc0c5050 2024-03-23T06:21:22.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.118+0000 7f4db9e00640 1 --2- 172.21.15.73:0/330470438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 0x7f4dbc1592a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009870 tx=0x7f4dac02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4c2f451e374fdb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.118+0000 7f4db8a00640 1 -- 172.21.15.73:0/330470438 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0317d0 con 0x7f4dbc0c5050 2024-03-23T06:21:22.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4db8a00640 1 -- 172.21.15.73:0/330470438 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac031930 con 0x7f4dbc0c5050 2024-03-23T06:21:22.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4db8a00640 1 -- 172.21.15.73:0/330470438 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac031cc0 con 0x7f4dbc0c5050 2024-03-23T06:21:22.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4dbb200640 1 -- 172.21.15.73:0/330470438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 msgr2=0x7f4dbc1592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4dbb200640 1 --2- 172.21.15.73:0/330470438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 0x7f4dbc1592a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009870 tx=0x7f4dac02b870 comp rx=0 tx=0).stop 2024-03-23T06:21:22.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4dbb200640 1 -- 172.21.15.73:0/330470438 shutdown_connections 2024-03-23T06:21:22.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4dbb200640 1 --2- 172.21.15.73:0/330470438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 0x7f4dbc1592a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4dbb200640 1 -- 172.21.15.73:0/330470438 >> 172.21.15.73:0/330470438 conn(0x7f4dbc0ceb80 msgr2=0x7f4dbc0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:22.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4dbb200640 1 -- 172.21.15.73:0/330470438 shutdown_connections 2024-03-23T06:21:22.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.119+0000 7f4dbb200640 1 -- 172.21.15.73:0/330470438 wait complete. 2024-03-23T06:21:22.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.121+0000 7f4dbb200640 1 Processor -- start 2024-03-23T06:21:22.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.121+0000 7f4dbb200640 1 -- start start 2024-03-23T06:21:22.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4dbb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dbc0b4780 0x7f4dbc1f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4dbb200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 0x7f4dbc150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4dbb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dbc0cb130 0x7f4dbc151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4dbb200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc158b80 con 0x7f4dbc0c5050 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4dbb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc14fc10 con 0x7f4dbc0b4780 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4dbb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc1f3260 con 0x7f4dbc0cb130 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4db9e00640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dbc0b4780 msgr2=0x7f4dbc1f28a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4db9e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dbc0b4780 0x7f4dbc1f28a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4db9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 0x7f4dbc150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4db9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 0x7f4dbc150c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53540/0 (socket says 172.21.15.73:53540) 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4db9400640 1 -- 172.21.15.73:0/959590019 learned_addr learned my addr 172.21.15.73:0/959590019 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.122+0000 7f4dba800640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dbc0cb130 0x7f4dbc151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db9400640 1 -- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dbc0cb130 msgr2=0x7f4dbc151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db9400640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dbc0cb130 0x7f4dbc151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db9400640 1 -- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dbc0b4780 msgr2=0x7f4dbc1f28a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:21:22.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db9400640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dbc0b4780 0x7f4dbc1f28a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db9400640 1 -- 172.21.15.73:0/959590019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0094d0 con 0x7f4dbc0c5050 2024-03-23T06:21:22.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db9400640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 0x7f4dbc150c20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4da800b550 tx=0x7f4da800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8003dc0 con 0x7f4dbc0c5050 2024-03-23T06:21:22.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da8005070 con 0x7f4dbc0c5050 2024-03-23T06:21:22.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8005420 con 0x7f4dbc0c5050 2024-03-23T06:21:22.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc14fe60 con 0x7f4dbc0c5050 2024-03-23T06:21:22.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.123+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc150420 con 0x7f4dbc0c5050 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.124+0000 7f4dbb200640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc1f2de0 0x7f4dbc145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.125+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc152080 con 0x7f4dbc1f2de0 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.125+0000 7f4db9e00640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc1f2de0 0x7f4dbc145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.125+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4da8005580 con 0x7f4dbc0c5050 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.125+0000 7f4db9e00640 1 -- 172.21.15.73:0/959590019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4dbc0c9910 con 0x7f4dbc1f2de0 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.126+0000 7f4db9e00640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc1f2de0 0x7f4dbc145e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc08caf0 tx=0x7f4dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.126+0000 7f4db2000640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d9c06abb0 0x7f4d9c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.126+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f4da8089710 con 0x7f4dbc0c5050 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.126+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac004220 con 0x7f4dbc1f2de0 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.127+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f4dac004380 con 0x7f4dbc1f2de0 2024-03-23T06:21:22.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.127+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc1f2de0 msgr2=0x7f4dbc145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.127+0000 7f4db2000640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc1f2de0 0x7f4dbc145e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc08caf0 tx=0x7f4dac0046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.127+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc1f2de0 msgr2=0x7f4dbc145e30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.127+0000 7f4db2000640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc1f2de0 0x7f4dbc145e30 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc08caf0 tx=0x7f4dac0046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.127+0000 7f4dba800640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d9c06abb0 0x7f4d9c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.127+0000 7f4dba800640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d9c06abb0 0x7f4d9c06d070 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007fd0 tx=0x7f4db4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.133+0000 7f4dbb200640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c4110 0x7f4dbc146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.133+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0723f0 con 0x7f4dbc0c4110 2024-03-23T06:21:22.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.133+0000 7f4db9e00640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c4110 0x7f4dbc146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.134+0000 7f4db9e00640 1 -- 172.21.15.73:0/959590019 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4dbc0c9630 con 0x7f4dbc0c4110 2024-03-23T06:21:22.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.134+0000 7f4db9e00640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c4110 0x7f4dbc146370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009870 tx=0x7f4dac009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.134+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac003b60 con 0x7f4dbc0c4110 2024-03-23T06:21:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4797 (secure 0 0 0) 0x7f4dac003cc0 con 0x7f4dbc0c4110 2024-03-23T06:21:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c4110 msgr2=0x7f4dbc146370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4db2000640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c4110 0x7f4dbc146370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009870 tx=0x7f4dac009240 comp rx=0 tx=0).stop 2024-03-23T06:21:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4db2000640 1 -- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c4110 msgr2=0x7f4dbc146370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:22.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4db2000640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c4110 0x7f4dbc146370 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009870 tx=0x7f4dac009240 comp rx=0 tx=0).stop 2024-03-23T06:21:22.136 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:21:22.136 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 106, 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:22.137 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:22.138 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:21:22.139 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:22.140 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:22.141 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:21:22.142 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.143 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:22.144 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:22.145 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.146 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.147 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:21:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.148 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:21:22.148 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d9c06abb0 msgr2=0x7f4d9c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dbb200640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d9c06abb0 0x7f4d9c06d070 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007fd0 tx=0x7f4db4009040 comp rx=0 tx=0).stop 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 msgr2=0x7f4dbc150c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dbb200640 1 --2- 172.21.15.73:0/959590019 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4dbc0c5050 0x7f4dbc150c20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4da800b550 tx=0x7f4da800ba10 comp rx=0 tx=0).stop 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dba800640 1 -- 172.21.15.73:0/959590019 reap_dead start 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dba800640 1 -- 172.21.15.73:0/959590019 reap_dead start 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 shutdown_connections 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 >> 172.21.15.73:0/959590019 conn(0x7f4dbc0ceb80 msgr2=0x7f4dbc14f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 shutdown_connections 2024-03-23T06:21:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.135+0000 7f4dbb200640 1 -- 172.21.15.73:0/959590019 wait complete. 2024-03-23T06:21:22.150 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:21:22.151 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-03-23T06:21:22.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:21:22.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.331+0000 7f5a83200640 1 Processor -- start 2024-03-23T06:21:22.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.331+0000 7f5a83200640 1 -- start start 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.332+0000 7f5a83200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a840c5050 0x7f5a841592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.332+0000 7f5a83200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840cb130 0x7f5a84069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.332+0000 7f5a83200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8415a1f0 con 0x7f5a840b4780 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.332+0000 7f5a83200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a840c5430 con 0x7f5a840c5050 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.332+0000 7f5a83200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84159950 con 0x7f5a840cb130 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.332+0000 7f5a82800640 1 -- >> v1:172.21.15.110:6789/0 conn(0x7f5a840b4780 legacy=0x7f5a840c9e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.110:6789/0 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.332+0000 7f5a81e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a840c5050 0x7f5a841592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.333+0000 7f5a81e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5a840c5050 0x7f5a841592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53578/0 (socket says 172.21.15.73:53578) 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.333+0000 7f5a81e00640 1 -- 172.21.15.73:0/3478186489 learned_addr learned my addr 172.21.15.73:0/3478186489 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.333+0000 7f5a81400640 1 --2- 172.21.15.73:0/3478186489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840cb130 0x7f5a84069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.333+0000 7f5a81e00640 1 -- 172.21.15.73:0/3478186489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840cb130 msgr2=0x7f5a84069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.333+0000 7f5a81e00640 1 --2- 172.21.15.73:0/3478186489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840cb130 0x7f5a84069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.333+0000 7f5a81e00640 1 -- 172.21.15.73:0/3478186489 >> v1:172.21.15.110:6789/0 conn(0x7f5a840b4780 legacy=0x7f5a840c9e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:22.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.333+0000 7f5a81e00640 1 -- 172.21.15.73:0/3478186489 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a84159c30 con 0x7f5a840c5050 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.334+0000 7f5a81e00640 1 --2- 172.21.15.73:0/3478186489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840c5050 0x7f5a841592a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009870 tx=0x7f5a7402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db71d8033075ad19 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.334+0000 7f5a80a00640 1 -- 172.21.15.73:0/3478186489 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a740317c0 con 0x7f5a840c5050 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.334+0000 7f5a80a00640 1 -- 172.21.15.73:0/3478186489 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74031920 con 0x7f5a840c5050 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.334+0000 7f5a80a00640 1 -- 172.21.15.73:0/3478186489 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74031cb0 con 0x7f5a840c5050 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.335+0000 7f5a83200640 1 -- 172.21.15.73:0/3478186489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840c5050 msgr2=0x7f5a841592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.335+0000 7f5a83200640 1 --2- 172.21.15.73:0/3478186489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840c5050 0x7f5a841592a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009870 tx=0x7f5a7402b860 comp rx=0 tx=0).stop 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.335+0000 7f5a83200640 1 -- 172.21.15.73:0/3478186489 shutdown_connections 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.335+0000 7f5a83200640 1 --2- 172.21.15.73:0/3478186489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840cb130 0x7f5a84069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.335+0000 7f5a83200640 1 --2- 172.21.15.73:0/3478186489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840c5050 0x7f5a841592a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.335+0000 7f5a83200640 1 -- 172.21.15.73:0/3478186489 >> 172.21.15.73:0/3478186489 conn(0x7f5a840ceb80 msgr2=0x7f5a840cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:22.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.335+0000 7f5a83200640 1 -- 172.21.15.73:0/3478186489 shutdown_connections 2024-03-23T06:21:22.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.335+0000 7f5a83200640 1 -- 172.21.15.73:0/3478186489 wait complete. 2024-03-23T06:21:22.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.336+0000 7f5a83200640 1 Processor -- start 2024-03-23T06:21:22.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.337+0000 7f5a83200640 1 -- start start 2024-03-23T06:21:22.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.337+0000 7f5a83200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840b4780 0x7f5a84154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.337+0000 7f5a83200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840c5050 0x7f5a840c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.337+0000 7f5a83200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a840cb130 0x7f5a841eed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.337+0000 7f5a83200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a841f2c40 con 0x7f5a840b4780 2024-03-23T06:21:22.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.337+0000 7f5a83200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a84154f10 con 0x7f5a840cb130 2024-03-23T06:21:22.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.337+0000 7f5a83200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a841f2310 con 0x7f5a840c5050 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840b4780 0x7f5a84154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840b4780 0x7f5a84154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53588/0 (socket says 172.21.15.73:53588) 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a82800640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a840cb130 msgr2=0x7f5a841eed00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 -- 172.21.15.73:0/2451619866 learned_addr learned my addr 172.21.15.73:0/2451619866 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a82800640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a840cb130 0x7f5a841eed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81400640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840c5050 0x7f5a840c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 -- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840c5050 msgr2=0x7f5a840c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840c5050 0x7f5a840c6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 -- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a840cb130 msgr2=0x7f5a841eed00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a840cb130 0x7f5a841eed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 -- 172.21.15.73:0/2451619866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740094d0 con 0x7f5a840b4780 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81400640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a840c5050 0x7f5a840c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a81e00640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840b4780 0x7f5a84154880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a7402b8a0 tx=0x7f5a740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.338+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74032860 con 0x7f5a840b4780 2024-03-23T06:21:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.339+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74032a00 con 0x7f5a840b4780 2024-03-23T06:21:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.339+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74032db0 con 0x7f5a840b4780 2024-03-23T06:21:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.339+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a841f25f0 con 0x7f5a840b4780 2024-03-23T06:21:22.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.339+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a84154610 con 0x7f5a840b4780 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.340+0000 7f5a83200640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841565e0 0x7f5a8414fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.340+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840723f0 con 0x7f5a841565e0 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.340+0000 7f5a81400640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841565e0 0x7f5a8414fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.340+0000 7f5a81400640 1 -- 172.21.15.73:0/2451619866 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a840c9910 con 0x7f5a841565e0 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.341+0000 7f5a81400640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841565e0 0x7f5a8414fd30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5a8408c0a0 tx=0x7f5a70011a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.341+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5a7404e450 con 0x7f5a840b4780 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a7a000640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a6406abe0 0x7f5a6406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5a740ab7e0 con 0x7f5a840b4780 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70015870 con 0x7f5a841565e0 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5a700159d0 con 0x7f5a841565e0 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841565e0 msgr2=0x7f5a8414fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a7a000640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841565e0 0x7f5a8414fd30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5a8408c0a0 tx=0x7f5a70011a60 comp rx=0 tx=0).stop 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841565e0 msgr2=0x7f5a8414fd30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a7a000640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841565e0 0x7f5a8414fd30 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5a8408c0a0 tx=0x7f5a70011a60 comp rx=0 tx=0).stop 2024-03-23T06:21:22.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.342+0000 7f5a82800640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a6406abe0 0x7f5a6406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.343+0000 7f5a82800640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a6406abe0 0x7f5a6406d0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c003cb0 tx=0x7f5a7c0091f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.349+0000 7f5a83200640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841ef240 0x7f5a84150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.349+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a841f2780 con 0x7f5a841ef240 2024-03-23T06:21:22.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.349+0000 7f5a81400640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841ef240 0x7f5a84150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.349+0000 7f5a81400640 1 -- 172.21.15.73:0/2451619866 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5a840c9630 con 0x7f5a841ef240 2024-03-23T06:21:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.350+0000 7f5a81400640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841ef240 0x7f5a84150270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a7001c000 tx=0x7f5a700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.350+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70021050 con 0x7f5a841ef240 2024-03-23T06:21:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.350+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7f5a70006740 con 0x7f5a841ef240 2024-03-23T06:21:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.350+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841ef240 msgr2=0x7f5a84150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.350+0000 7f5a7a000640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841ef240 0x7f5a84150270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a7001c000 tx=0x7f5a700046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.350+0000 7f5a7a000640 1 -- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841ef240 msgr2=0x7f5a84150270 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.350+0000 7f5a7a000640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a841ef240 0x7f5a84150270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 106, 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:21:22.352 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 0, 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:22.353 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:22.354 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:21:22.355 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.356 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.357 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:22.358 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.359 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:22.361 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.362 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:22.363 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:21:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:21:22.364 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a6406abe0 msgr2=0x7f5a6406d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a83200640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f5a6406abe0 0x7f5a6406d0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c003cb0 tx=0x7f5a7c0091f0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840b4780 msgr2=0x7f5a84154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a83200640 1 --2- 172.21.15.73:0/2451619866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a840b4780 0x7f5a84154880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5a7402b8a0 tx=0x7f5a740046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a82800640 1 -- 172.21.15.73:0/2451619866 reap_dead start 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a82800640 1 -- 172.21.15.73:0/2451619866 reap_dead start 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 shutdown_connections 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 >> 172.21.15.73:0/2451619866 conn(0x7f5a840ceb80 msgr2=0x7f5a840cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 shutdown_connections 2024-03-23T06:21:22.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:22.351+0000 7f5a83200640 1 -- 172.21.15.73:0/2451619866 wait complete. 2024-03-23T06:21:22.368 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-03-23T06:21:22.368 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-03-23T06:21:42.369 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-03-23T06:21:42.369 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-03-23T06:21:42.369 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-23T06:21:42.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-23T06:21:42.373 INFO:tasks.ceph.mon.b:Started 2024-03-23T06:21:42.373 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:21:42.373 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:21:42.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.592+0000 7fcb91200640 1 Processor -- start 2024-03-23T06:21:42.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.592+0000 7fcb91200640 1 -- start start 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb91200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0ced20 0x7fcb8c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb91200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb8c0caed0 0x7fcb8c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb91200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8c15a370 con 0x7fcb8c0cf100 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb91200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0cb8d0 con 0x7fcb8c0caed0 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb91200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0ca330 con 0x7fcb8c0ced20 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb8aa00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcb8c0cf100 0x7fcb8c0ca7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33014/0 (socket says 172.21.15.73:33014) 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb8aa00640 1 -- 172.21.15.73:0/3104553967 learned_addr learned my addr 172.21.15.73:0/3104553967 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb8be00640 1 -- 172.21.15.73:0/3104553967 >> v2:172.21.15.110:3300/0 conn(0x7fcb8c0caed0 msgr2=0x7fcb8c159e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb8b400640 1 --2- 172.21.15.73:0/3104553967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0ced20 0x7fcb8c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:42.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.594+0000 7fcb8be00640 1 --2- 172.21.15.73:0/3104553967 >> v2:172.21.15.110:3300/0 conn(0x7fcb8c0caed0 0x7fcb8c159e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:42.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.595+0000 7fcb8a000640 1 -- 172.21.15.73:0/3104553967 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868312133 0 0) 0x7fcb78001040 con 0x7fcb8c0cf100 2024-03-23T06:21:42.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.595+0000 7fcb8a000640 1 -- 172.21.15.73:0/3104553967 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb70003520 con 0x7fcb8c0cf100 2024-03-23T06:21:42.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.595+0000 7fcb8b400640 1 -- 172.21.15.73:0/3104553967 >> v2:172.21.15.110:3300/0 conn(0x7fcb8c0caed0 msgr2=0x7fcb8c159e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:42.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.595+0000 7fcb8b400640 1 --2- 172.21.15.73:0/3104553967 >> v2:172.21.15.110:3300/0 conn(0x7fcb8c0caed0 0x7fcb8c159e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.595+0000 7fcb8b400640 1 -- 172.21.15.73:0/3104553967 >> v1:172.21.15.73:6789/0 conn(0x7fcb8c0cf100 legacy=0x7fcb8c0ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:42.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.595+0000 7fcb8b400640 1 -- 172.21.15.73:0/3104553967 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0cbab0 con 0x7fcb8c0ced20 2024-03-23T06:21:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.596+0000 7fcb8b400640 1 --2- 172.21.15.73:0/3104553967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0ced20 0x7fcb8c0cb390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0097a0 tx=0x7fcb7c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=537d6bf1d07f6631 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.596+0000 7fcb8a000640 1 -- 172.21.15.73:0/3104553967 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c030610 con 0x7fcb8c0ced20 2024-03-23T06:21:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.596+0000 7fcb8a000640 1 -- 172.21.15.73:0/3104553967 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c030770 con 0x7fcb8c0ced20 2024-03-23T06:21:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.596+0000 7fcb8a000640 1 -- 172.21.15.73:0/3104553967 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c030ae0 con 0x7fcb8c0ced20 2024-03-23T06:21:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.597+0000 7fcb91200640 1 -- 172.21.15.73:0/3104553967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0ced20 msgr2=0x7fcb8c0cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.597+0000 7fcb91200640 1 --2- 172.21.15.73:0/3104553967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0ced20 0x7fcb8c0cb390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0097a0 tx=0x7fcb7c02b960 comp rx=0 tx=0).stop 2024-03-23T06:21:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.597+0000 7fcb91200640 1 -- 172.21.15.73:0/3104553967 shutdown_connections 2024-03-23T06:21:42.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.597+0000 7fcb91200640 1 --2- 172.21.15.73:0/3104553967 >> v2:172.21.15.110:3300/0 conn(0x7fcb8c0caed0 0x7fcb8c159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.597+0000 7fcb91200640 1 --2- 172.21.15.73:0/3104553967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0ced20 0x7fcb8c0cb390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.597+0000 7fcb91200640 1 -- 172.21.15.73:0/3104553967 >> 172.21.15.73:0/3104553967 conn(0x7fcb8c0713e0 msgr2=0x7fcb8c0717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.597+0000 7fcb91200640 1 -- 172.21.15.73:0/3104553967 shutdown_connections 2024-03-23T06:21:42.598 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.597+0000 7fcb91200640 1 -- 172.21.15.73:0/3104553967 wait complete. 2024-03-23T06:21:42.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.599+0000 7fcb91200640 1 Processor -- start 2024-03-23T06:21:42.599 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.599+0000 7fcb91200640 1 -- start start 2024-03-23T06:21:42.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb91200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c0caed0 0x7fcb8c1f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:42.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb91200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb8c0ced20 0x7fcb8c154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb91200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0cf100 0x7fcb8c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb91200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c56c0 con 0x7fcb8c0caed0 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb91200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c1540a0 con 0x7fcb8c0ced20 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb91200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c156240 con 0x7fcb8c0cf100 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb8aa00640 1 -- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb8c0ced20 msgr2=0x7fcb8c154530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:3300/0 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb8aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb8c0ced20 0x7fcb8c154530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb8be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0cf100 0x7fcb8c154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb8b400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c0caed0 0x7fcb8c1f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb8be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0cf100 0x7fcb8c154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:47196/0 (socket says 172.21.15.73:47196) 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.600+0000 7fcb8be00640 1 -- 172.21.15.73:0/2041935543 learned_addr learned my addr 172.21.15.73:0/2041935543 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb8be00640 1 -- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb8c0ced20 msgr2=0x7fcb8c154530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb8be00640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb8c0ced20 0x7fcb8c154530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb8be00640 1 -- 172.21.15.73:0/2041935543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c0caed0 msgr2=0x7fcb8c1f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:42.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb8be00640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c0caed0 0x7fcb8c1f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb8be00640 1 -- 172.21.15.73:0/2041935543 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c009400 con 0x7fcb8c0cf100 2024-03-23T06:21:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb8be00640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0cf100 0x7fcb8c154a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400be50 tx=0x7fcb8400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb83400640 1 -- 172.21.15.73:0/2041935543 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84016430 con 0x7fcb8c0cf100 2024-03-23T06:21:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb83400640 1 -- 172.21.15.73:0/2041935543 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb840165b0 con 0x7fcb8c0cf100 2024-03-23T06:21:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c1e0120 con 0x7fcb8c0cf100 2024-03-23T06:21:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb83400640 1 -- 172.21.15.73:0/2041935543 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84016960 con 0x7fcb8c0cf100 2024-03-23T06:21:42.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.601+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c156490 con 0x7fcb8c0cf100 2024-03-23T06:21:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.602+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c154250 con 0x7fcb8c0cf100 2024-03-23T06:21:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.603+0000 7fcb83400640 1 -- 172.21.15.73:0/2041935543 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcb84012020 con 0x7fcb8c0cf100 2024-03-23T06:21:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.604+0000 7fcb83400640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcb6c06abe0 0x7fcb6c06d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.604+0000 7fcb83400640 1 -- 172.21.15.73:0/2041935543 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fcb84089980 con 0x7fcb8c0cf100 2024-03-23T06:21:42.604 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.604+0000 7fcb8b400640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcb6c06abe0 0x7fcb6c06d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:42.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.605+0000 7fcb8b400640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcb6c06abe0 0x7fcb6c06d0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c036000 tx=0x7fcb7c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:42.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.609+0000 7fcb83400640 1 -- 172.21.15.73:0/2041935543 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fcb8c154250 con 0x7fcb8c0cf100 2024-03-23T06:21:42.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.881+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fcb8c154250 con 0x7fcb8c0cf100 2024-03-23T06:21:42.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.881+0000 7fcb83400640 1 -- 172.21.15.73:0/2041935543 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7fcb8c154250 con 0x7fcb8c0cf100 2024-03-23T06:21:42.881 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":106,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:21:42.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcb6c06abe0 msgr2=0x7fcb6c06d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:42.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcb6c06abe0 0x7fcb6c06d0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c036000 tx=0x7fcb7c008030 comp rx=0 tx=0).stop 2024-03-23T06:21:42.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0cf100 msgr2=0x7fcb8c154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:42.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0cf100 0x7fcb8c154a70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400be50 tx=0x7fcb8400bf40 comp rx=0 tx=0).stop 2024-03-23T06:21:42.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 shutdown_connections 2024-03-23T06:21:42.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcb6c06abe0 0x7fcb6c06d0a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb8c0cf100 0x7fcb8c154a70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb8c0ced20 0x7fcb8c154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 --2- 172.21.15.73:0/2041935543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c0caed0 0x7fcb8c1f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:42.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 >> 172.21.15.73:0/2041935543 conn(0x7fcb8c0713e0 msgr2=0x7fcb8c0cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:42.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 shutdown_connections 2024-03-23T06:21:42.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:42.884+0000 7fcb91200640 1 -- 172.21.15.73:0/2041935543 wait complete. 2024-03-23T06:21:45.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:21:46.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.102+0000 7f4672800640 1 Processor -- start 2024-03-23T06:21:46.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.103+0000 7f4672800640 1 -- start start 2024-03-23T06:21:46.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4672800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 0x7f466c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:46.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4672800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0caed0 0x7f466c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:46.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4672800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c15a370 con 0x7f466c0cf100 2024-03-23T06:21:46.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4672800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c0cb8d0 con 0x7f466c0ced20 2024-03-23T06:21:46.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4672800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0ca330 con 0x7f466c0caed0 2024-03-23T06:21:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4671400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 0x7f466c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4671e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0caed0 0x7f466c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4670a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f466c0cf100 0x7f466c0ca7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:60712/0 (socket says 172.21.15.73:60712) 2024-03-23T06:21:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4671400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 0x7f466c0cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57122/0 (socket says 172.21.15.73:57122) 2024-03-23T06:21:46.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.104+0000 7f4670a00640 1 -- 172.21.15.73:0/4137257133 learned_addr learned my addr 172.21.15.73:0/4137257133 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.105+0000 7f4671400640 1 -- 172.21.15.73:0/4137257133 >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 msgr2=0x7f466c0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-23T06:21:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.105+0000 7f4671400640 1 -- 172.21.15.73:0/4137257133 >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 msgr2=0x7f466c0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-23T06:21:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.105+0000 7f4671400640 1 --2- 172.21.15.73:0/4137257133 >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 0x7f466c0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.105+0000 7f4671400640 1 --2- 172.21.15.73:0/4137257133 >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 0x7f466c0cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.105+0000 7f4671e00640 1 -- 172.21.15.73:0/4137257133 >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 msgr2=0x7f466c0cb390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-23T06:21:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.105+0000 7f4671e00640 1 --2- 172.21.15.73:0/4137257133 >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 0x7f466c0cb390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.105+0000 7f4671e00640 1 -- 172.21.15.73:0/4137257133 >> v1:172.21.15.110:6789/0 conn(0x7f466c0cf100 legacy=0x7f466c0ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:46.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.105+0000 7f4671e00640 1 -- 172.21.15.73:0/4137257133 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c0cbab0 con 0x7f466c0caed0 2024-03-23T06:21:46.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.106+0000 7f4671e00640 1 --2- 172.21.15.73:0/4137257133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0caed0 0x7f466c159e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f466402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff99b2a388f654d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:46.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.107+0000 7f466be00640 1 -- 172.21.15.73:0/4137257133 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466402cce0 con 0x7f466c0caed0 2024-03-23T06:21:46.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.107+0000 7f466be00640 1 -- 172.21.15.73:0/4137257133 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466402ce40 con 0x7f466c0caed0 2024-03-23T06:21:46.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.107+0000 7f466be00640 1 -- 172.21.15.73:0/4137257133 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4664034660 con 0x7f466c0caed0 2024-03-23T06:21:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.107+0000 7f4672800640 1 -- 172.21.15.73:0/4137257133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0caed0 msgr2=0x7f466c159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.107+0000 7f4672800640 1 --2- 172.21.15.73:0/4137257133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0caed0 0x7f466c159e30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4664009d90 tx=0x7f466402bf30 comp rx=0 tx=0).stop 2024-03-23T06:21:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.108+0000 7f4672800640 1 -- 172.21.15.73:0/4137257133 shutdown_connections 2024-03-23T06:21:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.108+0000 7f4672800640 1 --2- 172.21.15.73:0/4137257133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0caed0 0x7f466c159e30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.108+0000 7f4672800640 1 --2- 172.21.15.73:0/4137257133 >> v2:172.21.15.110:3300/0 conn(0x7f466c0ced20 0x7f466c0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.108+0000 7f4672800640 1 -- 172.21.15.73:0/4137257133 >> 172.21.15.73:0/4137257133 conn(0x7f466c0713e0 msgr2=0x7f466c0717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.108+0000 7f4672800640 1 -- 172.21.15.73:0/4137257133 shutdown_connections 2024-03-23T06:21:46.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.108+0000 7f4672800640 1 -- 172.21.15.73:0/4137257133 wait complete. 2024-03-23T06:21:46.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.110+0000 7f4672800640 1 Processor -- start 2024-03-23T06:21:46.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.110+0000 7f4672800640 1 -- start start 2024-03-23T06:21:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4672800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466c0caed0 0x7f466c154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4672800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 0x7f466c1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4672800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0cf100 0x7f466c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4672800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0c4df0 con 0x7f466c0caed0 2024-03-23T06:21:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4672800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c153d20 con 0x7f466c0ced20 2024-03-23T06:21:46.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4672800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c0c2d10 con 0x7f466c0cf100 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466c0caed0 0x7f466c154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466c0caed0 0x7f466c154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:50052/0 (socket says 172.21.15.73:50052) 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671400640 1 -- 172.21.15.73:0/1492344767 learned_addr learned my addr 172.21.15.73:0/1492344767 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4670a00640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 0x7f466c1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671e00640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0cf100 0x7f466c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4670a00640 1 -- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 msgr2=0x7f466c1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4670a00640 1 -- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 msgr2=0x7f466c1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4670a00640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 0x7f466c1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4670a00640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 0x7f466c1552a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671400640 1 -- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0cf100 msgr2=0x7f466c1557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671400640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0cf100 0x7f466c1557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671400640 1 -- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 msgr2=0x7f466c1552a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-23T06:21:46.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671400640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 0x7f466c1552a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.112+0000 7f4671400640 1 -- 172.21.15.73:0/1492344767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4664009a70 con 0x7f466c0caed0 2024-03-23T06:21:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.113+0000 7f4671400640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466c0caed0 0x7f466c154800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f466000d7d0 tx=0x7f466000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.113+0000 7f4669600640 1 -- 172.21.15.73:0/1492344767 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000b6c0 con 0x7f466c0caed0 2024-03-23T06:21:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.113+0000 7f4669600640 1 -- 172.21.15.73:0/1492344767 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000b840 con 0x7f466c0caed0 2024-03-23T06:21:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.113+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c15cb50 con 0x7f466c0caed0 2024-03-23T06:21:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.113+0000 7f4669600640 1 -- 172.21.15.73:0/1492344767 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000bbf0 con 0x7f466c0caed0 2024-03-23T06:21:46.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.113+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c153fa0 con 0x7f466c0caed0 2024-03-23T06:21:46.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.114+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c0c5880 con 0x7f466c0caed0 2024-03-23T06:21:46.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.115+0000 7f4669600640 1 -- 172.21.15.73:0/1492344767 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f466000bd50 con 0x7f466c0caed0 2024-03-23T06:21:46.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.116+0000 7f4669600640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f464c06ac00 0x7f464c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:46.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.116+0000 7f4669600640 1 -- 172.21.15.73:0/1492344767 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f4660089c90 con 0x7f466c0caed0 2024-03-23T06:21:46.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.116+0000 7f4670a00640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f464c06ac00 0x7f464c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:46.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.117+0000 7f4670a00640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f464c06ac00 0x7f464c06d0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f466c0cfbd0 tx=0x7f4658009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:46.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.120+0000 7f4669600640 1 -- 172.21.15.73:0/1492344767 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f46600549d0 con 0x7f466c0caed0 2024-03-23T06:21:46.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.383+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f466c0c75f0 con 0x7f466c0caed0 2024-03-23T06:21:46.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.384+0000 7f4669600640 1 -- 172.21.15.73:0/1492344767 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1543 (secure 0 0 0) 0x7f4660057ff0 con 0x7f466c0caed0 2024-03-23T06:21:46.384 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":106,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:21:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f464c06ac00 msgr2=0x7f464c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f464c06ac00 0x7f464c06d0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f466c0cfbd0 tx=0x7f4658009040 comp rx=0 tx=0).stop 2024-03-23T06:21:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466c0caed0 msgr2=0x7f466c154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466c0caed0 0x7f466c154800 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f466000d7d0 tx=0x7f466000dc90 comp rx=0 tx=0).stop 2024-03-23T06:21:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 shutdown_connections 2024-03-23T06:21:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f464c06ac00 0x7f464c06d0c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f466c0cf100 0x7f466c1557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f466c0ced20 0x7f466c1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 --2- 172.21.15.73:0/1492344767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f466c0caed0 0x7f466c154800 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 >> 172.21.15.73:0/1492344767 conn(0x7f466c0713e0 msgr2=0x7f466c150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 shutdown_connections 2024-03-23T06:21:46.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:46.387+0000 7f4672800640 1 -- 172.21.15.73:0/1492344767 wait complete. 2024-03-23T06:21:49.406 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:21:49.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.606+0000 7fc54ea00640 1 Processor -- start 2024-03-23T06:21:49.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.606+0000 7fc54ea00640 1 -- start start 2024-03-23T06:21:49.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.607+0000 7fc54ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc5480c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:49.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc548069cb0 0x7fc54806a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:49.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54806c820 con 0x7fc54815c8c0 2024-03-23T06:21:49.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54ea00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5481592d0 con 0x7fc548069cb0 2024-03-23T06:21:49.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54806ca70 con 0x7fc5480c59d0 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54d600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc5480c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54cc00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc54815c8c0 0x7fc548159cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:60726/0 (socket says 172.21.15.73:60726) 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54cc00640 1 -- 172.21.15.73:0/4214324909 learned_addr learned my addr 172.21.15.73:0/4214324909 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54e000640 1 --2- 172.21.15.73:0/4214324909 >> v2:172.21.15.73:3300/0 conn(0x7fc548069cb0 0x7fc54806a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc547e00640 1 -- 172.21.15.73:0/4214324909 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140273098 0 0) 0x7fc54806c820 con 0x7fc54815c8c0 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc547e00640 1 -- 172.21.15.73:0/4214324909 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc530003520 con 0x7fc54815c8c0 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54d600640 1 -- 172.21.15.73:0/4214324909 >> v2:172.21.15.73:3300/0 conn(0x7fc548069cb0 msgr2=0x7fc54806a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54d600640 1 --2- 172.21.15.73:0/4214324909 >> v2:172.21.15.73:3300/0 conn(0x7fc548069cb0 0x7fc54806a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54d600640 1 -- 172.21.15.73:0/4214324909 >> v1:172.21.15.110:6789/0 conn(0x7fc54815c8c0 legacy=0x7fc548159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:49.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.608+0000 7fc54d600640 1 -- 172.21.15.73:0/4214324909 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54806cd50 con 0x7fc5480c59d0 2024-03-23T06:21:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.609+0000 7fc54d600640 1 --2- 172.21.15.73:0/4214324909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc5480c6d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0097a0 tx=0x7fc53c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c844c8909687492f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc547e00640 1 -- 172.21.15.73:0/4214324909 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c02d040 con 0x7fc5480c59d0 2024-03-23T06:21:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc547e00640 1 -- 172.21.15.73:0/4214324909 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c031810 con 0x7fc5480c59d0 2024-03-23T06:21:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc547e00640 1 -- 172.21.15.73:0/4214324909 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c031ba0 con 0x7fc5480c59d0 2024-03-23T06:21:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc54ea00640 1 -- 172.21.15.73:0/4214324909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 msgr2=0x7fc5480c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc54ea00640 1 --2- 172.21.15.73:0/4214324909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc5480c6d80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0097a0 tx=0x7fc53c02b8b0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc54ea00640 1 -- 172.21.15.73:0/4214324909 shutdown_connections 2024-03-23T06:21:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc54ea00640 1 --2- 172.21.15.73:0/4214324909 >> v2:172.21.15.73:3300/0 conn(0x7fc548069cb0 0x7fc54806a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc54ea00640 1 --2- 172.21.15.73:0/4214324909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc5480c6d80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc54ea00640 1 -- 172.21.15.73:0/4214324909 >> 172.21.15.73:0/4214324909 conn(0x7fc5480cb970 msgr2=0x7fc5480cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.610+0000 7fc54ea00640 1 -- 172.21.15.73:0/4214324909 shutdown_connections 2024-03-23T06:21:49.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.611+0000 7fc54ea00640 1 -- 172.21.15.73:0/4214324909 wait complete. 2024-03-23T06:21:49.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.612+0000 7fc54ea00640 1 Processor -- start 2024-03-23T06:21:49.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.612+0000 7fc54ea00640 1 -- start start 2024-03-23T06:21:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc548069cb0 0x7fc54814bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc54815c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54815c8c0 0x7fc548071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54ea00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5481e5640 con 0x7fc548069cb0 2024-03-23T06:21:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5481e2f40 con 0x7fc54815c8c0 2024-03-23T06:21:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54815a490 con 0x7fc5480c59d0 2024-03-23T06:21:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc54815c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54d600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc548069cb0 0x7fc54814bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54815c8c0 0x7fc548071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc54815c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:47240/0 (socket says 172.21.15.73:47240) 2024-03-23T06:21:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54815c8c0 0x7fc548071660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:57146/0 (socket says 172.21.15.73:57146) 2024-03-23T06:21:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.613+0000 7fc54cc00640 1 -- 172.21.15.73:0/2980364870 learned_addr learned my addr 172.21.15.73:0/2980364870 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54cc00640 1 -- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54815c8c0 msgr2=0x7fc548071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54cc00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54815c8c0 0x7fc548071660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54cc00640 1 -- 172.21.15.73:0/2980364870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc548069cb0 msgr2=0x7fc54814bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54cc00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc548069cb0 0x7fc54814bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54cc00640 1 -- 172.21.15.73:0/2980364870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c009400 con 0x7fc5480c59d0 2024-03-23T06:21:49.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54e000640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54815c8c0 0x7fc548071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:21:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54cc00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc54815c140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c500 tx=0x7fc53400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc545600640 1 -- 172.21.15.73:0/2980364870 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534005ce0 con 0x7fc5480c59d0 2024-03-23T06:21:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc545600640 1 -- 172.21.15.73:0/2980364870 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534005e40 con 0x7fc5480c59d0 2024-03-23T06:21:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc545600640 1 -- 172.21.15.73:0/2980364870 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5340072f0 con 0x7fc5480c59d0 2024-03-23T06:21:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54814c060 con 0x7fc5480c59d0 2024-03-23T06:21:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.614+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54815c680 con 0x7fc5480c59d0 2024-03-23T06:21:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.616+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54804e030 con 0x7fc5480c59d0 2024-03-23T06:21:49.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.616+0000 7fc545600640 1 -- 172.21.15.73:0/2980364870 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc534007510 con 0x7fc5480c59d0 2024-03-23T06:21:49.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.617+0000 7fc545600640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc52806ac00 0x7fc52806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.618+0000 7fc545600640 1 -- 172.21.15.73:0/2980364870 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fc534088cc0 con 0x7fc5480c59d0 2024-03-23T06:21:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.618+0000 7fc54d600640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc52806ac00 0x7fc52806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:49.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.618+0000 7fc54d600640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc52806ac00 0x7fc52806d0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc53c036000 tx=0x7fc53c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:49.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.621+0000 7fc545600640 1 -- 172.21.15.73:0/2980364870 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc53408f080 con 0x7fc5480c59d0 2024-03-23T06:21:49.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.889+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc54814ccc0 con 0x7fc5480c59d0 2024-03-23T06:21:49.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.889+0000 7fc545600640 1 -- 172.21.15.73:0/2980364870 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1548 (secure 0 0 0) 0x7fc534017020 con 0x7fc5480c59d0 2024-03-23T06:21:49.890 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:21:49.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc52806ac00 msgr2=0x7fc52806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc52806ac00 0x7fc52806d0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc53c036000 tx=0x7fc53c03c040 comp rx=0 tx=0).stop 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 msgr2=0x7fc54815c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc54815c140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c500 tx=0x7fc53400c9c0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 shutdown_connections 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc54815c8c0 0x7fc548071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc52806ac00 0x7fc52806d0c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5480c59d0 0x7fc54815c140 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 --2- 172.21.15.73:0/2980364870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc548069cb0 0x7fc54814bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 >> 172.21.15.73:0/2980364870 conn(0x7fc5480cb970 msgr2=0x7fc5480c6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 shutdown_connections 2024-03-23T06:21:49.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:49.892+0000 7fc54ea00640 1 -- 172.21.15.73:0/2980364870 wait complete. 2024-03-23T06:21:49.911 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:21:49.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-03-23T06:21:49.911 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-23T06:21:50.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.107+0000 7f3d0f200640 1 Processor -- start 2024-03-23T06:21:50.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.107+0000 7f3d0f200640 1 -- start start 2024-03-23T06:21:50.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.109+0000 7f3d0f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d100cb130 0x7f3d101592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.109+0000 7f3d0f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d100c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.109+0000 7f3d0f200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1015a1f0 con 0x7f3d100c5050 2024-03-23T06:21:50.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.109+0000 7f3d0f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100c5430 con 0x7f3d100cb130 2024-03-23T06:21:50.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.109+0000 7f3d0f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10159950 con 0x7f3d100b4780 2024-03-23T06:21:50.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.109+0000 7f3d0de00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3d100c5050 0x7f3d10069cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51916/0 (socket says 172.21.15.73:51916) 2024-03-23T06:21:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.109+0000 7f3d0de00640 1 -- 172.21.15.73:0/3207857380 learned_addr learned my addr 172.21.15.73:0/3207857380 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d07e00640 1 --2- 172.21.15.73:0/3207857380 >> v2:172.21.15.110:3300/0 conn(0x7f3d100cb130 0x7f3d101592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d0e800640 1 --2- 172.21.15.73:0/3207857380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d100c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d0d400640 1 -- 172.21.15.73:0/3207857380 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296500028 0 0) 0x7f3d1015a1f0 con 0x7f3d100c5050 2024-03-23T06:21:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d0d400640 1 -- 172.21.15.73:0/3207857380 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf4003520 con 0x7f3d100c5050 2024-03-23T06:21:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d0e800640 1 -- 172.21.15.73:0/3207857380 >> v2:172.21.15.110:3300/0 conn(0x7f3d100cb130 msgr2=0x7f3d101592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:50.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d0e800640 1 --2- 172.21.15.73:0/3207857380 >> v2:172.21.15.110:3300/0 conn(0x7f3d100cb130 0x7f3d101592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d0e800640 1 -- 172.21.15.73:0/3207857380 >> v1:172.21.15.73:6789/0 conn(0x7f3d100c5050 legacy=0x7f3d10069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d0e800640 1 -- 172.21.15.73:0/3207857380 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d10159c30 con 0x7f3d100b4780 2024-03-23T06:21:50.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.110+0000 7f3d07e00640 1 --2- 172.21.15.73:0/3207857380 >> v2:172.21.15.110:3300/0 conn(0x7f3d100cb130 0x7f3d101592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:21:50.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0e800640 1 --2- 172.21.15.73:0/3207857380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d100c9e30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009d90 tx=0x7f3d0802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eaef5d3665fb15b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0d400640 1 -- 172.21.15.73:0/3207857380 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0802cbd0 con 0x7f3d100b4780 2024-03-23T06:21:50.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0d400640 1 -- 172.21.15.73:0/3207857380 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0802cd30 con 0x7f3d100b4780 2024-03-23T06:21:50.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0d400640 1 -- 172.21.15.73:0/3207857380 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0802cea0 con 0x7f3d100b4780 2024-03-23T06:21:50.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0f200640 1 -- 172.21.15.73:0/3207857380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 msgr2=0x7f3d100c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0f200640 1 --2- 172.21.15.73:0/3207857380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d100c9e30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009d90 tx=0x7f3d0802be20 comp rx=0 tx=0).stop 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0f200640 1 -- 172.21.15.73:0/3207857380 shutdown_connections 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0f200640 1 --2- 172.21.15.73:0/3207857380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d100c9e30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0f200640 1 --2- 172.21.15.73:0/3207857380 >> v2:172.21.15.110:3300/0 conn(0x7f3d100cb130 0x7f3d101592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.112+0000 7f3d0f200640 1 -- 172.21.15.73:0/3207857380 >> 172.21.15.73:0/3207857380 conn(0x7f3d100ceb80 msgr2=0x7f3d100cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.113+0000 7f3d0f200640 1 -- 172.21.15.73:0/3207857380 shutdown_connections 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.113+0000 7f3d0f200640 1 -- 172.21.15.73:0/3207857380 wait complete. 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.114+0000 7f3d0f200640 1 Processor -- start 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.114+0000 7f3d0f200640 1 -- start start 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d10152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d100c5050 0x7f3d10153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d100cb130 0x7f3d101ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100c4300 con 0x7f3d100cb130 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101eeaf0 con 0x7f3d100c5050 2024-03-23T06:21:50.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d101557e0 con 0x7f3d100b4780 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d10152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d10152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41788/0 (socket says 172.21.15.73:41788) 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d07e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d100c5050 0x7f3d10153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0de00640 1 -- 172.21.15.73:0/4040228239 learned_addr learned my addr 172.21.15.73:0/4040228239 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.115+0000 7f3d0e800640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d100cb130 0x7f3d101ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0de00640 1 -- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d100c5050 msgr2=0x7f3d10153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0de00640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d100c5050 0x7f3d10153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0de00640 1 -- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d100cb130 msgr2=0x7f3d101ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0de00640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d100cb130 0x7f3d101ef2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0de00640 1 -- 172.21.15.73:0/4040228239 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8009400 con 0x7f3d100b4780 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d07e00640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d100c5050 0x7f3d10153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0e800640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d100cb130 0x7f3d101ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:21:50.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0de00640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d10152140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000c390 tx=0x7f3d0000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d00005ce0 con 0x7f3d100b4780 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d00005e40 con 0x7f3d100b4780 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d000072f0 con 0x7f3d100b4780 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d08009a70 con 0x7f3d100b4780 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.116+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1014ff90 con 0x7f3d100b4780 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.117+0000 7f3d0f200640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d101ef810 0x7f3d101eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.117+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100723f0 con 0x7f3d101ef810 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.118+0000 7f3d07e00640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d101ef810 0x7f3d101eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.118+0000 7f3d07e00640 1 -- 172.21.15.73:0/4040228239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d100c9910 con 0x7f3d101ef810 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.118+0000 7f3d07e00640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d101ef810 0x7f3d101eecb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009f30 tx=0x7f3cf800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.118+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8004240 con 0x7f3d101ef810 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.118+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3d00007450 con 0x7f3d100b4780 2024-03-23T06:21:50.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.119+0000 7f3d06000640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3cec06aca0 0x7f3cec06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.119+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f3d00088c30 con 0x7f3d100b4780 2024-03-23T06:21:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.120+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f3cf80043a0 con 0x7f3d101ef810 2024-03-23T06:21:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.120+0000 7f3d0e800640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3cec06aca0 0x7f3cec06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.120+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d101ef810 msgr2=0x7f3d101eecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.120+0000 7f3d06000640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d101ef810 0x7f3d101eecb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009f30 tx=0x7f3cf800f610 comp rx=0 tx=0).stop 2024-03-23T06:21:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.120+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d101ef810 msgr2=0x7f3d101eecb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.120+0000 7f3d06000640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d101ef810 0x7f3d101eecb0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009f30 tx=0x7f3cf800f610 comp rx=0 tx=0).stop 2024-03-23T06:21:50.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.120+0000 7f3d0e800640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3cec06aca0 0x7f3cec06d160 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3d08036000 tx=0x7f3d08030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.126+0000 7f3d0f200640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d10150270 0x7f3d1014c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.126+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100c9630 con 0x7f3d10150270 2024-03-23T06:21:50.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.126+0000 7f3d07e00640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d10150270 0x7f3d1014c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.127+0000 7f3d07e00640 1 -- 172.21.15.73:0/4040228239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3d1006a3c0 con 0x7f3d10150270 2024-03-23T06:21:50.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.127+0000 7f3d07e00640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d10150270 0x7f3d1014c120 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cf801b000 tx=0x7f3cf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.127+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf801eb30 con 0x7f3d10150270 2024-03-23T06:21:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4808 (secure 0 0 0) 0x7f3cf8004510 con 0x7f3d10150270 2024-03-23T06:21:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d10150270 msgr2=0x7f3d1014c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d06000640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d10150270 0x7f3d1014c120 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cf801b000 tx=0x7f3cf80046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d06000640 1 -- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d10150270 msgr2=0x7f3d1014c120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:50.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d06000640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d10150270 0x7f3d1014c120 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cf801b000 tx=0x7f3cf80046c0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.128 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "leader", 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 108, 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 2, 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.129 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:21:50.131 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.132 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:50.133 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.134 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.135 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.136 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.137 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.138 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.139 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:50.140 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.141 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:21:50.141 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:21:50.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3cec06aca0 msgr2=0x7f3cec06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0f200640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f3cec06aca0 0x7f3cec06d160 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3d08036000 tx=0x7f3d08030000 comp rx=0 tx=0).stop 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 msgr2=0x7f3d10152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0f200640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d10152140 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000c390 tx=0x7f3d0000c850 comp rx=0 tx=0).stop 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0e800640 1 -- 172.21.15.73:0/4040228239 reap_dead start 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 shutdown_connections 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0f200640 1 --2- 172.21.15.73:0/4040228239 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d100b4780 0x7f3d10152140 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 >> 172.21.15.73:0/4040228239 conn(0x7f3d100ceb80 msgr2=0x7f3d100cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.128+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 shutdown_connections 2024-03-23T06:21:50.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.129+0000 7f3d0f200640 1 -- 172.21.15.73:0/4040228239 wait complete. 2024-03-23T06:21:50.144 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:21:50.144 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-03-23T06:21:50.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-23T06:21:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.333+0000 7efcb5800640 1 Processor -- start 2024-03-23T06:21:50.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.334+0000 7efcb5800640 1 -- start start 2024-03-23T06:21:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.335+0000 7efcb5800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efcb00cb130 0x7efcb01592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.335+0000 7efcb5800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb015a1f0 con 0x7efcb00b4780 2024-03-23T06:21:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.335+0000 7efcb5800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb00c5430 con 0x7efcb00c5050 2024-03-23T06:21:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.335+0000 7efcb5800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb0159950 con 0x7efcb00cb130 2024-03-23T06:21:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.335+0000 7efca7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efcb00cb130 0x7efcb01592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.335+0000 7efcafe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7efcb00c5050 0x7efcb0069cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:34828/0 (socket says 172.21.15.73:34828) 2024-03-23T06:21:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.335+0000 7efcafe00640 1 -- 172.21.15.73:0/1573373503 learned_addr learned my addr 172.21.15.73:0/1573373503 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.336+0000 7efca7e00640 1 -- 172.21.15.73:0/1573373503 >> v1:172.21.15.110:6789/0 conn(0x7efcb00c5050 legacy=0x7efcb0069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.336+0000 7efca7e00640 1 -- 172.21.15.73:0/1573373503 >> v1:172.21.15.73:6789/0 conn(0x7efcb00b4780 legacy=0x7efcb00c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.336+0000 7efca7e00640 1 -- 172.21.15.73:0/1573373503 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0159c30 con 0x7efcb00cb130 2024-03-23T06:21:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.337+0000 7efca7e00640 1 --2- 172.21.15.73:0/1573373503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00cb130 0x7efcb01592a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc980097a0 tx=0x7efc9802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3acba4963417569d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.337+0000 7efcaf400640 1 -- 172.21.15.73:0/1573373503 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9802e070 con 0x7efcb00cb130 2024-03-23T06:21:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.337+0000 7efcaf400640 1 -- 172.21.15.73:0/1573373503 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc980315a0 con 0x7efcb00cb130 2024-03-23T06:21:50.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.337+0000 7efcaf400640 1 -- 172.21.15.73:0/1573373503 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98031930 con 0x7efcb00cb130 2024-03-23T06:21:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.337+0000 7efcb5800640 1 -- 172.21.15.73:0/1573373503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00cb130 msgr2=0x7efcb01592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.337+0000 7efcb5800640 1 --2- 172.21.15.73:0/1573373503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00cb130 0x7efcb01592a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc980097a0 tx=0x7efc9802b840 comp rx=0 tx=0).stop 2024-03-23T06:21:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.337+0000 7efcb5800640 1 -- 172.21.15.73:0/1573373503 shutdown_connections 2024-03-23T06:21:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.338+0000 7efcb5800640 1 --2- 172.21.15.73:0/1573373503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00cb130 0x7efcb01592a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.338+0000 7efcb5800640 1 -- 172.21.15.73:0/1573373503 >> 172.21.15.73:0/1573373503 conn(0x7efcb00ceb80 msgr2=0x7efcb00cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.338+0000 7efcb5800640 1 -- 172.21.15.73:0/1573373503 shutdown_connections 2024-03-23T06:21:50.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.338+0000 7efcb5800640 1 -- 172.21.15.73:0/1573373503 wait complete. 2024-03-23T06:21:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.339+0000 7efcb5800640 1 Processor -- start 2024-03-23T06:21:50.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.339+0000 7efcb5800640 1 -- start start 2024-03-23T06:21:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcb5800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00b4780 0x7efcb00cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcb5800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00c5050 0x7efcb01e05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcb5800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb00cb130 0x7efcb01e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcb5800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb01e16a0 con 0x7efcb00cb130 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcb5800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb01e0120 con 0x7efcb00b4780 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcb5800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb01e51c0 con 0x7efcb00c5050 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcafe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00b4780 0x7efcb00cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efca7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00c5050 0x7efcb01e05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcafe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00b4780 0x7efcb00cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:40120/0 (socket says 172.21.15.73:40120) 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcafe00640 1 -- 172.21.15.73:0/239207900 learned_addr learned my addr 172.21.15.73:0/239207900 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.340+0000 7efcb4e00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb00cb130 0x7efcb01e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcafe00640 1 -- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00c5050 msgr2=0x7efcb01e05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcafe00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00c5050 0x7efcb01e05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcafe00640 1 -- 172.21.15.73:0/239207900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb00cb130 msgr2=0x7efcb01e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcafe00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efcb00cb130 0x7efcb01e0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcafe00640 1 -- 172.21.15.73:0/239207900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009400 con 0x7efcb00b4780 2024-03-23T06:21:50.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcafe00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00b4780 0x7efcb00cdd00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efca000c480 tx=0x7efca000c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0005ce0 con 0x7efcb00b4780 2024-03-23T06:21:50.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0005e40 con 0x7efcb00b4780 2024-03-23T06:21:50.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb01efb10 con 0x7efcb00b4780 2024-03-23T06:21:50.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00072f0 con 0x7efcb00b4780 2024-03-23T06:21:50.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.341+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb01e4ee0 con 0x7efcb00b4780 2024-03-23T06:21:50.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.342+0000 7efcb5800640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb01df320 0x7efcb01dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.342+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00723f0 con 0x7efcb01df320 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.343+0000 7efca7e00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb01df320 0x7efcb01dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.343+0000 7efca7e00640 1 -- 172.21.15.73:0/239207900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcb00c9910 con 0x7efcb01df320 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.343+0000 7efca7e00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb01df320 0x7efcb01dfa30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcb008caf0 tx=0x7efc98004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.343+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98032a00 con 0x7efcb01df320 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.344+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7efc98032b60 con 0x7efcb01df320 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.344+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb01df320 msgr2=0x7efcb01dfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.344+0000 7efcacc00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb01df320 0x7efcb01dfa30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcb008caf0 tx=0x7efc98004730 comp rx=0 tx=0).stop 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.344+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb01df320 msgr2=0x7efcb01dfa30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.344+0000 7efcacc00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb01df320 0x7efcb01dfa30 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efcb008caf0 tx=0x7efc98004730 comp rx=0 tx=0).stop 2024-03-23T06:21:50.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.344+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efca0007450 con 0x7efcb00b4780 2024-03-23T06:21:50.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.345+0000 7efcacc00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efc8c06a980 0x7efc8c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.345+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7efca0088b00 con 0x7efcb00b4780 2024-03-23T06:21:50.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.345+0000 7efca7e00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efc8c06a980 0x7efc8c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.346+0000 7efca7e00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efc8c06a980 0x7efc8c06ce40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efcb01f3290 tx=0x7efc98044000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.351+0000 7efcb5800640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb014fac0 0x7efcb014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.351+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00c9630 con 0x7efcb014fac0 2024-03-23T06:21:50.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.351+0000 7efcb4e00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb014fac0 0x7efcb014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.351+0000 7efcb4e00640 1 -- 172.21.15.73:0/239207900 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7efcb01dff70 con 0x7efcb014fac0 2024-03-23T06:21:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.352+0000 7efcb4e00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb014fac0 0x7efcb014fea0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efca800f7e0 tx=0x7efca800fca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.352+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca8017070 con 0x7efcb014fac0 2024-03-23T06:21:50.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.352+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 <== mon.1 v2:172.21.15.110:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4466 (secure 0 0 0) 0x7efca8003b80 con 0x7efcb014fac0 2024-03-23T06:21:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.352+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb014fac0 msgr2=0x7efcb014fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.352+0000 7efcacc00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb014fac0 0x7efcb014fea0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efca800f7e0 tx=0x7efca800fca0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.352+0000 7efcacc00640 1 -- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb014fac0 msgr2=0x7efcb014fea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:50.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.352+0000 7efcacc00640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb014fac0 0x7efcb014fea0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efca800f7e0 tx=0x7efca800fca0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.353 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:21:50.353 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:50.353 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 108, 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 3, 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:50.354 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.355 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.356 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.357 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:21:50.357 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:21:50.357 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:21:50.357 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:21:50.357 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:21:50.357 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:21:50.357 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:50.357 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:50.358 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:21:50.358 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:21:50.358 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:21:50.358 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:21:50.358 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.359 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.360 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:21:50.361 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:21:50.362 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.363 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.364 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.365 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.366 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.367 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:21:50.367 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.367 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.367 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.367 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:21:50.367 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:21:50.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efc8c06a980 msgr2=0x7efc8c06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7efc8c06a980 0x7efc8c06ce40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efcb01f3290 tx=0x7efc98044000 comp rx=0 tx=0).stop 2024-03-23T06:21:50.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00b4780 msgr2=0x7efcb00cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00b4780 0x7efcb00cdd00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efca000c480 tx=0x7efca000c940 comp rx=0 tx=0).stop 2024-03-23T06:21:50.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb4e00640 1 -- 172.21.15.73:0/239207900 reap_dead start 2024-03-23T06:21:50.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 shutdown_connections 2024-03-23T06:21:50.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 --2- 172.21.15.73:0/239207900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb00b4780 0x7efcb00cdd00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 >> 172.21.15.73:0/239207900 conn(0x7efcb00ceb80 msgr2=0x7efcb01581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:50.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 shutdown_connections 2024-03-23T06:21:50.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.353+0000 7efcb5800640 1 -- 172.21.15.73:0/239207900 wait complete. 2024-03-23T06:21:50.370 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:21:50.370 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-03-23T06:21:50.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-23T06:21:50.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.560+0000 7f4d75c00640 1 Processor -- start 2024-03-23T06:21:50.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.560+0000 7f4d75c00640 1 -- start start 2024-03-23T06:21:50.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d75c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d700cb130 0x7f4d701592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d75c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4d700b4780 0x7f4d700c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d75c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7015a1f0 con 0x7f4d700c5050 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d75c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700c5430 con 0x7f4d700b4780 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d75c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d70159950 con 0x7f4d700cb130 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d6fe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4d700c5050 0x7f4d70069cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:34844/0 (socket says 172.21.15.73:34844) 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d6fe00640 1 -- 172.21.15.73:0/1950339715 learned_addr learned my addr 172.21.15.73:0/1950339715 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d6f400640 1 --2- 172.21.15.73:0/1950339715 >> v2:172.21.15.110:3300/0 conn(0x7f4d700cb130 0x7f4d701592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d75200640 1 --2- 172.21.15.73:0/1950339715 >> v2:172.21.15.73:3300/0 conn(0x7f4d700b4780 0x7f4d700c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d6ea00640 1 -- 172.21.15.73:0/1950339715 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91532526 0 0) 0x7f4d7015a1f0 con 0x7f4d700c5050 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.562+0000 7f4d6ea00640 1 -- 172.21.15.73:0/1950339715 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d54003520 con 0x7f4d700c5050 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.563+0000 7f4d6f400640 1 -- 172.21.15.73:0/1950339715 >> v2:172.21.15.73:3300/0 conn(0x7f4d700b4780 msgr2=0x7f4d700c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.563+0000 7f4d6f400640 1 --2- 172.21.15.73:0/1950339715 >> v2:172.21.15.73:3300/0 conn(0x7f4d700b4780 0x7f4d700c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.563+0000 7f4d6f400640 1 -- 172.21.15.73:0/1950339715 >> v1:172.21.15.110:6789/0 conn(0x7f4d700c5050 legacy=0x7f4d70069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.563+0000 7f4d6f400640 1 -- 172.21.15.73:0/1950339715 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d70159c30 con 0x7f4d700cb130 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d6f400640 1 --2- 172.21.15.73:0/1950339715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d700cb130 0x7f4d701592a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d70156ed0 tx=0x7f4d5802bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a42d8172c0dc41 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d6ea00640 1 -- 172.21.15.73:0/1950339715 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5802cb50 con 0x7f4d700cb130 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d6ea00640 1 -- 172.21.15.73:0/1950339715 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5802ccb0 con 0x7f4d700cb130 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d6ea00640 1 -- 172.21.15.73:0/1950339715 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58034660 con 0x7f4d700cb130 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d75c00640 1 -- 172.21.15.73:0/1950339715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d700cb130 msgr2=0x7f4d701592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d75c00640 1 --2- 172.21.15.73:0/1950339715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d700cb130 0x7f4d701592a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4d70156ed0 tx=0x7f4d5802bda0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d75c00640 1 -- 172.21.15.73:0/1950339715 shutdown_connections 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d75c00640 1 --2- 172.21.15.73:0/1950339715 >> v2:172.21.15.73:3300/0 conn(0x7f4d700b4780 0x7f4d700c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d75c00640 1 --2- 172.21.15.73:0/1950339715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d700cb130 0x7f4d701592a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.564+0000 7f4d75c00640 1 -- 172.21.15.73:0/1950339715 >> 172.21.15.73:0/1950339715 conn(0x7f4d700ceb80 msgr2=0x7f4d700cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.565+0000 7f4d75c00640 1 -- 172.21.15.73:0/1950339715 shutdown_connections 2024-03-23T06:21:50.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.565+0000 7f4d75c00640 1 -- 172.21.15.73:0/1950339715 wait complete. 2024-03-23T06:21:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.566+0000 7f4d75c00640 1 Processor -- start 2024-03-23T06:21:50.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.566+0000 7f4d75c00640 1 -- start start 2024-03-23T06:21:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d75c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700b4780 0x7f4d70151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d75c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d700c5050 0x7f4d70151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d75c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d700cb130 0x7f4d7014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d75c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700cf330 con 0x7f4d700b4780 2024-03-23T06:21:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d75c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70153d90 con 0x7f4d700cb130 2024-03-23T06:21:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d75c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70154070 con 0x7f4d700c5050 2024-03-23T06:21:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d6fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700b4780 0x7f4d70151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d6f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d700c5050 0x7f4d70151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d75200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d700cb130 0x7f4d7014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d6f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d700c5050 0x7f4d70151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41798/0 (socket says 172.21.15.73:41798) 2024-03-23T06:21:50.568 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.567+0000 7f4d6f400640 1 -- 172.21.15.73:0/3120523580 learned_addr learned my addr 172.21.15.73:0/3120523580 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d6fe00640 1 -- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d700c5050 msgr2=0x7f4d70151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d6fe00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d700c5050 0x7f4d70151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d6fe00640 1 -- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d700cb130 msgr2=0x7f4d7014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d6fe00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d700cb130 0x7f4d7014e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d6fe00640 1 -- 172.21.15.73:0/3120523580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58009a70 con 0x7f4d700b4780 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d6f400640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d700c5050 0x7f4d70151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d6fe00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700b4780 0x7f4d70151420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c430 tx=0x7f4d6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60005ce0 con 0x7f4d700b4780 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d60005e40 con 0x7f4d700b4780 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600072d0 con 0x7f4d700b4780 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.568+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d70154350 con 0x7f4d700b4780 2024-03-23T06:21:50.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.569+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d70154910 con 0x7f4d700b4780 2024-03-23T06:21:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.570+0000 7f4d75c00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d70156010 0x7f4d7014ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.570+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700723f0 con 0x7f4d70156010 2024-03-23T06:21:50.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.570+0000 7f4d6f400640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d70156010 0x7f4d7014ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.570+0000 7f4d6f400640 1 -- 172.21.15.73:0/3120523580 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d700c9910 con 0x7f4d70156010 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.570+0000 7f4d6f400640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d70156010 0x7f4d7014ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000f80 tx=0x7f4d58004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.571+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5803f8c0 con 0x7f4d70156010 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.571+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4d60007430 con 0x7f4d700b4780 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.572+0000 7f4d67e00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d4c06aca0 0x7f4d4c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.572+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f4d60088cf0 con 0x7f4d700b4780 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.572+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f4d5803fa20 con 0x7f4d70156010 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.572+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d70156010 msgr2=0x7f4d7014ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.572+0000 7f4d67e00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d70156010 0x7f4d7014ee80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000f80 tx=0x7f4d58004a40 comp rx=0 tx=0).stop 2024-03-23T06:21:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.572+0000 7f4d75200640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d4c06aca0 0x7f4d4c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.572+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d70156010 msgr2=0x7f4d7014ee80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.572+0000 7f4d67e00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d70156010 0x7f4d7014ee80 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000f80 tx=0x7f4d58004a40 comp rx=0 tx=0).stop 2024-03-23T06:21:50.573 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.573+0000 7f4d75200640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d4c06aca0 0x7f4d4c06d160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009b40 tx=0x7f4d68009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.579+0000 7f4d75c00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d701dfd30 0x7f4d701f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.579+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700c9630 con 0x7f4d701dfd30 2024-03-23T06:21:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.579+0000 7f4d6f400640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d701dfd30 0x7f4d701f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.579+0000 7f4d6f400640 1 -- 172.21.15.73:0/3120523580 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f4d7006a3c0 con 0x7f4d701dfd30 2024-03-23T06:21:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.579+0000 7f4d6f400640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d701dfd30 0x7f4d701f1a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d700681a0 tx=0x7f4d58031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.580+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5804f070 con 0x7f4d701dfd30 2024-03-23T06:21:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.580+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 <== mon.2 v2:172.21.15.110:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+5119 (secure 0 0 0) 0x7f4d58004000 con 0x7f4d701dfd30 2024-03-23T06:21:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.580+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d701dfd30 msgr2=0x7f4d701f1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.580+0000 7f4d67e00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d701dfd30 0x7f4d701f1a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d700681a0 tx=0x7f4d58031000 comp rx=0 tx=0).stop 2024-03-23T06:21:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.580+0000 7f4d67e00640 1 -- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d701dfd30 msgr2=0x7f4d701f1a40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-23T06:21:50.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.580+0000 7f4d67e00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d701dfd30 0x7f4d701f1a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.581 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:21:50.581 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:50.581 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:50.581 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "peon", 2024-03-23T06:21:50.581 INFO:teuthology.orchestra.run.smithi073.stdout: "election_epoch": 108, 2024-03-23T06:21:50.581 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum": [ 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: 0, 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: 1, 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: 2 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_age": 3, 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: "required_con": "2449958758054445060", 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: "required_mon": [ 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.582 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_con": "4540138322906710015", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "quorum_mon": [ 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.583 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.584 INFO:teuthology.orchestra.run.smithi073.stdout: "outside_quorum": [], 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "extra_probe_peers": [], 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "sync_provider": [], 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": { 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 1, 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "4707007f-1ceb-450e-b69b-d09789f75edc", 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-03-23T06:08:57.192527Z", 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release": 18, 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "min_mon_release_name": "reef", 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "election_strategy": 1, 2024-03-23T06:21:50.585 INFO:teuthology.orchestra.run.smithi073.stdout: "disallowed_leaders: ": "", 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false, 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "tiebreaker_mon": "", 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_ranks: ": "", 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "features": { 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "persistent": [ 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "kraken", 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "luminous", 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "mimic", 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap-prune", 2024-03-23T06:21:50.586 INFO:teuthology.orchestra.run.smithi073.stdout: "nautilus", 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: "octopus", 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: "pacific", 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: "elector-pinging", 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: "quincy", 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: "reef" 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: "optional": [] 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.587 INFO:teuthology.orchestra.run.smithi073.stdout: "mons": [ 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 0, 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "a", 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:3300", 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.588 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789", 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.73:6789/0", 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.73:6789/0", 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 1, 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "b", 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3300", 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789", 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6789/0", 2024-03-23T06:21:50.590 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6789/0", 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "rank": 2, 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "c", 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:3301", 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.591 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790", 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 0 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.110:6790/0", 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.110:6790/0", 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "priority": 0, 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 0, 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "{}" 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.592 INFO:teuthology.orchestra.run.smithi073.stdout: "feature_map": { 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": [ 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": [ 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.593 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": [ 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: "client": [ 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x2f018fb87aa4aafe", 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 1 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.594 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 5 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": [ 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: "features": "0x3f01cfbffffdffff", 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: "release": "luminous", 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 2 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": false 2024-03-23T06:21:50.595 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:21:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d4c06aca0 msgr2=0x7f4d4c06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75c00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f4d4c06aca0 0x7f4d4c06d160 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009b40 tx=0x7f4d68009190 comp rx=0 tx=0).stop 2024-03-23T06:21:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700b4780 msgr2=0x7f4d70151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75c00640 1 --2- 172.21.15.73:0/3120523580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700b4780 0x7f4d70151420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c430 tx=0x7f4d6000c8f0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75200640 1 -- 172.21.15.73:0/3120523580 reap_dead start 2024-03-23T06:21:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75200640 1 -- 172.21.15.73:0/3120523580 reap_dead start 2024-03-23T06:21:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 shutdown_connections 2024-03-23T06:21:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 >> 172.21.15.73:0/3120523580 conn(0x7f4d700ceb80 msgr2=0x7f4d701590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 shutdown_connections 2024-03-23T06:21:50.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.581+0000 7f4d75c00640 1 -- 172.21.15.73:0/3120523580 wait complete. 2024-03-23T06:21:50.598 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-03-23T06:21:50.598 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-23T06:21:50.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-23T06:21:50.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.790+0000 7fb68ec00640 1 Processor -- start 2024-03-23T06:21:50.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.790+0000 7fb68ec00640 1 -- start start 2024-03-23T06:21:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb68ec00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6881536a0 0x7fb6880ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb68ec00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb6881594f0 0x7fb6880cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb68ec00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880cab20 con 0x7fb688153a80 2024-03-23T06:21:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb68ec00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68815a520 con 0x7fb6881536a0 2024-03-23T06:21:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb68ec00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6881599a0 con 0x7fb6881594f0 2024-03-23T06:21:50.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb67fe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb688153a80 0x7fb6880cbe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:34848/0 (socket says 172.21.15.73:34848) 2024-03-23T06:21:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb67fe00640 1 -- 172.21.15.73:0/1229047174 learned_addr learned my addr 172.21.15.73:0/1229047174 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:21:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb68cc00640 1 --2- 172.21.15.73:0/1229047174 >> v2:172.21.15.110:3300/0 conn(0x7fb6881594f0 0x7fb6880cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.792+0000 7fb687e00640 1 --2- 172.21.15.73:0/1229047174 >> v2:172.21.15.73:3300/0 conn(0x7fb6881536a0 0x7fb6880ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.793+0000 7fb68cc00640 1 -- 172.21.15.73:0/1229047174 >> v2:172.21.15.73:3300/0 conn(0x7fb6881536a0 msgr2=0x7fb6880ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.793+0000 7fb68cc00640 1 --2- 172.21.15.73:0/1229047174 >> v2:172.21.15.73:3300/0 conn(0x7fb6881536a0 0x7fb6880ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.793+0000 7fb68cc00640 1 -- 172.21.15.73:0/1229047174 >> v1:172.21.15.110:6789/0 conn(0x7fb688153a80 legacy=0x7fb6880cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.793+0000 7fb68cc00640 1 -- 172.21.15.73:0/1229047174 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb688159c80 con 0x7fb6881594f0 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.793+0000 7fb687400640 1 -- 172.21.15.73:0/1229047174 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282463955 0 0) 0x7fb6880cab20 con 0x7fb688153a80 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb68cc00640 1 --2- 172.21.15.73:0/1229047174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 0x7fb6880cf1c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb680009d90 tx=0x7fb68002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff91bb997324228 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb687400640 1 -- 172.21.15.73:0/1229047174 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68002cc60 con 0x7fb6881594f0 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb687400640 1 -- 172.21.15.73:0/1229047174 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68002cdc0 con 0x7fb6881594f0 2024-03-23T06:21:50.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb687400640 1 -- 172.21.15.73:0/1229047174 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680034660 con 0x7fb6881594f0 2024-03-23T06:21:50.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb68ec00640 1 -- 172.21.15.73:0/1229047174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 msgr2=0x7fb6880cf1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1229047174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 0x7fb6880cf1c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb680009d90 tx=0x7fb68002beb0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb68ec00640 1 -- 172.21.15.73:0/1229047174 shutdown_connections 2024-03-23T06:21:50.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1229047174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 0x7fb6880cf1c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1229047174 >> v2:172.21.15.73:3300/0 conn(0x7fb6881536a0 0x7fb6880ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.794+0000 7fb68ec00640 1 -- 172.21.15.73:0/1229047174 >> 172.21.15.73:0/1229047174 conn(0x7fb68806a060 msgr2=0x7fb68806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.795+0000 7fb68ec00640 1 -- 172.21.15.73:0/1229047174 shutdown_connections 2024-03-23T06:21:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.795+0000 7fb68ec00640 1 -- 172.21.15.73:0/1229047174 wait complete. 2024-03-23T06:21:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.796+0000 7fb68ec00640 1 Processor -- start 2024-03-23T06:21:50.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.796+0000 7fb68ec00640 1 -- start start 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb68ec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6881536a0 0x7fb6880c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb68ec00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb688153a80 0x7fb6880c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb68ec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 0x7fb688144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb68ec00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880b2770 con 0x7fb688153a80 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb68ec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880cea50 con 0x7fb6881594f0 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb68ec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6881ef480 con 0x7fb6881536a0 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb687e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6881536a0 0x7fb6880c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb687e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6881536a0 0x7fb6880c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41824/0 (socket says 172.21.15.73:41824) 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb687e00640 1 -- 172.21.15.73:0/1366549289 learned_addr learned my addr 172.21.15.73:0/1366549289 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.797+0000 7fb68cc00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 0x7fb688144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb67fe00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb688153a80 0x7fb6880c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb687e00640 1 -- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 msgr2=0x7fb688144ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb687e00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 0x7fb688144ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb687e00640 1 -- 172.21.15.73:0/1366549289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb688153a80 msgr2=0x7fb6880c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb687e00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb688153a80 0x7fb6880c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb687e00640 1 -- 172.21.15.73:0/1366549289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680009a70 con 0x7fb6881536a0 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb687e00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6881536a0 0x7fb6880c4350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb67800e9b0 tx=0x7fb67800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb684c00640 1 -- 172.21.15.73:0/1366549289 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678009670 con 0x7fb6881536a0 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb684c00640 1 -- 172.21.15.73:0/1366549289 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67800c9a0 con 0x7fb6881536a0 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb684c00640 1 -- 172.21.15.73:0/1366549289 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800cd50 con 0x7fb6881536a0 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6881ef760 con 0x7fb6881536a0 2024-03-23T06:21:50.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.798+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6880b4020 con 0x7fb6881536a0 2024-03-23T06:21:50.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.799+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68814da70 con 0x7fb6881536a0 2024-03-23T06:21:50.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.800+0000 7fb684c00640 1 -- 172.21.15.73:0/1366549289 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb678013470 con 0x7fb6881536a0 2024-03-23T06:21:50.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.801+0000 7fb684c00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb66406ac30 0x7fb66406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:21:50.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.801+0000 7fb684c00640 1 -- 172.21.15.73:0/1366549289 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb678089c30 con 0x7fb6881536a0 2024-03-23T06:21:50.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.801+0000 7fb67fe00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb66406ac30 0x7fb66406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:21:50.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.802+0000 7fb67fe00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb66406ac30 0x7fb66406d0f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb6880ce690 tx=0x7fb670007b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:21:50.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:50.805+0000 7fb684c00640 1 -- 172.21.15.73:0/1366549289 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb678054ab0 con 0x7fb6881536a0 2024-03-23T06:21:51.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.071+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fb6880b3ba0 con 0x7fb6881536a0 2024-03-23T06:21:51.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.072+0000 7fb684c00640 1 -- 172.21.15.73:0/1366549289 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fb6880b3ba0 con 0x7fb6881536a0 2024-03-23T06:21:51.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb66406ac30 msgr2=0x7fb66406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:51.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb66406ac30 0x7fb66406d0f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb6880ce690 tx=0x7fb670007b70 comp rx=0 tx=0).stop 2024-03-23T06:21:51.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6881536a0 msgr2=0x7fb6880c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6881536a0 0x7fb6880c4350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb67800e9b0 tx=0x7fb67800ee70 comp rx=0 tx=0).stop 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 shutdown_connections 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6881594f0 0x7fb688144ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb688153a80 0x7fb6880c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb66406ac30 0x7fb66406d0f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 --2- 172.21.15.73:0/1366549289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6881536a0 0x7fb6880c4350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 >> 172.21.15.73:0/1366549289 conn(0x7fb68806a060 msgr2=0x7fb688157360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 shutdown_connections 2024-03-23T06:21:51.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:21:51.075+0000 7fb68ec00640 1 -- 172.21.15.73:0/1366549289 wait complete. 2024-03-23T06:21:51.093 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-03-23T06:22:01.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:22:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.303+0000 7f95ef200640 1 Processor -- start 2024-03-23T06:22:01.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.303+0000 7f95ef200640 1 -- start start 2024-03-23T06:22:01.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.304+0000 7f95ef200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95f00cf100 0x7f95f00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.304+0000 7f95ef200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00caed0 0x7f95f0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.304+0000 7f95ef200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f015a370 con 0x7f95f00ced20 2024-03-23T06:22:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.304+0000 7f95ef200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f00cb8d0 con 0x7f95f00cf100 2024-03-23T06:22:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.304+0000 7f95ef200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00ca330 con 0x7f95f00caed0 2024-03-23T06:22:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95ede00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f95f00ced20 0x7f95f00ca7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47398/0 (socket says 172.21.15.73:47398) 2024-03-23T06:22:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95ed400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95f00cf100 0x7f95f00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95ede00640 1 -- 172.21.15.73:0/3364607132 learned_addr learned my addr 172.21.15.73:0/3364607132 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:01.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95ee800640 1 --2- 172.21.15.73:0/3364607132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00caed0 0x7f95f0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95ed400640 1 -- 172.21.15.73:0/3364607132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00caed0 msgr2=0x7f95f0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95ed400640 1 --2- 172.21.15.73:0/3364607132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00caed0 0x7f95f0159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95eca00640 1 -- 172.21.15.73:0/3364607132 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822412774 0 0) 0x7f95e0001110 con 0x7f95f00ced20 2024-03-23T06:22:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95ed400640 1 -- 172.21.15.73:0/3364607132 >> v1:172.21.15.110:6789/0 conn(0x7f95f00ced20 legacy=0x7f95f00ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.305+0000 7f95ed400640 1 -- 172.21.15.73:0/3364607132 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00cbab0 con 0x7f95f00cf100 2024-03-23T06:22:01.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.306+0000 7f95ed400640 1 --2- 172.21.15.73:0/3364607132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00cf100 0x7f95f00cb390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0097a0 tx=0x7f95dc02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3ea3b86be47629 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.306+0000 7f95eca00640 1 -- 172.21.15.73:0/3364607132 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc030800 con 0x7f95f00cf100 2024-03-23T06:22:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.306+0000 7f95eca00640 1 -- 172.21.15.73:0/3364607132 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc030960 con 0x7f95f00cf100 2024-03-23T06:22:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.306+0000 7f95eca00640 1 -- 172.21.15.73:0/3364607132 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc030cf0 con 0x7f95f00cf100 2024-03-23T06:22:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.307+0000 7f95ef200640 1 -- 172.21.15.73:0/3364607132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00cf100 msgr2=0x7f95f00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.307+0000 7f95ef200640 1 --2- 172.21.15.73:0/3364607132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00cf100 0x7f95f00cb390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0097a0 tx=0x7f95dc02b940 comp rx=0 tx=0).stop 2024-03-23T06:22:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.307+0000 7f95ef200640 1 -- 172.21.15.73:0/3364607132 shutdown_connections 2024-03-23T06:22:01.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.307+0000 7f95ef200640 1 --2- 172.21.15.73:0/3364607132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00caed0 0x7f95f0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.307+0000 7f95ef200640 1 --2- 172.21.15.73:0/3364607132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00cf100 0x7f95f00cb390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.307+0000 7f95ef200640 1 -- 172.21.15.73:0/3364607132 >> 172.21.15.73:0/3364607132 conn(0x7f95f00713e0 msgr2=0x7f95f00717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.307+0000 7f95ef200640 1 -- 172.21.15.73:0/3364607132 shutdown_connections 2024-03-23T06:22:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.307+0000 7f95ef200640 1 -- 172.21.15.73:0/3364607132 wait complete. 2024-03-23T06:22:01.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.309+0000 7f95ef200640 1 Processor -- start 2024-03-23T06:22:01.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.309+0000 7f95ef200640 1 -- start start 2024-03-23T06:22:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ef200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00caed0 0x7f95f015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ef200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00ced20 0x7f95f0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ef200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00cf100 0x7f95f015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ef200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f01f2870 con 0x7f95f00caed0 2024-03-23T06:22:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ef200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f015c020 con 0x7f95f00ced20 2024-03-23T06:22:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ef200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f01f22d0 con 0x7f95f00cf100 2024-03-23T06:22:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ed400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00ced20 0x7f95f0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ede00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00caed0 0x7f95f015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ee800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00cf100 0x7f95f015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ed400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00ced20 0x7f95f0156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:42950/0 (socket says 172.21.15.73:42950) 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ed400640 1 -- 172.21.15.73:0/1123898555 learned_addr learned my addr 172.21.15.73:0/1123898555 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ee800640 1 -- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00ced20 msgr2=0x7f95f0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ee800640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00ced20 0x7f95f0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ee800640 1 -- 172.21.15.73:0/1123898555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00caed0 msgr2=0x7f95f015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ee800640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00caed0 0x7f95f015afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.310+0000 7f95ee800640 1 -- 172.21.15.73:0/1123898555 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc009400 con 0x7f95f00cf100 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.311+0000 7f95ee800640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00cf100 0x7f95f015a780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95e800eb70 tx=0x7f95e800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.311+0000 7f95e6000640 1 -- 172.21.15.73:0/1123898555 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800cd20 con 0x7f95f00cf100 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.311+0000 7f95e6000640 1 -- 172.21.15.73:0/1123898555 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800f040 con 0x7f95f00cf100 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.311+0000 7f95e6000640 1 -- 172.21.15.73:0/1123898555 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80146c0 con 0x7f95f00cf100 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.311+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f01f2590 con 0x7f95f00cf100 2024-03-23T06:22:01.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.311+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f015b9d0 con 0x7f95f00cf100 2024-03-23T06:22:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.312+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f004e030 con 0x7f95f00cf100 2024-03-23T06:22:01.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.313+0000 7f95e6000640 1 -- 172.21.15.73:0/1123898555 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f95e8014820 con 0x7f95f00cf100 2024-03-23T06:22:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.314+0000 7f95e6000640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95d006ac00 0x7f95d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.314+0000 7f95e6000640 1 -- 172.21.15.73:0/1123898555 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f95e808a2d0 con 0x7f95f00cf100 2024-03-23T06:22:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.314+0000 7f95ede00640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95d006ac00 0x7f95d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.314+0000 7f95ede00640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95d006ac00 0x7f95d006d0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e0007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:01.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.321+0000 7f95e6000640 1 -- 172.21.15.73:0/1123898555 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f95e8055160 con 0x7f95f00cf100 2024-03-23T06:22:01.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.557+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95f015c160 con 0x7f95f00cf100 2024-03-23T06:22:01.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.558+0000 7f95e6000640 1 -- 172.21.15.73:0/1123898555 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6280 (secure 0 0 0) 0x7f95e8018090 con 0x7f95f00cf100 2024-03-23T06:22:01.558 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:01.558 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:39.659193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4256,"mds_2":4253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4256":{"gid":4256,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:22:01.558 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-23T06:22:01.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95d006ac00 msgr2=0x7f95d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95d006ac00 0x7f95d006d0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f95e0000f60 tx=0x7f95e0007b90 comp rx=0 tx=0).stop 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00cf100 msgr2=0x7f95f015a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00cf100 0x7f95f015a780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95e800eb70 tx=0x7f95e800c490 comp rx=0 tx=0).stop 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 shutdown_connections 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f95d006ac00 0x7f95d006d0c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f00cf100 0x7f95f015a780 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00ced20 0x7f95f0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 --2- 172.21.15.73:0/1123898555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95f00caed0 0x7f95f015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.560+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 >> 172.21.15.73:0/1123898555 conn(0x7f95f00713e0 msgr2=0x7f95f00717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.561+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 shutdown_connections 2024-03-23T06:22:01.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.561+0000 7f95ef200640 1 -- 172.21.15.73:0/1123898555 wait complete. 2024-03-23T06:22:01.577 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-03-23T06:22:01.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-23T06:22:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.766+0000 7f0bb6400640 1 Processor -- start 2024-03-23T06:22:01.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.767+0000 7f0bb6400640 1 -- start start 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.768+0000 7f0bb6400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0bb00caed0 0x7f0bb00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.768+0000 7f0bb6400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb00ca330 con 0x7f0bb00ced20 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.768+0000 7f0bb6400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb00cbab0 con 0x7f0bb00cf100 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.768+0000 7f0bb6400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb00cb8d0 con 0x7f0bb00caed0 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.768+0000 7f0bafe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0bb00cf100 0x7f0bb0153150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47412/0 (socket says 172.21.15.73:47412) 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.768+0000 7f0bafe00640 1 -- 172.21.15.73:0/442567492 learned_addr learned my addr 172.21.15.73:0/442567492 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.768+0000 7f0bb5a00640 1 --2- 172.21.15.73:0/442567492 >> v2:172.21.15.110:3300/0 conn(0x7f0bb00caed0 0x7f0bb00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.769+0000 7f0baf400640 1 -- 172.21.15.73:0/442567492 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218428311 0 0) 0x7f0bb00cbab0 con 0x7f0bb00cf100 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.769+0000 7f0baf400640 1 -- 172.21.15.73:0/442567492 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b98003520 con 0x7f0bb00cf100 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.769+0000 7f0bb5a00640 1 -- 172.21.15.73:0/442567492 >> v1:172.21.15.110:6789/0 conn(0x7f0bb00cf100 legacy=0x7f0bb0153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.769+0000 7f0bb5a00640 1 -- 172.21.15.73:0/442567492 >> v1:172.21.15.73:6789/0 conn(0x7f0bb00ced20 legacy=0x7f0bb00ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.769+0000 7f0baf400640 1 -- 172.21.15.73:0/442567492 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257514290 0 0) 0x7f0bb00ca330 con 0x7f0bb00ced20 2024-03-23T06:22:01.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.769+0000 7f0bb5a00640 1 -- 172.21.15.73:0/442567492 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00cbd90 con 0x7f0bb00caed0 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.770+0000 7f0bb5a00640 1 --2- 172.21.15.73:0/442567492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00caed0 0x7f0bb00cb390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009d90 tx=0x7f0ba802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdaad655bf13cd32 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.770+0000 7f0baf400640 1 -- 172.21.15.73:0/442567492 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba802cd80 con 0x7f0bb00caed0 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.770+0000 7f0baf400640 1 -- 172.21.15.73:0/442567492 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8034440 con 0x7f0bb00caed0 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.770+0000 7f0baf400640 1 -- 172.21.15.73:0/442567492 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80347d0 con 0x7f0bb00caed0 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.771+0000 7f0bb6400640 1 -- 172.21.15.73:0/442567492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00caed0 msgr2=0x7f0bb00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.771+0000 7f0bb6400640 1 --2- 172.21.15.73:0/442567492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00caed0 0x7f0bb00cb390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009d90 tx=0x7f0ba802bfd0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.771+0000 7f0bb6400640 1 -- 172.21.15.73:0/442567492 shutdown_connections 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.771+0000 7f0bb6400640 1 --2- 172.21.15.73:0/442567492 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00caed0 0x7f0bb00cb390 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.771+0000 7f0bb6400640 1 -- 172.21.15.73:0/442567492 >> 172.21.15.73:0/442567492 conn(0x7f0bb00713e0 msgr2=0x7f0bb00717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.771+0000 7f0bb6400640 1 -- 172.21.15.73:0/442567492 shutdown_connections 2024-03-23T06:22:01.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.771+0000 7f0bb6400640 1 -- 172.21.15.73:0/442567492 wait complete. 2024-03-23T06:22:01.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.772+0000 7f0bb6400640 1 Processor -- start 2024-03-23T06:22:01.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.772+0000 7f0bb6400640 1 -- start start 2024-03-23T06:22:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.773+0000 7f0bb6400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bb00caed0 0x7f0bb0150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.773+0000 7f0bb6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00ced20 0x7f0bb0157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.773+0000 7f0bb6400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb00cf100 0x7f0bb014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.773+0000 7f0bb6400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01e1700 con 0x7f0bb00caed0 2024-03-23T06:22:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.773+0000 7f0bb6400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb01ef2b0 con 0x7f0bb00ced20 2024-03-23T06:22:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.773+0000 7f0bb6400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0150420 con 0x7f0bb00cf100 2024-03-23T06:22:01.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb00cf100 0x7f0bb014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bafe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00ced20 0x7f0bb0157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bb00caed0 0x7f0bb0150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb00cf100 0x7f0bb014dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51950/0 (socket says 172.21.15.73:51950) 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 -- 172.21.15.73:0/4047295610 learned_addr learned my addr 172.21.15.73:0/4047295610 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 -- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00ced20 msgr2=0x7f0bb0157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00ced20 0x7f0bb0157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 -- 172.21.15.73:0/4047295610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bb00caed0 msgr2=0x7f0bb0150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bb00caed0 0x7f0bb0150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 -- 172.21.15.73:0/4047295610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8009a70 con 0x7f0bb00cf100 2024-03-23T06:22:01.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bb5a00640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb00cf100 0x7f0bb014dee0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009d90 tx=0x7f0ba8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.774+0000 7f0bacc00640 1 -- 172.21.15.73:0/4047295610 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8009450 con 0x7f0bb00cf100 2024-03-23T06:22:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.775+0000 7f0bacc00640 1 -- 172.21.15.73:0/4047295610 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba8034e50 con 0x7f0bb00cf100 2024-03-23T06:22:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.775+0000 7f0bacc00640 1 -- 172.21.15.73:0/4047295610 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8003bd0 con 0x7f0bb00cf100 2024-03-23T06:22:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.775+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb0150700 con 0x7f0bb00cf100 2024-03-23T06:22:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.775+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb01ef590 con 0x7f0bb00cf100 2024-03-23T06:22:01.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.776+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb01508c0 con 0x7f0bb00cf100 2024-03-23T06:22:01.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.777+0000 7f0bacc00640 1 -- 172.21.15.73:0/4047295610 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0ba8040450 con 0x7f0bb00cf100 2024-03-23T06:22:01.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.777+0000 7f0bacc00640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0b9006ac00 0x7f0b9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:01.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.777+0000 7f0bacc00640 1 -- 172.21.15.73:0/4047295610 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f0ba80ac2e0 con 0x7f0bb00cf100 2024-03-23T06:22:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.778+0000 7f0bb5000640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0b9006ac00 0x7f0b9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:01.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.778+0000 7f0bb5000640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0b9006ac00 0x7f0b9006d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4000f60 tx=0x7f0ba4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:01.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:01.785+0000 7f0bacc00640 1 -- 172.21.15.73:0/4047295610 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0ba8077280 con 0x7f0bb00cf100 2024-03-23T06:22:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.039+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0bb0150560 con 0x7f0bb00cf100 2024-03-23T06:22:02.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.039+0000 7f0bacc00640 1 -- 172.21.15.73:0/4047295610 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1549 (secure 0 0 0) 0x7f0bb0150560 con 0x7f0bb00cf100 2024-03-23T06:22:02.040 INFO:teuthology.orchestra.run.smithi073.stdout:{"election_epoch":108,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","modified":"2024-03-23T06:08:57.192527Z","created":"2024-03-23T06:08:57.192527Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3300","nonce":0},{"type":"v1","addr":"172.21.15.110:6789","nonce":0}]},"addr":"172.21.15.110:6789/0","public_addr":"172.21.15.110:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:3301","nonce":0},{"type":"v1","addr":"172.21.15.110:6790","nonce":0}]},"addr":"172.21.15.110:6790/0","public_addr":"172.21.15.110:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-23T06:22:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0b9006ac00 msgr2=0x7f0b9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0b9006ac00 0x7f0b9006d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4000f60 tx=0x7f0ba4009040 comp rx=0 tx=0).stop 2024-03-23T06:22:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb00cf100 msgr2=0x7f0bb014dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb00cf100 0x7f0bb014dee0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009d90 tx=0x7f0ba8004a40 comp rx=0 tx=0).stop 2024-03-23T06:22:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 shutdown_connections 2024-03-23T06:22:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f0b9006ac00 0x7f0b9006d0c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bb00cf100 0x7f0bb014dee0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb00ced20 0x7f0bb0157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 --2- 172.21.15.73:0/4047295610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0bb00caed0 0x7f0bb0150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 >> 172.21.15.73:0/4047295610 conn(0x7f0bb00713e0 msgr2=0x7f0bb00cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 shutdown_connections 2024-03-23T06:22:02.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.042+0000 7f0bb6400640 1 -- 172.21.15.73:0/4047295610 wait complete. 2024-03-23T06:22:02.058 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-03-23T06:22:02.059 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-23T06:22:02.068 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-23T06:22:02.068 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:22:02.069 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T06:22:02.128 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-23T06:22:02.128 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-23T06:22:02.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:22:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.454+0000 7f8caf200640 1 Processor -- start 2024-03-23T06:22:02.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.455+0000 7f8caf200640 1 -- start start 2024-03-23T06:22:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8caf200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00ced20 0x7f8cb00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8caf200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8cb00cf100 0x7f8cb0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8caf200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8cb00ca7c0 0x7f8cb00cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8caf200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00cb8d0 con 0x7f8cb00cf100 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8caf200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb015a370 con 0x7f8cb00ca7c0 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8caf200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00ca330 con 0x7f8cb00ced20 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8cade00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00ced20 0x7f8cb00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8cae800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8cb00ca7c0 0x7f8cb00cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8ca7e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8cb00cf100 0x7f8cb0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8cade00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00ced20 0x7f8cb00cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51960/0 (socket says 172.21.15.73:51960) 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.456+0000 7f8cade00640 1 -- 172.21.15.73:0/2275811778 learned_addr learned my addr 172.21.15.73:0/2275811778 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.457+0000 7f8cade00640 1 -- 172.21.15.73:0/2275811778 >> v2:172.21.15.110:3300/0 conn(0x7f8cb00ca7c0 msgr2=0x7f8cb00cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.457+0000 7f8cade00640 1 --2- 172.21.15.73:0/2275811778 >> v2:172.21.15.110:3300/0 conn(0x7f8cb00ca7c0 0x7f8cb00cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.457+0000 7f8cade00640 1 -- 172.21.15.73:0/2275811778 >> v2:172.21.15.73:3300/0 conn(0x7f8cb00cf100 msgr2=0x7f8cb0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.457+0000 7f8cade00640 1 --2- 172.21.15.73:0/2275811778 >> v2:172.21.15.73:3300/0 conn(0x7f8cb00cf100 0x7f8cb0159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.457+0000 7f8cade00640 1 -- 172.21.15.73:0/2275811778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00cb1b0 con 0x7f8cb00ced20 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.458+0000 7f8cade00640 1 --2- 172.21.15.73:0/2275811778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00ced20 0x7f8cb00cb390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00c9900 tx=0x7f8ca002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f78a577958d0118 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.458+0000 7f8cad400640 1 -- 172.21.15.73:0/2275811778 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0030860 con 0x7f8cb00ced20 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.458+0000 7f8cad400640 1 -- 172.21.15.73:0/2275811778 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca00309c0 con 0x7f8cb00ced20 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.458+0000 7f8cad400640 1 -- 172.21.15.73:0/2275811778 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0030d50 con 0x7f8cb00ced20 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 -- 172.21.15.73:0/2275811778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00ced20 msgr2=0x7f8cb00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 --2- 172.21.15.73:0/2275811778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00ced20 0x7f8cb00cb390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00c9900 tx=0x7f8ca002b9a0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 -- 172.21.15.73:0/2275811778 shutdown_connections 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 --2- 172.21.15.73:0/2275811778 >> v2:172.21.15.110:3300/0 conn(0x7f8cb00ca7c0 0x7f8cb00cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 --2- 172.21.15.73:0/2275811778 >> v2:172.21.15.73:3300/0 conn(0x7f8cb00cf100 0x7f8cb0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 --2- 172.21.15.73:0/2275811778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00ced20 0x7f8cb00cb390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 -- 172.21.15.73:0/2275811778 >> 172.21.15.73:0/2275811778 conn(0x7f8cb00713e0 msgr2=0x7f8cb00717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 -- 172.21.15.73:0/2275811778 shutdown_connections 2024-03-23T06:22:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.459+0000 7f8caf200640 1 -- 172.21.15.73:0/2275811778 wait complete. 2024-03-23T06:22:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.460+0000 7f8caf200640 1 Processor -- start 2024-03-23T06:22:02.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.461+0000 7f8caf200640 1 -- start start 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.461+0000 7f8caf200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cb00ca7c0 0x7f8cb01f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.461+0000 7f8caf200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb00ced20 0x7f8cb01586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.461+0000 7f8caf200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00cf100 0x7f8cb0158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.461+0000 7f8caf200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb014a910 con 0x7f8cb00ca7c0 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.461+0000 7f8caf200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb0156c20 con 0x7f8cb00ced20 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.461+0000 7f8caf200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00c2bc0 con 0x7f8cb00cf100 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8cade00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cb00ca7c0 0x7f8cb01f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb00ced20 0x7f8cb01586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8cae800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00cf100 0x7f8cb0158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8cade00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cb00ca7c0 0x7f8cb01f0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47208/0 (socket says 172.21.15.73:47208) 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8cade00640 1 -- 172.21.15.73:0/227131381 learned_addr learned my addr 172.21.15.73:0/227131381 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:02.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8ca7e00640 1 -- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00cf100 msgr2=0x7f8cb0158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8ca7e00640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00cf100 0x7f8cb0158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8ca7e00640 1 -- 172.21.15.73:0/227131381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cb00ca7c0 msgr2=0x7f8cb01f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8ca7e00640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cb00ca7c0 0x7f8cb01f0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8ca7e00640 1 -- 172.21.15.73:0/227131381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00094d0 con 0x7f8cb00ced20 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8cae800640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00cf100 0x7f8cb0158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8cade00640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cb00ca7c0 0x7f8cb01f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.462+0000 7f8ca7e00640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb00ced20 0x7f8cb01586f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800e870 tx=0x7f8c9800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.463+0000 7f8ca6000640 1 -- 172.21.15.73:0/227131381 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800ee60 con 0x7f8cb00ced20 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.463+0000 7f8ca6000640 1 -- 172.21.15.73:0/227131381 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9800c940 con 0x7f8cb00ced20 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.463+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb00c2e60 con 0x7f8cb00ced20 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.463+0000 7f8ca6000640 1 -- 172.21.15.73:0/227131381 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800ccd0 con 0x7f8cb00ced20 2024-03-23T06:22:02.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.463+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb00c3420 con 0x7f8cb00ced20 2024-03-23T06:22:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.464+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb004e030 con 0x7f8cb00ced20 2024-03-23T06:22:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.465+0000 7f8ca6000640 1 -- 172.21.15.73:0/227131381 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8c98013470 con 0x7f8cb00ced20 2024-03-23T06:22:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.465+0000 7f8ca6000640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8c8c06ac30 0x7f8c8c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.466+0000 7f8ca6000640 1 -- 172.21.15.73:0/227131381 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f8c98089a00 con 0x7f8cb00ced20 2024-03-23T06:22:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.466+0000 7f8cade00640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8c8c06ac30 0x7f8c8c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.467+0000 7f8cade00640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8c8c06ac30 0x7f8c8c06d0f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00090b0 tx=0x7f8ca0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:02.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.470+0000 7f8ca6000640 1 -- 172.21.15.73:0/227131381 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8c98054890 con 0x7f8cb00ced20 2024-03-23T06:22:02.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.655+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cb0071860 con 0x7f8cb00ced20 2024-03-23T06:22:02.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.656+0000 7f8ca6000640 1 -- 172.21.15.73:0/227131381 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18088 (secure 0 0 0) 0x7f8c98017090 con 0x7f8cb00ced20 2024-03-23T06:22:02.656 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:02.657 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:39.659625+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2},{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:22:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.658+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8c8c06ac30 msgr2=0x7f8c8c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.658+0000 7f8caf200640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8c8c06ac30 0x7f8c8c06d0f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00090b0 tx=0x7f8ca0008030 comp rx=0 tx=0).stop 2024-03-23T06:22:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb00ced20 msgr2=0x7f8cb01586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb00ced20 0x7f8cb01586f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800e870 tx=0x7f8c9800ed30 comp rx=0 tx=0).stop 2024-03-23T06:22:02.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 shutdown_connections 2024-03-23T06:22:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f8c8c06ac30 0x7f8c8c06d0f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cb00cf100 0x7f8cb0158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cb00ced20 0x7f8cb01586f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 --2- 172.21.15.73:0/227131381 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8cb00ca7c0 0x7f8cb01f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 >> 172.21.15.73:0/227131381 conn(0x7f8cb00713e0 msgr2=0x7f8cb00c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 shutdown_connections 2024-03-23T06:22:02.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.659+0000 7f8caf200640 1 -- 172.21.15.73:0/227131381 wait complete. 2024-03-23T06:22:02.677 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-23T06:09:46.691191+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-23T06:09:56.066381+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-23T06:09:56.917187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-23T06:09:59.981596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-23T06:22:02.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-23T06:22:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.876+0000 7f8468a00640 1 Processor -- start 2024-03-23T06:22:02.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.876+0000 7f8468a00640 1 -- start start 2024-03-23T06:22:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.877+0000 7f8468a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8464153670 0x7f8464142060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8468a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f846406ce70 0x7f846406a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8468a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846415c8d0 con 0x7f84640c6870 2024-03-23T06:22:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8468a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846415d8e0 con 0x7f846406ce70 2024-03-23T06:22:02.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8468a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8464153a50 con 0x7f8464153670 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8463400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8464153670 0x7f8464142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8463e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f846406ce70 0x7f846406a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8462a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f84640c6870 0x7f84640c5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47420/0 (socket says 172.21.15.73:47420) 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8462a00640 1 -- 172.21.15.73:0/1637290532 learned_addr learned my addr 172.21.15.73:0/1637290532 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8463400640 1 -- 172.21.15.73:0/1637290532 >> v2:172.21.15.73:3300/0 conn(0x7f846406ce70 msgr2=0x7f846406a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8463400640 1 --2- 172.21.15.73:0/1637290532 >> v2:172.21.15.73:3300/0 conn(0x7f846406ce70 0x7f846406a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8463400640 1 -- 172.21.15.73:0/1637290532 >> v1:172.21.15.110:6789/0 conn(0x7f84640c6870 legacy=0x7f84640c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8463400640 1 -- 172.21.15.73:0/1637290532 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8464142710 con 0x7f8464153670 2024-03-23T06:22:02.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.878+0000 7f8462000640 1 -- 172.21.15.73:0/1637290532 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 750121802 0 0) 0x7f846415c8d0 con 0x7f84640c6870 2024-03-23T06:22:02.880 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.879+0000 7f8463400640 1 --2- 172.21.15.73:0/1637290532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8464153670 0x7f8464142060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f846406d8e0 tx=0x7f845402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e70dee6c6b0c3001 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8462000640 1 -- 172.21.15.73:0/1637290532 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454031830 con 0x7f8464153670 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8462000640 1 -- 172.21.15.73:0/1637290532 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8454031990 con 0x7f8464153670 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8462000640 1 -- 172.21.15.73:0/1637290532 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454031d20 con 0x7f8464153670 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8468a00640 1 -- 172.21.15.73:0/1637290532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8464153670 msgr2=0x7f8464142060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8468a00640 1 --2- 172.21.15.73:0/1637290532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8464153670 0x7f8464142060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f846406d8e0 tx=0x7f845402b8d0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8468a00640 1 -- 172.21.15.73:0/1637290532 shutdown_connections 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8468a00640 1 --2- 172.21.15.73:0/1637290532 >> v2:172.21.15.73:3300/0 conn(0x7f846406ce70 0x7f846406a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8468a00640 1 --2- 172.21.15.73:0/1637290532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8464153670 0x7f8464142060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8468a00640 1 -- 172.21.15.73:0/1637290532 >> 172.21.15.73:0/1637290532 conn(0x7f846406d910 msgr2=0x7f846406dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8468a00640 1 -- 172.21.15.73:0/1637290532 shutdown_connections 2024-03-23T06:22:02.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.880+0000 7f8468a00640 1 -- 172.21.15.73:0/1637290532 wait complete. 2024-03-23T06:22:02.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.882+0000 7f8468a00640 1 Processor -- start 2024-03-23T06:22:02.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.882+0000 7f8468a00640 1 -- start start 2024-03-23T06:22:02.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8468a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f846406ce70 0x7f8464156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8468a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84640c6870 0x7f84641f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8468a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8464153670 0x7f84641efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8468a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84641f2980 con 0x7f84640c6870 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8468a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84641efa30 con 0x7f846406ce70 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8468a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84641f26a0 con 0x7f8464153670 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8462a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84640c6870 0x7f84641f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8463400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f846406ce70 0x7f8464156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8463e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8464153670 0x7f84641efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8463400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f846406ce70 0x7f8464156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43010/0 (socket says 172.21.15.73:43010) 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.883+0000 7f8463400640 1 -- 172.21.15.73:0/816608258 learned_addr learned my addr 172.21.15.73:0/816608258 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8462a00640 1 -- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8464153670 msgr2=0x7f84641efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8462a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8464153670 0x7f84641efec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8462a00640 1 -- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f846406ce70 msgr2=0x7f8464156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8462a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f846406ce70 0x7f8464156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8462a00640 1 -- 172.21.15.73:0/816608258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454009400 con 0x7f84640c6870 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8463400640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f846406ce70 0x7f8464156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:02.885 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8462a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84640c6870 0x7f84641f1c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f845000c450 tx=0x7f845000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f845b400640 1 -- 172.21.15.73:0/816608258 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500074e0 con 0x7f84640c6870 2024-03-23T06:22:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f845b400640 1 -- 172.21.15.73:0/816608258 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8450007640 con 0x7f84640c6870 2024-03-23T06:22:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8464155230 con 0x7f84640c6870 2024-03-23T06:22:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f845b400640 1 -- 172.21.15.73:0/816608258 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450004a20 con 0x7f84640c6870 2024-03-23T06:22:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.884+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84640caa60 con 0x7f84640c6870 2024-03-23T06:22:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.885+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8464155090 con 0x7f84640c6870 2024-03-23T06:22:02.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.886+0000 7f845b400640 1 -- 172.21.15.73:0/816608258 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8450004b80 con 0x7f84640c6870 2024-03-23T06:22:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.887+0000 7f845b400640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844406ac30 0x7f844406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.887+0000 7f845b400640 1 -- 172.21.15.73:0/816608258 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f8450088a70 con 0x7f84640c6870 2024-03-23T06:22:02.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.887+0000 7f8463400640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844406ac30 0x7f844406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:02.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.888+0000 7f8463400640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844406ac30 0x7f844406d0f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f845402b910 tx=0x7f845403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:02.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:02.892+0000 7f845b400640 1 -- 172.21.15.73:0/816608258 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8464155090 con 0x7f84640c6870 2024-03-23T06:22:03.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.076+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8464155090 con 0x7f84640c6870 2024-03-23T06:22:03.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.077+0000 7f845b400640 1 -- 172.21.15.73:0/816608258 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8464155090 con 0x7f84640c6870 2024-03-23T06:22:03.077 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-23T06:22:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.079+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844406ac30 msgr2=0x7f844406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.079+0000 7f8468a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844406ac30 0x7f844406d0f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f845402b910 tx=0x7f845403c040 comp rx=0 tx=0).stop 2024-03-23T06:22:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.079+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84640c6870 msgr2=0x7f84641f1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.079+0000 7f8468a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84640c6870 0x7f84641f1c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f845000c450 tx=0x7f845000c910 comp rx=0 tx=0).stop 2024-03-23T06:22:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.079+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 shutdown_connections 2024-03-23T06:22:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.079+0000 7f8468a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f844406ac30 0x7f844406d0f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.080+0000 7f8468a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8464153670 0x7f84641efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.080+0000 7f8468a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84640c6870 0x7f84641f1c70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.080+0000 7f8468a00640 1 --2- 172.21.15.73:0/816608258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f846406ce70 0x7f8464156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.080+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 >> 172.21.15.73:0/816608258 conn(0x7f846406d910 msgr2=0x7f846406fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.080+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 shutdown_connections 2024-03-23T06:22:03.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.080+0000 7f8468a00640 1 -- 172.21.15.73:0/816608258 wait complete. 2024-03-23T06:22:03.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-23T06:22:03.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.296+0000 7fb95d200640 1 Processor -- start 2024-03-23T06:22:03.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.296+0000 7fb95d200640 1 -- start start 2024-03-23T06:22:03.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.297+0000 7fb95d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9580c63c0 0x7fb9580c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.297+0000 7fb95d200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c67a0 0x7fb95806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.297+0000 7fb95d200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb958157880 con 0x7fb958150a90 2024-03-23T06:22:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.297+0000 7fb95d200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb958156f70 con 0x7fb9580c63c0 2024-03-23T06:22:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.297+0000 7fb95d200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580c7930 con 0x7fb9580c67a0 2024-03-23T06:22:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb957400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9580c63c0 0x7fb9580c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb957e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb958150a90 0x7fb95815a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47434/0 (socket says 172.21.15.73:47434) 2024-03-23T06:22:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb957e00640 1 -- 172.21.15.73:0/435638840 learned_addr learned my addr 172.21.15.73:0/435638840 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:03.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb94ea00640 1 --2- 172.21.15.73:0/435638840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c67a0 0x7fb95806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb956a00640 1 -- 172.21.15.73:0/435638840 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289291963 0 0) 0x7fb958157880 con 0x7fb958150a90 2024-03-23T06:22:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb956a00640 1 -- 172.21.15.73:0/435638840 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb93c003520 con 0x7fb958150a90 2024-03-23T06:22:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb94ea00640 1 -- 172.21.15.73:0/435638840 >> v2:172.21.15.73:3300/0 conn(0x7fb9580c63c0 msgr2=0x7fb9580c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:03.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb94ea00640 1 --2- 172.21.15.73:0/435638840 >> v2:172.21.15.73:3300/0 conn(0x7fb9580c63c0 0x7fb9580c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb94ea00640 1 -- 172.21.15.73:0/435638840 >> v1:172.21.15.110:6789/0 conn(0x7fb958150a90 legacy=0x7fb95815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.298+0000 7fb94ea00640 1 -- 172.21.15.73:0/435638840 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580c7c10 con 0x7fb9580c67a0 2024-03-23T06:22:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.299+0000 7fb94ea00640 1 --2- 172.21.15.73:0/435638840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c67a0 0x7fb95806d310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9400097a0 tx=0x7fb94002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be837a39598f91bb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.299+0000 7fb956a00640 1 -- 172.21.15.73:0/435638840 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94002d040 con 0x7fb9580c67a0 2024-03-23T06:22:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.299+0000 7fb956a00640 1 -- 172.21.15.73:0/435638840 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb940031810 con 0x7fb9580c67a0 2024-03-23T06:22:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.299+0000 7fb956a00640 1 -- 172.21.15.73:0/435638840 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940031ba0 con 0x7fb9580c67a0 2024-03-23T06:22:03.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.300+0000 7fb95d200640 1 -- 172.21.15.73:0/435638840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c67a0 msgr2=0x7fb95806d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.300+0000 7fb95d200640 1 --2- 172.21.15.73:0/435638840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c67a0 0x7fb95806d310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9400097a0 tx=0x7fb94002b8b0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.300+0000 7fb95d200640 1 -- 172.21.15.73:0/435638840 shutdown_connections 2024-03-23T06:22:03.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.300+0000 7fb95d200640 1 --2- 172.21.15.73:0/435638840 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c67a0 0x7fb95806d310 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.300+0000 7fb95d200640 1 --2- 172.21.15.73:0/435638840 >> v2:172.21.15.73:3300/0 conn(0x7fb9580c63c0 0x7fb9580c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.300+0000 7fb95d200640 1 -- 172.21.15.73:0/435638840 >> 172.21.15.73:0/435638840 conn(0x7fb9580c9370 msgr2=0x7fb9580c9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:03.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.300+0000 7fb95d200640 1 -- 172.21.15.73:0/435638840 shutdown_connections 2024-03-23T06:22:03.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.300+0000 7fb95d200640 1 -- 172.21.15.73:0/435638840 wait complete. 2024-03-23T06:22:03.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.302+0000 7fb95d200640 1 Processor -- start 2024-03-23T06:22:03.302 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.302+0000 7fb95d200640 1 -- start start 2024-03-23T06:22:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb95d200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c63c0 0x7fb9581ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb95d200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580c67a0 0x7fb9581567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb95d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb958150a90 0x7fb95814b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb95d200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb958151940 con 0x7fb9580c67a0 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb95d200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb958142df0 con 0x7fb958150a90 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb95d200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9581ed7e0 con 0x7fb9580c63c0 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb958150a90 0x7fb95814b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c63c0 0x7fb9581ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb94ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580c67a0 0x7fb9581567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c63c0 0x7fb9581ed2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51986/0 (socket says 172.21.15.73:51986) 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957400640 1 -- 172.21.15.73:0/1176090653 learned_addr learned my addr 172.21.15.73:0/1176090653 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957400640 1 -- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb958150a90 msgr2=0x7fb95814b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957400640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb958150a90 0x7fb95814b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957400640 1 -- 172.21.15.73:0/1176090653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580c67a0 msgr2=0x7fb9581567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957400640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580c67a0 0x7fb9581567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957400640 1 -- 172.21.15.73:0/1176090653 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb940009400 con 0x7fb9580c63c0 2024-03-23T06:22:03.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.303+0000 7fb957e00640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb958150a90 0x7fb95814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:03.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.304+0000 7fb957400640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c63c0 0x7fb9581ed2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb948009db0 tx=0x7fb94800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:03.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.304+0000 7fb94fe00640 1 -- 172.21.15.73:0/1176090653 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948014480 con 0x7fb9580c63c0 2024-03-23T06:22:03.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.304+0000 7fb94fe00640 1 -- 172.21.15.73:0/1176090653 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94800f040 con 0x7fb9580c63c0 2024-03-23T06:22:03.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.304+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb958157e90 con 0x7fb9580c63c0 2024-03-23T06:22:03.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.304+0000 7fb94fe00640 1 -- 172.21.15.73:0/1176090653 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb948014800 con 0x7fb9580c63c0 2024-03-23T06:22:03.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.304+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95814ab30 con 0x7fb9580c63c0 2024-03-23T06:22:03.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.305+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb958067060 con 0x7fb9580c63c0 2024-03-23T06:22:03.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.306+0000 7fb94fe00640 1 -- 172.21.15.73:0/1176090653 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb948014960 con 0x7fb9580c63c0 2024-03-23T06:22:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.307+0000 7fb94fe00640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb93406ac00 0x7fb93406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.307+0000 7fb94fe00640 1 -- 172.21.15.73:0/1176090653 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb94808a190 con 0x7fb9580c63c0 2024-03-23T06:22:03.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.307+0000 7fb94ea00640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb93406ac00 0x7fb93406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.308+0000 7fb94ea00640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb93406ac00 0x7fb93406d0c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb940036000 tx=0x7fb94003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.315+0000 7fb94fe00640 1 -- 172.21.15.73:0/1176090653 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb9480550a0 con 0x7fb9580c63c0 2024-03-23T06:22:03.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.508+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb95804e030 con 0x7fb9580c63c0 2024-03-23T06:22:03.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.510+0000 7fb94fe00640 1 -- 172.21.15.73:0/1176090653 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9480586c0 con 0x7fb9580c63c0 2024-03-23T06:22:03.509 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:22:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb93406ac00 msgr2=0x7fb93406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb93406ac00 0x7fb93406d0c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb940036000 tx=0x7fb94003c040 comp rx=0 tx=0).stop 2024-03-23T06:22:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c63c0 msgr2=0x7fb9581ed2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c63c0 0x7fb9581ed2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb948009db0 tx=0x7fb94800c490 comp rx=0 tx=0).stop 2024-03-23T06:22:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 shutdown_connections 2024-03-23T06:22:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb958150a90 0x7fb95814b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9580c67a0 0x7fb9581567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb93406ac00 0x7fb93406d0c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 --2- 172.21.15.73:0/1176090653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9580c63c0 0x7fb9581ed2a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 >> 172.21.15.73:0/1176090653 conn(0x7fb9580c9370 msgr2=0x7fb9580c3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 shutdown_connections 2024-03-23T06:22:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.512+0000 7fb95d200640 1 -- 172.21.15.73:0/1176090653 wait complete. 2024-03-23T06:22:03.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-23T06:22:03.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.726+0000 7ff32b000640 1 Processor -- start 2024-03-23T06:22:03.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.726+0000 7ff32b000640 1 -- start start 2024-03-23T06:22:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.727+0000 7ff32b000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3240c5df0 0x7ff324159f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff32b000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff32406a830 0x7ff32406ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff32b000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff32415ca60 0x7ff32415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff32b000640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3240c64b0 con 0x7ff32406a830 2024-03-23T06:22:03.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff32b000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3240707a0 con 0x7ff32415ca60 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff32b000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff324070a80 con 0x7ff3240c5df0 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff32406a830 0x7ff32406ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3240c5df0 0x7ff324159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff32406a830 0x7ff32406ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47248/0 (socket says 172.21.15.73:47248) 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3240c5df0 0x7ff324159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:51994/0 (socket says 172.21.15.73:51994) 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329200640 1 -- 172.21.15.73:0/653306232 learned_addr learned my addr 172.21.15.73:0/653306232 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff32a600640 1 --2- 172.21.15.73:0/653306232 >> v2:172.21.15.110:3300/0 conn(0x7ff32415ca60 0x7ff32415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329c00640 1 -- 172.21.15.73:0/653306232 >> v2:172.21.15.110:3300/0 conn(0x7ff32415ca60 msgr2=0x7ff32415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329c00640 1 --2- 172.21.15.73:0/653306232 >> v2:172.21.15.110:3300/0 conn(0x7ff32415ca60 0x7ff32415ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329c00640 1 -- 172.21.15.73:0/653306232 >> v2:172.21.15.73:3300/0 conn(0x7ff32406a830 msgr2=0x7ff32406ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329c00640 1 --2- 172.21.15.73:0/653306232 >> v2:172.21.15.73:3300/0 conn(0x7ff32406a830 0x7ff32406ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329c00640 1 -- 172.21.15.73:0/653306232 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324069d50 con 0x7ff3240c5df0 2024-03-23T06:22:03.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.728+0000 7ff329200640 1 --2- 172.21.15.73:0/653306232 >> v2:172.21.15.73:3300/0 conn(0x7ff32406a830 0x7ff32406ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.729+0000 7ff329c00640 1 --2- 172.21.15.73:0/653306232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3240c5df0 0x7ff324159f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff324070160 tx=0x7ff31802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5687e9b090144c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff323e00640 1 -- 172.21.15.73:0/653306232 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318031830 con 0x7ff3240c5df0 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff323e00640 1 -- 172.21.15.73:0/653306232 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff318031990 con 0x7ff3240c5df0 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff323e00640 1 -- 172.21.15.73:0/653306232 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318031d20 con 0x7ff3240c5df0 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff32b000640 1 -- 172.21.15.73:0/653306232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3240c5df0 msgr2=0x7ff324159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff32b000640 1 --2- 172.21.15.73:0/653306232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3240c5df0 0x7ff324159f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff324070160 tx=0x7ff31802b8d0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff32b000640 1 -- 172.21.15.73:0/653306232 shutdown_connections 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff32b000640 1 --2- 172.21.15.73:0/653306232 >> v2:172.21.15.110:3300/0 conn(0x7ff32415ca60 0x7ff32415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff32b000640 1 --2- 172.21.15.73:0/653306232 >> v2:172.21.15.73:3300/0 conn(0x7ff32406a830 0x7ff32406ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff32b000640 1 --2- 172.21.15.73:0/653306232 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3240c5df0 0x7ff324159f40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff32b000640 1 -- 172.21.15.73:0/653306232 >> 172.21.15.73:0/653306232 conn(0x7ff3240cbbb0 msgr2=0x7ff3240cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.730+0000 7ff32b000640 1 -- 172.21.15.73:0/653306232 shutdown_connections 2024-03-23T06:22:03.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.731+0000 7ff32b000640 1 -- 172.21.15.73:0/653306232 wait complete. 2024-03-23T06:22:03.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.732+0000 7ff32b000640 1 Processor -- start 2024-03-23T06:22:03.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.732+0000 7ff32b000640 1 -- start start 2024-03-23T06:22:03.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff32b000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff32406a830 0x7ff3241ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff32b000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3240c5df0 0x7ff3240af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff32b000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff32415ca60 0x7ff32415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff32b000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3241f26e0 con 0x7ff3240c5df0 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff32b000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240afe50 con 0x7ff32415ca60 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff32b000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240adfa0 con 0x7ff32406a830 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff329200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3240c5df0 0x7ff3240af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff329c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff32406a830 0x7ff3241ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff32a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff32415ca60 0x7ff32415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.733+0000 7ff329c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff32406a830 0x7ff3241ef380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:52002/0 (socket says 172.21.15.73:52002) 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff329c00640 1 -- 172.21.15.73:0/1314020703 learned_addr learned my addr 172.21.15.73:0/1314020703 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff329c00640 1 -- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff32415ca60 msgr2=0x7ff32415bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff329c00640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff32415ca60 0x7ff32415bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff329c00640 1 -- 172.21.15.73:0/1314020703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3240c5df0 msgr2=0x7ff3240af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff329c00640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3240c5df0 0x7ff3240af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff329c00640 1 -- 172.21.15.73:0/1314020703 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100094d0 con 0x7ff32406a830 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff329200640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3240c5df0 0x7ff3240af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff329c00640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff32406a830 0x7ff3241ef380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff31802bee0 tx=0x7ff3180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff321600640 1 -- 172.21.15.73:0/1314020703 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31803a830 con 0x7ff32406a830 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.734+0000 7ff321600640 1 -- 172.21.15.73:0/1314020703 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31803a9b0 con 0x7ff32406a830 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.735+0000 7ff321600640 1 -- 172.21.15.73:0/1314020703 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31803ad60 con 0x7ff32406a830 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.735+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff318009400 con 0x7ff32406a830 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.735+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3240adcc0 con 0x7ff32406a830 2024-03-23T06:22:03.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.736+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32404e030 con 0x7ff32406a830 2024-03-23T06:22:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.737+0000 7ff321600640 1 -- 172.21.15.73:0/1314020703 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff31804c440 con 0x7ff32406a830 2024-03-23T06:22:03.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.737+0000 7ff321600640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff30406ac00 0x7ff30406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.737+0000 7ff321600640 1 -- 172.21.15.73:0/1314020703 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7ff3180ab410 con 0x7ff32406a830 2024-03-23T06:22:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.738+0000 7ff329200640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff30406ac00 0x7ff30406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:03.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.738+0000 7ff329200640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff30406ac00 0x7ff30406d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff3240c2f00 tx=0x7ff310009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:03.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.745+0000 7ff321600640 1 -- 172.21.15.73:0/1314020703 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7ff3180761e0 con 0x7ff32406a830 2024-03-23T06:22:03.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.938+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3240bf530 con 0x7ff32406a830 2024-03-23T06:22:03.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.938+0000 7ff321600640 1 -- 172.21.15.73:0/1314020703 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff318079800 con 0x7ff32406a830 2024-03-23T06:22:03.939 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-23T06:22:03.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff30406ac00 msgr2=0x7ff30406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff30406ac00 0x7ff30406d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff3240c2f00 tx=0x7ff310009240 comp rx=0 tx=0).stop 2024-03-23T06:22:03.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff32406a830 msgr2=0x7ff3241ef380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:03.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff32406a830 0x7ff3241ef380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff31802bee0 tx=0x7ff3180046c0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 shutdown_connections 2024-03-23T06:22:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff32415ca60 0x7ff32415bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3240c5df0 0x7ff3240af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7ff30406ac00 0x7ff30406d0c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 --2- 172.21.15.73:0/1314020703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff32406a830 0x7ff3241ef380 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 >> 172.21.15.73:0/1314020703 conn(0x7ff3240cbbb0 msgr2=0x7ff324159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 shutdown_connections 2024-03-23T06:22:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:03.941+0000 7ff32b000640 1 -- 172.21.15.73:0/1314020703 wait complete. 2024-03-23T06:22:03.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-23T06:22:04.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.158+0000 7fe22fe00640 1 Processor -- start 2024-03-23T06:22:04.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.158+0000 7fe22fe00640 1 -- start start 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.159+0000 7fe22fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe2300715a0 0x7fe2301575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.159+0000 7fe22fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300c5340 0x7fe230157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.159+0000 7fe22fe00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23006e5c0 con 0x7fe2301511e0 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.159+0000 7fe22fe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe230065a50 con 0x7fe2300715a0 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.159+0000 7fe22fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2301515c0 con 0x7fe2300c5340 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.160+0000 7fe22ea00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe2301511e0 0x7fe2300c6f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33682/0 (socket says 172.21.15.73:33682) 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.160+0000 7fe22ea00640 1 -- 172.21.15.73:0/3519998722 learned_addr learned my addr 172.21.15.73:0/3519998722 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.160+0000 7fe22f400640 1 --2- 172.21.15.73:0/3519998722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300c5340 0x7fe230157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.160+0000 7fe22e000640 1 --2- 172.21.15.73:0/3519998722 >> v2:172.21.15.73:3300/0 conn(0x7fe2300715a0 0x7fe2301575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.160+0000 7fe22f400640 1 -- 172.21.15.73:0/3519998722 >> v2:172.21.15.73:3300/0 conn(0x7fe2300715a0 msgr2=0x7fe2301575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:04.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.160+0000 7fe22f400640 1 --2- 172.21.15.73:0/3519998722 >> v2:172.21.15.73:3300/0 conn(0x7fe2300715a0 0x7fe2301575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.160+0000 7fe22f400640 1 -- 172.21.15.73:0/3519998722 >> v1:172.21.15.73:6789/0 conn(0x7fe2301511e0 legacy=0x7fe2300c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.160+0000 7fe22f400640 1 -- 172.21.15.73:0/3519998722 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2301570c0 con 0x7fe2300c5340 2024-03-23T06:22:04.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.161+0000 7fe22f400640 1 --2- 172.21.15.73:0/3519998722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300c5340 0x7fe230157b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe228009d90 tx=0x7fe22802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb2f0dbd0fa57302 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:04.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22d600640 1 -- 172.21.15.73:0/3519998722 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22802cbc0 con 0x7fe2300c5340 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22d600640 1 -- 172.21.15.73:0/3519998722 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22802cd20 con 0x7fe2300c5340 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22d600640 1 -- 172.21.15.73:0/3519998722 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228034660 con 0x7fe2300c5340 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22fe00640 1 -- 172.21.15.73:0/3519998722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300c5340 msgr2=0x7fe230157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22fe00640 1 --2- 172.21.15.73:0/3519998722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300c5340 0x7fe230157b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe228009d90 tx=0x7fe22802be10 comp rx=0 tx=0).stop 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22fe00640 1 -- 172.21.15.73:0/3519998722 shutdown_connections 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22fe00640 1 --2- 172.21.15.73:0/3519998722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300c5340 0x7fe230157b00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22fe00640 1 --2- 172.21.15.73:0/3519998722 >> v2:172.21.15.73:3300/0 conn(0x7fe2300715a0 0x7fe2301575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22fe00640 1 -- 172.21.15.73:0/3519998722 >> 172.21.15.73:0/3519998722 conn(0x7fe23006d910 msgr2=0x7fe23006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22fe00640 1 -- 172.21.15.73:0/3519998722 shutdown_connections 2024-03-23T06:22:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.162+0000 7fe22fe00640 1 -- 172.21.15.73:0/3519998722 wait complete. 2024-03-23T06:22:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.164+0000 7fe22fe00640 1 Processor -- start 2024-03-23T06:22:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.164+0000 7fe22fe00640 1 -- start start 2024-03-23T06:22:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300715a0 0x7fe23014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2300c5340 0x7fe23014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2301511e0 0x7fe2301efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300c3a70 con 0x7fe2300c5340 2024-03-23T06:22:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe230146c40 con 0x7fe2301511e0 2024-03-23T06:22:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300c3d30 con 0x7fe2300715a0 2024-03-23T06:22:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2300c5340 0x7fe23014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300715a0 0x7fe23014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2301511e0 0x7fe2301efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22e000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2300c5340 0x7fe23014c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47270/0 (socket says 172.21.15.73:47270) 2024-03-23T06:22:04.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.165+0000 7fe22e000640 1 -- 172.21.15.73:0/463866210 learned_addr learned my addr 172.21.15.73:0/463866210 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22ea00640 1 -- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2301511e0 msgr2=0x7fe2301efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22ea00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2301511e0 0x7fe2301efea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22ea00640 1 -- 172.21.15.73:0/463866210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2300c5340 msgr2=0x7fe23014c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22ea00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2300c5340 0x7fe23014c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22ea00640 1 -- 172.21.15.73:0/463866210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe228009a70 con 0x7fe2300715a0 2024-03-23T06:22:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22f400640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2301511e0 0x7fe2301efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22e000640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2300c5340 0x7fe23014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22ea00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300715a0 0x7fe23014ab70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe22000c440 tx=0x7fe220001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:04.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe226a00640 1 -- 172.21.15.73:0/463866210 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220005ce0 con 0x7fe2300715a0 2024-03-23T06:22:04.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe226a00640 1 -- 172.21.15.73:0/463866210 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe220005e40 con 0x7fe2300715a0 2024-03-23T06:22:04.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2300c32d0 con 0x7fe2300715a0 2024-03-23T06:22:04.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe226a00640 1 -- 172.21.15.73:0/463866210 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2200072d0 con 0x7fe2300715a0 2024-03-23T06:22:04.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.166+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23014cc80 con 0x7fe2300715a0 2024-03-23T06:22:04.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.167+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2300c3130 con 0x7fe2300715a0 2024-03-23T06:22:04.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.168+0000 7fe226a00640 1 -- 172.21.15.73:0/463866210 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe2200074f0 con 0x7fe2300715a0 2024-03-23T06:22:04.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.169+0000 7fe226a00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe21006ac00 0x7fe21006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.169+0000 7fe226a00640 1 -- 172.21.15.73:0/463866210 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe220088bd0 con 0x7fe2300715a0 2024-03-23T06:22:04.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.169+0000 7fe22e000640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe21006ac00 0x7fe21006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.170+0000 7fe22e000640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe21006ac00 0x7fe21006d0c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe23014d360 tx=0x7fe21c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:04.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.174+0000 7fe226a00640 1 -- 172.21.15.73:0/463866210 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe2300c3130 con 0x7fe2300715a0 2024-03-23T06:22:04.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.391+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe2300c3130 con 0x7fe2300715a0 2024-03-23T06:22:04.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.391+0000 7fe226a00640 1 -- 172.21.15.73:0/463866210 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe2300c3130 con 0x7fe2300715a0 2024-03-23T06:22:04.391 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-23T06:22:04.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe21006ac00 msgr2=0x7fe21006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe21006ac00 0x7fe21006d0c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe23014d360 tx=0x7fe21c009190 comp rx=0 tx=0).stop 2024-03-23T06:22:04.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300715a0 msgr2=0x7fe23014ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300715a0 0x7fe23014ab70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe22000c440 tx=0x7fe220001e70 comp rx=0 tx=0).stop 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 shutdown_connections 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2301511e0 0x7fe2301efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2300c5340 0x7fe23014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe21006ac00 0x7fe21006d0c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 --2- 172.21.15.73:0/463866210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2300715a0 0x7fe23014ab70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 >> 172.21.15.73:0/463866210 conn(0x7fe23006d910 msgr2=0x7fe23006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 shutdown_connections 2024-03-23T06:22:04.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.395+0000 7fe22fe00640 1 -- 172.21.15.73:0/463866210 wait complete. 2024-03-23T06:22:04.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-23T06:22:04.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.608+0000 7f9a77200640 1 Processor -- start 2024-03-23T06:22:04.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.608+0000 7f9a77200640 1 -- start start 2024-03-23T06:22:04.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a77200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a7006b410 0x7f9a7006f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a77200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006df30 0x7f9a7006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a77200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a700c7af0 con 0x7f9a7006b030 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a77200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7006daa0 con 0x7f9a7006b410 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a77200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7006e920 con 0x7f9a7006df30 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a75200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006df30 0x7f9a7006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a67e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a7006b410 0x7f9a7006f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a6fe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9a7006b030 0x7f9a70159fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47444/0 (socket says 172.21.15.73:47444) 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.610+0000 7f9a6fe00640 1 -- 172.21.15.73:0/4137923985 learned_addr learned my addr 172.21.15.73:0/4137923985 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.611+0000 7f9a75200640 1 -- 172.21.15.73:0/4137923985 >> v2:172.21.15.73:3300/0 conn(0x7f9a7006b410 msgr2=0x7f9a7006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.611+0000 7f9a75200640 1 --2- 172.21.15.73:0/4137923985 >> v2:172.21.15.73:3300/0 conn(0x7f9a7006b410 0x7f9a7006f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.611+0000 7f9a75200640 1 -- 172.21.15.73:0/4137923985 >> v1:172.21.15.110:6789/0 conn(0x7f9a7006b030 legacy=0x7f9a70159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.611+0000 7f9a75200640 1 -- 172.21.15.73:0/4137923985 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7006d740 con 0x7f9a7006df30 2024-03-23T06:22:04.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.611+0000 7f9a6f400640 1 -- 172.21.15.73:0/4137923985 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518609608 0 0) 0x7f9a700c7af0 con 0x7f9a7006b030 2024-03-23T06:22:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.612+0000 7f9a75200640 1 --2- 172.21.15.73:0/4137923985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006df30 0x7f9a7006e3e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a68009d90 tx=0x7f9a6802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78944bb93d9f940d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.612+0000 7f9a6f400640 1 -- 172.21.15.73:0/4137923985 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6802cc60 con 0x7f9a7006df30 2024-03-23T06:22:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.612+0000 7f9a6f400640 1 -- 172.21.15.73:0/4137923985 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6802cdc0 con 0x7f9a7006df30 2024-03-23T06:22:04.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.612+0000 7f9a6f400640 1 -- 172.21.15.73:0/4137923985 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68034660 con 0x7f9a7006df30 2024-03-23T06:22:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.613+0000 7f9a77200640 1 -- 172.21.15.73:0/4137923985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006df30 msgr2=0x7f9a7006e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.613+0000 7f9a77200640 1 --2- 172.21.15.73:0/4137923985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006df30 0x7f9a7006e3e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a68009d90 tx=0x7f9a6802beb0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.613+0000 7f9a77200640 1 -- 172.21.15.73:0/4137923985 shutdown_connections 2024-03-23T06:22:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.613+0000 7f9a77200640 1 --2- 172.21.15.73:0/4137923985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006df30 0x7f9a7006e3e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.613+0000 7f9a77200640 1 --2- 172.21.15.73:0/4137923985 >> v2:172.21.15.73:3300/0 conn(0x7f9a7006b410 0x7f9a7006f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.613+0000 7f9a77200640 1 -- 172.21.15.73:0/4137923985 >> 172.21.15.73:0/4137923985 conn(0x7f9a700ccdd0 msgr2=0x7f9a700cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.613+0000 7f9a77200640 1 -- 172.21.15.73:0/4137923985 shutdown_connections 2024-03-23T06:22:04.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.613+0000 7f9a77200640 1 -- 172.21.15.73:0/4137923985 wait complete. 2024-03-23T06:22:04.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.615+0000 7f9a77200640 1 Processor -- start 2024-03-23T06:22:04.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.615+0000 7f9a77200640 1 -- start start 2024-03-23T06:22:04.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a77200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006b030 0x7f9a70140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a77200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a7006b410 0x7f9a7013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a77200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7006df30 0x7f9a7013ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a77200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a70140a60 con 0x7f9a7006df30 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a77200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7013e4f0 con 0x7f9a7006b410 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a77200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a701ef9e0 con 0x7f9a7006b030 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a6fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006b030 0x7f9a70140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a67e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a7006b410 0x7f9a7013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a75200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7006df30 0x7f9a7013ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a6fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006b030 0x7f9a70140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:52048/0 (socket says 172.21.15.73:52048) 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a67e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a7006b410 0x7f9a7013cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43050/0 (socket says 172.21.15.73:43050) 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.617+0000 7f9a6fe00640 1 -- 172.21.15.73:0/3993542766 learned_addr learned my addr 172.21.15.73:0/3993542766 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6fe00640 1 -- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a7006b410 msgr2=0x7f9a7013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6fe00640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a7006b410 0x7f9a7013cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6fe00640 1 -- 172.21.15.73:0/3993542766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7006df30 msgr2=0x7f9a7013ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6fe00640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7006df30 0x7f9a7013ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6fe00640 1 -- 172.21.15.73:0/3993542766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68009a70 con 0x7f9a7006b030 2024-03-23T06:22:04.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6fe00640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006b030 0x7f9a70140520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800c430 tx=0x7f9a5800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:04.619 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6cc00640 1 -- 172.21.15.73:0/3993542766 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a580074e0 con 0x7f9a7006b030 2024-03-23T06:22:04.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6cc00640 1 -- 172.21.15.73:0/3993542766 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a58007660 con 0x7f9a7006b030 2024-03-23T06:22:04.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a6cc00640 1 -- 172.21.15.73:0/3993542766 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58004a20 con 0x7f9a7006b030 2024-03-23T06:22:04.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a70140dc0 con 0x7f9a7006b030 2024-03-23T06:22:04.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.618+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7013e740 con 0x7f9a7006b030 2024-03-23T06:22:04.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.619+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a70067060 con 0x7f9a7006b030 2024-03-23T06:22:04.620 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.620+0000 7f9a6cc00640 1 -- 172.21.15.73:0/3993542766 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9a58004b80 con 0x7f9a7006b030 2024-03-23T06:22:04.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.621+0000 7f9a6cc00640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9a4c06ac00 0x7f9a4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:04.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.621+0000 7f9a6cc00640 1 -- 172.21.15.73:0/3993542766 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f9a580892b0 con 0x7f9a7006b030 2024-03-23T06:22:04.621 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.621+0000 7f9a67e00640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9a4c06ac00 0x7f9a4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:04.622 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.622+0000 7f9a67e00640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9a4c06ac00 0x7f9a4c06d0c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a700c9270 tx=0x7f9a60009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:04.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.625+0000 7f9a6cc00640 1 -- 172.21.15.73:0/3993542766 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9a58054260 con 0x7f9a7006b030 2024-03-23T06:22:04.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.833+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a7006ea90 con 0x7f9a7006b030 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.833+0000 7f9a6cc00640 1 -- 172.21.15.73:0/3993542766 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9a58057880 con 0x7f9a7006b030 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9a4c06ac00 msgr2=0x7f9a4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9a4c06ac00 0x7f9a4c06d0c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9a700c9270 tx=0x7f9a60009190 comp rx=0 tx=0).stop 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006b030 msgr2=0x7f9a70140520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006b030 0x7f9a70140520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800c430 tx=0x7f9a5800c8f0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 shutdown_connections 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a7006df30 0x7f9a7013ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a7006b410 0x7f9a7013cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9a4c06ac00 0x7f9a4c06d0c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 --2- 172.21.15.73:0/3993542766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a7006b030 0x7f9a70140520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:04.888 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 >> 172.21.15.73:0/3993542766 conn(0x7f9a700ccdd0 msgr2=0x7f9a70158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:04.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 shutdown_connections 2024-03-23T06:22:04.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:04.836+0000 7f9a77200640 1 -- 172.21.15.73:0/3993542766 wait complete. 2024-03-23T06:22:04.889 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-23T06:22:04.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:22:04.889 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-23T06:22:05.079 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:22:05.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:22:05.079 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-23T06:22:05.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:22:05.156 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-23T06:22:05.357 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-23T06:22:05.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:22:05.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-23T06:22:05.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-23T06:22:05.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-03-23T06:22:05.592 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-23T06:22:05.603 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-23T06:22:05.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:22:05.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.806+0000 7f7564000640 1 Processor -- start 2024-03-23T06:22:05.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.806+0000 7f7564000640 1 -- start start 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.807+0000 7f7564000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c0c5a10 0x7f755c0bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.807+0000 7f7564000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c157b60 con 0x7f755c1513f0 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.807+0000 7f7564000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0c0830 con 0x7f755c0c03a0 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.807+0000 7f7564000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c158dc0 con 0x7f755c0c5a10 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.808+0000 7f7560c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c0c5a10 0x7f755c0bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.808+0000 7f7561600640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f755c1513f0 0x7f755c1586b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:33686/0 (socket says 172.21.15.73:33686) 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.808+0000 7f7561600640 1 -- 172.21.15.73:0/2339549024 learned_addr learned my addr 172.21.15.73:0/2339549024 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.808+0000 7f7560c00640 1 -- 172.21.15.73:0/2339549024 >> v1:172.21.15.110:6789/0 conn(0x7f755c0c03a0 legacy=0x7f755c071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:05.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.808+0000 7f7560c00640 1 -- 172.21.15.73:0/2339549024 >> v1:172.21.15.73:6789/0 conn(0x7f755c1513f0 legacy=0x7f755c1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:05.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.808+0000 7f7560c00640 1 -- 172.21.15.73:0/2339549024 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c0c0b10 con 0x7f755c0c5a10 2024-03-23T06:22:05.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.808+0000 7f755be00640 1 -- 172.21.15.73:0/2339549024 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319026310 0 0) 0x7f755c0c0830 con 0x7f755c0c03a0 2024-03-23T06:22:05.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.809+0000 7f7560c00640 1 --2- 172.21.15.73:0/2339549024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c0c5a10 0x7f755c0bfe60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f75480097d0 tx=0x7f754802b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28057a955f505a6b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:05.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f755be00640 1 -- 172.21.15.73:0/2339549024 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548030890 con 0x7f755c0c5a10 2024-03-23T06:22:05.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f755be00640 1 -- 172.21.15.73:0/2339549024 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75480309f0 con 0x7f755c0c5a10 2024-03-23T06:22:05.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f755be00640 1 -- 172.21.15.73:0/2339549024 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548030d80 con 0x7f755c0c5a10 2024-03-23T06:22:05.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f7564000640 1 -- 172.21.15.73:0/2339549024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c0c5a10 msgr2=0x7f755c0bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:05.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f7564000640 1 --2- 172.21.15.73:0/2339549024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c0c5a10 0x7f755c0bfe60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f75480097d0 tx=0x7f754802b9d0 comp rx=0 tx=0).stop 2024-03-23T06:22:05.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f7564000640 1 -- 172.21.15.73:0/2339549024 shutdown_connections 2024-03-23T06:22:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f7564000640 1 --2- 172.21.15.73:0/2339549024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c0c5a10 0x7f755c0bfe60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f7564000640 1 -- 172.21.15.73:0/2339549024 >> 172.21.15.73:0/2339549024 conn(0x7f755c06bb40 msgr2=0x7f755c06bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f7564000640 1 -- 172.21.15.73:0/2339549024 shutdown_connections 2024-03-23T06:22:05.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.810+0000 7f7564000640 1 -- 172.21.15.73:0/2339549024 wait complete. 2024-03-23T06:22:05.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.812+0000 7f7564000640 1 Processor -- start 2024-03-23T06:22:05.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.812+0000 7f7564000640 1 -- start start 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.813+0000 7f7564000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f755c0c5a10 0x7f755c1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.813+0000 7f7564000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f755c1513f0 0x7f755c1f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.813+0000 7f7564000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c071560 0x7f755c070290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.813+0000 7f7564000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0c6a20 con 0x7f755c1513f0 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.813+0000 7f7564000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c071a30 con 0x7f755c0c5a10 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.813+0000 7f7564000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0c8250 con 0x7f755c071560 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.813+0000 7f7561600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f755c0c5a10 0x7f755c1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c071560 0x7f755c070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7560c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f755c1513f0 0x7f755c1f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c071560 0x7f755c070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:52060/0 (socket says 172.21.15.73:52060) 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7561600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f755c0c5a10 0x7f755c1488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43058/0 (socket says 172.21.15.73:43058) 2024-03-23T06:22:05.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 -- 172.21.15.73:0/3729139057 learned_addr learned my addr 172.21.15.73:0/3729139057 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 -- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f755c0c5a10 msgr2=0x7f755c1488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f755c0c5a10 0x7f755c1488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 -- 172.21.15.73:0/3729139057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f755c1513f0 msgr2=0x7f755c1f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f755c1513f0 0x7f755c1f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 -- 172.21.15.73:0/3729139057 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7548009400 con 0x7f755c071560 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7562000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c071560 0x7f755c070290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f755400c740 tx=0x7f755400cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.814+0000 7f7559600640 1 -- 172.21.15.73:0/3729139057 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554003da0 con 0x7f755c071560 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.815+0000 7f7559600640 1 -- 172.21.15.73:0/3729139057 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755400ce50 con 0x7f755c071560 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.815+0000 7f7559600640 1 -- 172.21.15.73:0/3729139057 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554005290 con 0x7f755c071560 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.815+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c1f76a0 con 0x7f755c071560 2024-03-23T06:22:05.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.815+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c0c6740 con 0x7f755c071560 2024-03-23T06:22:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.816+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c0c0ee0 con 0x7f755c071560 2024-03-23T06:22:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.817+0000 7f7559600640 1 -- 172.21.15.73:0/3729139057 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f75540053f0 con 0x7f755c071560 2024-03-23T06:22:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.817+0000 7f7559600640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f753c06ac00 0x7f753c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:05.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.818+0000 7f7559600640 1 -- 172.21.15.73:0/3729139057 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f7554088ee0 con 0x7f755c071560 2024-03-23T06:22:05.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.818+0000 7f7561600640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f753c06ac00 0x7f753c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:05.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.818+0000 7f7561600640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f753c06ac00 0x7f753c06d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7550005880 tx=0x7f7550009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:05.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:05.822+0000 7f7559600640 1 -- 172.21.15.73:0/3729139057 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7554053d60 con 0x7f755c071560 2024-03-23T06:22:06.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.019+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f755c0c5e50 con 0x7f753c06ac00 2024-03-23T06:22:06.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.045+0000 7f7559600640 1 -- 172.21.15.73:0/3729139057 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370346 (secure 0 0 0) 0x7f755000f820 con 0x7f753c06ac00 2024-03-23T06:22:06.052 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:06.054 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f753c06ac00 msgr2=0x7f753c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f753c06ac00 0x7f753c06d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7550005880 tx=0x7f7550009040 comp rx=0 tx=0).stop 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c071560 msgr2=0x7f755c070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c071560 0x7f755c070290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f755400c740 tx=0x7f755400cc00 comp rx=0 tx=0).stop 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 shutdown_connections 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f753c06ac00 0x7f753c06d0c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f755c071560 0x7f755c070290 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f755c1513f0 0x7f755c1f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 --2- 172.21.15.73:0/3729139057 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f755c0c5a10 0x7f755c1488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 >> 172.21.15.73:0/3729139057 conn(0x7f755c06bb40 msgr2=0x7f755c1e3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.051+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 shutdown_connections 2024-03-23T06:22:06.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.052+0000 7f7564000640 1 -- 172.21.15.73:0/3729139057 wait complete. 2024-03-23T06:22:06.073 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-03-23T06:22:04.821367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402009,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469594,"num_write_kb":34184412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170678,"ondisk_log_size":170678,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10077296,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9900211,"kb_avail":744897424,"statfs":{"total":773094113280,"available":762774962176,"internally_reserved":0,"allocated":181256192,"data_stored":179740522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10137816632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002606"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:20.806395+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:20:20.806395+0000","last_peered":"2024-03-23T06:20:20.806395+0000","last_clean":"2024-03-23T06:20:20.806395+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:20:20.806395+0000","last_undegraded":"2024-03-23T06:20:20.806395+0000","last_fullsized":"2024-03-23T06:20:20.806395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.131862+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:21:28.131862+0000","last_peered":"2024-03-23T06:21:28.131862+0000","last_clean":"2024-03-23T06:21:28.131862+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:21:28.131862+0000","last_undegraded":"2024-03-23T06:21:28.131862+0000","last_fullsized":"2024-03-23T06:21:28.131862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4667,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.014941+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:21:28.014941+0000","last_peered":"2024-03-23T06:21:28.014941+0000","last_clean":"2024-03-23T06:21:28.014941+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:21:28.014941+0000","last_undegraded":"2024-03-23T06:21:28.014941+0000","last_fullsized":"2024-03-23T06:21:28.014941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'12","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.027749+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:21:28.027749+0000","last_peered":"2024-03-23T06:21:28.027749+0000","last_clean":"2024-03-23T06:21:28.027749+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:21:28.027749+0000","last_undegraded":"2024-03-23T06:21:28.027749+0000","last_fullsized":"2024-03-23T06:21:28.027749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.058640+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:21:28.058640+0000","last_peered":"2024-03-23T06:21:28.058640+0000","last_clean":"2024-03-23T06:21:28.058640+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:21:28.058640+0000","last_undegraded":"2024-03-23T06:21:28.058640+0000","last_fullsized":"2024-03-23T06:21:28.058640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.860271+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:21:27.860271+0000","last_peered":"2024-03-23T06:21:27.860271+0000","last_clean":"2024-03-23T06:21:27.860271+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:21:27.860271+0000","last_undegraded":"2024-03-23T06:21:27.860271+0000","last_fullsized":"2024-03-23T06:21:27.860271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'160","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.998561+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:21:27.998561+0000","last_peered":"2024-03-23T06:21:27.998561+0000","last_clean":"2024-03-23T06:21:27.998561+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:21:27.998561+0000","last_undegraded":"2024-03-23T06:21:27.998561+0000","last_fullsized":"2024-03-23T06:21:27.998561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'12","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:21.569214+0000","last_change":"2024-03-23T06:10:39.674095+0000","last_active":"2024-03-23T06:21:21.569214+0000","last_peered":"2024-03-23T06:21:21.569214+0000","last_clean":"2024-03-23T06:21:21.569214+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:21:21.569214+0000","last_undegraded":"2024-03-23T06:21:21.569214+0000","last_fullsized":"2024-03-23T06:21:21.569214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:13:50.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.115530+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:21:28.115530+0000","last_peered":"2024-03-23T06:21:28.115530+0000","last_clean":"2024-03-23T06:21:28.115530+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:21:28.115530+0000","last_undegraded":"2024-03-23T06:21:28.115530+0000","last_fullsized":"2024-03-23T06:21:28.115530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'21","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:58.144198+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:19:58.144198+0000","last_peered":"2024-03-23T06:19:58.144198+0000","last_clean":"2024-03-23T06:19:58.144198+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:19:58.144198+0000","last_undegraded":"2024-03-23T06:19:58.144198+0000","last_fullsized":"2024-03-23T06:19:58.144198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.113132+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:21:28.113132+0000","last_peered":"2024-03-23T06:21:28.113132+0000","last_clean":"2024-03-23T06:21:28.113132+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:21:28.113132+0000","last_undegraded":"2024-03-23T06:21:28.113132+0000","last_fullsized":"2024-03-23T06:21:28.113132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.096714+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:21:28.096714+0000","last_peered":"2024-03-23T06:21:28.096714+0000","last_clean":"2024-03-23T06:21:28.096714+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:21:28.096714+0000","last_undegraded":"2024-03-23T06:21:28.096714+0000","last_fullsized":"2024-03-23T06:21:28.096714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:09.321326+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:21:09.321326+0000","last_peered":"2024-03-23T06:21:09.321326+0000","last_clean":"2024-03-23T06:21:09.321326+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:21:09.321326+0000","last_undegraded":"2024-03-23T06:21:09.321326+0000","last_fullsized":"2024-03-23T06:21:09.321326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'397","reported_seq":419,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.108327+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:21:28.108327+0000","last_peered":"2024-03-23T06:21:28.108327+0000","last_clean":"2024-03-23T06:21:28.108327+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:21:28.108327+0000","last_undegraded":"2024-03-23T06:21:28.108327+0000","last_fullsized":"2024-03-23T06:21:28.108327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.115760+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:21:28.115760+0000","last_peered":"2024-03-23T06:21:28.115760+0000","last_clean":"2024-03-23T06:21:28.115760+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:21:28.115760+0000","last_undegraded":"2024-03-23T06:21:28.115760+0000","last_fullsized":"2024-03-23T06:21:28.115760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.142792+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:21:28.142792+0000","last_peered":"2024-03-23T06:21:28.142792+0000","last_clean":"2024-03-23T06:21:28.142792+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:21:28.142792+0000","last_undegraded":"2024-03-23T06:21:28.142792+0000","last_fullsized":"2024-03-23T06:21:28.142792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'7","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.027833+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:21:28.027833+0000","last_peered":"2024-03-23T06:21:28.027833+0000","last_clean":"2024-03-23T06:21:28.027833+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:21:28.027833+0000","last_undegraded":"2024-03-23T06:21:28.027833+0000","last_fullsized":"2024-03-23T06:21:28.027833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.118953+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:21:28.118953+0000","last_peered":"2024-03-23T06:21:28.118953+0000","last_clean":"2024-03-23T06:21:28.118953+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:21:28.118953+0000","last_undegraded":"2024-03-23T06:21:28.118953+0000","last_fullsized":"2024-03-23T06:21:28.118953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.150434+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:21:28.150434+0000","last_peered":"2024-03-23T06:21:28.150434+0000","last_clean":"2024-03-23T06:21:28.150434+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:21:28.150434+0000","last_undegraded":"2024-03-23T06:21:28.150434+0000","last_fullsized":"2024-03-23T06:21:28.150434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.043901+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:21:28.043901+0000","last_peered":"2024-03-23T06:21:28.043901+0000","last_clean":"2024-03-23T06:21:28.043901+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:21:28.043901+0000","last_undegraded":"2024-03-23T06:21:28.043901+0000","last_fullsized":"2024-03-23T06:21:28.043901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6036,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.971677+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:21:27.971677+0000","last_peered":"2024-03-23T06:21:27.971677+0000","last_clean":"2024-03-23T06:21:27.971677+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:21:27.971677+0000","last_undegraded":"2024-03-23T06:21:27.971677+0000","last_fullsized":"2024-03-23T06:21:27.971677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.051865+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:21:28.051865+0000","last_peered":"2024-03-23T06:21:28.051865+0000","last_clean":"2024-03-23T06:21:28.051865+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:21:28.051865+0000","last_undegraded":"2024-03-23T06:21:28.051865+0000","last_fullsized":"2024-03-23T06:21:28.051865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.994466+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:21:27.994466+0000","last_peered":"2024-03-23T06:21:27.994466+0000","last_clean":"2024-03-23T06:21:27.994466+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:21:27.994466+0000","last_undegraded":"2024-03-23T06:21:27.994466+0000","last_fullsized":"2024-03-23T06:21:27.994466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159465+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:21:28.159465+0000","last_peered":"2024-03-23T06:21:28.159465+0000","last_clean":"2024-03-23T06:21:28.159465+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:21:28.159465+0000","last_undegraded":"2024-03-23T06:21:28.159465+0000","last_fullsized":"2024-03-23T06:21:28.159465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.033045+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:21:28.033045+0000","last_peered":"2024-03-23T06:21:28.033045+0000","last_clean":"2024-03-23T06:21:28.033045+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:21:28.033045+0000","last_undegraded":"2024-03-23T06:21:28.033045+0000","last_fullsized":"2024-03-23T06:21:28.033045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.096336+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:21:28.096336+0000","last_peered":"2024-03-23T06:21:28.096336+0000","last_clean":"2024-03-23T06:21:28.096336+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:21:28.096336+0000","last_undegraded":"2024-03-23T06:21:28.096336+0000","last_fullsized":"2024-03-23T06:21:28.096336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.105191+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:21:28.105191+0000","last_peered":"2024-03-23T06:21:28.105191+0000","last_clean":"2024-03-23T06:21:28.105191+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:21:28.105191+0000","last_undegraded":"2024-03-23T06:21:28.105191+0000","last_fullsized":"2024-03-23T06:21:28.105191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'7","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.876642+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:21:27.876642+0000","last_peered":"2024-03-23T06:21:27.876642+0000","last_clean":"2024-03-23T06:21:27.876642+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:21:27.876642+0000","last_undegraded":"2024-03-23T06:21:27.876642+0000","last_fullsized":"2024-03-23T06:21:27.876642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'97","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:13.919544+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:21:13.919544+0000","last_peered":"2024-03-23T06:21:13.919544+0000","last_clean":"2024-03-23T06:21:13.919544+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:21:13.919544+0000","last_undegraded":"2024-03-23T06:21:13.919544+0000","last_fullsized":"2024-03-23T06:21:13.919544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.211457+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:21:28.211457+0000","last_peered":"2024-03-23T06:21:28.211457+0000","last_clean":"2024-03-23T06:21:28.211457+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:21:28.211457+0000","last_undegraded":"2024-03-23T06:21:28.211457+0000","last_fullsized":"2024-03-23T06:21:28.211457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.990603+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:21:27.990603+0000","last_peered":"2024-03-23T06:21:27.990603+0000","last_clean":"2024-03-23T06:21:27.990603+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:21:27.990603+0000","last_undegraded":"2024-03-23T06:21:27.990603+0000","last_fullsized":"2024-03-23T06:21:27.990603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.014027+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:21:28.014027+0000","last_peered":"2024-03-23T06:21:28.014027+0000","last_clean":"2024-03-23T06:21:28.014027+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:21:28.014027+0000","last_undegraded":"2024-03-23T06:21:28.014027+0000","last_fullsized":"2024-03-23T06:21:28.014027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159961+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:21:28.159961+0000","last_peered":"2024-03-23T06:21:28.159961+0000","last_clean":"2024-03-23T06:21:28.159961+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:21:28.159961+0000","last_undegraded":"2024-03-23T06:21:28.159961+0000","last_fullsized":"2024-03-23T06:21:28.159961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.948476+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:21:27.948476+0000","last_peered":"2024-03-23T06:21:27.948476+0000","last_clean":"2024-03-23T06:21:27.948476+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:21:27.948476+0000","last_undegraded":"2024-03-23T06:21:27.948476+0000","last_fullsized":"2024-03-23T06:21:27.948476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:29.338317+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:20:29.338317+0000","last_peered":"2024-03-23T06:20:29.338317+0000","last_clean":"2024-03-23T06:20:29.338317+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:20:29.338317+0000","last_undegraded":"2024-03-23T06:20:29.338317+0000","last_fullsized":"2024-03-23T06:20:29.338317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4625,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.124327+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:21:28.124327+0000","last_peered":"2024-03-23T06:21:28.124327+0000","last_clean":"2024-03-23T06:21:28.124327+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:21:28.124327+0000","last_undegraded":"2024-03-23T06:21:28.124327+0000","last_fullsized":"2024-03-23T06:21:28.124327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159654+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:21:28.159654+0000","last_peered":"2024-03-23T06:21:28.159654+0000","last_clean":"2024-03-23T06:21:28.159654+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:21:28.159654+0000","last_undegraded":"2024-03-23T06:21:28.159654+0000","last_fullsized":"2024-03-23T06:21:28.159654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'26","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.964155+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:21:27.964155+0000","last_peered":"2024-03-23T06:21:27.964155+0000","last_clean":"2024-03-23T06:21:27.964155+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:21:27.964155+0000","last_undegraded":"2024-03-23T06:21:27.964155+0000","last_fullsized":"2024-03-23T06:21:27.964155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.999073+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:21:27.999073+0000","last_peered":"2024-03-23T06:21:27.999073+0000","last_clean":"2024-03-23T06:21:27.999073+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:21:27.999073+0000","last_undegraded":"2024-03-23T06:21:27.999073+0000","last_fullsized":"2024-03-23T06:21:27.999073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.203657+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:21:28.203657+0000","last_peered":"2024-03-23T06:21:28.203657+0000","last_clean":"2024-03-23T06:21:28.203657+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:21:28.203657+0000","last_undegraded":"2024-03-23T06:21:28.203657+0000","last_fullsized":"2024-03-23T06:21:28.203657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'39","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:12.480714+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:21:12.480714+0000","last_peered":"2024-03-23T06:21:12.480714+0000","last_clean":"2024-03-23T06:21:12.480714+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:21:12.480714+0000","last_undegraded":"2024-03-23T06:21:12.480714+0000","last_fullsized":"2024-03-23T06:21:12.480714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":37,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.063846+0000","last_change":"2024-03-23T06:10:39.799662+0000","last_active":"2024-03-23T06:21:28.063846+0000","last_peered":"2024-03-23T06:21:28.063846+0000","last_clean":"2024-03-23T06:21:28.063846+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:21:28.063846+0000","last_undegraded":"2024-03-23T06:21:28.063846+0000","last_fullsized":"2024-03-23T06:21:28.063846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:17:27.260098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.884923+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:21:27.884923+0000","last_peered":"2024-03-23T06:21:27.884923+0000","last_clean":"2024-03-23T06:21:27.884923+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:21:27.884923+0000","last_undegraded":"2024-03-23T06:21:27.884923+0000","last_fullsized":"2024-03-23T06:21:27.884923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'50","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.063568+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:21:28.063568+0000","last_peered":"2024-03-23T06:21:28.063568+0000","last_clean":"2024-03-23T06:21:28.063568+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:21:28.063568+0000","last_undegraded":"2024-03-23T06:21:28.063568+0000","last_fullsized":"2024-03-23T06:21:28.063568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.197863+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:21:28.197863+0000","last_peered":"2024-03-23T06:21:28.197863+0000","last_clean":"2024-03-23T06:21:28.197863+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:21:28.197863+0000","last_undegraded":"2024-03-23T06:21:28.197863+0000","last_fullsized":"2024-03-23T06:21:28.197863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:18:23.117850+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:18:23.117850+0000","last_peered":"2024-03-23T06:18:23.117850+0000","last_clean":"2024-03-23T06:18:23.117850+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:18:23.117850+0000","last_undegraded":"2024-03-23T06:18:23.117850+0000","last_fullsized":"2024-03-23T06:18:23.117850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.005245+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:21:28.005245+0000","last_peered":"2024-03-23T06:21:28.005245+0000","last_clean":"2024-03-23T06:21:28.005245+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:21:28.005245+0000","last_undegraded":"2024-03-23T06:21:28.005245+0000","last_fullsized":"2024-03-23T06:21:28.005245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:01.486653+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:20:01.486653+0000","last_peered":"2024-03-23T06:20:01.486653+0000","last_clean":"2024-03-23T06:20:01.486653+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:20:01.486653+0000","last_undegraded":"2024-03-23T06:20:01.486653+0000","last_fullsized":"2024-03-23T06:20:01.486653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.076122+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:21:28.076122+0000","last_peered":"2024-03-23T06:21:28.076122+0000","last_clean":"2024-03-23T06:21:28.076122+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:21:28.076122+0000","last_undegraded":"2024-03-23T06:21:28.076122+0000","last_fullsized":"2024-03-23T06:21:28.076122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.957984+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:21:27.957984+0000","last_peered":"2024-03-23T06:21:27.957984+0000","last_clean":"2024-03-23T06:21:27.957984+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:21:27.957984+0000","last_undegraded":"2024-03-23T06:21:27.957984+0000","last_fullsized":"2024-03-23T06:21:27.957984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.079874+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:21:28.079874+0000","last_peered":"2024-03-23T06:21:28.079874+0000","last_clean":"2024-03-23T06:21:28.079874+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:21:28.079874+0000","last_undegraded":"2024-03-23T06:21:28.079874+0000","last_fullsized":"2024-03-23T06:21:28.079874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.033340+0000","last_change":"2024-03-23T06:10:39.804956+0000","last_active":"2024-03-23T06:21:28.033340+0000","last_peered":"2024-03-23T06:21:28.033340+0000","last_clean":"2024-03-23T06:21:28.033340+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:21:28.033340+0000","last_undegraded":"2024-03-23T06:21:28.033340+0000","last_fullsized":"2024-03-23T06:21:28.033340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:15:46.873772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'11","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:20.406066+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:21:20.406066+0000","last_peered":"2024-03-23T06:21:20.406066+0000","last_clean":"2024-03-23T06:21:20.406066+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:21:20.406066+0000","last_undegraded":"2024-03-23T06:21:20.406066+0000","last_fullsized":"2024-03-23T06:21:20.406066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:19.369022+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:21:19.369022+0000","last_peered":"2024-03-23T06:21:19.369022+0000","last_clean":"2024-03-23T06:21:19.369022+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:21:19.369022+0000","last_undegraded":"2024-03-23T06:21:19.369022+0000","last_fullsized":"2024-03-23T06:21:19.369022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.219047+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:21:28.219047+0000","last_peered":"2024-03-23T06:21:28.219047+0000","last_clean":"2024-03-23T06:21:28.219047+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:21:28.219047+0000","last_undegraded":"2024-03-23T06:21:28.219047+0000","last_fullsized":"2024-03-23T06:21:28.219047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.970005+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:21:27.970005+0000","last_peered":"2024-03-23T06:21:27.970005+0000","last_clean":"2024-03-23T06:21:27.970005+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:21:27.970005+0000","last_undegraded":"2024-03-23T06:21:27.970005+0000","last_fullsized":"2024-03-23T06:21:27.970005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'23","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.052456+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:21:28.052456+0000","last_peered":"2024-03-23T06:21:28.052456+0000","last_clean":"2024-03-23T06:21:28.052456+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:21:28.052456+0000","last_undegraded":"2024-03-23T06:21:28.052456+0000","last_fullsized":"2024-03-23T06:21:28.052456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5573,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.176007+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:21:28.176007+0000","last_peered":"2024-03-23T06:21:28.176007+0000","last_clean":"2024-03-23T06:21:28.176007+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:21:28.176007+0000","last_undegraded":"2024-03-23T06:21:28.176007+0000","last_fullsized":"2024-03-23T06:21:28.176007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.955280+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:21:27.955280+0000","last_peered":"2024-03-23T06:21:27.955280+0000","last_clean":"2024-03-23T06:21:27.955280+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:21:27.955280+0000","last_undegraded":"2024-03-23T06:21:27.955280+0000","last_fullsized":"2024-03-23T06:21:27.955280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'50","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:18.397725+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:21:18.397725+0000","last_peered":"2024-03-23T06:21:18.397725+0000","last_clean":"2024-03-23T06:21:18.397725+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:21:18.397725+0000","last_undegraded":"2024-03-23T06:21:18.397725+0000","last_fullsized":"2024-03-23T06:21:18.397725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632534,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.134687+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:21:28.134687+0000","last_peered":"2024-03-23T06:21:28.134687+0000","last_clean":"2024-03-23T06:21:28.134687+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:21:28.134687+0000","last_undegraded":"2024-03-23T06:21:28.134687+0000","last_fullsized":"2024-03-23T06:21:28.134687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.172134+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:21:28.172134+0000","last_peered":"2024-03-23T06:21:28.172134+0000","last_clean":"2024-03-23T06:21:28.172134+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:21:28.172134+0000","last_undegraded":"2024-03-23T06:21:28.172134+0000","last_fullsized":"2024-03-23T06:21:28.172134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.237214+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:21:28.237214+0000","last_peered":"2024-03-23T06:21:28.237214+0000","last_clean":"2024-03-23T06:21:28.237214+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:21:28.237214+0000","last_undegraded":"2024-03-23T06:21:28.237214+0000","last_fullsized":"2024-03-23T06:21:28.237214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5959,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.199315+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:21:28.199315+0000","last_peered":"2024-03-23T06:21:28.199315+0000","last_clean":"2024-03-23T06:21:28.199315+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:21:28.199315+0000","last_undegraded":"2024-03-23T06:21:28.199315+0000","last_fullsized":"2024-03-23T06:21:28.199315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'9","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.025055+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:21:28.025055+0000","last_peered":"2024-03-23T06:21:28.025055+0000","last_clean":"2024-03-23T06:21:28.025055+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:21:28.025055+0000","last_undegraded":"2024-03-23T06:21:28.025055+0000","last_fullsized":"2024-03-23T06:21:28.025055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.042850+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:21:28.042850+0000","last_peered":"2024-03-23T06:21:28.042850+0000","last_clean":"2024-03-23T06:21:28.042850+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:21:28.042850+0000","last_undegraded":"2024-03-23T06:21:28.042850+0000","last_fullsized":"2024-03-23T06:21:28.042850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.129118+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:21:28.129118+0000","last_peered":"2024-03-23T06:21:28.129118+0000","last_clean":"2024-03-23T06:21:28.129118+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:21:28.129118+0000","last_undegraded":"2024-03-23T06:21:28.129118+0000","last_fullsized":"2024-03-23T06:21:28.129118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.113199+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:21:28.113199+0000","last_peered":"2024-03-23T06:21:28.113199+0000","last_clean":"2024-03-23T06:21:28.113199+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:21:28.113199+0000","last_undegraded":"2024-03-23T06:21:28.113199+0000","last_fullsized":"2024-03-23T06:21:28.113199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.235104+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:21:28.235104+0000","last_peered":"2024-03-23T06:21:28.235104+0000","last_clean":"2024-03-23T06:21:28.235104+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:21:28.235104+0000","last_undegraded":"2024-03-23T06:21:28.235104+0000","last_fullsized":"2024-03-23T06:21:28.235104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.233362+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:21:28.233362+0000","last_peered":"2024-03-23T06:21:28.233362+0000","last_clean":"2024-03-23T06:21:28.233362+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:21:28.233362+0000","last_undegraded":"2024-03-23T06:21:28.233362+0000","last_fullsized":"2024-03-23T06:21:28.233362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'11","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.126196+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:21:28.126196+0000","last_peered":"2024-03-23T06:21:28.126196+0000","last_clean":"2024-03-23T06:21:28.126196+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:21:28.126196+0000","last_undegraded":"2024-03-23T06:21:28.126196+0000","last_fullsized":"2024-03-23T06:21:28.126196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'40","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.141491+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:21:28.141491+0000","last_peered":"2024-03-23T06:21:28.141491+0000","last_clean":"2024-03-23T06:21:28.141491+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:21:28.141491+0000","last_undegraded":"2024-03-23T06:21:28.141491+0000","last_fullsized":"2024-03-23T06:21:28.141491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.933026+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:21:27.933026+0000","last_peered":"2024-03-23T06:21:27.933026+0000","last_clean":"2024-03-23T06:21:27.933026+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:21:27.933026+0000","last_undegraded":"2024-03-23T06:21:27.933026+0000","last_fullsized":"2024-03-23T06:21:27.933026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:37.936955+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:19:37.936955+0000","last_peered":"2024-03-23T06:19:37.936955+0000","last_clean":"2024-03-23T06:19:37.936955+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:19:37.936955+0000","last_undegraded":"2024-03-23T06:19:37.936955+0000","last_fullsized":"2024-03-23T06:19:37.936955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'230","reported_seq":252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.005048+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:21:28.005048+0000","last_peered":"2024-03-23T06:21:28.005048+0000","last_clean":"2024-03-23T06:21:28.005048+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:21:28.005048+0000","last_undegraded":"2024-03-23T06:21:28.005048+0000","last_fullsized":"2024-03-23T06:21:28.005048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.232433+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:21:28.232433+0000","last_peered":"2024-03-23T06:21:28.232433+0000","last_clean":"2024-03-23T06:21:28.232433+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:21:28.232433+0000","last_undegraded":"2024-03-23T06:21:28.232433+0000","last_fullsized":"2024-03-23T06:21:28.232433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.228775+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:21:28.228775+0000","last_peered":"2024-03-23T06:21:28.228775+0000","last_clean":"2024-03-23T06:21:28.228775+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:21:28.228775+0000","last_undegraded":"2024-03-23T06:21:28.228775+0000","last_fullsized":"2024-03-23T06:21:28.228775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:29.064848+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:21:29.064848+0000","last_peered":"2024-03-23T06:21:29.064848+0000","last_clean":"2024-03-23T06:21:29.064848+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:21:29.064848+0000","last_undegraded":"2024-03-23T06:21:29.064848+0000","last_fullsized":"2024-03-23T06:21:29.064848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.124181+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:21:28.124181+0000","last_peered":"2024-03-23T06:21:28.124181+0000","last_clean":"2024-03-23T06:21:28.124181+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:21:28.124181+0000","last_undegraded":"2024-03-23T06:21:28.124181+0000","last_fullsized":"2024-03-23T06:21:28.124181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:19.434417+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:21:19.434417+0000","last_peered":"2024-03-23T06:21:19.434417+0000","last_clean":"2024-03-23T06:21:19.434417+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:21:19.434417+0000","last_undegraded":"2024-03-23T06:21:19.434417+0000","last_fullsized":"2024-03-23T06:21:19.434417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.145165+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:21:28.145165+0000","last_peered":"2024-03-23T06:21:28.145165+0000","last_clean":"2024-03-23T06:21:28.145165+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:21:28.145165+0000","last_undegraded":"2024-03-23T06:21:28.145165+0000","last_fullsized":"2024-03-23T06:21:28.145165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.212540+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:21:28.212540+0000","last_peered":"2024-03-23T06:21:28.212540+0000","last_clean":"2024-03-23T06:21:28.212540+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:21:28.212540+0000","last_undegraded":"2024-03-23T06:21:28.212540+0000","last_fullsized":"2024-03-23T06:21:28.212540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.187686+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:21:28.187686+0000","last_peered":"2024-03-23T06:21:28.187686+0000","last_clean":"2024-03-23T06:21:28.187686+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:21:28.187686+0000","last_undegraded":"2024-03-23T06:21:28.187686+0000","last_fullsized":"2024-03-23T06:21:28.187686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.070858+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:21:28.070858+0000","last_peered":"2024-03-23T06:21:28.070858+0000","last_clean":"2024-03-23T06:21:28.070858+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:21:28.070858+0000","last_undegraded":"2024-03-23T06:21:28.070858+0000","last_fullsized":"2024-03-23T06:21:28.070858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.172172+0000","last_change":"2024-03-23T06:10:39.801920+0000","last_active":"2024-03-23T06:21:28.172172+0000","last_peered":"2024-03-23T06:21:28.172172+0000","last_clean":"2024-03-23T06:21:28.172172+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:21:28.172172+0000","last_undegraded":"2024-03-23T06:21:28.172172+0000","last_fullsized":"2024-03-23T06:21:28.172172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:39:07.343046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.138206+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:21:28.138206+0000","last_peered":"2024-03-23T06:21:28.138206+0000","last_clean":"2024-03-23T06:21:28.138206+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:21:28.138206+0000","last_undegraded":"2024-03-23T06:21:28.138206+0000","last_fullsized":"2024-03-23T06:21:28.138206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'15","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.994223+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:21:27.994223+0000","last_peered":"2024-03-23T06:21:27.994223+0000","last_clean":"2024-03-23T06:21:27.994223+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:21:27.994223+0000","last_undegraded":"2024-03-23T06:21:27.994223+0000","last_fullsized":"2024-03-23T06:21:27.994223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'33","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:40.168784+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:19:40.168784+0000","last_peered":"2024-03-23T06:19:40.168784+0000","last_clean":"2024-03-23T06:19:40.168784+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:19:40.168784+0000","last_undegraded":"2024-03-23T06:19:40.168784+0000","last_fullsized":"2024-03-23T06:19:40.168784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159725+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:21:28.159725+0000","last_peered":"2024-03-23T06:21:28.159725+0000","last_clean":"2024-03-23T06:21:28.159725+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:21:28.159725+0000","last_undegraded":"2024-03-23T06:21:28.159725+0000","last_fullsized":"2024-03-23T06:21:28.159725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.797643+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:21:27.797643+0000","last_peered":"2024-03-23T06:21:27.797643+0000","last_clean":"2024-03-23T06:21:27.797643+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:21:27.797643+0000","last_undegraded":"2024-03-23T06:21:27.797643+0000","last_fullsized":"2024-03-23T06:21:27.797643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.140714+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:21:28.140714+0000","last_peered":"2024-03-23T06:21:28.140714+0000","last_clean":"2024-03-23T06:21:28.140714+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:21:28.140714+0000","last_undegraded":"2024-03-23T06:21:28.140714+0000","last_fullsized":"2024-03-23T06:21:28.140714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:55.674981+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:19:55.674981+0000","last_peered":"2024-03-23T06:19:55.674981+0000","last_clean":"2024-03-23T06:19:55.674981+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:19:55.674981+0000","last_undegraded":"2024-03-23T06:19:55.674981+0000","last_fullsized":"2024-03-23T06:19:55.674981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.901341+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:21:27.901341+0000","last_peered":"2024-03-23T06:21:27.901341+0000","last_clean":"2024-03-23T06:21:27.901341+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:21:27.901341+0000","last_undegraded":"2024-03-23T06:21:27.901341+0000","last_fullsized":"2024-03-23T06:21:27.901341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.921034+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:21:27.921034+0000","last_peered":"2024-03-23T06:21:27.921034+0000","last_clean":"2024-03-23T06:21:27.921034+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:21:27.921034+0000","last_undegraded":"2024-03-23T06:21:27.921034+0000","last_fullsized":"2024-03-23T06:21:27.921034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'984","reported_seq":1004,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.142592+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:21:28.142592+0000","last_peered":"2024-03-23T06:21:28.142592+0000","last_clean":"2024-03-23T06:21:28.142592+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:21:28.142592+0000","last_undegraded":"2024-03-23T06:21:28.142592+0000","last_fullsized":"2024-03-23T06:21:28.142592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195132,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":977,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'15","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.087887+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:21:28.087887+0000","last_peered":"2024-03-23T06:21:28.087887+0000","last_clean":"2024-03-23T06:21:28.087887+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:21:28.087887+0000","last_undegraded":"2024-03-23T06:21:28.087887+0000","last_fullsized":"2024-03-23T06:21:28.087887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.145556+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:21:28.145556+0000","last_peered":"2024-03-23T06:21:28.145556+0000","last_clean":"2024-03-23T06:21:28.145556+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:21:28.145556+0000","last_undegraded":"2024-03-23T06:21:28.145556+0000","last_fullsized":"2024-03-23T06:21:28.145556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.181123+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:21:28.181123+0000","last_peered":"2024-03-23T06:21:28.181123+0000","last_clean":"2024-03-23T06:21:28.181123+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:21:28.181123+0000","last_undegraded":"2024-03-23T06:21:28.181123+0000","last_fullsized":"2024-03-23T06:21:28.181123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'17","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.929863+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:21:27.929863+0000","last_peered":"2024-03-23T06:21:27.929863+0000","last_clean":"2024-03-23T06:21:27.929863+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:21:27.929863+0000","last_undegraded":"2024-03-23T06:21:27.929863+0000","last_fullsized":"2024-03-23T06:21:27.929863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.118351+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:21:28.118351+0000","last_peered":"2024-03-23T06:21:28.118351+0000","last_clean":"2024-03-23T06:21:28.118351+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:21:28.118351+0000","last_undegraded":"2024-03-23T06:21:28.118351+0000","last_fullsized":"2024-03-23T06:21:28.118351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.915401+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:21:27.915401+0000","last_peered":"2024-03-23T06:21:27.915401+0000","last_clean":"2024-03-23T06:21:27.915401+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:21:27.915401+0000","last_undegraded":"2024-03-23T06:21:27.915401+0000","last_fullsized":"2024-03-23T06:21:27.915401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'9","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:25.305777+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:21:25.305777+0000","last_peered":"2024-03-23T06:21:25.305777+0000","last_clean":"2024-03-23T06:21:25.305777+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:21:25.305777+0000","last_undegraded":"2024-03-23T06:21:25.305777+0000","last_fullsized":"2024-03-23T06:21:25.305777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'9","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.917072+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:21:27.917072+0000","last_peered":"2024-03-23T06:21:27.917072+0000","last_clean":"2024-03-23T06:21:27.917072+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:21:27.917072+0000","last_undegraded":"2024-03-23T06:21:27.917072+0000","last_fullsized":"2024-03-23T06:21:27.917072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'20","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.171124+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:21:28.171124+0000","last_peered":"2024-03-23T06:21:28.171124+0000","last_clean":"2024-03-23T06:21:28.171124+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:21:28.171124+0000","last_undegraded":"2024-03-23T06:21:28.171124+0000","last_fullsized":"2024-03-23T06:21:28.171124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.997857+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:21:27.997857+0000","last_peered":"2024-03-23T06:21:27.997857+0000","last_clean":"2024-03-23T06:21:27.997857+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:21:27.997857+0000","last_undegraded":"2024-03-23T06:21:27.997857+0000","last_fullsized":"2024-03-23T06:21:27.997857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.051804+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:21:28.051804+0000","last_peered":"2024-03-23T06:21:28.051804+0000","last_clean":"2024-03-23T06:21:28.051804+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:21:28.051804+0000","last_undegraded":"2024-03-23T06:21:28.051804+0000","last_fullsized":"2024-03-23T06:21:28.051804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.131592+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:21:28.131592+0000","last_peered":"2024-03-23T06:21:28.131592+0000","last_clean":"2024-03-23T06:21:28.131592+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:21:28.131592+0000","last_undegraded":"2024-03-23T06:21:28.131592+0000","last_fullsized":"2024-03-23T06:21:28.131592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'15","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.022798+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:21:28.022798+0000","last_peered":"2024-03-23T06:21:28.022798+0000","last_clean":"2024-03-23T06:21:28.022798+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:21:28.022798+0000","last_undegraded":"2024-03-23T06:21:28.022798+0000","last_fullsized":"2024-03-23T06:21:28.022798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'16","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.910153+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:21:27.910153+0000","last_peered":"2024-03-23T06:21:27.910153+0000","last_clean":"2024-03-23T06:21:27.910153+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:21:27.910153+0000","last_undegraded":"2024-03-23T06:21:27.910153+0000","last_fullsized":"2024-03-23T06:21:27.910153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.943172+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:21:27.943172+0000","last_peered":"2024-03-23T06:21:27.943172+0000","last_clean":"2024-03-23T06:21:27.943172+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:21:27.943172+0000","last_undegraded":"2024-03-23T06:21:27.943172+0000","last_fullsized":"2024-03-23T06:21:27.943172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.871940+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:21:27.871940+0000","last_peered":"2024-03-23T06:21:27.871940+0000","last_clean":"2024-03-23T06:21:27.871940+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:21:27.871940+0000","last_undegraded":"2024-03-23T06:21:27.871940+0000","last_fullsized":"2024-03-23T06:21:27.871940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'21","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.217843+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:21:28.217843+0000","last_peered":"2024-03-23T06:21:28.217843+0000","last_clean":"2024-03-23T06:21:28.217843+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:21:28.217843+0000","last_undegraded":"2024-03-23T06:21:28.217843+0000","last_fullsized":"2024-03-23T06:21:28.217843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.868807+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:21:27.868807+0000","last_peered":"2024-03-23T06:21:27.868807+0000","last_clean":"2024-03-23T06:21:27.868807+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:21:27.868807+0000","last_undegraded":"2024-03-23T06:21:27.868807+0000","last_fullsized":"2024-03-23T06:21:27.868807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.203325+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:21:28.203325+0000","last_peered":"2024-03-23T06:21:28.203325+0000","last_clean":"2024-03-23T06:21:28.203325+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:21:28.203325+0000","last_undegraded":"2024-03-23T06:21:28.203325+0000","last_fullsized":"2024-03-23T06:21:28.203325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.154446+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:21:28.154446+0000","last_peered":"2024-03-23T06:21:28.154446+0000","last_clean":"2024-03-23T06:21:28.154446+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:21:28.154446+0000","last_undegraded":"2024-03-23T06:21:28.154446+0000","last_fullsized":"2024-03-23T06:21:28.154446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.234420+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:21:28.234420+0000","last_peered":"2024-03-23T06:21:28.234420+0000","last_clean":"2024-03-23T06:21:28.234420+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:21:28.234420+0000","last_undegraded":"2024-03-23T06:21:28.234420+0000","last_fullsized":"2024-03-23T06:21:28.234420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'17","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.071450+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:21:28.071450+0000","last_peered":"2024-03-23T06:21:28.071450+0000","last_clean":"2024-03-23T06:21:28.071450+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:21:28.071450+0000","last_undegraded":"2024-03-23T06:21:28.071450+0000","last_fullsized":"2024-03-23T06:21:28.071450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'11","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.865254+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:21:27.865254+0000","last_peered":"2024-03-23T06:21:27.865254+0000","last_clean":"2024-03-23T06:21:27.865254+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:21:27.865254+0000","last_undegraded":"2024-03-23T06:21:27.865254+0000","last_fullsized":"2024-03-23T06:21:27.865254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'12","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:18.799985+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:21:18.799985+0000","last_peered":"2024-03-23T06:21:18.799985+0000","last_clean":"2024-03-23T06:21:18.799985+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:21:18.799985+0000","last_undegraded":"2024-03-23T06:21:18.799985+0000","last_fullsized":"2024-03-23T06:21:18.799985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'22","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.180520+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:21:28.180520+0000","last_peered":"2024-03-23T06:21:28.180520+0000","last_clean":"2024-03-23T06:21:28.180520+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:21:28.180520+0000","last_undegraded":"2024-03-23T06:21:28.180520+0000","last_fullsized":"2024-03-23T06:21:28.180520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.927474+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:21:27.927474+0000","last_peered":"2024-03-23T06:21:27.927474+0000","last_clean":"2024-03-23T06:21:27.927474+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:21:27.927474+0000","last_undegraded":"2024-03-23T06:21:27.927474+0000","last_fullsized":"2024-03-23T06:21:27.927474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.814576+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:21:27.814576+0000","last_peered":"2024-03-23T06:21:27.814576+0000","last_clean":"2024-03-23T06:21:27.814576+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:21:27.814576+0000","last_undegraded":"2024-03-23T06:21:27.814576+0000","last_fullsized":"2024-03-23T06:21:27.814576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'10","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.885343+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:21:27.885343+0000","last_peered":"2024-03-23T06:21:27.885343+0000","last_clean":"2024-03-23T06:21:27.885343+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:21:27.885343+0000","last_undegraded":"2024-03-23T06:21:27.885343+0000","last_fullsized":"2024-03-23T06:21:27.885343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.387105+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:21:27.387105+0000","last_peered":"2024-03-23T06:21:27.387105+0000","last_clean":"2024-03-23T06:21:27.387105+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:21:27.387105+0000","last_undegraded":"2024-03-23T06:21:27.387105+0000","last_fullsized":"2024-03-23T06:21:27.387105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.105362+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:21:28.105362+0000","last_peered":"2024-03-23T06:21:28.105362+0000","last_clean":"2024-03-23T06:21:28.105362+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:21:28.105362+0000","last_undegraded":"2024-03-23T06:21:28.105362+0000","last_fullsized":"2024-03-23T06:21:28.105362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.875430+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:21:27.875430+0000","last_peered":"2024-03-23T06:21:27.875430+0000","last_clean":"2024-03-23T06:21:27.875430+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:21:27.875430+0000","last_undegraded":"2024-03-23T06:21:27.875430+0000","last_fullsized":"2024-03-23T06:21:27.875430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.919523+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:21:27.919523+0000","last_peered":"2024-03-23T06:21:27.919523+0000","last_clean":"2024-03-23T06:21:27.919523+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:21:27.919523+0000","last_undegraded":"2024-03-23T06:21:27.919523+0000","last_fullsized":"2024-03-23T06:21:27.919523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:17.254550+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:21:17.254550+0000","last_peered":"2024-03-23T06:21:17.254550+0000","last_clean":"2024-03-23T06:21:17.254550+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:21:17.254550+0000","last_undegraded":"2024-03-23T06:21:17.254550+0000","last_fullsized":"2024-03-23T06:21:17.254550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.017597+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:21:28.017597+0000","last_peered":"2024-03-23T06:21:28.017597+0000","last_clean":"2024-03-23T06:21:28.017597+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:21:28.017597+0000","last_undegraded":"2024-03-23T06:21:28.017597+0000","last_fullsized":"2024-03-23T06:21:28.017597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88811641,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2349,"num_write_kb":88563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177623282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2348,"ondisk_log_size":2348,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1363056,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1325886,"kb_avail":93008784,"statfs":{"total":96636764160,"available":95240994816,"internally_reserved":0,"allocated":38051840,"data_stored":37867231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1357707720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.8239999999999998,"5min":7.4420000000000002,"15min":4.649},"min":{"1min":0.32700000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":16.913,"5min":170.84299999999999,"15min":309.57499999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":2.3100000000000001,"5min":7.2069999999999999,"15min":4.5540000000000003},"min":{"1min":0.38600000000000001,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":11.553000000000001,"5min":178.934,"15min":300.98500000000001},"last":0.75}]},{"osd":1,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":10.808,"15min":5.3719999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.82,"5min":359.48599999999999,"15min":359.48599999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":9.3800000000000008,"15min":5.0759999999999996},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.6440000000000001,"5min":359.20299999999997,"15min":359.20299999999997},"last":1.3}]},{"osd":2,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":3.8599999999999999,"5min":8.2759999999999998,"15min":4.4409999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":29.532,"5min":56.805999999999997,"15min":58.277000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":3.2959999999999998,"5min":9.9809999999999999,"15min":5.1310000000000002},"min":{"1min":0.57399999999999995,"5min":0.52100000000000002,"15min":0.32900000000000001},"max":{"1min":17.776,"5min":89.454999999999998,"15min":119.176},"last":1.21}]},{"osd":4,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":6.4829999999999997,"15min":3.1899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":20.178999999999998,"5min":36.270000000000003,"15min":36.270000000000003},"last":0.95799999999999996},{"interface":"front","average":{"1min":2.8889999999999998,"5min":6.9240000000000004,"15min":3.8929999999999998},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.32800000000000001},"max":{"1min":21.093,"5min":38.718000000000004,"15min":64.325000000000003},"last":1.1499999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":1.867,"5min":6.7060000000000004,"15min":3.8039999999999998},"min":{"1min":0.46100000000000002,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":9.423,"5min":38.759999999999998,"15min":58.317},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.9379999999999999,"5min":6.5640000000000001,"15min":3.5569999999999999},"min":{"1min":0.53300000000000003,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":9.4529999999999994,"5min":33.854999999999997,"15min":33.854999999999997},"last":1.1739999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":6.9930000000000003,"15min":3.7410000000000001},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":5.1539999999999999,"5min":31.623999999999999,"15min":31.623999999999999},"last":1.276},{"interface":"front","average":{"1min":2.2829999999999999,"5min":6.4189999999999996,"15min":3.2559999999999998},"min":{"1min":0.67100000000000004,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":9.3900000000000006,"5min":37.179000000000002,"15min":37.179000000000002},"last":1.351}]},{"osd":7,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":4.0960000000000001,"5min":7.9029999999999996,"15min":4.218},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.388000000000002,"5min":38.621000000000002,"15min":58.344000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":3.4430000000000001,"5min":7.4119999999999999,"15min":3.6880000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":19.349,"5min":38.680999999999997,"15min":38.680999999999997},"last":1.323}]}]},{"osd":2,"up_from":14,"seq":60129542290,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.2490000000000001,"5min":5.1079999999999997,"15min":3.8050000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":23.753,"5min":49.142000000000003,"15min":126.152},"last":0.76400000000000001},{"interface":"front","average":{"1min":2.7669999999999999,"5min":4.7169999999999996,"15min":3.2450000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":23.312000000000001,"5min":29.206,"15min":143.14099999999999},"last":1.2569999999999999}]},{"osd":1,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.379,"5min":6.9400000000000004,"15min":4.3390000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":23.280000000000001,"5min":55.564999999999998,"15min":55.564999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":4.1859999999999999,"5min":7.2030000000000003,"15min":3.8119999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.31900000000000001},"max":{"1min":18.187999999999999,"5min":55.354999999999997,"15min":55.354999999999997},"last":1.0529999999999999}]},{"osd":3,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":5.2240000000000002,"5min":17.103000000000002,"15min":7.4960000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.27600000000000002},"max":{"1min":38.366,"5min":529.81799999999998,"15min":529.81799999999998},"last":1.091},{"interface":"front","average":{"1min":4.6539999999999999,"5min":11.901,"15min":5.7839999999999998},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":14.378,"5min":528.94200000000001,"15min":528.94200000000001},"last":1.242}]},{"osd":4,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":6.7610000000000001,"5min":6.6779999999999999,"15min":3.431},"min":{"1min":0.37,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":31.062999999999999,"5min":49.430999999999997,"15min":49.430999999999997},"last":0.98599999999999999},{"interface":"front","average":{"1min":9.0259999999999998,"5min":7.7889999999999997,"15min":4.5250000000000004},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.312},"max":{"1min":44.173000000000002,"5min":60.298000000000002,"15min":83.525999999999996},"last":1.01}]},{"osd":5,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":5.1829999999999998,"5min":6.0490000000000004,"15min":3.9649999999999999},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":35.433999999999997,"5min":35.433999999999997,"15min":82.456000000000003},"last":1.3779999999999999},{"interface":"front","average":{"1min":4.9980000000000002,"5min":6.1539999999999999,"15min":3.7599999999999998},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.35199999999999998},"max":{"1min":35.472999999999999,"5min":35.472999999999999,"15min":82.971000000000004},"last":1.482}]},{"osd":6,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.2559999999999998,"5min":6.1280000000000001,"15min":3.6469999999999998},"min":{"1min":0.39700000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":13.169,"5min":57.420999999999999,"15min":83.007999999999996},"last":1.143},{"interface":"front","average":{"1min":4.0679999999999996,"5min":6.6769999999999996,"15min":3.629},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.914,"5min":49.768000000000001,"15min":49.768000000000001},"last":1.1930000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":6.5250000000000004,"5min":6.6390000000000002,"15min":4.2789999999999999},"min":{"1min":0.51400000000000001,"5min":0.44900000000000001,"15min":0.35099999999999998},"max":{"1min":23.207000000000001,"5min":43.113,"15min":77.353999999999999},"last":1.5740000000000001},{"interface":"front","average":{"1min":6.1520000000000001,"5min":8.2750000000000004,"15min":4.2640000000000002},"min":{"1min":0.56200000000000006,"5min":0.38,"15min":0.38},"max":{"1min":28.085000000000001,"5min":83.406999999999996,"15min":83.406999999999996},"last":1.218}]}]},{"osd":1,"up_from":14,"seq":60129542292,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":2.5049999999999999,"5min":4.8719999999999999,"15min":2.8279999999999998},"min":{"1min":0.47799999999999998,"5min":0.25700000000000001,"15min":0.221},"max":{"1min":7.2119999999999997,"5min":70.713999999999999,"15min":70.713999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":4.1239999999999997,"5min":4.6050000000000004,"15min":2.6930000000000001},"min":{"1min":0.63100000000000001,"5min":0.247,"15min":0.247},"max":{"1min":12.242000000000001,"5min":30.41,"15min":30.41},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":6.0860000000000003,"5min":9.5790000000000006,"15min":4.5869999999999997},"min":{"1min":0.70599999999999996,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":21.725000000000001,"5min":127.342,"15min":127.342},"last":1.2929999999999999},{"interface":"front","average":{"1min":4.0099999999999998,"5min":7.335,"15min":4.2549999999999999},"min":{"1min":0.38800000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":11.699,"5min":107.748,"15min":107.748},"last":1.3500000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":4.8289999999999997,"5min":7.2889999999999997,"15min":4.024},"min":{"1min":0.46600000000000003,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":19.071999999999999,"5min":31.780000000000001,"15min":31.780000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":2.96,"5min":5.6040000000000001,"15min":4.0010000000000003},"min":{"1min":0.502,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.183999999999999,"5min":31.821999999999999,"15min":175.29300000000001},"last":1.222}]},{"osd":4,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":5.0380000000000003,"15min":3.1440000000000001},"min":{"1min":0.58399999999999996,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":10.223000000000001,"5min":32.368000000000002,"15min":78.060000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":3.1909999999999998,"5min":5.5030000000000001,"15min":3.1379999999999999},"min":{"1min":0.65100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":10.254,"5min":38.856000000000002,"15min":80.959999999999994},"last":1.0169999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":5.4320000000000004,"15min":3.2639999999999998},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":13.395,"5min":70.670000000000002,"15min":70.670000000000002},"last":1.069},{"interface":"front","average":{"1min":4.3719999999999999,"5min":4.609,"15min":2.6960000000000002},"min":{"1min":0.622,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":26.341000000000001,"5min":30.431000000000001,"15min":30.431000000000001},"last":1.1759999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":4.1130000000000004,"5min":6.1200000000000001,"15min":3.2970000000000002},"min":{"1min":0.61899999999999999,"5min":0.375,"15min":0.375},"max":{"1min":16.693000000000001,"5min":40.606999999999999,"15min":40.606999999999999},"last":1.147},{"interface":"front","average":{"1min":4.016,"5min":6.5369999999999999,"15min":3.6099999999999999},"min":{"1min":0.74099999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":16.997,"5min":68.369,"15min":68.369},"last":1.3169999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":6.9050000000000002,"5min":6.9640000000000004,"15min":3.9790000000000001},"min":{"1min":0.84599999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":28.331,"5min":68.475999999999999,"15min":90.965999999999994},"last":1.25},{"interface":"front","average":{"1min":7.7510000000000003,"5min":7.6360000000000001,"15min":4.1120000000000001},"min":{"1min":0.89300000000000002,"5min":0.48099999999999998,"15min":0.38700000000000001},"max":{"1min":29.065000000000001,"5min":68.415000000000006,"15min":84.465000000000003},"last":1.399}]}]},{"osd":0,"up_from":14,"seq":60129542295,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":12.144,"15min":5.3419999999999996},"min":{"1min":0.439,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":9.5180000000000007,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":2.3730000000000002,"5min":5.7039999999999997,"15min":3.1099999999999999},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":11.704000000000001,"5min":76.515000000000001,"15min":76.515000000000001},"last":0.91000000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.649,"5min":6.0780000000000003,"15min":3.4350000000000001},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.33300000000000002},"max":{"1min":14.335000000000001,"5min":58.996000000000002,"15min":58.996000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":2.1549999999999998,"5min":4.9809999999999999,"15min":3.54},"min":{"1min":0.48099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.641,"5min":50.271000000000001,"15min":62.466000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":5.8799999999999999,"15min":3.5550000000000002},"min":{"1min":0.5,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":15.768000000000001,"5min":44.116999999999997,"15min":44.360999999999997},"last":0.94099999999999995},{"interface":"front","average":{"1min":3.5670000000000002,"5min":5.8019999999999996,"15min":3.4409999999999998},"min":{"1min":0.502,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":14.231999999999999,"5min":44.212000000000003,"15min":81.251000000000005},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":4.7030000000000003,"5min":6.8630000000000004,"15min":3.2450000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":37.588000000000001,"5min":72.588999999999999,"15min":72.588999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":4.3410000000000002,"5min":6.3609999999999998,"15min":3.3490000000000002},"min":{"1min":0.59199999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":34.561999999999998,"5min":69.566000000000003,"15min":69.566000000000003},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.645,"5min":6.1849999999999996,"15min":3.1709999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":22.946999999999999,"5min":72.552000000000007,"15min":72.552000000000007},"last":0.755},{"interface":"front","average":{"1min":2.2410000000000001,"5min":5.6740000000000004,"15min":3.0859999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":13.670999999999999,"5min":72.626999999999995,"15min":72.626999999999995},"last":0.86099999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":5.1310000000000002,"15min":2.9319999999999999},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":9.0310000000000006,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.79000000000000004},{"interface":"front","average":{"1min":2.0089999999999999,"5min":5.806,"15min":3.1459999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":8.9760000000000009,"5min":72.656999999999996,"15min":72.656999999999996},"last":1.145}]},{"osd":7,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":3.2799999999999998,"5min":6.7050000000000001,"15min":3.3900000000000001},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":18.199000000000002,"5min":69.662000000000006,"15min":69.662000000000006},"last":0.96999999999999997},{"interface":"front","average":{"1min":3.2189999999999999,"5min":5.2279999999999998,"15min":2.96},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.38700000000000001},"max":{"1min":18.236000000000001,"5min":69.632000000000005,"15min":69.632000000000005},"last":1.006}]}]},{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":4.2240000000000002,"15min":2.2869999999999999},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.9240000000000004,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.441},{"interface":"front","average":{"1min":2.6960000000000002,"5min":4.2119999999999997,"15min":2.0409999999999999},"min":{"1min":0.29299999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":27.337,"5min":42.582000000000001,"15min":42.582000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":5.1710000000000003,"5min":10.372999999999999,"15min":4.2629999999999999},"min":{"1min":0.378,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":29.841000000000001,"5min":310.09300000000002,"15min":310.09300000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":5.3929999999999998,"5min":10.302,"15min":4.3140000000000001},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":29.881,"5min":309.70999999999998,"15min":309.70999999999998},"last":0.73099999999999998}]},{"osd":2,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.0419999999999998,"5min":4.7050000000000001,"15min":2.52},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":33.079999999999998,"5min":50.680999999999997,"15min":63.014000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":6.133,"15min":2.9809999999999999},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.8089999999999999,"5min":73.218000000000004,"15min":73.218000000000004},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":7.3550000000000004,"15min":3.2999999999999998},"min":{"1min":0.441,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":23.777000000000001,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":2.6800000000000002,"5min":5.4269999999999996,"15min":2.742},"min":{"1min":0.32200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":23.949000000000002,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":7.7140000000000004,"5min":5.6399999999999997,"15min":2.254},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.219},"max":{"1min":33.005000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":7.867,"5min":5.4189999999999996,"15min":2.2410000000000001},"min":{"1min":0.28599999999999998,"5min":0.224,"15min":0.224},"max":{"1min":33.106999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.29099999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.7200000000000002,"5min":4.5999999999999996,"15min":1.9039999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":28.922999999999998,"5min":35.884,"15min":35.884},"last":0.317},{"interface":"front","average":{"1min":6.226,"5min":4.9960000000000004,"15min":2.0510000000000002},"min":{"1min":0.33800000000000002,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":33.048000000000002,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.30599999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.7509999999999999,"5min":3.9089999999999998,"15min":1.7410000000000001},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":27.506,"5min":32.799999999999997,"15min":32.799999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":3.6930000000000001,"5min":3.9630000000000001,"15min":1.742},"min":{"1min":0.32600000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":27.533999999999999,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":3.3109999999999999,"15min":1.794},"min":{"1min":0.376,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":6.1440000000000001,"5min":47.136000000000003,"15min":47.136000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":2.2989999999999999,"5min":3.8450000000000002,"15min":2.0950000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":16.620000000000001,"5min":43.140000000000001,"15min":43.140000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":4.3319999999999999,"15min":2.7610000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":10.538,"5min":77.959000000000003,"15min":96.375},"last":0.72099999999999997},{"interface":"front","average":{"1min":2.0049999999999999,"5min":6.0259999999999998,"15min":3.3839999999999999},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.4690000000000003,"5min":96.034000000000006,"15min":96.034000000000006},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":4.3659999999999997,"15min":3.3969999999999998},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.9370000000000003,"5min":53.225000000000001,"15min":91.947999999999993},"last":0.497},{"interface":"front","average":{"1min":2.1619999999999999,"5min":5.165,"15min":3.202},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":18.454000000000001,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.622}]},{"osd":3,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":3.645,"5min":5.9880000000000004,"15min":3.657},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":24.745999999999999,"5min":73.837000000000003,"15min":107.29000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":4.1669999999999998,"5min":5.907,"15min":3.766},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":26.498000000000001,"5min":73.692999999999998,"15min":107.27200000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":7.9210000000000003,"5min":4.6600000000000001,"15min":2.1440000000000001},"min":{"1min":0.252,"5min":0.216,"15min":0.216},"max":{"1min":45.302,"5min":45.302,"15min":45.302},"last":0.26500000000000001},{"interface":"front","average":{"1min":8.0129999999999999,"5min":4.7249999999999996,"15min":2.202},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.251},"max":{"1min":45.408000000000001,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.35499999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":4.1669999999999998,"15min":1.8400000000000001},"min":{"1min":0.27700000000000002,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":24.779,"5min":39.625,"15min":39.625},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.9470000000000001,"5min":3.3639999999999999,"15min":1.6719999999999999},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":26.454999999999998,"5min":37.686,"15min":37.686},"last":0.39700000000000002}]},{"osd":7,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":3.3300000000000001,"5min":3.4580000000000002,"15min":1.6479999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":24.359999999999999,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":4.1609999999999996,"5min":3.3300000000000001,"15min":1.5680000000000001},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":26.521000000000001,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.48299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26600828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":3.1200000000000001,"15min":1.6619999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.9969999999999999,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":3.4079999999999999,"15min":1.7390000000000001},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":3.871,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.40500000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":4.8319999999999999,"15min":2.3069999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":16.021000000000001,"5min":69.873999999999995,"15min":69.873999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":2.1299999999999999,"5min":4.8410000000000002,"15min":2.383},"min":{"1min":0.41399999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":11.035,"5min":50.758000000000003,"15min":50.758000000000003},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.423,"5min":5.1059999999999999,"15min":2.726},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":18.189,"5min":100.931,"15min":100.931},"last":0.58099999999999996},{"interface":"front","average":{"1min":2.6219999999999999,"5min":6.4400000000000004,"15min":3.1269999999999998},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":18.815000000000001,"5min":142.041,"15min":142.041},"last":0.37}]},{"osd":3,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":6.0490000000000004,"15min":2.9369999999999998},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9.6340000000000003,"5min":63.905999999999999,"15min":63.905999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.7250000000000001,"5min":5.9930000000000003,"15min":3.0310000000000001},"min":{"1min":0.38800000000000001,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":9.6210000000000004,"5min":61.076000000000001,"15min":61.076000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":3.4700000000000002,"15min":1.603},"min":{"1min":0.248,"5min":0.219,"15min":0.219},"max":{"1min":2.5539999999999998,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.312},{"interface":"front","average":{"1min":0.68200000000000005,"5min":3.8370000000000002,"15min":1.7350000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":3.9540000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.35899999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":3.5579999999999998,"5min":5.1699999999999999,"15min":2.1110000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":32.395000000000003,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":3.681,"5min":5.3890000000000002,"15min":2.3250000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":32.616999999999997,"5min":40.314,"15min":40.314},"last":0.32400000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":3.859,"15min":1.819},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.25700000000000001},"max":{"1min":3.8570000000000002,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":4.7720000000000002,"15min":2.0630000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":4.0019999999999998,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.38500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574997,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":3.0249999999999999,"15min":1.716},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":26.696000000000002,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":2.6600000000000001,"5min":3.2610000000000001,"15min":1.8999999999999999},"min":{"1min":0.38700000000000001,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":26.655000000000001,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.68799999999999994}]},{"osd":1,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":5.3780000000000001,"15min":2.7290000000000001},"min":{"1min":0.314,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":6.5529999999999999,"5min":51.387999999999998,"15min":51.387999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.393,"5min":3.75,"15min":2.1640000000000001},"min":{"1min":0.39600000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.633,"5min":50.207000000000001,"15min":50.207000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":5.056,"5min":10.506,"15min":4.6859999999999999},"min":{"1min":0.29099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":40.793999999999997,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.26,"5min":9.3879999999999999,"15min":4.2000000000000002},"min":{"1min":0.34599999999999997,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":4.6870000000000003,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.64200000000000002}]},{"osd":3,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":5.3319999999999999,"15min":2.762},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.5220000000000002,"5min":53.134999999999998,"15min":53.134999999999998},"last":0.499},{"interface":"front","average":{"1min":2.137,"5min":6.9210000000000003,"15min":4.3179999999999996},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.30399999999999999},"max":{"1min":5.633,"5min":62.134,"15min":161.191},"last":0.72299999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":3.75,"15min":1.647},"min":{"1min":0.23499999999999999,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":2.8519999999999999,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":3.8119999999999998,"15min":1.7230000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.22800000000000001},"max":{"1min":3.0259999999999998,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.313}]},{"osd":6,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":6.6719999999999997,"15min":2.6389999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.22900000000000001},"max":{"1min":3.137,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.24099999999999999},{"interface":"front","average":{"1min":1.151,"5min":6.2510000000000003,"15min":2.5510000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.3899999999999997,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.29999999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":2.3769999999999998,"5min":5.0099999999999998,"15min":2.101},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.24299999999999999},"max":{"1min":26.707999999999998,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":2.4129999999999998,"5min":4.4450000000000003,"15min":1.9179999999999999},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":26.725999999999999,"5min":51.997,"15min":51.997},"last":0.372}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:22:06.080 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:22:06.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.312+0000 7f2d75600640 1 Processor -- start 2024-03-23T06:22:06.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.312+0000 7f2d75600640 1 -- start start 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.313+0000 7f2d75600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701536a0 0x7f2d700ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.313+0000 7f2d75600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d70153a80 0x7f2d700cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.313+0000 7f2d75600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d700cab20 con 0x7f2d701594f0 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.313+0000 7f2d75600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7015a520 con 0x7f2d70153a80 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.313+0000 7f2d75600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701599a0 con 0x7f2d701536a0 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.314+0000 7f2d6e000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d70153a80 0x7f2d700cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.314+0000 7f2d6ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701536a0 0x7f2d700ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.314+0000 7f2d6ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701536a0 0x7f2d700ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:52064/0 (socket says 172.21.15.73:52064) 2024-03-23T06:22:06.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.314+0000 7f2d6ea00640 1 -- 172.21.15.73:0/1248064128 learned_addr learned my addr 172.21.15.73:0/1248064128 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:06.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.314+0000 7f2d6e000640 1 -- 172.21.15.73:0/1248064128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701536a0 msgr2=0x7f2d700ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:06.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.314+0000 7f2d6e000640 1 --2- 172.21.15.73:0/1248064128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701536a0 0x7f2d700ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.314+0000 7f2d6e000640 1 -- 172.21.15.73:0/1248064128 >> v1:172.21.15.73:6789/0 conn(0x7f2d701594f0 legacy=0x7f2d700cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.314+0000 7f2d6e000640 1 -- 172.21.15.73:0/1248064128 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d70159c80 con 0x7f2d70153a80 2024-03-23T06:22:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.315+0000 7f2d6e000640 1 --2- 172.21.15.73:0/1248064128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d70153a80 0x7f2d700cbe90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0097a0 tx=0x7f2d5c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9fb8df57ca57f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d6d600640 1 -- 172.21.15.73:0/1248064128 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c02d040 con 0x7f2d70153a80 2024-03-23T06:22:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d6d600640 1 -- 172.21.15.73:0/1248064128 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c031810 con 0x7f2d70153a80 2024-03-23T06:22:06.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d6d600640 1 -- 172.21.15.73:0/1248064128 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c031ba0 con 0x7f2d70153a80 2024-03-23T06:22:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d75600640 1 -- 172.21.15.73:0/1248064128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d70153a80 msgr2=0x7f2d700cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d75600640 1 --2- 172.21.15.73:0/1248064128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d70153a80 0x7f2d700cbe90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0097a0 tx=0x7f2d5c02b8b0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d75600640 1 -- 172.21.15.73:0/1248064128 shutdown_connections 2024-03-23T06:22:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d75600640 1 --2- 172.21.15.73:0/1248064128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d70153a80 0x7f2d700cbe90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d75600640 1 --2- 172.21.15.73:0/1248064128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701536a0 0x7f2d700ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d75600640 1 -- 172.21.15.73:0/1248064128 >> 172.21.15.73:0/1248064128 conn(0x7f2d7006a060 msgr2=0x7f2d7006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d75600640 1 -- 172.21.15.73:0/1248064128 shutdown_connections 2024-03-23T06:22:06.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.316+0000 7f2d75600640 1 -- 172.21.15.73:0/1248064128 wait complete. 2024-03-23T06:22:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.319+0000 7f2d75600640 1 Processor -- start 2024-03-23T06:22:06.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.319+0000 7f2d75600640 1 -- start start 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d75600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d701536a0 0x7f2d70143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d75600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70153a80 0x7f2d701f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d75600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701594f0 0x7f2d701f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d75600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7014f260 con 0x7f2d701536a0 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d75600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701496c0 con 0x7f2d70153a80 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d75600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701f3320 con 0x7f2d701594f0 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d701536a0 0x7f2d70143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701594f0 0x7f2d701f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70153a80 0x7f2d701f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d701536a0 0x7f2d70143220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47306/0 (socket says 172.21.15.73:47306) 2024-03-23T06:22:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70153a80 0x7f2d701f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43068/0 (socket says 172.21.15.73:43068) 2024-03-23T06:22:06.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6ea00640 1 -- 172.21.15.73:0/527947363 learned_addr learned my addr 172.21.15.73:0/527947363 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6f400640 1 -- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70153a80 msgr2=0x7f2d701f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6f400640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70153a80 0x7f2d701f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6f400640 1 -- 172.21.15.73:0/527947363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d701536a0 msgr2=0x7f2d70143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6f400640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d701536a0 0x7f2d70143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.321+0000 7f2d6f400640 1 -- 172.21.15.73:0/527947363 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c009400 con 0x7f2d701594f0 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.322+0000 7f2d6f400640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701594f0 0x7f2d701f2950 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c700 tx=0x7f2d6800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.322+0000 7f2d66a00640 1 -- 172.21.15.73:0/527947363 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68003b70 con 0x7f2d701594f0 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.322+0000 7f2d66a00640 1 -- 172.21.15.73:0/527947363 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d68003cd0 con 0x7f2d701594f0 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.322+0000 7f2d66a00640 1 -- 172.21.15.73:0/527947363 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68005310 con 0x7f2d701594f0 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.322+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d700cec40 con 0x7f2d701594f0 2024-03-23T06:22:06.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.322+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d700ce680 con 0x7f2d701594f0 2024-03-23T06:22:06.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.323+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7014d9d0 con 0x7f2d701594f0 2024-03-23T06:22:06.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.324+0000 7f2d66a00640 1 -- 172.21.15.73:0/527947363 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2d68005470 con 0x7f2d701594f0 2024-03-23T06:22:06.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.325+0000 7f2d66a00640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5006ac00 0x7f2d5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.325+0000 7f2d66a00640 1 -- 172.21.15.73:0/527947363 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f2d68089230 con 0x7f2d701594f0 2024-03-23T06:22:06.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.325+0000 7f2d6ea00640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5006ac00 0x7f2d5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.326+0000 7f2d6ea00640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5006ac00 0x7f2d5006d0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2d600094a0 tx=0x7f2d60009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:06.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.329+0000 7f2d66a00640 1 -- 172.21.15.73:0/527947363 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2d7014d9d0 con 0x7f2d701594f0 2024-03-23T06:22:06.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.520+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d700cb970 con 0x7f2d5006ac00 2024-03-23T06:22:06.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.530+0000 7f2d66a00640 1 -- 172.21.15.73:0/527947363 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370346 (secure 0 0 0) 0x7f2d60009960 con 0x7f2d5006ac00 2024-03-23T06:22:06.536 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:06.539 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:22:06.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5006ac00 msgr2=0x7f2d5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5006ac00 0x7f2d5006d0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2d600094a0 tx=0x7f2d60009240 comp rx=0 tx=0).stop 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701594f0 msgr2=0x7f2d701f2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701594f0 0x7f2d701f2950 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c700 tx=0x7f2d6800cbc0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 shutdown_connections 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2d5006ac00 0x7f2d5006d0c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d701594f0 0x7f2d701f2950 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d70153a80 0x7f2d701f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 --2- 172.21.15.73:0/527947363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d701536a0 0x7f2d70143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 >> 172.21.15.73:0/527947363 conn(0x7f2d7006a060 msgr2=0x7f2d700c3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 shutdown_connections 2024-03-23T06:22:06.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.538+0000 7f2d75600640 1 -- 172.21.15.73:0/527947363 wait complete. 2024-03-23T06:22:06.559 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-03-23T06:22:04.821367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402009,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469594,"num_write_kb":34184412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170678,"ondisk_log_size":170678,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10077296,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9900211,"kb_avail":744897424,"statfs":{"total":773094113280,"available":762774962176,"internally_reserved":0,"allocated":181256192,"data_stored":179740522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10137816632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002606"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:20.806395+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:20:20.806395+0000","last_peered":"2024-03-23T06:20:20.806395+0000","last_clean":"2024-03-23T06:20:20.806395+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:20:20.806395+0000","last_undegraded":"2024-03-23T06:20:20.806395+0000","last_fullsized":"2024-03-23T06:20:20.806395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.131862+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:21:28.131862+0000","last_peered":"2024-03-23T06:21:28.131862+0000","last_clean":"2024-03-23T06:21:28.131862+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:21:28.131862+0000","last_undegraded":"2024-03-23T06:21:28.131862+0000","last_fullsized":"2024-03-23T06:21:28.131862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4667,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.014941+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:21:28.014941+0000","last_peered":"2024-03-23T06:21:28.014941+0000","last_clean":"2024-03-23T06:21:28.014941+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:21:28.014941+0000","last_undegraded":"2024-03-23T06:21:28.014941+0000","last_fullsized":"2024-03-23T06:21:28.014941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'12","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.027749+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:21:28.027749+0000","last_peered":"2024-03-23T06:21:28.027749+0000","last_clean":"2024-03-23T06:21:28.027749+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:21:28.027749+0000","last_undegraded":"2024-03-23T06:21:28.027749+0000","last_fullsized":"2024-03-23T06:21:28.027749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.058640+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:21:28.058640+0000","last_peered":"2024-03-23T06:21:28.058640+0000","last_clean":"2024-03-23T06:21:28.058640+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:21:28.058640+0000","last_undegraded":"2024-03-23T06:21:28.058640+0000","last_fullsized":"2024-03-23T06:21:28.058640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.860271+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:21:27.860271+0000","last_peered":"2024-03-23T06:21:27.860271+0000","last_clean":"2024-03-23T06:21:27.860271+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:21:27.860271+0000","last_undegraded":"2024-03-23T06:21:27.860271+0000","last_fullsized":"2024-03-23T06:21:27.860271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'160","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.998561+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:21:27.998561+0000","last_peered":"2024-03-23T06:21:27.998561+0000","last_clean":"2024-03-23T06:21:27.998561+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:21:27.998561+0000","last_undegraded":"2024-03-23T06:21:27.998561+0000","last_fullsized":"2024-03-23T06:21:27.998561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'12","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:21.569214+0000","last_change":"2024-03-23T06:10:39.674095+0000","last_active":"2024-03-23T06:21:21.569214+0000","last_peered":"2024-03-23T06:21:21.569214+0000","last_clean":"2024-03-23T06:21:21.569214+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:21:21.569214+0000","last_undegraded":"2024-03-23T06:21:21.569214+0000","last_fullsized":"2024-03-23T06:21:21.569214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:13:50.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.115530+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:21:28.115530+0000","last_peered":"2024-03-23T06:21:28.115530+0000","last_clean":"2024-03-23T06:21:28.115530+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:21:28.115530+0000","last_undegraded":"2024-03-23T06:21:28.115530+0000","last_fullsized":"2024-03-23T06:21:28.115530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'21","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:58.144198+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:19:58.144198+0000","last_peered":"2024-03-23T06:19:58.144198+0000","last_clean":"2024-03-23T06:19:58.144198+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:19:58.144198+0000","last_undegraded":"2024-03-23T06:19:58.144198+0000","last_fullsized":"2024-03-23T06:19:58.144198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.113132+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:21:28.113132+0000","last_peered":"2024-03-23T06:21:28.113132+0000","last_clean":"2024-03-23T06:21:28.113132+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:21:28.113132+0000","last_undegraded":"2024-03-23T06:21:28.113132+0000","last_fullsized":"2024-03-23T06:21:28.113132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.096714+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:21:28.096714+0000","last_peered":"2024-03-23T06:21:28.096714+0000","last_clean":"2024-03-23T06:21:28.096714+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:21:28.096714+0000","last_undegraded":"2024-03-23T06:21:28.096714+0000","last_fullsized":"2024-03-23T06:21:28.096714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:09.321326+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:21:09.321326+0000","last_peered":"2024-03-23T06:21:09.321326+0000","last_clean":"2024-03-23T06:21:09.321326+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:21:09.321326+0000","last_undegraded":"2024-03-23T06:21:09.321326+0000","last_fullsized":"2024-03-23T06:21:09.321326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'397","reported_seq":419,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.108327+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:21:28.108327+0000","last_peered":"2024-03-23T06:21:28.108327+0000","last_clean":"2024-03-23T06:21:28.108327+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:21:28.108327+0000","last_undegraded":"2024-03-23T06:21:28.108327+0000","last_fullsized":"2024-03-23T06:21:28.108327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.115760+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:21:28.115760+0000","last_peered":"2024-03-23T06:21:28.115760+0000","last_clean":"2024-03-23T06:21:28.115760+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:21:28.115760+0000","last_undegraded":"2024-03-23T06:21:28.115760+0000","last_fullsized":"2024-03-23T06:21:28.115760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.142792+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:21:28.142792+0000","last_peered":"2024-03-23T06:21:28.142792+0000","last_clean":"2024-03-23T06:21:28.142792+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:21:28.142792+0000","last_undegraded":"2024-03-23T06:21:28.142792+0000","last_fullsized":"2024-03-23T06:21:28.142792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'7","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.027833+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:21:28.027833+0000","last_peered":"2024-03-23T06:21:28.027833+0000","last_clean":"2024-03-23T06:21:28.027833+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:21:28.027833+0000","last_undegraded":"2024-03-23T06:21:28.027833+0000","last_fullsized":"2024-03-23T06:21:28.027833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.118953+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:21:28.118953+0000","last_peered":"2024-03-23T06:21:28.118953+0000","last_clean":"2024-03-23T06:21:28.118953+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:21:28.118953+0000","last_undegraded":"2024-03-23T06:21:28.118953+0000","last_fullsized":"2024-03-23T06:21:28.118953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.150434+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:21:28.150434+0000","last_peered":"2024-03-23T06:21:28.150434+0000","last_clean":"2024-03-23T06:21:28.150434+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:21:28.150434+0000","last_undegraded":"2024-03-23T06:21:28.150434+0000","last_fullsized":"2024-03-23T06:21:28.150434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.043901+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:21:28.043901+0000","last_peered":"2024-03-23T06:21:28.043901+0000","last_clean":"2024-03-23T06:21:28.043901+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:21:28.043901+0000","last_undegraded":"2024-03-23T06:21:28.043901+0000","last_fullsized":"2024-03-23T06:21:28.043901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6036,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.971677+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:21:27.971677+0000","last_peered":"2024-03-23T06:21:27.971677+0000","last_clean":"2024-03-23T06:21:27.971677+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:21:27.971677+0000","last_undegraded":"2024-03-23T06:21:27.971677+0000","last_fullsized":"2024-03-23T06:21:27.971677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.051865+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:21:28.051865+0000","last_peered":"2024-03-23T06:21:28.051865+0000","last_clean":"2024-03-23T06:21:28.051865+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:21:28.051865+0000","last_undegraded":"2024-03-23T06:21:28.051865+0000","last_fullsized":"2024-03-23T06:21:28.051865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.994466+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:21:27.994466+0000","last_peered":"2024-03-23T06:21:27.994466+0000","last_clean":"2024-03-23T06:21:27.994466+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:21:27.994466+0000","last_undegraded":"2024-03-23T06:21:27.994466+0000","last_fullsized":"2024-03-23T06:21:27.994466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159465+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:21:28.159465+0000","last_peered":"2024-03-23T06:21:28.159465+0000","last_clean":"2024-03-23T06:21:28.159465+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:21:28.159465+0000","last_undegraded":"2024-03-23T06:21:28.159465+0000","last_fullsized":"2024-03-23T06:21:28.159465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.033045+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:21:28.033045+0000","last_peered":"2024-03-23T06:21:28.033045+0000","last_clean":"2024-03-23T06:21:28.033045+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:21:28.033045+0000","last_undegraded":"2024-03-23T06:21:28.033045+0000","last_fullsized":"2024-03-23T06:21:28.033045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.096336+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:21:28.096336+0000","last_peered":"2024-03-23T06:21:28.096336+0000","last_clean":"2024-03-23T06:21:28.096336+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:21:28.096336+0000","last_undegraded":"2024-03-23T06:21:28.096336+0000","last_fullsized":"2024-03-23T06:21:28.096336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.105191+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:21:28.105191+0000","last_peered":"2024-03-23T06:21:28.105191+0000","last_clean":"2024-03-23T06:21:28.105191+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:21:28.105191+0000","last_undegraded":"2024-03-23T06:21:28.105191+0000","last_fullsized":"2024-03-23T06:21:28.105191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'7","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.876642+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:21:27.876642+0000","last_peered":"2024-03-23T06:21:27.876642+0000","last_clean":"2024-03-23T06:21:27.876642+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:21:27.876642+0000","last_undegraded":"2024-03-23T06:21:27.876642+0000","last_fullsized":"2024-03-23T06:21:27.876642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'97","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:13.919544+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:21:13.919544+0000","last_peered":"2024-03-23T06:21:13.919544+0000","last_clean":"2024-03-23T06:21:13.919544+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:21:13.919544+0000","last_undegraded":"2024-03-23T06:21:13.919544+0000","last_fullsized":"2024-03-23T06:21:13.919544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.211457+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:21:28.211457+0000","last_peered":"2024-03-23T06:21:28.211457+0000","last_clean":"2024-03-23T06:21:28.211457+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:21:28.211457+0000","last_undegraded":"2024-03-23T06:21:28.211457+0000","last_fullsized":"2024-03-23T06:21:28.211457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.990603+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:21:27.990603+0000","last_peered":"2024-03-23T06:21:27.990603+0000","last_clean":"2024-03-23T06:21:27.990603+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:21:27.990603+0000","last_undegraded":"2024-03-23T06:21:27.990603+0000","last_fullsized":"2024-03-23T06:21:27.990603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.014027+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:21:28.014027+0000","last_peered":"2024-03-23T06:21:28.014027+0000","last_clean":"2024-03-23T06:21:28.014027+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:21:28.014027+0000","last_undegraded":"2024-03-23T06:21:28.014027+0000","last_fullsized":"2024-03-23T06:21:28.014027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159961+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:21:28.159961+0000","last_peered":"2024-03-23T06:21:28.159961+0000","last_clean":"2024-03-23T06:21:28.159961+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:21:28.159961+0000","last_undegraded":"2024-03-23T06:21:28.159961+0000","last_fullsized":"2024-03-23T06:21:28.159961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.948476+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:21:27.948476+0000","last_peered":"2024-03-23T06:21:27.948476+0000","last_clean":"2024-03-23T06:21:27.948476+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:21:27.948476+0000","last_undegraded":"2024-03-23T06:21:27.948476+0000","last_fullsized":"2024-03-23T06:21:27.948476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:29.338317+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:20:29.338317+0000","last_peered":"2024-03-23T06:20:29.338317+0000","last_clean":"2024-03-23T06:20:29.338317+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:20:29.338317+0000","last_undegraded":"2024-03-23T06:20:29.338317+0000","last_fullsized":"2024-03-23T06:20:29.338317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4625,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.124327+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:21:28.124327+0000","last_peered":"2024-03-23T06:21:28.124327+0000","last_clean":"2024-03-23T06:21:28.124327+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:21:28.124327+0000","last_undegraded":"2024-03-23T06:21:28.124327+0000","last_fullsized":"2024-03-23T06:21:28.124327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159654+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:21:28.159654+0000","last_peered":"2024-03-23T06:21:28.159654+0000","last_clean":"2024-03-23T06:21:28.159654+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:21:28.159654+0000","last_undegraded":"2024-03-23T06:21:28.159654+0000","last_fullsized":"2024-03-23T06:21:28.159654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'26","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.964155+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:21:27.964155+0000","last_peered":"2024-03-23T06:21:27.964155+0000","last_clean":"2024-03-23T06:21:27.964155+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:21:27.964155+0000","last_undegraded":"2024-03-23T06:21:27.964155+0000","last_fullsized":"2024-03-23T06:21:27.964155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.999073+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:21:27.999073+0000","last_peered":"2024-03-23T06:21:27.999073+0000","last_clean":"2024-03-23T06:21:27.999073+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:21:27.999073+0000","last_undegraded":"2024-03-23T06:21:27.999073+0000","last_fullsized":"2024-03-23T06:21:27.999073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.203657+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:21:28.203657+0000","last_peered":"2024-03-23T06:21:28.203657+0000","last_clean":"2024-03-23T06:21:28.203657+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:21:28.203657+0000","last_undegraded":"2024-03-23T06:21:28.203657+0000","last_fullsized":"2024-03-23T06:21:28.203657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'39","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:12.480714+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:21:12.480714+0000","last_peered":"2024-03-23T06:21:12.480714+0000","last_clean":"2024-03-23T06:21:12.480714+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:21:12.480714+0000","last_undegraded":"2024-03-23T06:21:12.480714+0000","last_fullsized":"2024-03-23T06:21:12.480714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":37,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.063846+0000","last_change":"2024-03-23T06:10:39.799662+0000","last_active":"2024-03-23T06:21:28.063846+0000","last_peered":"2024-03-23T06:21:28.063846+0000","last_clean":"2024-03-23T06:21:28.063846+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:21:28.063846+0000","last_undegraded":"2024-03-23T06:21:28.063846+0000","last_fullsized":"2024-03-23T06:21:28.063846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:17:27.260098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.884923+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:21:27.884923+0000","last_peered":"2024-03-23T06:21:27.884923+0000","last_clean":"2024-03-23T06:21:27.884923+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:21:27.884923+0000","last_undegraded":"2024-03-23T06:21:27.884923+0000","last_fullsized":"2024-03-23T06:21:27.884923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'50","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.063568+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:21:28.063568+0000","last_peered":"2024-03-23T06:21:28.063568+0000","last_clean":"2024-03-23T06:21:28.063568+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:21:28.063568+0000","last_undegraded":"2024-03-23T06:21:28.063568+0000","last_fullsized":"2024-03-23T06:21:28.063568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.197863+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:21:28.197863+0000","last_peered":"2024-03-23T06:21:28.197863+0000","last_clean":"2024-03-23T06:21:28.197863+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:21:28.197863+0000","last_undegraded":"2024-03-23T06:21:28.197863+0000","last_fullsized":"2024-03-23T06:21:28.197863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:18:23.117850+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:18:23.117850+0000","last_peered":"2024-03-23T06:18:23.117850+0000","last_clean":"2024-03-23T06:18:23.117850+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:18:23.117850+0000","last_undegraded":"2024-03-23T06:18:23.117850+0000","last_fullsized":"2024-03-23T06:18:23.117850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.005245+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:21:28.005245+0000","last_peered":"2024-03-23T06:21:28.005245+0000","last_clean":"2024-03-23T06:21:28.005245+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:21:28.005245+0000","last_undegraded":"2024-03-23T06:21:28.005245+0000","last_fullsized":"2024-03-23T06:21:28.005245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:01.486653+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:20:01.486653+0000","last_peered":"2024-03-23T06:20:01.486653+0000","last_clean":"2024-03-23T06:20:01.486653+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:20:01.486653+0000","last_undegraded":"2024-03-23T06:20:01.486653+0000","last_fullsized":"2024-03-23T06:20:01.486653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.076122+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:21:28.076122+0000","last_peered":"2024-03-23T06:21:28.076122+0000","last_clean":"2024-03-23T06:21:28.076122+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:21:28.076122+0000","last_undegraded":"2024-03-23T06:21:28.076122+0000","last_fullsized":"2024-03-23T06:21:28.076122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.957984+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:21:27.957984+0000","last_peered":"2024-03-23T06:21:27.957984+0000","last_clean":"2024-03-23T06:21:27.957984+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:21:27.957984+0000","last_undegraded":"2024-03-23T06:21:27.957984+0000","last_fullsized":"2024-03-23T06:21:27.957984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.079874+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:21:28.079874+0000","last_peered":"2024-03-23T06:21:28.079874+0000","last_clean":"2024-03-23T06:21:28.079874+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:21:28.079874+0000","last_undegraded":"2024-03-23T06:21:28.079874+0000","last_fullsized":"2024-03-23T06:21:28.079874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.033340+0000","last_change":"2024-03-23T06:10:39.804956+0000","last_active":"2024-03-23T06:21:28.033340+0000","last_peered":"2024-03-23T06:21:28.033340+0000","last_clean":"2024-03-23T06:21:28.033340+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:21:28.033340+0000","last_undegraded":"2024-03-23T06:21:28.033340+0000","last_fullsized":"2024-03-23T06:21:28.033340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:15:46.873772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'11","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:20.406066+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:21:20.406066+0000","last_peered":"2024-03-23T06:21:20.406066+0000","last_clean":"2024-03-23T06:21:20.406066+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:21:20.406066+0000","last_undegraded":"2024-03-23T06:21:20.406066+0000","last_fullsized":"2024-03-23T06:21:20.406066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:19.369022+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:21:19.369022+0000","last_peered":"2024-03-23T06:21:19.369022+0000","last_clean":"2024-03-23T06:21:19.369022+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:21:19.369022+0000","last_undegraded":"2024-03-23T06:21:19.369022+0000","last_fullsized":"2024-03-23T06:21:19.369022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.219047+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:21:28.219047+0000","last_peered":"2024-03-23T06:21:28.219047+0000","last_clean":"2024-03-23T06:21:28.219047+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:21:28.219047+0000","last_undegraded":"2024-03-23T06:21:28.219047+0000","last_fullsized":"2024-03-23T06:21:28.219047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.970005+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:21:27.970005+0000","last_peered":"2024-03-23T06:21:27.970005+0000","last_clean":"2024-03-23T06:21:27.970005+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:21:27.970005+0000","last_undegraded":"2024-03-23T06:21:27.970005+0000","last_fullsized":"2024-03-23T06:21:27.970005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'23","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.052456+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:21:28.052456+0000","last_peered":"2024-03-23T06:21:28.052456+0000","last_clean":"2024-03-23T06:21:28.052456+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:21:28.052456+0000","last_undegraded":"2024-03-23T06:21:28.052456+0000","last_fullsized":"2024-03-23T06:21:28.052456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5573,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.176007+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:21:28.176007+0000","last_peered":"2024-03-23T06:21:28.176007+0000","last_clean":"2024-03-23T06:21:28.176007+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:21:28.176007+0000","last_undegraded":"2024-03-23T06:21:28.176007+0000","last_fullsized":"2024-03-23T06:21:28.176007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.955280+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:21:27.955280+0000","last_peered":"2024-03-23T06:21:27.955280+0000","last_clean":"2024-03-23T06:21:27.955280+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:21:27.955280+0000","last_undegraded":"2024-03-23T06:21:27.955280+0000","last_fullsized":"2024-03-23T06:21:27.955280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'50","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:18.397725+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:21:18.397725+0000","last_peered":"2024-03-23T06:21:18.397725+0000","last_clean":"2024-03-23T06:21:18.397725+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:21:18.397725+0000","last_undegraded":"2024-03-23T06:21:18.397725+0000","last_fullsized":"2024-03-23T06:21:18.397725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632534,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.134687+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:21:28.134687+0000","last_peered":"2024-03-23T06:21:28.134687+0000","last_clean":"2024-03-23T06:21:28.134687+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:21:28.134687+0000","last_undegraded":"2024-03-23T06:21:28.134687+0000","last_fullsized":"2024-03-23T06:21:28.134687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.172134+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:21:28.172134+0000","last_peered":"2024-03-23T06:21:28.172134+0000","last_clean":"2024-03-23T06:21:28.172134+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:21:28.172134+0000","last_undegraded":"2024-03-23T06:21:28.172134+0000","last_fullsized":"2024-03-23T06:21:28.172134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.237214+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:21:28.237214+0000","last_peered":"2024-03-23T06:21:28.237214+0000","last_clean":"2024-03-23T06:21:28.237214+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:21:28.237214+0000","last_undegraded":"2024-03-23T06:21:28.237214+0000","last_fullsized":"2024-03-23T06:21:28.237214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5959,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.199315+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:21:28.199315+0000","last_peered":"2024-03-23T06:21:28.199315+0000","last_clean":"2024-03-23T06:21:28.199315+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:21:28.199315+0000","last_undegraded":"2024-03-23T06:21:28.199315+0000","last_fullsized":"2024-03-23T06:21:28.199315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'9","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.025055+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:21:28.025055+0000","last_peered":"2024-03-23T06:21:28.025055+0000","last_clean":"2024-03-23T06:21:28.025055+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:21:28.025055+0000","last_undegraded":"2024-03-23T06:21:28.025055+0000","last_fullsized":"2024-03-23T06:21:28.025055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.042850+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:21:28.042850+0000","last_peered":"2024-03-23T06:21:28.042850+0000","last_clean":"2024-03-23T06:21:28.042850+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:21:28.042850+0000","last_undegraded":"2024-03-23T06:21:28.042850+0000","last_fullsized":"2024-03-23T06:21:28.042850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.129118+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:21:28.129118+0000","last_peered":"2024-03-23T06:21:28.129118+0000","last_clean":"2024-03-23T06:21:28.129118+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:21:28.129118+0000","last_undegraded":"2024-03-23T06:21:28.129118+0000","last_fullsized":"2024-03-23T06:21:28.129118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.113199+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:21:28.113199+0000","last_peered":"2024-03-23T06:21:28.113199+0000","last_clean":"2024-03-23T06:21:28.113199+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:21:28.113199+0000","last_undegraded":"2024-03-23T06:21:28.113199+0000","last_fullsized":"2024-03-23T06:21:28.113199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.235104+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:21:28.235104+0000","last_peered":"2024-03-23T06:21:28.235104+0000","last_clean":"2024-03-23T06:21:28.235104+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:21:28.235104+0000","last_undegraded":"2024-03-23T06:21:28.235104+0000","last_fullsized":"2024-03-23T06:21:28.235104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.233362+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:21:28.233362+0000","last_peered":"2024-03-23T06:21:28.233362+0000","last_clean":"2024-03-23T06:21:28.233362+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:21:28.233362+0000","last_undegraded":"2024-03-23T06:21:28.233362+0000","last_fullsized":"2024-03-23T06:21:28.233362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'11","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.126196+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:21:28.126196+0000","last_peered":"2024-03-23T06:21:28.126196+0000","last_clean":"2024-03-23T06:21:28.126196+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:21:28.126196+0000","last_undegraded":"2024-03-23T06:21:28.126196+0000","last_fullsized":"2024-03-23T06:21:28.126196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'40","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.141491+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:21:28.141491+0000","last_peered":"2024-03-23T06:21:28.141491+0000","last_clean":"2024-03-23T06:21:28.141491+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:21:28.141491+0000","last_undegraded":"2024-03-23T06:21:28.141491+0000","last_fullsized":"2024-03-23T06:21:28.141491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.933026+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:21:27.933026+0000","last_peered":"2024-03-23T06:21:27.933026+0000","last_clean":"2024-03-23T06:21:27.933026+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:21:27.933026+0000","last_undegraded":"2024-03-23T06:21:27.933026+0000","last_fullsized":"2024-03-23T06:21:27.933026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:37.936955+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:19:37.936955+0000","last_peered":"2024-03-23T06:19:37.936955+0000","last_clean":"2024-03-23T06:19:37.936955+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:19:37.936955+0000","last_undegraded":"2024-03-23T06:19:37.936955+0000","last_fullsized":"2024-03-23T06:19:37.936955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'230","reported_seq":252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.005048+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:21:28.005048+0000","last_peered":"2024-03-23T06:21:28.005048+0000","last_clean":"2024-03-23T06:21:28.005048+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:21:28.005048+0000","last_undegraded":"2024-03-23T06:21:28.005048+0000","last_fullsized":"2024-03-23T06:21:28.005048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":226,"num_write_kb":4211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.232433+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:21:28.232433+0000","last_peered":"2024-03-23T06:21:28.232433+0000","last_clean":"2024-03-23T06:21:28.232433+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:21:28.232433+0000","last_undegraded":"2024-03-23T06:21:28.232433+0000","last_fullsized":"2024-03-23T06:21:28.232433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.228775+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:21:28.228775+0000","last_peered":"2024-03-23T06:21:28.228775+0000","last_clean":"2024-03-23T06:21:28.228775+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:21:28.228775+0000","last_undegraded":"2024-03-23T06:21:28.228775+0000","last_fullsized":"2024-03-23T06:21:28.228775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:29.064848+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:21:29.064848+0000","last_peered":"2024-03-23T06:21:29.064848+0000","last_clean":"2024-03-23T06:21:29.064848+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:21:29.064848+0000","last_undegraded":"2024-03-23T06:21:29.064848+0000","last_fullsized":"2024-03-23T06:21:29.064848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.124181+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:21:28.124181+0000","last_peered":"2024-03-23T06:21:28.124181+0000","last_clean":"2024-03-23T06:21:28.124181+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:21:28.124181+0000","last_undegraded":"2024-03-23T06:21:28.124181+0000","last_fullsized":"2024-03-23T06:21:28.124181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:19.434417+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:21:19.434417+0000","last_peered":"2024-03-23T06:21:19.434417+0000","last_clean":"2024-03-23T06:21:19.434417+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:21:19.434417+0000","last_undegraded":"2024-03-23T06:21:19.434417+0000","last_fullsized":"2024-03-23T06:21:19.434417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.145165+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:21:28.145165+0000","last_peered":"2024-03-23T06:21:28.145165+0000","last_clean":"2024-03-23T06:21:28.145165+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:21:28.145165+0000","last_undegraded":"2024-03-23T06:21:28.145165+0000","last_fullsized":"2024-03-23T06:21:28.145165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.212540+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:21:28.212540+0000","last_peered":"2024-03-23T06:21:28.212540+0000","last_clean":"2024-03-23T06:21:28.212540+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:21:28.212540+0000","last_undegraded":"2024-03-23T06:21:28.212540+0000","last_fullsized":"2024-03-23T06:21:28.212540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.187686+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:21:28.187686+0000","last_peered":"2024-03-23T06:21:28.187686+0000","last_clean":"2024-03-23T06:21:28.187686+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:21:28.187686+0000","last_undegraded":"2024-03-23T06:21:28.187686+0000","last_fullsized":"2024-03-23T06:21:28.187686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.070858+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:21:28.070858+0000","last_peered":"2024-03-23T06:21:28.070858+0000","last_clean":"2024-03-23T06:21:28.070858+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:21:28.070858+0000","last_undegraded":"2024-03-23T06:21:28.070858+0000","last_fullsized":"2024-03-23T06:21:28.070858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.172172+0000","last_change":"2024-03-23T06:10:39.801920+0000","last_active":"2024-03-23T06:21:28.172172+0000","last_peered":"2024-03-23T06:21:28.172172+0000","last_clean":"2024-03-23T06:21:28.172172+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:21:28.172172+0000","last_undegraded":"2024-03-23T06:21:28.172172+0000","last_fullsized":"2024-03-23T06:21:28.172172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:39:07.343046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.138206+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:21:28.138206+0000","last_peered":"2024-03-23T06:21:28.138206+0000","last_clean":"2024-03-23T06:21:28.138206+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:21:28.138206+0000","last_undegraded":"2024-03-23T06:21:28.138206+0000","last_fullsized":"2024-03-23T06:21:28.138206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'15","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.994223+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:21:27.994223+0000","last_peered":"2024-03-23T06:21:27.994223+0000","last_clean":"2024-03-23T06:21:27.994223+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:21:27.994223+0000","last_undegraded":"2024-03-23T06:21:27.994223+0000","last_fullsized":"2024-03-23T06:21:27.994223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'33","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:40.168784+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:19:40.168784+0000","last_peered":"2024-03-23T06:19:40.168784+0000","last_clean":"2024-03-23T06:19:40.168784+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:19:40.168784+0000","last_undegraded":"2024-03-23T06:19:40.168784+0000","last_fullsized":"2024-03-23T06:19:40.168784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159725+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:21:28.159725+0000","last_peered":"2024-03-23T06:21:28.159725+0000","last_clean":"2024-03-23T06:21:28.159725+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:21:28.159725+0000","last_undegraded":"2024-03-23T06:21:28.159725+0000","last_fullsized":"2024-03-23T06:21:28.159725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.797643+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:21:27.797643+0000","last_peered":"2024-03-23T06:21:27.797643+0000","last_clean":"2024-03-23T06:21:27.797643+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:21:27.797643+0000","last_undegraded":"2024-03-23T06:21:27.797643+0000","last_fullsized":"2024-03-23T06:21:27.797643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.140714+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:21:28.140714+0000","last_peered":"2024-03-23T06:21:28.140714+0000","last_clean":"2024-03-23T06:21:28.140714+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:21:28.140714+0000","last_undegraded":"2024-03-23T06:21:28.140714+0000","last_fullsized":"2024-03-23T06:21:28.140714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:55.674981+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:19:55.674981+0000","last_peered":"2024-03-23T06:19:55.674981+0000","last_clean":"2024-03-23T06:19:55.674981+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:19:55.674981+0000","last_undegraded":"2024-03-23T06:19:55.674981+0000","last_fullsized":"2024-03-23T06:19:55.674981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.901341+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:21:27.901341+0000","last_peered":"2024-03-23T06:21:27.901341+0000","last_clean":"2024-03-23T06:21:27.901341+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:21:27.901341+0000","last_undegraded":"2024-03-23T06:21:27.901341+0000","last_fullsized":"2024-03-23T06:21:27.901341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.921034+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:21:27.921034+0000","last_peered":"2024-03-23T06:21:27.921034+0000","last_clean":"2024-03-23T06:21:27.921034+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:21:27.921034+0000","last_undegraded":"2024-03-23T06:21:27.921034+0000","last_fullsized":"2024-03-23T06:21:27.921034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'984","reported_seq":1004,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.142592+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:21:28.142592+0000","last_peered":"2024-03-23T06:21:28.142592+0000","last_clean":"2024-03-23T06:21:28.142592+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:21:28.142592+0000","last_undegraded":"2024-03-23T06:21:28.142592+0000","last_fullsized":"2024-03-23T06:21:28.142592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195132,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":977,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'15","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.087887+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:21:28.087887+0000","last_peered":"2024-03-23T06:21:28.087887+0000","last_clean":"2024-03-23T06:21:28.087887+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:21:28.087887+0000","last_undegraded":"2024-03-23T06:21:28.087887+0000","last_fullsized":"2024-03-23T06:21:28.087887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.145556+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:21:28.145556+0000","last_peered":"2024-03-23T06:21:28.145556+0000","last_clean":"2024-03-23T06:21:28.145556+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:21:28.145556+0000","last_undegraded":"2024-03-23T06:21:28.145556+0000","last_fullsized":"2024-03-23T06:21:28.145556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.181123+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:21:28.181123+0000","last_peered":"2024-03-23T06:21:28.181123+0000","last_clean":"2024-03-23T06:21:28.181123+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:21:28.181123+0000","last_undegraded":"2024-03-23T06:21:28.181123+0000","last_fullsized":"2024-03-23T06:21:28.181123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'17","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.929863+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:21:27.929863+0000","last_peered":"2024-03-23T06:21:27.929863+0000","last_clean":"2024-03-23T06:21:27.929863+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:21:27.929863+0000","last_undegraded":"2024-03-23T06:21:27.929863+0000","last_fullsized":"2024-03-23T06:21:27.929863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.118351+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:21:28.118351+0000","last_peered":"2024-03-23T06:21:28.118351+0000","last_clean":"2024-03-23T06:21:28.118351+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:21:28.118351+0000","last_undegraded":"2024-03-23T06:21:28.118351+0000","last_fullsized":"2024-03-23T06:21:28.118351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.915401+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:21:27.915401+0000","last_peered":"2024-03-23T06:21:27.915401+0000","last_clean":"2024-03-23T06:21:27.915401+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:21:27.915401+0000","last_undegraded":"2024-03-23T06:21:27.915401+0000","last_fullsized":"2024-03-23T06:21:27.915401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'9","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:25.305777+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:21:25.305777+0000","last_peered":"2024-03-23T06:21:25.305777+0000","last_clean":"2024-03-23T06:21:25.305777+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:21:25.305777+0000","last_undegraded":"2024-03-23T06:21:25.305777+0000","last_fullsized":"2024-03-23T06:21:25.305777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'9","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.917072+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:21:27.917072+0000","last_peered":"2024-03-23T06:21:27.917072+0000","last_clean":"2024-03-23T06:21:27.917072+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:21:27.917072+0000","last_undegraded":"2024-03-23T06:21:27.917072+0000","last_fullsized":"2024-03-23T06:21:27.917072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'20","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.171124+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:21:28.171124+0000","last_peered":"2024-03-23T06:21:28.171124+0000","last_clean":"2024-03-23T06:21:28.171124+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:21:28.171124+0000","last_undegraded":"2024-03-23T06:21:28.171124+0000","last_fullsized":"2024-03-23T06:21:28.171124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.997857+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:21:27.997857+0000","last_peered":"2024-03-23T06:21:27.997857+0000","last_clean":"2024-03-23T06:21:27.997857+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:21:27.997857+0000","last_undegraded":"2024-03-23T06:21:27.997857+0000","last_fullsized":"2024-03-23T06:21:27.997857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.051804+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:21:28.051804+0000","last_peered":"2024-03-23T06:21:28.051804+0000","last_clean":"2024-03-23T06:21:28.051804+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:21:28.051804+0000","last_undegraded":"2024-03-23T06:21:28.051804+0000","last_fullsized":"2024-03-23T06:21:28.051804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.131592+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:21:28.131592+0000","last_peered":"2024-03-23T06:21:28.131592+0000","last_clean":"2024-03-23T06:21:28.131592+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:21:28.131592+0000","last_undegraded":"2024-03-23T06:21:28.131592+0000","last_fullsized":"2024-03-23T06:21:28.131592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'15","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.022798+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:21:28.022798+0000","last_peered":"2024-03-23T06:21:28.022798+0000","last_clean":"2024-03-23T06:21:28.022798+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:21:28.022798+0000","last_undegraded":"2024-03-23T06:21:28.022798+0000","last_fullsized":"2024-03-23T06:21:28.022798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'16","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.910153+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:21:27.910153+0000","last_peered":"2024-03-23T06:21:27.910153+0000","last_clean":"2024-03-23T06:21:27.910153+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:21:27.910153+0000","last_undegraded":"2024-03-23T06:21:27.910153+0000","last_fullsized":"2024-03-23T06:21:27.910153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.943172+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:21:27.943172+0000","last_peered":"2024-03-23T06:21:27.943172+0000","last_clean":"2024-03-23T06:21:27.943172+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:21:27.943172+0000","last_undegraded":"2024-03-23T06:21:27.943172+0000","last_fullsized":"2024-03-23T06:21:27.943172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.871940+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:21:27.871940+0000","last_peered":"2024-03-23T06:21:27.871940+0000","last_clean":"2024-03-23T06:21:27.871940+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:21:27.871940+0000","last_undegraded":"2024-03-23T06:21:27.871940+0000","last_fullsized":"2024-03-23T06:21:27.871940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'21","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.217843+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:21:28.217843+0000","last_peered":"2024-03-23T06:21:28.217843+0000","last_clean":"2024-03-23T06:21:28.217843+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:21:28.217843+0000","last_undegraded":"2024-03-23T06:21:28.217843+0000","last_fullsized":"2024-03-23T06:21:28.217843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.868807+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:21:27.868807+0000","last_peered":"2024-03-23T06:21:27.868807+0000","last_clean":"2024-03-23T06:21:27.868807+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:21:27.868807+0000","last_undegraded":"2024-03-23T06:21:27.868807+0000","last_fullsized":"2024-03-23T06:21:27.868807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.203325+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:21:28.203325+0000","last_peered":"2024-03-23T06:21:28.203325+0000","last_clean":"2024-03-23T06:21:28.203325+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:21:28.203325+0000","last_undegraded":"2024-03-23T06:21:28.203325+0000","last_fullsized":"2024-03-23T06:21:28.203325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.154446+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:21:28.154446+0000","last_peered":"2024-03-23T06:21:28.154446+0000","last_clean":"2024-03-23T06:21:28.154446+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:21:28.154446+0000","last_undegraded":"2024-03-23T06:21:28.154446+0000","last_fullsized":"2024-03-23T06:21:28.154446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.234420+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:21:28.234420+0000","last_peered":"2024-03-23T06:21:28.234420+0000","last_clean":"2024-03-23T06:21:28.234420+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:21:28.234420+0000","last_undegraded":"2024-03-23T06:21:28.234420+0000","last_fullsized":"2024-03-23T06:21:28.234420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'17","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.071450+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:21:28.071450+0000","last_peered":"2024-03-23T06:21:28.071450+0000","last_clean":"2024-03-23T06:21:28.071450+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:21:28.071450+0000","last_undegraded":"2024-03-23T06:21:28.071450+0000","last_fullsized":"2024-03-23T06:21:28.071450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'11","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.865254+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:21:27.865254+0000","last_peered":"2024-03-23T06:21:27.865254+0000","last_clean":"2024-03-23T06:21:27.865254+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:21:27.865254+0000","last_undegraded":"2024-03-23T06:21:27.865254+0000","last_fullsized":"2024-03-23T06:21:27.865254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'12","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:18.799985+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:21:18.799985+0000","last_peered":"2024-03-23T06:21:18.799985+0000","last_clean":"2024-03-23T06:21:18.799985+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:21:18.799985+0000","last_undegraded":"2024-03-23T06:21:18.799985+0000","last_fullsized":"2024-03-23T06:21:18.799985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'22","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.180520+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:21:28.180520+0000","last_peered":"2024-03-23T06:21:28.180520+0000","last_clean":"2024-03-23T06:21:28.180520+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:21:28.180520+0000","last_undegraded":"2024-03-23T06:21:28.180520+0000","last_fullsized":"2024-03-23T06:21:28.180520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.927474+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:21:27.927474+0000","last_peered":"2024-03-23T06:21:27.927474+0000","last_clean":"2024-03-23T06:21:27.927474+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:21:27.927474+0000","last_undegraded":"2024-03-23T06:21:27.927474+0000","last_fullsized":"2024-03-23T06:21:27.927474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.814576+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:21:27.814576+0000","last_peered":"2024-03-23T06:21:27.814576+0000","last_clean":"2024-03-23T06:21:27.814576+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:21:27.814576+0000","last_undegraded":"2024-03-23T06:21:27.814576+0000","last_fullsized":"2024-03-23T06:21:27.814576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'10","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.885343+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:21:27.885343+0000","last_peered":"2024-03-23T06:21:27.885343+0000","last_clean":"2024-03-23T06:21:27.885343+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:21:27.885343+0000","last_undegraded":"2024-03-23T06:21:27.885343+0000","last_fullsized":"2024-03-23T06:21:27.885343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.387105+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:21:27.387105+0000","last_peered":"2024-03-23T06:21:27.387105+0000","last_clean":"2024-03-23T06:21:27.387105+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:21:27.387105+0000","last_undegraded":"2024-03-23T06:21:27.387105+0000","last_fullsized":"2024-03-23T06:21:27.387105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.105362+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:21:28.105362+0000","last_peered":"2024-03-23T06:21:28.105362+0000","last_clean":"2024-03-23T06:21:28.105362+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:21:28.105362+0000","last_undegraded":"2024-03-23T06:21:28.105362+0000","last_fullsized":"2024-03-23T06:21:28.105362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.875430+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:21:27.875430+0000","last_peered":"2024-03-23T06:21:27.875430+0000","last_clean":"2024-03-23T06:21:27.875430+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:21:27.875430+0000","last_undegraded":"2024-03-23T06:21:27.875430+0000","last_fullsized":"2024-03-23T06:21:27.875430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.919523+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:21:27.919523+0000","last_peered":"2024-03-23T06:21:27.919523+0000","last_clean":"2024-03-23T06:21:27.919523+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:21:27.919523+0000","last_undegraded":"2024-03-23T06:21:27.919523+0000","last_fullsized":"2024-03-23T06:21:27.919523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:17.254550+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:21:17.254550+0000","last_peered":"2024-03-23T06:21:17.254550+0000","last_clean":"2024-03-23T06:21:17.254550+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:21:17.254550+0000","last_undegraded":"2024-03-23T06:21:17.254550+0000","last_fullsized":"2024-03-23T06:21:17.254550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.017597+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:21:28.017597+0000","last_peered":"2024-03-23T06:21:28.017597+0000","last_clean":"2024-03-23T06:21:28.017597+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:21:28.017597+0000","last_undegraded":"2024-03-23T06:21:28.017597+0000","last_fullsized":"2024-03-23T06:21:28.017597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88811641,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2349,"num_write_kb":88563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177623282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2348,"ondisk_log_size":2348,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1363056,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1325886,"kb_avail":93008784,"statfs":{"total":96636764160,"available":95240994816,"internally_reserved":0,"allocated":38051840,"data_stored":37867231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1357707720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.8239999999999998,"5min":7.4420000000000002,"15min":4.649},"min":{"1min":0.32700000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":16.913,"5min":170.84299999999999,"15min":309.57499999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":2.3100000000000001,"5min":7.2069999999999999,"15min":4.5540000000000003},"min":{"1min":0.38600000000000001,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":11.553000000000001,"5min":178.934,"15min":300.98500000000001},"last":0.75}]},{"osd":1,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":10.808,"15min":5.3719999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.82,"5min":359.48599999999999,"15min":359.48599999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":9.3800000000000008,"15min":5.0759999999999996},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.6440000000000001,"5min":359.20299999999997,"15min":359.20299999999997},"last":1.3}]},{"osd":2,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":3.8599999999999999,"5min":8.2759999999999998,"15min":4.4409999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":29.532,"5min":56.805999999999997,"15min":58.277000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":3.2959999999999998,"5min":9.9809999999999999,"15min":5.1310000000000002},"min":{"1min":0.57399999999999995,"5min":0.52100000000000002,"15min":0.32900000000000001},"max":{"1min":17.776,"5min":89.454999999999998,"15min":119.176},"last":1.21}]},{"osd":4,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":6.4829999999999997,"15min":3.1899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":20.178999999999998,"5min":36.270000000000003,"15min":36.270000000000003},"last":0.95799999999999996},{"interface":"front","average":{"1min":2.8889999999999998,"5min":6.9240000000000004,"15min":3.8929999999999998},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.32800000000000001},"max":{"1min":21.093,"5min":38.718000000000004,"15min":64.325000000000003},"last":1.1499999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":1.867,"5min":6.7060000000000004,"15min":3.8039999999999998},"min":{"1min":0.46100000000000002,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":9.423,"5min":38.759999999999998,"15min":58.317},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.9379999999999999,"5min":6.5640000000000001,"15min":3.5569999999999999},"min":{"1min":0.53300000000000003,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":9.4529999999999994,"5min":33.854999999999997,"15min":33.854999999999997},"last":1.1739999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":6.9930000000000003,"15min":3.7410000000000001},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":5.1539999999999999,"5min":31.623999999999999,"15min":31.623999999999999},"last":1.276},{"interface":"front","average":{"1min":2.2829999999999999,"5min":6.4189999999999996,"15min":3.2559999999999998},"min":{"1min":0.67100000000000004,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":9.3900000000000006,"5min":37.179000000000002,"15min":37.179000000000002},"last":1.351}]},{"osd":7,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":4.0960000000000001,"5min":7.9029999999999996,"15min":4.218},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.388000000000002,"5min":38.621000000000002,"15min":58.344000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":3.4430000000000001,"5min":7.4119999999999999,"15min":3.6880000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":19.349,"5min":38.680999999999997,"15min":38.680999999999997},"last":1.323}]}]},{"osd":2,"up_from":14,"seq":60129542290,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.2490000000000001,"5min":5.1079999999999997,"15min":3.8050000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":23.753,"5min":49.142000000000003,"15min":126.152},"last":0.76400000000000001},{"interface":"front","average":{"1min":2.7669999999999999,"5min":4.7169999999999996,"15min":3.2450000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":23.312000000000001,"5min":29.206,"15min":143.14099999999999},"last":1.2569999999999999}]},{"osd":1,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.379,"5min":6.9400000000000004,"15min":4.3390000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":23.280000000000001,"5min":55.564999999999998,"15min":55.564999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":4.1859999999999999,"5min":7.2030000000000003,"15min":3.8119999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.31900000000000001},"max":{"1min":18.187999999999999,"5min":55.354999999999997,"15min":55.354999999999997},"last":1.0529999999999999}]},{"osd":3,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":5.2240000000000002,"5min":17.103000000000002,"15min":7.4960000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.27600000000000002},"max":{"1min":38.366,"5min":529.81799999999998,"15min":529.81799999999998},"last":1.091},{"interface":"front","average":{"1min":4.6539999999999999,"5min":11.901,"15min":5.7839999999999998},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":14.378,"5min":528.94200000000001,"15min":528.94200000000001},"last":1.242}]},{"osd":4,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":6.7610000000000001,"5min":6.6779999999999999,"15min":3.431},"min":{"1min":0.37,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":31.062999999999999,"5min":49.430999999999997,"15min":49.430999999999997},"last":0.98599999999999999},{"interface":"front","average":{"1min":9.0259999999999998,"5min":7.7889999999999997,"15min":4.5250000000000004},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.312},"max":{"1min":44.173000000000002,"5min":60.298000000000002,"15min":83.525999999999996},"last":1.01}]},{"osd":5,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":5.1829999999999998,"5min":6.0490000000000004,"15min":3.9649999999999999},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":35.433999999999997,"5min":35.433999999999997,"15min":82.456000000000003},"last":1.3779999999999999},{"interface":"front","average":{"1min":4.9980000000000002,"5min":6.1539999999999999,"15min":3.7599999999999998},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.35199999999999998},"max":{"1min":35.472999999999999,"5min":35.472999999999999,"15min":82.971000000000004},"last":1.482}]},{"osd":6,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.2559999999999998,"5min":6.1280000000000001,"15min":3.6469999999999998},"min":{"1min":0.39700000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":13.169,"5min":57.420999999999999,"15min":83.007999999999996},"last":1.143},{"interface":"front","average":{"1min":4.0679999999999996,"5min":6.6769999999999996,"15min":3.629},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.914,"5min":49.768000000000001,"15min":49.768000000000001},"last":1.1930000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":6.5250000000000004,"5min":6.6390000000000002,"15min":4.2789999999999999},"min":{"1min":0.51400000000000001,"5min":0.44900000000000001,"15min":0.35099999999999998},"max":{"1min":23.207000000000001,"5min":43.113,"15min":77.353999999999999},"last":1.5740000000000001},{"interface":"front","average":{"1min":6.1520000000000001,"5min":8.2750000000000004,"15min":4.2640000000000002},"min":{"1min":0.56200000000000006,"5min":0.38,"15min":0.38},"max":{"1min":28.085000000000001,"5min":83.406999999999996,"15min":83.406999999999996},"last":1.218}]}]},{"osd":1,"up_from":14,"seq":60129542292,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":2.5049999999999999,"5min":4.8719999999999999,"15min":2.8279999999999998},"min":{"1min":0.47799999999999998,"5min":0.25700000000000001,"15min":0.221},"max":{"1min":7.2119999999999997,"5min":70.713999999999999,"15min":70.713999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":4.1239999999999997,"5min":4.6050000000000004,"15min":2.6930000000000001},"min":{"1min":0.63100000000000001,"5min":0.247,"15min":0.247},"max":{"1min":12.242000000000001,"5min":30.41,"15min":30.41},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":6.0860000000000003,"5min":9.5790000000000006,"15min":4.5869999999999997},"min":{"1min":0.70599999999999996,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":21.725000000000001,"5min":127.342,"15min":127.342},"last":1.2929999999999999},{"interface":"front","average":{"1min":4.0099999999999998,"5min":7.335,"15min":4.2549999999999999},"min":{"1min":0.38800000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":11.699,"5min":107.748,"15min":107.748},"last":1.3500000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":4.8289999999999997,"5min":7.2889999999999997,"15min":4.024},"min":{"1min":0.46600000000000003,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":19.071999999999999,"5min":31.780000000000001,"15min":31.780000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":2.96,"5min":5.6040000000000001,"15min":4.0010000000000003},"min":{"1min":0.502,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.183999999999999,"5min":31.821999999999999,"15min":175.29300000000001},"last":1.222}]},{"osd":4,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":5.0380000000000003,"15min":3.1440000000000001},"min":{"1min":0.58399999999999996,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":10.223000000000001,"5min":32.368000000000002,"15min":78.060000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":3.1909999999999998,"5min":5.5030000000000001,"15min":3.1379999999999999},"min":{"1min":0.65100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":10.254,"5min":38.856000000000002,"15min":80.959999999999994},"last":1.0169999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":5.4320000000000004,"15min":3.2639999999999998},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":13.395,"5min":70.670000000000002,"15min":70.670000000000002},"last":1.069},{"interface":"front","average":{"1min":4.3719999999999999,"5min":4.609,"15min":2.6960000000000002},"min":{"1min":0.622,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":26.341000000000001,"5min":30.431000000000001,"15min":30.431000000000001},"last":1.1759999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":4.1130000000000004,"5min":6.1200000000000001,"15min":3.2970000000000002},"min":{"1min":0.61899999999999999,"5min":0.375,"15min":0.375},"max":{"1min":16.693000000000001,"5min":40.606999999999999,"15min":40.606999999999999},"last":1.147},{"interface":"front","average":{"1min":4.016,"5min":6.5369999999999999,"15min":3.6099999999999999},"min":{"1min":0.74099999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":16.997,"5min":68.369,"15min":68.369},"last":1.3169999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":6.9050000000000002,"5min":6.9640000000000004,"15min":3.9790000000000001},"min":{"1min":0.84599999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":28.331,"5min":68.475999999999999,"15min":90.965999999999994},"last":1.25},{"interface":"front","average":{"1min":7.7510000000000003,"5min":7.6360000000000001,"15min":4.1120000000000001},"min":{"1min":0.89300000000000002,"5min":0.48099999999999998,"15min":0.38700000000000001},"max":{"1min":29.065000000000001,"5min":68.415000000000006,"15min":84.465000000000003},"last":1.399}]}]},{"osd":0,"up_from":14,"seq":60129542295,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":12.144,"15min":5.3419999999999996},"min":{"1min":0.439,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":9.5180000000000007,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":2.3730000000000002,"5min":5.7039999999999997,"15min":3.1099999999999999},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":11.704000000000001,"5min":76.515000000000001,"15min":76.515000000000001},"last":0.91000000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.649,"5min":6.0780000000000003,"15min":3.4350000000000001},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.33300000000000002},"max":{"1min":14.335000000000001,"5min":58.996000000000002,"15min":58.996000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":2.1549999999999998,"5min":4.9809999999999999,"15min":3.54},"min":{"1min":0.48099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.641,"5min":50.271000000000001,"15min":62.466000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":5.8799999999999999,"15min":3.5550000000000002},"min":{"1min":0.5,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":15.768000000000001,"5min":44.116999999999997,"15min":44.360999999999997},"last":0.94099999999999995},{"interface":"front","average":{"1min":3.5670000000000002,"5min":5.8019999999999996,"15min":3.4409999999999998},"min":{"1min":0.502,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":14.231999999999999,"5min":44.212000000000003,"15min":81.251000000000005},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":4.7030000000000003,"5min":6.8630000000000004,"15min":3.2450000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":37.588000000000001,"5min":72.588999999999999,"15min":72.588999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":4.3410000000000002,"5min":6.3609999999999998,"15min":3.3490000000000002},"min":{"1min":0.59199999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":34.561999999999998,"5min":69.566000000000003,"15min":69.566000000000003},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.645,"5min":6.1849999999999996,"15min":3.1709999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":22.946999999999999,"5min":72.552000000000007,"15min":72.552000000000007},"last":0.755},{"interface":"front","average":{"1min":2.2410000000000001,"5min":5.6740000000000004,"15min":3.0859999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":13.670999999999999,"5min":72.626999999999995,"15min":72.626999999999995},"last":0.86099999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":5.1310000000000002,"15min":2.9319999999999999},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":9.0310000000000006,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.79000000000000004},{"interface":"front","average":{"1min":2.0089999999999999,"5min":5.806,"15min":3.1459999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":8.9760000000000009,"5min":72.656999999999996,"15min":72.656999999999996},"last":1.145}]},{"osd":7,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":3.2799999999999998,"5min":6.7050000000000001,"15min":3.3900000000000001},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":18.199000000000002,"5min":69.662000000000006,"15min":69.662000000000006},"last":0.96999999999999997},{"interface":"front","average":{"1min":3.2189999999999999,"5min":5.2279999999999998,"15min":2.96},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.38700000000000001},"max":{"1min":18.236000000000001,"5min":69.632000000000005,"15min":69.632000000000005},"last":1.006}]}]},{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":4.2240000000000002,"15min":2.2869999999999999},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.9240000000000004,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.441},{"interface":"front","average":{"1min":2.6960000000000002,"5min":4.2119999999999997,"15min":2.0409999999999999},"min":{"1min":0.29299999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":27.337,"5min":42.582000000000001,"15min":42.582000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":5.1710000000000003,"5min":10.372999999999999,"15min":4.2629999999999999},"min":{"1min":0.378,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":29.841000000000001,"5min":310.09300000000002,"15min":310.09300000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":5.3929999999999998,"5min":10.302,"15min":4.3140000000000001},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":29.881,"5min":309.70999999999998,"15min":309.70999999999998},"last":0.73099999999999998}]},{"osd":2,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.0419999999999998,"5min":4.7050000000000001,"15min":2.52},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":33.079999999999998,"5min":50.680999999999997,"15min":63.014000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":6.133,"15min":2.9809999999999999},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.8089999999999999,"5min":73.218000000000004,"15min":73.218000000000004},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":7.3550000000000004,"15min":3.2999999999999998},"min":{"1min":0.441,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":23.777000000000001,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":2.6800000000000002,"5min":5.4269999999999996,"15min":2.742},"min":{"1min":0.32200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":23.949000000000002,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":7.7140000000000004,"5min":5.6399999999999997,"15min":2.254},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.219},"max":{"1min":33.005000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":7.867,"5min":5.4189999999999996,"15min":2.2410000000000001},"min":{"1min":0.28599999999999998,"5min":0.224,"15min":0.224},"max":{"1min":33.106999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.29099999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.7200000000000002,"5min":4.5999999999999996,"15min":1.9039999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":28.922999999999998,"5min":35.884,"15min":35.884},"last":0.317},{"interface":"front","average":{"1min":6.226,"5min":4.9960000000000004,"15min":2.0510000000000002},"min":{"1min":0.33800000000000002,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":33.048000000000002,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.30599999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.7509999999999999,"5min":3.9089999999999998,"15min":1.7410000000000001},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":27.506,"5min":32.799999999999997,"15min":32.799999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":3.6930000000000001,"5min":3.9630000000000001,"15min":1.742},"min":{"1min":0.32600000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":27.533999999999999,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":3.3109999999999999,"15min":1.794},"min":{"1min":0.376,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":6.1440000000000001,"5min":47.136000000000003,"15min":47.136000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":2.2989999999999999,"5min":3.8450000000000002,"15min":2.0950000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":16.620000000000001,"5min":43.140000000000001,"15min":43.140000000000001},"last":0.309}]},{"osd":1,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":4.3319999999999999,"15min":2.7610000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":10.538,"5min":77.959000000000003,"15min":96.375},"last":0.72099999999999997},{"interface":"front","average":{"1min":2.0049999999999999,"5min":6.0259999999999998,"15min":3.3839999999999999},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.4690000000000003,"5min":96.034000000000006,"15min":96.034000000000006},"last":0.66100000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":4.3659999999999997,"15min":3.3969999999999998},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.9370000000000003,"5min":53.225000000000001,"15min":91.947999999999993},"last":0.497},{"interface":"front","average":{"1min":2.1619999999999999,"5min":5.165,"15min":3.202},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":18.454000000000001,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.622}]},{"osd":3,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":3.645,"5min":5.9880000000000004,"15min":3.657},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":24.745999999999999,"5min":73.837000000000003,"15min":107.29000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":4.1669999999999998,"5min":5.907,"15min":3.766},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":26.498000000000001,"5min":73.692999999999998,"15min":107.27200000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":7.9210000000000003,"5min":4.6600000000000001,"15min":2.1440000000000001},"min":{"1min":0.252,"5min":0.216,"15min":0.216},"max":{"1min":45.302,"5min":45.302,"15min":45.302},"last":0.26500000000000001},{"interface":"front","average":{"1min":8.0129999999999999,"5min":4.7249999999999996,"15min":2.202},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.251},"max":{"1min":45.408000000000001,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.35499999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":4.1669999999999998,"15min":1.8400000000000001},"min":{"1min":0.27700000000000002,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":24.779,"5min":39.625,"15min":39.625},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.9470000000000001,"5min":3.3639999999999999,"15min":1.6719999999999999},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":26.454999999999998,"5min":37.686,"15min":37.686},"last":0.39700000000000002}]},{"osd":7,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":3.3300000000000001,"5min":3.4580000000000002,"15min":1.6479999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":24.359999999999999,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":4.1609999999999996,"5min":3.3300000000000001,"15min":1.5680000000000001},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":26.521000000000001,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.48299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26600828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":3.1200000000000001,"15min":1.6619999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.9969999999999999,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":3.4079999999999999,"15min":1.7390000000000001},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":3.871,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.40500000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":4.8319999999999999,"15min":2.3069999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":16.021000000000001,"5min":69.873999999999995,"15min":69.873999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":2.1299999999999999,"5min":4.8410000000000002,"15min":2.383},"min":{"1min":0.41399999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":11.035,"5min":50.758000000000003,"15min":50.758000000000003},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.423,"5min":5.1059999999999999,"15min":2.726},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":18.189,"5min":100.931,"15min":100.931},"last":0.58099999999999996},{"interface":"front","average":{"1min":2.6219999999999999,"5min":6.4400000000000004,"15min":3.1269999999999998},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":18.815000000000001,"5min":142.041,"15min":142.041},"last":0.37}]},{"osd":3,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":6.0490000000000004,"15min":2.9369999999999998},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9.6340000000000003,"5min":63.905999999999999,"15min":63.905999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.7250000000000001,"5min":5.9930000000000003,"15min":3.0310000000000001},"min":{"1min":0.38800000000000001,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":9.6210000000000004,"5min":61.076000000000001,"15min":61.076000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":3.4700000000000002,"15min":1.603},"min":{"1min":0.248,"5min":0.219,"15min":0.219},"max":{"1min":2.5539999999999998,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.312},{"interface":"front","average":{"1min":0.68200000000000005,"5min":3.8370000000000002,"15min":1.7350000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":3.9540000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.35899999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":3.5579999999999998,"5min":5.1699999999999999,"15min":2.1110000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":32.395000000000003,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":3.681,"5min":5.3890000000000002,"15min":2.3250000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":32.616999999999997,"5min":40.314,"15min":40.314},"last":0.32400000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":3.859,"15min":1.819},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.25700000000000001},"max":{"1min":3.8570000000000002,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":4.7720000000000002,"15min":2.0630000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":4.0019999999999998,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.38500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574997,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":3.0249999999999999,"15min":1.716},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":26.696000000000002,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":2.6600000000000001,"5min":3.2610000000000001,"15min":1.8999999999999999},"min":{"1min":0.38700000000000001,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":26.655000000000001,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.68799999999999994}]},{"osd":1,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":5.3780000000000001,"15min":2.7290000000000001},"min":{"1min":0.314,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":6.5529999999999999,"5min":51.387999999999998,"15min":51.387999999999998},"last":0.39300000000000002},{"interface":"front","average":{"1min":1.393,"5min":3.75,"15min":2.1640000000000001},"min":{"1min":0.39600000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.633,"5min":50.207000000000001,"15min":50.207000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":5.056,"5min":10.506,"15min":4.6859999999999999},"min":{"1min":0.29099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":40.793999999999997,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.26,"5min":9.3879999999999999,"15min":4.2000000000000002},"min":{"1min":0.34599999999999997,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":4.6870000000000003,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.64200000000000002}]},{"osd":3,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":5.3319999999999999,"15min":2.762},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.5220000000000002,"5min":53.134999999999998,"15min":53.134999999999998},"last":0.499},{"interface":"front","average":{"1min":2.137,"5min":6.9210000000000003,"15min":4.3179999999999996},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.30399999999999999},"max":{"1min":5.633,"5min":62.134,"15min":161.191},"last":0.72299999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":3.75,"15min":1.647},"min":{"1min":0.23499999999999999,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":2.8519999999999999,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":3.8119999999999998,"15min":1.7230000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.22800000000000001},"max":{"1min":3.0259999999999998,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.313}]},{"osd":6,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":6.6719999999999997,"15min":2.6389999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.22900000000000001},"max":{"1min":3.137,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.24099999999999999},{"interface":"front","average":{"1min":1.151,"5min":6.2510000000000003,"15min":2.5510000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.3899999999999997,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.29999999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":2.3769999999999998,"5min":5.0099999999999998,"15min":2.101},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.24299999999999999},"max":{"1min":26.707999999999998,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":2.4129999999999998,"5min":4.4450000000000003,"15min":1.9179999999999999},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":26.725999999999999,"5min":51.997,"15min":51.997},"last":0.372}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:22:06.565 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-23T06:22:06.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:22:06.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.805+0000 7f2a66c00640 1 Processor -- start 2024-03-23T06:22:06.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.805+0000 7f2a66c00640 1 -- start start 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.807+0000 7f2a66c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a60151230 0x7f2a600c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.807+0000 7f2a66c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2a600c6f10 0x7f2a600cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a66c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6006bee0 con 0x7f2a600cb520 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a66c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6006adc0 con 0x7f2a600c6f10 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a66c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a600c6a80 con 0x7f2a60151230 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a5fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a60151230 0x7f2a600c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a57400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2a600c6f10 0x7f2a600cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a5fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a60151230 0x7f2a600c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43070/0 (socket says 172.21.15.73:43070) 2024-03-23T06:22:06.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a57400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2a600c6f10 0x7f2a600cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47308/0 (socket says 172.21.15.73:47308) 2024-03-23T06:22:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a5fe00640 1 -- 172.21.15.73:0/628860823 learned_addr learned my addr 172.21.15.73:0/628860823 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a5fe00640 1 -- 172.21.15.73:0/628860823 >> v2:172.21.15.73:3300/0 conn(0x7f2a600c6f10 msgr2=0x7f2a600cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a5fe00640 1 --2- 172.21.15.73:0/628860823 >> v2:172.21.15.73:3300/0 conn(0x7f2a600c6f10 0x7f2a600cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a5fe00640 1 -- 172.21.15.73:0/628860823 >> v1:172.21.15.73:6789/0 conn(0x7f2a600cb520 legacy=0x7f2a600c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.808+0000 7f2a5fe00640 1 -- 172.21.15.73:0/628860823 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a600c7980 con 0x7f2a60151230 2024-03-23T06:22:06.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.809+0000 7f2a5fe00640 1 --2- 172.21.15.73:0/628860823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a60151230 0x7f2a600c7440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a600c95b0 tx=0x7f2a5002ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ca6c3d5be6c93e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.810+0000 7f2a5f400640 1 -- 172.21.15.73:0/628860823 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5002f850 con 0x7f2a60151230 2024-03-23T06:22:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.810+0000 7f2a5f400640 1 -- 172.21.15.73:0/628860823 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5002f9b0 con 0x7f2a60151230 2024-03-23T06:22:06.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.810+0000 7f2a5f400640 1 -- 172.21.15.73:0/628860823 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5002fd40 con 0x7f2a60151230 2024-03-23T06:22:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.811+0000 7f2a66c00640 1 -- 172.21.15.73:0/628860823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a60151230 msgr2=0x7f2a600c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.811+0000 7f2a66c00640 1 --2- 172.21.15.73:0/628860823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a60151230 0x7f2a600c7440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a600c95b0 tx=0x7f2a5002ba30 comp rx=0 tx=0).stop 2024-03-23T06:22:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.811+0000 7f2a66c00640 1 -- 172.21.15.73:0/628860823 shutdown_connections 2024-03-23T06:22:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.811+0000 7f2a66c00640 1 --2- 172.21.15.73:0/628860823 >> v2:172.21.15.73:3300/0 conn(0x7f2a600c6f10 0x7f2a600cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.811+0000 7f2a66c00640 1 --2- 172.21.15.73:0/628860823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a60151230 0x7f2a600c7440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.811+0000 7f2a66c00640 1 -- 172.21.15.73:0/628860823 >> 172.21.15.73:0/628860823 conn(0x7f2a600cba10 msgr2=0x7f2a600cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.811+0000 7f2a66c00640 1 -- 172.21.15.73:0/628860823 shutdown_connections 2024-03-23T06:22:06.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.811+0000 7f2a66c00640 1 -- 172.21.15.73:0/628860823 wait complete. 2024-03-23T06:22:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.813+0000 7f2a66c00640 1 Processor -- start 2024-03-23T06:22:06.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.814+0000 7f2a66c00640 1 -- start start 2024-03-23T06:22:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a66c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a600c6f10 0x7f2a60144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a66c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a600cb520 0x7f2a60149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a66c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a60151230 0x7f2a6013d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a66c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601ed800 con 0x7f2a600cb520 2024-03-23T06:22:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a66c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601ece80 con 0x7f2a600c6f10 2024-03-23T06:22:06.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a66c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a601470b0 con 0x7f2a60151230 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a5fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a600c6f10 0x7f2a60144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a5fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a600c6f10 0x7f2a60144f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43082/0 (socket says 172.21.15.73:43082) 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a5fe00640 1 -- 172.21.15.73:0/2722017394 learned_addr learned my addr 172.21.15.73:0/2722017394 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a64c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a60151230 0x7f2a6013d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.815+0000 7f2a57400640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a600cb520 0x7f2a60149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5fe00640 1 -- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a60151230 msgr2=0x7f2a6013d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5fe00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a60151230 0x7f2a6013d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5fe00640 1 -- 172.21.15.73:0/2722017394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a600cb520 msgr2=0x7f2a60149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5fe00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a600cb520 0x7f2a60149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5fe00640 1 -- 172.21.15.73:0/2722017394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500094d0 con 0x7f2a600c6f10 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5fe00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a600c6f10 0x7f2a60144f60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a5002ba70 tx=0x7f2a50004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5cc00640 1 -- 172.21.15.73:0/2722017394 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50037c40 con 0x7f2a600c6f10 2024-03-23T06:22:06.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5cc00640 1 -- 172.21.15.73:0/2722017394 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a50037dc0 con 0x7f2a600c6f10 2024-03-23T06:22:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a5cc00640 1 -- 172.21.15.73:0/2722017394 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50041640 con 0x7f2a600c6f10 2024-03-23T06:22:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a601ed140 con 0x7f2a600c6f10 2024-03-23T06:22:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.816+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a60150470 con 0x7f2a600c6f10 2024-03-23T06:22:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.818+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6004e110 con 0x7f2a600c6f10 2024-03-23T06:22:06.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.818+0000 7f2a5cc00640 1 -- 172.21.15.73:0/2722017394 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2a500417a0 con 0x7f2a600c6f10 2024-03-23T06:22:06.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.819+0000 7f2a5cc00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2a3c06ac00 0x7f2a3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:06.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.820+0000 7f2a5cc00640 1 -- 172.21.15.73:0/2722017394 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f2a5003c070 con 0x7f2a600c6f10 2024-03-23T06:22:06.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.820+0000 7f2a57400640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2a3c06ac00 0x7f2a3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:06.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.820+0000 7f2a57400640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2a3c06ac00 0x7f2a3c06d0c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a60146b90 tx=0x7f2a48009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:06.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:06.823+0000 7f2a5cc00640 1 -- 172.21.15.73:0/2722017394 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2a500772c0 con 0x7f2a600c6f10 2024-03-23T06:22:07.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.017+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a601ecfc0 con 0x7f2a3c06ac00 2024-03-23T06:22:07.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.027+0000 7f2a5cc00640 1 -- 172.21.15.73:0/2722017394 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370429 (secure 0 0 0) 0x7f2a48011a30 con 0x7f2a3c06ac00 2024-03-23T06:22:07.033 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:07.035 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:22:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.032+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2a3c06ac00 msgr2=0x7f2a3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2a3c06ac00 0x7f2a3c06d0c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2a60146b90 tx=0x7f2a48009190 comp rx=0 tx=0).stop 2024-03-23T06:22:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a600c6f10 msgr2=0x7f2a60144f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a600c6f10 0x7f2a60144f60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a5002ba70 tx=0x7f2a50004730 comp rx=0 tx=0).stop 2024-03-23T06:22:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 shutdown_connections 2024-03-23T06:22:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f2a3c06ac00 0x7f2a3c06d0c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a60151230 0x7f2a6013d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a600cb520 0x7f2a60149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 --2- 172.21.15.73:0/2722017394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a600c6f10 0x7f2a60144f60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 >> 172.21.15.73:0/2722017394 conn(0x7f2a600cba10 msgr2=0x7f2a600c2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:07.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 shutdown_connections 2024-03-23T06:22:07.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.033+0000 7f2a66c00640 1 -- 172.21.15.73:0/2722017394 wait complete. 2024-03-23T06:22:07.053 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2024-03-23T06:22:06.821787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402009,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469595,"num_write_kb":34184413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170823,"ondisk_log_size":170823,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10077296,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9900211,"kb_avail":744897424,"statfs":{"total":773094113280,"available":762774962176,"internally_reserved":0,"allocated":181256192,"data_stored":179740522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10137816632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002547"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:20.806395+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:20:20.806395+0000","last_peered":"2024-03-23T06:20:20.806395+0000","last_clean":"2024-03-23T06:20:20.806395+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:20:20.806395+0000","last_undegraded":"2024-03-23T06:20:20.806395+0000","last_fullsized":"2024-03-23T06:20:20.806395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.131862+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:21:28.131862+0000","last_peered":"2024-03-23T06:21:28.131862+0000","last_clean":"2024-03-23T06:21:28.131862+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:21:28.131862+0000","last_undegraded":"2024-03-23T06:21:28.131862+0000","last_fullsized":"2024-03-23T06:21:28.131862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4667,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.014941+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:21:28.014941+0000","last_peered":"2024-03-23T06:21:28.014941+0000","last_clean":"2024-03-23T06:21:28.014941+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:21:28.014941+0000","last_undegraded":"2024-03-23T06:21:28.014941+0000","last_fullsized":"2024-03-23T06:21:28.014941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'12","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.027749+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:21:28.027749+0000","last_peered":"2024-03-23T06:21:28.027749+0000","last_clean":"2024-03-23T06:21:28.027749+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:21:28.027749+0000","last_undegraded":"2024-03-23T06:21:28.027749+0000","last_fullsized":"2024-03-23T06:21:28.027749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.058640+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:21:28.058640+0000","last_peered":"2024-03-23T06:21:28.058640+0000","last_clean":"2024-03-23T06:21:28.058640+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:21:28.058640+0000","last_undegraded":"2024-03-23T06:21:28.058640+0000","last_fullsized":"2024-03-23T06:21:28.058640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.860271+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:21:27.860271+0000","last_peered":"2024-03-23T06:21:27.860271+0000","last_clean":"2024-03-23T06:21:27.860271+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:21:27.860271+0000","last_undegraded":"2024-03-23T06:21:27.860271+0000","last_fullsized":"2024-03-23T06:21:27.860271+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:13.535723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'160","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.998561+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:21:27.998561+0000","last_peered":"2024-03-23T06:21:27.998561+0000","last_clean":"2024-03-23T06:21:27.998561+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:21:27.998561+0000","last_undegraded":"2024-03-23T06:21:27.998561+0000","last_fullsized":"2024-03-23T06:21:27.998561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'12","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:21.569214+0000","last_change":"2024-03-23T06:10:39.674095+0000","last_active":"2024-03-23T06:21:21.569214+0000","last_peered":"2024-03-23T06:21:21.569214+0000","last_clean":"2024-03-23T06:21:21.569214+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:21:21.569214+0000","last_undegraded":"2024-03-23T06:21:21.569214+0000","last_fullsized":"2024-03-23T06:21:21.569214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:13:50.485767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.115530+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:21:28.115530+0000","last_peered":"2024-03-23T06:21:28.115530+0000","last_clean":"2024-03-23T06:21:28.115530+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:21:28.115530+0000","last_undegraded":"2024-03-23T06:21:28.115530+0000","last_fullsized":"2024-03-23T06:21:28.115530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:03.833941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'21","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:58.144198+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:19:58.144198+0000","last_peered":"2024-03-23T06:19:58.144198+0000","last_clean":"2024-03-23T06:19:58.144198+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:19:58.144198+0000","last_undegraded":"2024-03-23T06:19:58.144198+0000","last_fullsized":"2024-03-23T06:19:58.144198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.113132+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:21:28.113132+0000","last_peered":"2024-03-23T06:21:28.113132+0000","last_clean":"2024-03-23T06:21:28.113132+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:21:28.113132+0000","last_undegraded":"2024-03-23T06:21:28.113132+0000","last_fullsized":"2024-03-23T06:21:28.113132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.096714+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:21:28.096714+0000","last_peered":"2024-03-23T06:21:28.096714+0000","last_clean":"2024-03-23T06:21:28.096714+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:21:28.096714+0000","last_undegraded":"2024-03-23T06:21:28.096714+0000","last_fullsized":"2024-03-23T06:21:28.096714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:30:49.907121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:09.321326+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:21:09.321326+0000","last_peered":"2024-03-23T06:21:09.321326+0000","last_clean":"2024-03-23T06:21:09.321326+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:21:09.321326+0000","last_undegraded":"2024-03-23T06:21:09.321326+0000","last_fullsized":"2024-03-23T06:21:09.321326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'397","reported_seq":419,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.108327+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:21:28.108327+0000","last_peered":"2024-03-23T06:21:28.108327+0000","last_clean":"2024-03-23T06:21:28.108327+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:21:28.108327+0000","last_undegraded":"2024-03-23T06:21:28.108327+0000","last_fullsized":"2024-03-23T06:21:28.108327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.115760+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:21:28.115760+0000","last_peered":"2024-03-23T06:21:28.115760+0000","last_clean":"2024-03-23T06:21:28.115760+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:21:28.115760+0000","last_undegraded":"2024-03-23T06:21:28.115760+0000","last_fullsized":"2024-03-23T06:21:28.115760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.142792+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:21:28.142792+0000","last_peered":"2024-03-23T06:21:28.142792+0000","last_clean":"2024-03-23T06:21:28.142792+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:21:28.142792+0000","last_undegraded":"2024-03-23T06:21:28.142792+0000","last_fullsized":"2024-03-23T06:21:28.142792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'7","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.027833+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:21:28.027833+0000","last_peered":"2024-03-23T06:21:28.027833+0000","last_clean":"2024-03-23T06:21:28.027833+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:21:28.027833+0000","last_undegraded":"2024-03-23T06:21:28.027833+0000","last_fullsized":"2024-03-23T06:21:28.027833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.118953+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:21:28.118953+0000","last_peered":"2024-03-23T06:21:28.118953+0000","last_clean":"2024-03-23T06:21:28.118953+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:21:28.118953+0000","last_undegraded":"2024-03-23T06:21:28.118953+0000","last_fullsized":"2024-03-23T06:21:28.118953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'19","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.074649+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:22:05.074649+0000","last_peered":"2024-03-23T06:22:05.074649+0000","last_clean":"2024-03-23T06:22:05.074649+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:22:05.074649+0000","last_undegraded":"2024-03-23T06:22:05.074649+0000","last_fullsized":"2024-03-23T06:22:05.074649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.043901+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:21:28.043901+0000","last_peered":"2024-03-23T06:21:28.043901+0000","last_clean":"2024-03-23T06:21:28.043901+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:21:28.043901+0000","last_undegraded":"2024-03-23T06:21:28.043901+0000","last_fullsized":"2024-03-23T06:21:28.043901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6036,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.971677+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:21:27.971677+0000","last_peered":"2024-03-23T06:21:27.971677+0000","last_clean":"2024-03-23T06:21:27.971677+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:21:27.971677+0000","last_undegraded":"2024-03-23T06:21:27.971677+0000","last_fullsized":"2024-03-23T06:21:27.971677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.051865+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:21:28.051865+0000","last_peered":"2024-03-23T06:21:28.051865+0000","last_clean":"2024-03-23T06:21:28.051865+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:21:28.051865+0000","last_undegraded":"2024-03-23T06:21:28.051865+0000","last_fullsized":"2024-03-23T06:21:28.051865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.994466+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:21:27.994466+0000","last_peered":"2024-03-23T06:21:27.994466+0000","last_clean":"2024-03-23T06:21:27.994466+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:21:27.994466+0000","last_undegraded":"2024-03-23T06:21:27.994466+0000","last_fullsized":"2024-03-23T06:21:27.994466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159465+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:21:28.159465+0000","last_peered":"2024-03-23T06:21:28.159465+0000","last_clean":"2024-03-23T06:21:28.159465+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:21:28.159465+0000","last_undegraded":"2024-03-23T06:21:28.159465+0000","last_fullsized":"2024-03-23T06:21:28.159465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:45:26.587738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.073325+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:22:05.073325+0000","last_peered":"2024-03-23T06:22:05.073325+0000","last_clean":"2024-03-23T06:22:05.073325+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:22:05.073325+0000","last_undegraded":"2024-03-23T06:22:05.073325+0000","last_fullsized":"2024-03-23T06:22:05.073325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.096336+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:21:28.096336+0000","last_peered":"2024-03-23T06:21:28.096336+0000","last_clean":"2024-03-23T06:21:28.096336+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:21:28.096336+0000","last_undegraded":"2024-03-23T06:21:28.096336+0000","last_fullsized":"2024-03-23T06:21:28.096336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.105191+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:21:28.105191+0000","last_peered":"2024-03-23T06:21:28.105191+0000","last_clean":"2024-03-23T06:21:28.105191+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:21:28.105191+0000","last_undegraded":"2024-03-23T06:21:28.105191+0000","last_fullsized":"2024-03-23T06:21:28.105191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:36.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'17","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.077716+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:22:05.077716+0000","last_peered":"2024-03-23T06:22:05.077716+0000","last_clean":"2024-03-23T06:22:05.077716+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:22:05.077716+0000","last_undegraded":"2024-03-23T06:22:05.077716+0000","last_fullsized":"2024-03-23T06:22:05.077716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'97","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:13.919544+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:21:13.919544+0000","last_peered":"2024-03-23T06:21:13.919544+0000","last_clean":"2024-03-23T06:21:13.919544+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:21:13.919544+0000","last_undegraded":"2024-03-23T06:21:13.919544+0000","last_fullsized":"2024-03-23T06:21:13.919544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":194,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4675,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.211457+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:21:28.211457+0000","last_peered":"2024-03-23T06:21:28.211457+0000","last_clean":"2024-03-23T06:21:28.211457+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:21:28.211457+0000","last_undegraded":"2024-03-23T06:21:28.211457+0000","last_fullsized":"2024-03-23T06:21:28.211457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.068530+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:22:05.068530+0000","last_peered":"2024-03-23T06:22:05.068530+0000","last_clean":"2024-03-23T06:22:05.068530+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:22:05.068530+0000","last_undegraded":"2024-03-23T06:22:05.068530+0000","last_fullsized":"2024-03-23T06:22:05.068530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.014027+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:21:28.014027+0000","last_peered":"2024-03-23T06:21:28.014027+0000","last_clean":"2024-03-23T06:21:28.014027+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:21:28.014027+0000","last_undegraded":"2024-03-23T06:21:28.014027+0000","last_fullsized":"2024-03-23T06:21:28.014027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159961+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:21:28.159961+0000","last_peered":"2024-03-23T06:21:28.159961+0000","last_clean":"2024-03-23T06:21:28.159961+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:21:28.159961+0000","last_undegraded":"2024-03-23T06:21:28.159961+0000","last_fullsized":"2024-03-23T06:21:28.159961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.077011+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:22:05.077011+0000","last_peered":"2024-03-23T06:22:05.077011+0000","last_clean":"2024-03-23T06:22:05.077011+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:22:05.077011+0000","last_undegraded":"2024-03-23T06:22:05.077011+0000","last_fullsized":"2024-03-23T06:22:05.077011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:40:37.285911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:29.338317+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:20:29.338317+0000","last_peered":"2024-03-23T06:20:29.338317+0000","last_clean":"2024-03-23T06:20:29.338317+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:20:29.338317+0000","last_undegraded":"2024-03-23T06:20:29.338317+0000","last_fullsized":"2024-03-23T06:20:29.338317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4625,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.124327+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:21:28.124327+0000","last_peered":"2024-03-23T06:21:28.124327+0000","last_clean":"2024-03-23T06:21:28.124327+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:21:28.124327+0000","last_undegraded":"2024-03-23T06:21:28.124327+0000","last_fullsized":"2024-03-23T06:21:28.124327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159654+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:21:28.159654+0000","last_peered":"2024-03-23T06:21:28.159654+0000","last_clean":"2024-03-23T06:21:28.159654+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:21:28.159654+0000","last_undegraded":"2024-03-23T06:21:28.159654+0000","last_fullsized":"2024-03-23T06:21:28.159654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'26","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.964155+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:21:27.964155+0000","last_peered":"2024-03-23T06:21:27.964155+0000","last_clean":"2024-03-23T06:21:27.964155+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:21:27.964155+0000","last_undegraded":"2024-03-23T06:21:27.964155+0000","last_fullsized":"2024-03-23T06:21:27.964155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.999073+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:21:27.999073+0000","last_peered":"2024-03-23T06:21:27.999073+0000","last_clean":"2024-03-23T06:21:27.999073+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:21:27.999073+0000","last_undegraded":"2024-03-23T06:21:27.999073+0000","last_fullsized":"2024-03-23T06:21:27.999073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.203657+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:21:28.203657+0000","last_peered":"2024-03-23T06:21:28.203657+0000","last_clean":"2024-03-23T06:21:28.203657+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:21:28.203657+0000","last_undegraded":"2024-03-23T06:21:28.203657+0000","last_fullsized":"2024-03-23T06:21:28.203657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'39","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:12.480714+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:21:12.480714+0000","last_peered":"2024-03-23T06:21:12.480714+0000","last_clean":"2024-03-23T06:21:12.480714+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:21:12.480714+0000","last_undegraded":"2024-03-23T06:21:12.480714+0000","last_fullsized":"2024-03-23T06:21:12.480714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":37,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.063846+0000","last_change":"2024-03-23T06:10:39.799662+0000","last_active":"2024-03-23T06:21:28.063846+0000","last_peered":"2024-03-23T06:21:28.063846+0000","last_clean":"2024-03-23T06:21:28.063846+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:21:28.063846+0000","last_undegraded":"2024-03-23T06:21:28.063846+0000","last_fullsized":"2024-03-23T06:21:28.063846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:17:27.260098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.079200+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:22:05.079200+0000","last_peered":"2024-03-23T06:22:05.079200+0000","last_clean":"2024-03-23T06:22:05.079200+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:05.079200+0000","last_undegraded":"2024-03-23T06:22:05.079200+0000","last_fullsized":"2024-03-23T06:22:05.079200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'50","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.063568+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:21:28.063568+0000","last_peered":"2024-03-23T06:21:28.063568+0000","last_clean":"2024-03-23T06:21:28.063568+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:21:28.063568+0000","last_undegraded":"2024-03-23T06:21:28.063568+0000","last_fullsized":"2024-03-23T06:21:28.063568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.197863+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:21:28.197863+0000","last_peered":"2024-03-23T06:21:28.197863+0000","last_clean":"2024-03-23T06:21:28.197863+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:21:28.197863+0000","last_undegraded":"2024-03-23T06:21:28.197863+0000","last_fullsized":"2024-03-23T06:21:28.197863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.094797+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:22:05.094797+0000","last_peered":"2024-03-23T06:22:05.094797+0000","last_clean":"2024-03-23T06:22:05.094797+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:22:05.094797+0000","last_undegraded":"2024-03-23T06:22:05.094797+0000","last_fullsized":"2024-03-23T06:22:05.094797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.005245+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:21:28.005245+0000","last_peered":"2024-03-23T06:21:28.005245+0000","last_clean":"2024-03-23T06:21:28.005245+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:21:28.005245+0000","last_undegraded":"2024-03-23T06:21:28.005245+0000","last_fullsized":"2024-03-23T06:21:28.005245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:01.486653+0000","last_change":"2024-03-23T06:09:48.252043+0000","last_active":"2024-03-23T06:20:01.486653+0000","last_peered":"2024-03-23T06:20:01.486653+0000","last_clean":"2024-03-23T06:20:01.486653+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:20:01.486653+0000","last_undegraded":"2024-03-23T06:20:01.486653+0000","last_fullsized":"2024-03-23T06:20:01.486653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:47.020335+0000","last_clean_scrub_stamp":"2024-03-23T06:09:47.020335+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:44:55.097301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.076122+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:21:28.076122+0000","last_peered":"2024-03-23T06:21:28.076122+0000","last_clean":"2024-03-23T06:21:28.076122+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:21:28.076122+0000","last_undegraded":"2024-03-23T06:21:28.076122+0000","last_fullsized":"2024-03-23T06:21:28.076122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.957984+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:21:27.957984+0000","last_peered":"2024-03-23T06:21:27.957984+0000","last_clean":"2024-03-23T06:21:27.957984+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:21:27.957984+0000","last_undegraded":"2024-03-23T06:21:27.957984+0000","last_fullsized":"2024-03-23T06:21:27.957984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.079874+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:21:28.079874+0000","last_peered":"2024-03-23T06:21:28.079874+0000","last_clean":"2024-03-23T06:21:28.079874+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:21:28.079874+0000","last_undegraded":"2024-03-23T06:21:28.079874+0000","last_fullsized":"2024-03-23T06:21:28.079874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5280,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.033340+0000","last_change":"2024-03-23T06:10:39.804956+0000","last_active":"2024-03-23T06:21:28.033340+0000","last_peered":"2024-03-23T06:21:28.033340+0000","last_clean":"2024-03-23T06:21:28.033340+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:21:28.033340+0000","last_undegraded":"2024-03-23T06:21:28.033340+0000","last_fullsized":"2024-03-23T06:21:28.033340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:15:46.873772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'11","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:20.406066+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:21:20.406066+0000","last_peered":"2024-03-23T06:21:20.406066+0000","last_clean":"2024-03-23T06:21:20.406066+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:21:20.406066+0000","last_undegraded":"2024-03-23T06:21:20.406066+0000","last_fullsized":"2024-03-23T06:21:20.406066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:19.369022+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:21:19.369022+0000","last_peered":"2024-03-23T06:21:19.369022+0000","last_clean":"2024-03-23T06:21:19.369022+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:21:19.369022+0000","last_undegraded":"2024-03-23T06:21:19.369022+0000","last_fullsized":"2024-03-23T06:21:19.369022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.219047+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:21:28.219047+0000","last_peered":"2024-03-23T06:21:28.219047+0000","last_clean":"2024-03-23T06:21:28.219047+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:21:28.219047+0000","last_undegraded":"2024-03-23T06:21:28.219047+0000","last_fullsized":"2024-03-23T06:21:28.219047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.970005+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:21:27.970005+0000","last_peered":"2024-03-23T06:21:27.970005+0000","last_clean":"2024-03-23T06:21:27.970005+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:21:27.970005+0000","last_undegraded":"2024-03-23T06:21:27.970005+0000","last_fullsized":"2024-03-23T06:21:27.970005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'23","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.052456+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:21:28.052456+0000","last_peered":"2024-03-23T06:21:28.052456+0000","last_clean":"2024-03-23T06:21:28.052456+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:21:28.052456+0000","last_undegraded":"2024-03-23T06:21:28.052456+0000","last_fullsized":"2024-03-23T06:21:28.052456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5573,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.176007+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:21:28.176007+0000","last_peered":"2024-03-23T06:21:28.176007+0000","last_clean":"2024-03-23T06:21:28.176007+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:21:28.176007+0000","last_undegraded":"2024-03-23T06:21:28.176007+0000","last_fullsized":"2024-03-23T06:21:28.176007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.093267+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:22:05.093267+0000","last_peered":"2024-03-23T06:22:05.093267+0000","last_clean":"2024-03-23T06:22:05.093267+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:22:05.093267+0000","last_undegraded":"2024-03-23T06:22:05.093267+0000","last_fullsized":"2024-03-23T06:22:05.093267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:47.521964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'50","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:18.397725+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:21:18.397725+0000","last_peered":"2024-03-23T06:21:18.397725+0000","last_clean":"2024-03-23T06:21:18.397725+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:21:18.397725+0000","last_undegraded":"2024-03-23T06:21:18.397725+0000","last_fullsized":"2024-03-23T06:21:18.397725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632534,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4585,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.134687+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:21:28.134687+0000","last_peered":"2024-03-23T06:21:28.134687+0000","last_clean":"2024-03-23T06:21:28.134687+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:21:28.134687+0000","last_undegraded":"2024-03-23T06:21:28.134687+0000","last_fullsized":"2024-03-23T06:21:28.134687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:47.365688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.172134+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:21:28.172134+0000","last_peered":"2024-03-23T06:21:28.172134+0000","last_clean":"2024-03-23T06:21:28.172134+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:21:28.172134+0000","last_undegraded":"2024-03-23T06:21:28.172134+0000","last_fullsized":"2024-03-23T06:21:28.172134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.237214+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:21:28.237214+0000","last_peered":"2024-03-23T06:21:28.237214+0000","last_clean":"2024-03-23T06:21:28.237214+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:21:28.237214+0000","last_undegraded":"2024-03-23T06:21:28.237214+0000","last_fullsized":"2024-03-23T06:21:28.237214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5959,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.199315+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:21:28.199315+0000","last_peered":"2024-03-23T06:21:28.199315+0000","last_clean":"2024-03-23T06:21:28.199315+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:21:28.199315+0000","last_undegraded":"2024-03-23T06:21:28.199315+0000","last_fullsized":"2024-03-23T06:21:28.199315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'9","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.025055+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:21:28.025055+0000","last_peered":"2024-03-23T06:21:28.025055+0000","last_clean":"2024-03-23T06:21:28.025055+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:21:28.025055+0000","last_undegraded":"2024-03-23T06:21:28.025055+0000","last_fullsized":"2024-03-23T06:21:28.025055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:20:44.474612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'9","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.042850+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:21:28.042850+0000","last_peered":"2024-03-23T06:21:28.042850+0000","last_clean":"2024-03-23T06:21:28.042850+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:21:28.042850+0000","last_undegraded":"2024-03-23T06:21:28.042850+0000","last_fullsized":"2024-03-23T06:21:28.042850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.129118+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:21:28.129118+0000","last_peered":"2024-03-23T06:21:28.129118+0000","last_clean":"2024-03-23T06:21:28.129118+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:21:28.129118+0000","last_undegraded":"2024-03-23T06:21:28.129118+0000","last_fullsized":"2024-03-23T06:21:28.129118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.113199+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:21:28.113199+0000","last_peered":"2024-03-23T06:21:28.113199+0000","last_clean":"2024-03-23T06:21:28.113199+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:21:28.113199+0000","last_undegraded":"2024-03-23T06:21:28.113199+0000","last_fullsized":"2024-03-23T06:21:28.113199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.235104+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:21:28.235104+0000","last_peered":"2024-03-23T06:21:28.235104+0000","last_clean":"2024-03-23T06:21:28.235104+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:21:28.235104+0000","last_undegraded":"2024-03-23T06:21:28.235104+0000","last_fullsized":"2024-03-23T06:21:28.235104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.233362+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:21:28.233362+0000","last_peered":"2024-03-23T06:21:28.233362+0000","last_clean":"2024-03-23T06:21:28.233362+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:21:28.233362+0000","last_undegraded":"2024-03-23T06:21:28.233362+0000","last_fullsized":"2024-03-23T06:21:28.233362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'22","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.097935+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:22:05.097935+0000","last_peered":"2024-03-23T06:22:05.097935+0000","last_clean":"2024-03-23T06:22:05.097935+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:22:05.097935+0000","last_undegraded":"2024-03-23T06:22:05.097935+0000","last_fullsized":"2024-03-23T06:22:05.097935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'40","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.141491+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:21:28.141491+0000","last_peered":"2024-03-23T06:21:28.141491+0000","last_clean":"2024-03-23T06:21:28.141491+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:21:28.141491+0000","last_undegraded":"2024-03-23T06:21:28.141491+0000","last_fullsized":"2024-03-23T06:21:28.141491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.933026+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:21:27.933026+0000","last_peered":"2024-03-23T06:21:27.933026+0000","last_clean":"2024-03-23T06:21:27.933026+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:21:27.933026+0000","last_undegraded":"2024-03-23T06:21:27.933026+0000","last_fullsized":"2024-03-23T06:21:27.933026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:37.936955+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:19:37.936955+0000","last_peered":"2024-03-23T06:19:37.936955+0000","last_clean":"2024-03-23T06:19:37.936955+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:19:37.936955+0000","last_undegraded":"2024-03-23T06:19:37.936955+0000","last_fullsized":"2024-03-23T06:19:37.936955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'231","reported_seq":253,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:45.978574+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:21:45.978574+0000","last_peered":"2024-03-23T06:21:45.978574+0000","last_clean":"2024-03-23T06:21:45.978574+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:21:45.978574+0000","last_undegraded":"2024-03-23T06:21:45.978574+0000","last_fullsized":"2024-03-23T06:21:45.978574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:52:07.092877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.232433+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:21:28.232433+0000","last_peered":"2024-03-23T06:21:28.232433+0000","last_clean":"2024-03-23T06:21:28.232433+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:21:28.232433+0000","last_undegraded":"2024-03-23T06:21:28.232433+0000","last_fullsized":"2024-03-23T06:21:28.232433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.228775+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:21:28.228775+0000","last_peered":"2024-03-23T06:21:28.228775+0000","last_clean":"2024-03-23T06:21:28.228775+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:21:28.228775+0000","last_undegraded":"2024-03-23T06:21:28.228775+0000","last_fullsized":"2024-03-23T06:21:28.228775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:29.064848+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:21:29.064848+0000","last_peered":"2024-03-23T06:21:29.064848+0000","last_clean":"2024-03-23T06:21:29.064848+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:21:29.064848+0000","last_undegraded":"2024-03-23T06:21:29.064848+0000","last_fullsized":"2024-03-23T06:21:29.064848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5717,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.124181+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:21:28.124181+0000","last_peered":"2024-03-23T06:21:28.124181+0000","last_clean":"2024-03-23T06:21:28.124181+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:21:28.124181+0000","last_undegraded":"2024-03-23T06:21:28.124181+0000","last_fullsized":"2024-03-23T06:21:28.124181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:15:01.291486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:19.434417+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:21:19.434417+0000","last_peered":"2024-03-23T06:21:19.434417+0000","last_clean":"2024-03-23T06:21:19.434417+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:21:19.434417+0000","last_undegraded":"2024-03-23T06:21:19.434417+0000","last_fullsized":"2024-03-23T06:21:19.434417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.145165+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:21:28.145165+0000","last_peered":"2024-03-23T06:21:28.145165+0000","last_clean":"2024-03-23T06:21:28.145165+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:21:28.145165+0000","last_undegraded":"2024-03-23T06:21:28.145165+0000","last_fullsized":"2024-03-23T06:21:28.145165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.212540+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:21:28.212540+0000","last_peered":"2024-03-23T06:21:28.212540+0000","last_clean":"2024-03-23T06:21:28.212540+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:21:28.212540+0000","last_undegraded":"2024-03-23T06:21:28.212540+0000","last_fullsized":"2024-03-23T06:21:28.212540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.102194+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:22:05.102194+0000","last_peered":"2024-03-23T06:22:05.102194+0000","last_clean":"2024-03-23T06:22:05.102194+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:22:05.102194+0000","last_undegraded":"2024-03-23T06:22:05.102194+0000","last_fullsized":"2024-03-23T06:22:05.102194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:52.555108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.070858+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:21:28.070858+0000","last_peered":"2024-03-23T06:21:28.070858+0000","last_clean":"2024-03-23T06:21:28.070858+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:21:28.070858+0000","last_undegraded":"2024-03-23T06:21:28.070858+0000","last_fullsized":"2024-03-23T06:21:28.070858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:15:44.036145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.172172+0000","last_change":"2024-03-23T06:10:39.801920+0000","last_active":"2024-03-23T06:21:28.172172+0000","last_peered":"2024-03-23T06:21:28.172172+0000","last_clean":"2024-03-23T06:21:28.172172+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:21:28.172172+0000","last_undegraded":"2024-03-23T06:21:28.172172+0000","last_fullsized":"2024-03-23T06:21:28.172172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:39:07.343046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4714,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.138206+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:21:28.138206+0000","last_peered":"2024-03-23T06:21:28.138206+0000","last_clean":"2024-03-23T06:21:28.138206+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:21:28.138206+0000","last_undegraded":"2024-03-23T06:21:28.138206+0000","last_fullsized":"2024-03-23T06:21:28.138206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'19","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.078584+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:22:05.078584+0000","last_peered":"2024-03-23T06:22:05.078584+0000","last_clean":"2024-03-23T06:22:05.078584+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:22:05.078584+0000","last_undegraded":"2024-03-23T06:22:05.078584+0000","last_fullsized":"2024-03-23T06:22:05.078584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'33","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:40.168784+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:19:40.168784+0000","last_peered":"2024-03-23T06:19:40.168784+0000","last_clean":"2024-03-23T06:19:40.168784+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:19:40.168784+0000","last_undegraded":"2024-03-23T06:19:40.168784+0000","last_fullsized":"2024-03-23T06:19:40.168784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159725+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:21:28.159725+0000","last_peered":"2024-03-23T06:21:28.159725+0000","last_clean":"2024-03-23T06:21:28.159725+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:21:28.159725+0000","last_undegraded":"2024-03-23T06:21:28.159725+0000","last_fullsized":"2024-03-23T06:21:28.159725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.797643+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:21:27.797643+0000","last_peered":"2024-03-23T06:21:27.797643+0000","last_clean":"2024-03-23T06:21:27.797643+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:21:27.797643+0000","last_undegraded":"2024-03-23T06:21:27.797643+0000","last_fullsized":"2024-03-23T06:21:27.797643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.140714+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:21:28.140714+0000","last_peered":"2024-03-23T06:21:28.140714+0000","last_clean":"2024-03-23T06:21:28.140714+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:21:28.140714+0000","last_undegraded":"2024-03-23T06:21:28.140714+0000","last_fullsized":"2024-03-23T06:21:28.140714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:55.674981+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:19:55.674981+0000","last_peered":"2024-03-23T06:19:55.674981+0000","last_clean":"2024-03-23T06:19:55.674981+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:19:55.674981+0000","last_undegraded":"2024-03-23T06:19:55.674981+0000","last_fullsized":"2024-03-23T06:19:55.674981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.092445+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:22:05.092445+0000","last_peered":"2024-03-23T06:22:05.092445+0000","last_clean":"2024-03-23T06:22:05.092445+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:22:05.092445+0000","last_undegraded":"2024-03-23T06:22:05.092445+0000","last_fullsized":"2024-03-23T06:22:05.092445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.921034+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:21:27.921034+0000","last_peered":"2024-03-23T06:21:27.921034+0000","last_clean":"2024-03-23T06:21:27.921034+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:21:27.921034+0000","last_undegraded":"2024-03-23T06:21:27.921034+0000","last_fullsized":"2024-03-23T06:21:27.921034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'984","reported_seq":1004,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.142592+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:21:28.142592+0000","last_peered":"2024-03-23T06:21:28.142592+0000","last_clean":"2024-03-23T06:21:28.142592+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:21:28.142592+0000","last_undegraded":"2024-03-23T06:21:28.142592+0000","last_fullsized":"2024-03-23T06:21:28.142592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":984,"log_dups_size":0,"ondisk_log_size":984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195132,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":977,"num_write_kb":4979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'15","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.087887+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:21:28.087887+0000","last_peered":"2024-03-23T06:21:28.087887+0000","last_clean":"2024-03-23T06:21:28.087887+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:21:28.087887+0000","last_undegraded":"2024-03-23T06:21:28.087887+0000","last_fullsized":"2024-03-23T06:21:28.087887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:33:45.002768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.145556+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:21:28.145556+0000","last_peered":"2024-03-23T06:21:28.145556+0000","last_clean":"2024-03-23T06:21:28.145556+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:21:28.145556+0000","last_undegraded":"2024-03-23T06:21:28.145556+0000","last_fullsized":"2024-03-23T06:21:28.145556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'23","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.084119+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:22:05.084119+0000","last_peered":"2024-03-23T06:22:05.084119+0000","last_clean":"2024-03-23T06:22:05.084119+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:22:05.084119+0000","last_undegraded":"2024-03-23T06:22:05.084119+0000","last_fullsized":"2024-03-23T06:22:05.084119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:45:53.837508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'17","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.929863+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:21:27.929863+0000","last_peered":"2024-03-23T06:21:27.929863+0000","last_clean":"2024-03-23T06:21:27.929863+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:21:27.929863+0000","last_undegraded":"2024-03-23T06:21:27.929863+0000","last_fullsized":"2024-03-23T06:21:27.929863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.118351+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:21:28.118351+0000","last_peered":"2024-03-23T06:21:28.118351+0000","last_clean":"2024-03-23T06:21:28.118351+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:21:28.118351+0000","last_undegraded":"2024-03-23T06:21:28.118351+0000","last_fullsized":"2024-03-23T06:21:28.118351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.915401+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:21:27.915401+0000","last_peered":"2024-03-23T06:21:27.915401+0000","last_clean":"2024-03-23T06:21:27.915401+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:21:27.915401+0000","last_undegraded":"2024-03-23T06:21:27.915401+0000","last_fullsized":"2024-03-23T06:21:27.915401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.092060+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:22:05.092060+0000","last_peered":"2024-03-23T06:22:05.092060+0000","last_clean":"2024-03-23T06:22:05.092060+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:22:05.092060+0000","last_undegraded":"2024-03-23T06:22:05.092060+0000","last_fullsized":"2024-03-23T06:22:05.092060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.067695+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:22:05.067695+0000","last_peered":"2024-03-23T06:22:05.067695+0000","last_clean":"2024-03-23T06:22:05.067695+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:22:05.067695+0000","last_undegraded":"2024-03-23T06:22:05.067695+0000","last_fullsized":"2024-03-23T06:22:05.067695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.103977+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:22:05.103977+0000","last_peered":"2024-03-23T06:22:05.103977+0000","last_clean":"2024-03-23T06:22:05.103977+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:22:05.103977+0000","last_undegraded":"2024-03-23T06:22:05.103977+0000","last_fullsized":"2024-03-23T06:22:05.103977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.997857+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:21:27.997857+0000","last_peered":"2024-03-23T06:21:27.997857+0000","last_clean":"2024-03-23T06:21:27.997857+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:21:27.997857+0000","last_undegraded":"2024-03-23T06:21:27.997857+0000","last_fullsized":"2024-03-23T06:21:27.997857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.051804+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:21:28.051804+0000","last_peered":"2024-03-23T06:21:28.051804+0000","last_clean":"2024-03-23T06:21:28.051804+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:21:28.051804+0000","last_undegraded":"2024-03-23T06:21:28.051804+0000","last_fullsized":"2024-03-23T06:21:28.051804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.131592+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:21:28.131592+0000","last_peered":"2024-03-23T06:21:28.131592+0000","last_clean":"2024-03-23T06:21:28.131592+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:21:28.131592+0000","last_undegraded":"2024-03-23T06:21:28.131592+0000","last_fullsized":"2024-03-23T06:21:28.131592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'15","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.022798+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:21:28.022798+0000","last_peered":"2024-03-23T06:21:28.022798+0000","last_clean":"2024-03-23T06:21:28.022798+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:21:28.022798+0000","last_undegraded":"2024-03-23T06:21:28.022798+0000","last_fullsized":"2024-03-23T06:21:28.022798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:34.714217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'27","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.095011+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:22:05.095011+0000","last_peered":"2024-03-23T06:22:05.095011+0000","last_clean":"2024-03-23T06:22:05.095011+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:22:05.095011+0000","last_undegraded":"2024-03-23T06:22:05.095011+0000","last_fullsized":"2024-03-23T06:22:05.095011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'12","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.943172+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:21:27.943172+0000","last_peered":"2024-03-23T06:21:27.943172+0000","last_clean":"2024-03-23T06:21:27.943172+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:21:27.943172+0000","last_undegraded":"2024-03-23T06:21:27.943172+0000","last_fullsized":"2024-03-23T06:21:27.943172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.871940+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:21:27.871940+0000","last_peered":"2024-03-23T06:21:27.871940+0000","last_clean":"2024-03-23T06:21:27.871940+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:21:27.871940+0000","last_undegraded":"2024-03-23T06:21:27.871940+0000","last_fullsized":"2024-03-23T06:21:27.871940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'21","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.217843+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:21:28.217843+0000","last_peered":"2024-03-23T06:21:28.217843+0000","last_clean":"2024-03-23T06:21:28.217843+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:21:28.217843+0000","last_undegraded":"2024-03-23T06:21:28.217843+0000","last_fullsized":"2024-03-23T06:21:28.217843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.868807+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:21:27.868807+0000","last_peered":"2024-03-23T06:21:27.868807+0000","last_clean":"2024-03-23T06:21:27.868807+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:21:27.868807+0000","last_undegraded":"2024-03-23T06:21:27.868807+0000","last_fullsized":"2024-03-23T06:21:27.868807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.203325+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:21:28.203325+0000","last_peered":"2024-03-23T06:21:28.203325+0000","last_clean":"2024-03-23T06:21:28.203325+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:21:28.203325+0000","last_undegraded":"2024-03-23T06:21:28.203325+0000","last_fullsized":"2024-03-23T06:21:28.203325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.154446+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:21:28.154446+0000","last_peered":"2024-03-23T06:21:28.154446+0000","last_clean":"2024-03-23T06:21:28.154446+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:21:28.154446+0000","last_undegraded":"2024-03-23T06:21:28.154446+0000","last_fullsized":"2024-03-23T06:21:28.154446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'22","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.069453+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:22:05.069453+0000","last_peered":"2024-03-23T06:22:05.069453+0000","last_clean":"2024-03-23T06:22:05.069453+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:22:05.069453+0000","last_undegraded":"2024-03-23T06:22:05.069453+0000","last_fullsized":"2024-03-23T06:22:05.069453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.089355+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:22:05.089355+0000","last_peered":"2024-03-23T06:22:05.089355+0000","last_clean":"2024-03-23T06:22:05.089355+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:22:05.089355+0000","last_undegraded":"2024-03-23T06:22:05.089355+0000","last_fullsized":"2024-03-23T06:22:05.089355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'11","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.865254+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:21:27.865254+0000","last_peered":"2024-03-23T06:21:27.865254+0000","last_clean":"2024-03-23T06:21:27.865254+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:21:27.865254+0000","last_undegraded":"2024-03-23T06:21:27.865254+0000","last_fullsized":"2024-03-23T06:21:27.865254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'12","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:18.799985+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:21:18.799985+0000","last_peered":"2024-03-23T06:21:18.799985+0000","last_clean":"2024-03-23T06:21:18.799985+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:21:18.799985+0000","last_undegraded":"2024-03-23T06:21:18.799985+0000","last_fullsized":"2024-03-23T06:21:18.799985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'22","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.180520+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:21:28.180520+0000","last_peered":"2024-03-23T06:21:28.180520+0000","last_clean":"2024-03-23T06:21:28.180520+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:21:28.180520+0000","last_undegraded":"2024-03-23T06:21:28.180520+0000","last_fullsized":"2024-03-23T06:21:28.180520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.927474+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:21:27.927474+0000","last_peered":"2024-03-23T06:21:27.927474+0000","last_clean":"2024-03-23T06:21:27.927474+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:21:27.927474+0000","last_undegraded":"2024-03-23T06:21:27.927474+0000","last_fullsized":"2024-03-23T06:21:27.927474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:14.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.814576+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:21:27.814576+0000","last_peered":"2024-03-23T06:21:27.814576+0000","last_clean":"2024-03-23T06:21:27.814576+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:21:27.814576+0000","last_undegraded":"2024-03-23T06:21:27.814576+0000","last_fullsized":"2024-03-23T06:21:27.814576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'10","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.885343+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:21:27.885343+0000","last_peered":"2024-03-23T06:21:27.885343+0000","last_clean":"2024-03-23T06:21:27.885343+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:21:27.885343+0000","last_undegraded":"2024-03-23T06:21:27.885343+0000","last_fullsized":"2024-03-23T06:21:27.885343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.090491+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:22:05.090491+0000","last_peered":"2024-03-23T06:22:05.090491+0000","last_clean":"2024-03-23T06:22:05.090491+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:22:05.090491+0000","last_undegraded":"2024-03-23T06:22:05.090491+0000","last_fullsized":"2024-03-23T06:22:05.090491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:00:48.308983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.105362+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:21:28.105362+0000","last_peered":"2024-03-23T06:21:28.105362+0000","last_clean":"2024-03-23T06:21:28.105362+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:21:28.105362+0000","last_undegraded":"2024-03-23T06:21:28.105362+0000","last_fullsized":"2024-03-23T06:21:28.105362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.920662+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:21:27.920662+0000","last_peered":"2024-03-23T06:21:27.920662+0000","last_clean":"2024-03-23T06:21:27.920662+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:21:27.920662+0000","last_undegraded":"2024-03-23T06:21:27.920662+0000","last_fullsized":"2024-03-23T06:21:27.920662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:23:47.353024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.919523+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:21:27.919523+0000","last_peered":"2024-03-23T06:21:27.919523+0000","last_clean":"2024-03-23T06:21:27.919523+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:21:27.919523+0000","last_undegraded":"2024-03-23T06:21:27.919523+0000","last_fullsized":"2024-03-23T06:21:27.919523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'6","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:17.254550+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:21:17.254550+0000","last_peered":"2024-03-23T06:21:17.254550+0000","last_clean":"2024-03-23T06:21:17.254550+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:21:17.254550+0000","last_undegraded":"2024-03-23T06:21:17.254550+0000","last_fullsized":"2024-03-23T06:21:17.254550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.017597+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:21:28.017597+0000","last_peered":"2024-03-23T06:21:28.017597+0000","last_clean":"2024-03-23T06:21:28.017597+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:21:28.017597+0000","last_undegraded":"2024-03-23T06:21:28.017597+0000","last_fullsized":"2024-03-23T06:21:28.017597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":917,"ondisk_log_size":917,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88811641,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2350,"num_write_kb":88564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177623423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2349,"ondisk_log_size":2349,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1363056,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1325886,"kb_avail":93008784,"statfs":{"total":96636764160,"available":95240994816,"internally_reserved":0,"allocated":38051840,"data_stored":37867231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1357707720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.8239999999999998,"5min":7.4420000000000002,"15min":4.649},"min":{"1min":0.32700000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":16.913,"5min":170.84299999999999,"15min":309.57499999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":2.3100000000000001,"5min":7.2069999999999999,"15min":4.5540000000000003},"min":{"1min":0.38600000000000001,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":11.553000000000001,"5min":178.934,"15min":300.98500000000001},"last":0.75}]},{"osd":1,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":10.808,"15min":5.3719999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.82,"5min":359.48599999999999,"15min":359.48599999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":9.3800000000000008,"15min":5.0759999999999996},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.6440000000000001,"5min":359.20299999999997,"15min":359.20299999999997},"last":1.3}]},{"osd":2,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":3.8599999999999999,"5min":8.2759999999999998,"15min":4.4409999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":29.532,"5min":56.805999999999997,"15min":58.277000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":3.2959999999999998,"5min":9.9809999999999999,"15min":5.1310000000000002},"min":{"1min":0.57399999999999995,"5min":0.52100000000000002,"15min":0.32900000000000001},"max":{"1min":17.776,"5min":89.454999999999998,"15min":119.176},"last":1.21}]},{"osd":4,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":6.4829999999999997,"15min":3.1899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":20.178999999999998,"5min":36.270000000000003,"15min":36.270000000000003},"last":0.95799999999999996},{"interface":"front","average":{"1min":2.8889999999999998,"5min":6.9240000000000004,"15min":3.8929999999999998},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.32800000000000001},"max":{"1min":21.093,"5min":38.718000000000004,"15min":64.325000000000003},"last":1.1499999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":1.867,"5min":6.7060000000000004,"15min":3.8039999999999998},"min":{"1min":0.46100000000000002,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":9.423,"5min":38.759999999999998,"15min":58.317},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.9379999999999999,"5min":6.5640000000000001,"15min":3.5569999999999999},"min":{"1min":0.53300000000000003,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":9.4529999999999994,"5min":33.854999999999997,"15min":33.854999999999997},"last":1.1739999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":6.9930000000000003,"15min":3.7410000000000001},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":5.1539999999999999,"5min":31.623999999999999,"15min":31.623999999999999},"last":1.276},{"interface":"front","average":{"1min":2.2829999999999999,"5min":6.4189999999999996,"15min":3.2559999999999998},"min":{"1min":0.67100000000000004,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":9.3900000000000006,"5min":37.179000000000002,"15min":37.179000000000002},"last":1.351}]},{"osd":7,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":4.0960000000000001,"5min":7.9029999999999996,"15min":4.218},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.388000000000002,"5min":38.621000000000002,"15min":58.344000000000001},"last":1.2330000000000001},{"interface":"front","average":{"1min":3.4430000000000001,"5min":7.4119999999999999,"15min":3.6880000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":19.349,"5min":38.680999999999997,"15min":38.680999999999997},"last":1.323}]}]},{"osd":2,"up_from":14,"seq":60129542291,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.2490000000000001,"5min":5.1079999999999997,"15min":3.8050000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":23.753,"5min":49.142000000000003,"15min":126.152},"last":0.65800000000000003},{"interface":"front","average":{"1min":2.7669999999999999,"5min":4.7169999999999996,"15min":3.2450000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":23.312000000000001,"5min":29.206,"15min":143.14099999999999},"last":0.82599999999999996}]},{"osd":1,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.379,"5min":6.9400000000000004,"15min":4.3390000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":23.280000000000001,"5min":55.564999999999998,"15min":55.564999999999998},"last":0.93100000000000005},{"interface":"front","average":{"1min":4.1859999999999999,"5min":7.2030000000000003,"15min":3.8119999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.31900000000000001},"max":{"1min":18.187999999999999,"5min":55.354999999999997,"15min":55.354999999999997},"last":0.68100000000000005}]},{"osd":3,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":5.2240000000000002,"5min":17.103000000000002,"15min":7.4960000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.27600000000000002},"max":{"1min":38.366,"5min":529.81799999999998,"15min":529.81799999999998},"last":0.755},{"interface":"front","average":{"1min":4.6539999999999999,"5min":11.901,"15min":5.7839999999999998},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":14.378,"5min":528.94200000000001,"15min":528.94200000000001},"last":1.3220000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":6.7610000000000001,"5min":6.6779999999999999,"15min":3.431},"min":{"1min":0.37,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":31.062999999999999,"5min":49.430999999999997,"15min":49.430999999999997},"last":1.125},{"interface":"front","average":{"1min":9.0259999999999998,"5min":7.7889999999999997,"15min":4.5250000000000004},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.312},"max":{"1min":44.173000000000002,"5min":60.298000000000002,"15min":83.525999999999996},"last":0.97999999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":5.1829999999999998,"5min":6.0490000000000004,"15min":3.9649999999999999},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":35.433999999999997,"5min":35.433999999999997,"15min":82.456000000000003},"last":1.0209999999999999},{"interface":"front","average":{"1min":4.9980000000000002,"5min":6.1539999999999999,"15min":3.7599999999999998},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.35199999999999998},"max":{"1min":35.472999999999999,"5min":35.472999999999999,"15min":82.971000000000004},"last":1.1839999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.2559999999999998,"5min":6.1280000000000001,"15min":3.6469999999999998},"min":{"1min":0.39700000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":13.169,"5min":57.420999999999999,"15min":83.007999999999996},"last":1.2290000000000001},{"interface":"front","average":{"1min":4.0679999999999996,"5min":6.6769999999999996,"15min":3.629},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.914,"5min":49.768000000000001,"15min":49.768000000000001},"last":1.419}]},{"osd":7,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":6.5250000000000004,"5min":6.6390000000000002,"15min":4.2789999999999999},"min":{"1min":0.51400000000000001,"5min":0.44900000000000001,"15min":0.35099999999999998},"max":{"1min":23.207000000000001,"5min":43.113,"15min":77.353999999999999},"last":1.266},{"interface":"front","average":{"1min":6.1520000000000001,"5min":8.2750000000000004,"15min":4.2640000000000002},"min":{"1min":0.56200000000000006,"5min":0.38,"15min":0.38},"max":{"1min":28.085000000000001,"5min":83.406999999999996,"15min":83.406999999999996},"last":0.91000000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542292,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":2.5049999999999999,"5min":4.8719999999999999,"15min":2.8279999999999998},"min":{"1min":0.47799999999999998,"5min":0.25700000000000001,"15min":0.221},"max":{"1min":7.2119999999999997,"5min":70.713999999999999,"15min":70.713999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":4.1239999999999997,"5min":4.6050000000000004,"15min":2.6930000000000001},"min":{"1min":0.63100000000000001,"5min":0.247,"15min":0.247},"max":{"1min":12.242000000000001,"5min":30.41,"15min":30.41},"last":0.67000000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":6.0860000000000003,"5min":9.5790000000000006,"15min":4.5869999999999997},"min":{"1min":0.70599999999999996,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":21.725000000000001,"5min":127.342,"15min":127.342},"last":1.2929999999999999},{"interface":"front","average":{"1min":4.0099999999999998,"5min":7.335,"15min":4.2549999999999999},"min":{"1min":0.38800000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":11.699,"5min":107.748,"15min":107.748},"last":1.3500000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":4.8289999999999997,"5min":7.2889999999999997,"15min":4.024},"min":{"1min":0.46600000000000003,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":19.071999999999999,"5min":31.780000000000001,"15min":31.780000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":2.96,"5min":5.6040000000000001,"15min":4.0010000000000003},"min":{"1min":0.502,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.183999999999999,"5min":31.821999999999999,"15min":175.29300000000001},"last":1.222}]},{"osd":4,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":5.0380000000000003,"15min":3.1440000000000001},"min":{"1min":0.58399999999999996,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":10.223000000000001,"5min":32.368000000000002,"15min":78.060000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":3.1909999999999998,"5min":5.5030000000000001,"15min":3.1379999999999999},"min":{"1min":0.65100000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":10.254,"5min":38.856000000000002,"15min":80.959999999999994},"last":1.0169999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":3.161,"5min":5.4320000000000004,"15min":3.2639999999999998},"min":{"1min":0.37,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":13.395,"5min":70.670000000000002,"15min":70.670000000000002},"last":1.069},{"interface":"front","average":{"1min":4.3719999999999999,"5min":4.609,"15min":2.6960000000000002},"min":{"1min":0.622,"5min":0.42799999999999999,"15min":0.41999999999999998},"max":{"1min":26.341000000000001,"5min":30.431000000000001,"15min":30.431000000000001},"last":1.1759999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":4.1130000000000004,"5min":6.1200000000000001,"15min":3.2970000000000002},"min":{"1min":0.61899999999999999,"5min":0.375,"15min":0.375},"max":{"1min":16.693000000000001,"5min":40.606999999999999,"15min":40.606999999999999},"last":1.147},{"interface":"front","average":{"1min":4.016,"5min":6.5369999999999999,"15min":3.6099999999999999},"min":{"1min":0.74099999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":16.997,"5min":68.369,"15min":68.369},"last":1.3169999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:21:08 2024","interfaces":[{"interface":"back","average":{"1min":6.9050000000000002,"5min":6.9640000000000004,"15min":3.9790000000000001},"min":{"1min":0.84599999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":28.331,"5min":68.475999999999999,"15min":90.965999999999994},"last":1.25},{"interface":"front","average":{"1min":7.7510000000000003,"5min":7.6360000000000001,"15min":4.1120000000000001},"min":{"1min":0.89300000000000002,"5min":0.48099999999999998,"15min":0.38700000000000001},"max":{"1min":29.065000000000001,"5min":68.415000000000006,"15min":84.465000000000003},"last":1.399}]}]},{"osd":0,"up_from":14,"seq":60129542295,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":12.144,"15min":5.3419999999999996},"min":{"1min":0.439,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":9.5180000000000007,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":2.3730000000000002,"5min":5.7039999999999997,"15min":3.1099999999999999},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":11.704000000000001,"5min":76.515000000000001,"15min":76.515000000000001},"last":0.91000000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.649,"5min":6.0780000000000003,"15min":3.4350000000000001},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.33300000000000002},"max":{"1min":14.335000000000001,"5min":58.996000000000002,"15min":58.996000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":2.1549999999999998,"5min":4.9809999999999999,"15min":3.54},"min":{"1min":0.48099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.641,"5min":50.271000000000001,"15min":62.466000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":5.8799999999999999,"15min":3.5550000000000002},"min":{"1min":0.5,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":15.768000000000001,"5min":44.116999999999997,"15min":44.360999999999997},"last":0.94099999999999995},{"interface":"front","average":{"1min":3.5670000000000002,"5min":5.8019999999999996,"15min":3.4409999999999998},"min":{"1min":0.502,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":14.231999999999999,"5min":44.212000000000003,"15min":81.251000000000005},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":4.7030000000000003,"5min":6.8630000000000004,"15min":3.2450000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":37.588000000000001,"5min":72.588999999999999,"15min":72.588999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":4.3410000000000002,"5min":6.3609999999999998,"15min":3.3490000000000002},"min":{"1min":0.59199999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":34.561999999999998,"5min":69.566000000000003,"15min":69.566000000000003},"last":0.72999999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.645,"5min":6.1849999999999996,"15min":3.1709999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":22.946999999999999,"5min":72.552000000000007,"15min":72.552000000000007},"last":0.755},{"interface":"front","average":{"1min":2.2410000000000001,"5min":5.6740000000000004,"15min":3.0859999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":13.670999999999999,"5min":72.626999999999995,"15min":72.626999999999995},"last":0.86099999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":5.1310000000000002,"15min":2.9319999999999999},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":9.0310000000000006,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.79000000000000004},{"interface":"front","average":{"1min":2.0089999999999999,"5min":5.806,"15min":3.1459999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":8.9760000000000009,"5min":72.656999999999996,"15min":72.656999999999996},"last":1.145}]},{"osd":7,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":3.2799999999999998,"5min":6.7050000000000001,"15min":3.3900000000000001},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":18.199000000000002,"5min":69.662000000000006,"15min":69.662000000000006},"last":0.96999999999999997},{"interface":"front","average":{"1min":3.2189999999999999,"5min":5.2279999999999998,"15min":2.96},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.38700000000000001},"max":{"1min":18.236000000000001,"5min":69.632000000000005,"15min":69.632000000000005},"last":1.006}]}]},{"osd":7,"up_from":13,"seq":55834574997,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":4.2240000000000002,"15min":2.2869999999999999},"min":{"1min":0.26700000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":5.9240000000000004,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.441},{"interface":"front","average":{"1min":2.6960000000000002,"5min":4.2119999999999997,"15min":2.0409999999999999},"min":{"1min":0.29299999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":27.337,"5min":42.582000000000001,"15min":42.582000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":5.1710000000000003,"5min":10.372999999999999,"15min":4.2629999999999999},"min":{"1min":0.378,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":29.841000000000001,"5min":310.09300000000002,"15min":310.09300000000002},"last":0.76200000000000001},{"interface":"front","average":{"1min":5.3929999999999998,"5min":10.302,"15min":4.3140000000000001},"min":{"1min":0.36599999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":29.881,"5min":309.70999999999998,"15min":309.70999999999998},"last":0.73099999999999998}]},{"osd":2,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.0419999999999998,"5min":4.7050000000000001,"15min":2.52},"min":{"1min":0.32000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":33.079999999999998,"5min":50.680999999999997,"15min":63.014000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.91800000000000004,"5min":6.133,"15min":2.9809999999999999},"min":{"1min":0.314,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.8089999999999999,"5min":73.218000000000004,"15min":73.218000000000004},"last":0.36599999999999999}]},{"osd":3,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":2.4540000000000002,"5min":7.3550000000000004,"15min":3.2999999999999998},"min":{"1min":0.441,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":23.777000000000001,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":2.6800000000000002,"5min":5.4269999999999996,"15min":2.742},"min":{"1min":0.32200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":23.949000000000002,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.53200000000000003}]},{"osd":4,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":7.7140000000000004,"5min":5.6399999999999997,"15min":2.254},"min":{"1min":0.25600000000000001,"5min":0.249,"15min":0.219},"max":{"1min":33.005000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":7.867,"5min":5.4189999999999996,"15min":2.2410000000000001},"min":{"1min":0.28599999999999998,"5min":0.224,"15min":0.224},"max":{"1min":33.106999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.29099999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.7200000000000002,"5min":4.5999999999999996,"15min":1.9039999999999999},"min":{"1min":0.30399999999999999,"5min":0.26400000000000001,"15min":0.25900000000000001},"max":{"1min":28.922999999999998,"5min":35.884,"15min":35.884},"last":0.317},{"interface":"front","average":{"1min":6.226,"5min":4.9960000000000004,"15min":2.0510000000000002},"min":{"1min":0.33800000000000002,"5min":0.249,"15min":0.24399999999999999},"max":{"1min":33.048000000000002,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.30599999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:04 2024","interfaces":[{"interface":"back","average":{"1min":3.7509999999999999,"5min":3.9089999999999998,"15min":1.7410000000000001},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":27.506,"5min":32.799999999999997,"15min":32.799999999999997},"last":0.33000000000000002},{"interface":"front","average":{"1min":3.6930000000000001,"5min":3.9630000000000001,"15min":1.742},"min":{"1min":0.32600000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":27.533999999999999,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.34599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":3.3109999999999999,"15min":1.794},"min":{"1min":0.376,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":6.1440000000000001,"5min":47.136000000000003,"15min":47.136000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":2.2989999999999999,"5min":3.8450000000000002,"15min":2.0950000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":16.620000000000001,"5min":43.140000000000001,"15min":43.140000000000001},"last":0.71399999999999997}]},{"osd":1,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":4.3319999999999999,"15min":2.7610000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":10.538,"5min":77.959000000000003,"15min":96.375},"last":0.62},{"interface":"front","average":{"1min":2.0049999999999999,"5min":6.0259999999999998,"15min":3.3839999999999999},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.4690000000000003,"5min":96.034000000000006,"15min":96.034000000000006},"last":0.88600000000000001}]},{"osd":2,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":4.3659999999999997,"15min":3.3969999999999998},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.9370000000000003,"5min":53.225000000000001,"15min":91.947999999999993},"last":0.38100000000000001},{"interface":"front","average":{"1min":2.1619999999999999,"5min":5.165,"15min":3.202},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":18.454000000000001,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.438}]},{"osd":3,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":3.645,"5min":5.9880000000000004,"15min":3.657},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":24.745999999999999,"5min":73.837000000000003,"15min":107.29000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":4.1669999999999998,"5min":5.907,"15min":3.766},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":26.498000000000001,"5min":73.692999999999998,"15min":107.27200000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":7.9210000000000003,"5min":4.6600000000000001,"15min":2.1440000000000001},"min":{"1min":0.252,"5min":0.216,"15min":0.216},"max":{"1min":45.302,"5min":45.302,"15min":45.302},"last":0.374},{"interface":"front","average":{"1min":8.0129999999999999,"5min":4.7249999999999996,"15min":2.202},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.251},"max":{"1min":45.408000000000001,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":4.1669999999999998,"15min":1.8400000000000001},"min":{"1min":0.27700000000000002,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":24.779,"5min":39.625,"15min":39.625},"last":0.39500000000000002},{"interface":"front","average":{"1min":1.9470000000000001,"5min":3.3639999999999999,"15min":1.6719999999999999},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":26.454999999999998,"5min":37.686,"15min":37.686},"last":0.35099999999999998}]},{"osd":7,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":3.3300000000000001,"5min":3.4580000000000002,"15min":1.6479999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":24.359999999999999,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":4.1609999999999996,"5min":3.3300000000000001,"15min":1.5680000000000001},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":26.521000000000001,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.42699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575000,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26600828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":3.1200000000000001,"15min":1.6619999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.9969999999999999,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":3.4079999999999999,"15min":1.7390000000000001},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":3.871,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.40500000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":4.8319999999999999,"15min":2.3069999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":16.021000000000001,"5min":69.873999999999995,"15min":69.873999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":2.1299999999999999,"5min":4.8410000000000002,"15min":2.383},"min":{"1min":0.41399999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":11.035,"5min":50.758000000000003,"15min":50.758000000000003},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.423,"5min":5.1059999999999999,"15min":2.726},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":18.189,"5min":100.931,"15min":100.931},"last":0.58099999999999996},{"interface":"front","average":{"1min":2.6219999999999999,"5min":6.4400000000000004,"15min":3.1269999999999998},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":18.815000000000001,"5min":142.041,"15min":142.041},"last":0.37}]},{"osd":3,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":6.0490000000000004,"15min":2.9369999999999998},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9.6340000000000003,"5min":63.905999999999999,"15min":63.905999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.7250000000000001,"5min":5.9930000000000003,"15min":3.0310000000000001},"min":{"1min":0.38800000000000001,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":9.6210000000000004,"5min":61.076000000000001,"15min":61.076000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":3.4700000000000002,"15min":1.603},"min":{"1min":0.248,"5min":0.219,"15min":0.219},"max":{"1min":2.5539999999999998,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.312},{"interface":"front","average":{"1min":0.68200000000000005,"5min":3.8370000000000002,"15min":1.7350000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":3.9540000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.35899999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":3.5579999999999998,"5min":5.1699999999999999,"15min":2.1110000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":32.395000000000003,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":3.681,"5min":5.3890000000000002,"15min":2.3250000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":32.616999999999997,"5min":40.314,"15min":40.314},"last":0.32400000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":3.859,"15min":1.819},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.25700000000000001},"max":{"1min":3.8570000000000002,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":4.7720000000000002,"15min":2.0630000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":4.0019999999999998,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.38500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":3.0249999999999999,"15min":1.716},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":26.696000000000002,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":2.6600000000000001,"5min":3.2610000000000001,"15min":1.8999999999999999},"min":{"1min":0.38700000000000001,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":26.655000000000001,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.44800000000000001}]},{"osd":1,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":5.3780000000000001,"15min":2.7290000000000001},"min":{"1min":0.314,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":6.5529999999999999,"5min":51.387999999999998,"15min":51.387999999999998},"last":0.627},{"interface":"front","average":{"1min":1.393,"5min":3.75,"15min":2.1640000000000001},"min":{"1min":0.39600000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.633,"5min":50.207000000000001,"15min":50.207000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":5.056,"5min":10.506,"15min":4.6859999999999999},"min":{"1min":0.29099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":40.793999999999997,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.438},{"interface":"front","average":{"1min":1.26,"5min":9.3879999999999999,"15min":4.2000000000000002},"min":{"1min":0.34599999999999997,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":4.6870000000000003,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":5.3319999999999999,"15min":2.762},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.5220000000000002,"5min":53.134999999999998,"15min":53.134999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":2.137,"5min":6.9210000000000003,"15min":4.3179999999999996},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.30399999999999999},"max":{"1min":5.633,"5min":62.134,"15min":161.191},"last":0.43099999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":3.75,"15min":1.647},"min":{"1min":0.23499999999999999,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":2.8519999999999999,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.31},{"interface":"front","average":{"1min":0.82199999999999995,"5min":3.8119999999999998,"15min":1.7230000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.22800000000000001},"max":{"1min":3.0259999999999998,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.34599999999999997}]},{"osd":6,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":6.6719999999999997,"15min":2.6389999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.22900000000000001},"max":{"1min":3.137,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.151,"5min":6.2510000000000003,"15min":2.5510000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.3899999999999997,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.38500000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":2.3769999999999998,"5min":5.0099999999999998,"15min":2.101},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.24299999999999999},"max":{"1min":26.707999999999998,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.378},{"interface":"front","average":{"1min":2.4129999999999998,"5min":4.4450000000000003,"15min":1.9179999999999999},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":26.725999999999999,"5min":51.997,"15min":51.997},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:22:07.059 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:22:07.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.294+0000 7f589fe00640 1 Processor -- start 2024-03-23T06:22:07.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.294+0000 7f589fe00640 1 -- start start 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.295+0000 7f589fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ced20 0x7f58a00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.295+0000 7f589fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58a00cf100 0x7f58a0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.295+0000 7f589fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58a00ca7c0 0x7f58a00cac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.295+0000 7f589fe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a00cb8d0 con 0x7f58a00cf100 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.295+0000 7f589fe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a015a370 con 0x7f58a00ca7c0 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.295+0000 7f589fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00ca330 con 0x7f58a00ced20 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589e000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58a00cf100 0x7f58a0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58a00ca7c0 0x7f58a00cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ced20 0x7f58a00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58a00ca7c0 0x7f58a00cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43092/0 (socket says 172.21.15.73:43092) 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589f400640 1 -- 172.21.15.73:0/2539454063 learned_addr learned my addr 172.21.15.73:0/2539454063 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:07.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589e000640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58a00cf100 0x7f58a0159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47328/0 (socket says 172.21.15.73:47328) 2024-03-23T06:22:07.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589ea00640 1 -- 172.21.15.73:0/2539454063 >> v2:172.21.15.110:3300/0 conn(0x7f58a00ca7c0 msgr2=0x7f58a00cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:07.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589ea00640 1 --2- 172.21.15.73:0/2539454063 >> v2:172.21.15.110:3300/0 conn(0x7f58a00ca7c0 0x7f58a00cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589ea00640 1 -- 172.21.15.73:0/2539454063 >> v2:172.21.15.73:3300/0 conn(0x7f58a00cf100 msgr2=0x7f58a0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:07.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589ea00640 1 --2- 172.21.15.73:0/2539454063 >> v2:172.21.15.73:3300/0 conn(0x7f58a00cf100 0x7f58a0159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589ea00640 1 -- 172.21.15.73:0/2539454063 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00cb1b0 con 0x7f58a00ced20 2024-03-23T06:22:07.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.296+0000 7f589f400640 1 --2- 172.21.15.73:0/2539454063 >> v2:172.21.15.110:3300/0 conn(0x7f58a00ca7c0 0x7f58a00cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:07.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.297+0000 7f589ea00640 1 --2- 172.21.15.73:0/2539454063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ced20 0x7f58a00cb390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f58a00c9900 tx=0x7f589002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f802b62f175486 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:07.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589d600640 1 -- 172.21.15.73:0/2539454063 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890031830 con 0x7f58a00ced20 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589d600640 1 -- 172.21.15.73:0/2539454063 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890031990 con 0x7f58a00ced20 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589d600640 1 -- 172.21.15.73:0/2539454063 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890031d20 con 0x7f58a00ced20 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 -- 172.21.15.73:0/2539454063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ced20 msgr2=0x7f58a00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 --2- 172.21.15.73:0/2539454063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ced20 0x7f58a00cb390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f58a00c9900 tx=0x7f589002b8d0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 -- 172.21.15.73:0/2539454063 shutdown_connections 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 --2- 172.21.15.73:0/2539454063 >> v2:172.21.15.110:3300/0 conn(0x7f58a00ca7c0 0x7f58a00cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 --2- 172.21.15.73:0/2539454063 >> v2:172.21.15.73:3300/0 conn(0x7f58a00cf100 0x7f58a0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 --2- 172.21.15.73:0/2539454063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ced20 0x7f58a00cb390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 -- 172.21.15.73:0/2539454063 >> 172.21.15.73:0/2539454063 conn(0x7f58a00713e0 msgr2=0x7f58a00717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 -- 172.21.15.73:0/2539454063 shutdown_connections 2024-03-23T06:22:07.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.298+0000 7f589fe00640 1 -- 172.21.15.73:0/2539454063 wait complete. 2024-03-23T06:22:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.300+0000 7f589fe00640 1 Processor -- start 2024-03-23T06:22:07.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.301+0000 7f589fe00640 1 -- start start 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ca7c0 0x7f58a01eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a00ced20 0x7f58a00c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00cf100 0x7f58a0157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00c5910 con 0x7f58a00ced20 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01ee1c0 con 0x7f58a00cf100 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a01ef110 con 0x7f58a00ca7c0 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ca7c0 0x7f58a01eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ca7c0 0x7f58a01eebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:52116/0 (socket says 172.21.15.73:52116) 2024-03-23T06:22:07.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589ea00640 1 -- 172.21.15.73:0/2969789610 learned_addr learned my addr 172.21.15.73:0/2969789610 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589f400640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00cf100 0x7f58a0157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589e000640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a00ced20 0x7f58a00c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589ea00640 1 -- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00cf100 msgr2=0x7f58a0157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589ea00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00cf100 0x7f58a0157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589ea00640 1 -- 172.21.15.73:0/2969789610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a00ced20 msgr2=0x7f58a00c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589ea00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a00ced20 0x7f58a00c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.302+0000 7f589ea00640 1 -- 172.21.15.73:0/2969789610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009b30 con 0x7f58a00ca7c0 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.303+0000 7f589ea00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ca7c0 0x7f58a01eebd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5890009890 tx=0x7f58900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.303+0000 7f5896a00640 1 -- 172.21.15.73:0/2969789610 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589003a630 con 0x7f58a00ca7c0 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.303+0000 7f5896a00640 1 -- 172.21.15.73:0/2969789610 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589003a7b0 con 0x7f58a00ca7c0 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.303+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5890009400 con 0x7f58a00ca7c0 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.303+0000 7f5896a00640 1 -- 172.21.15.73:0/2969789610 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589003ab60 con 0x7f58a00ca7c0 2024-03-23T06:22:07.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.303+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a00c4e40 con 0x7f58a00ca7c0 2024-03-23T06:22:07.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.304+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a004e030 con 0x7f58a00ca7c0 2024-03-23T06:22:07.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.305+0000 7f5896a00640 1 -- 172.21.15.73:0/2969789610 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f589003acc0 con 0x7f58a00ca7c0 2024-03-23T06:22:07.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.306+0000 7f5896a00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f588006ac00 0x7f588006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:07.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.306+0000 7f5896a00640 1 -- 172.21.15.73:0/2969789610 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f58900ab250 con 0x7f58a00ca7c0 2024-03-23T06:22:07.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.306+0000 7f589e000640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f588006ac00 0x7f588006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:07.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.307+0000 7f589e000640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f588006ac00 0x7f588006d0c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f58a00c9d50 tx=0x7f588c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:07.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.311+0000 7f5896a00640 1 -- 172.21.15.73:0/2969789610 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f5890076160 con 0x7f58a00ca7c0 2024-03-23T06:22:07.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.505+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58a0066f80 con 0x7f58a00ca7c0 2024-03-23T06:22:07.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.507+0000 7f5896a00640 1 -- 172.21.15.73:0/2969789610 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18088 (secure 0 0 0) 0x7f5890079780 con 0x7f58a00ca7c0 2024-03-23T06:22:07.508 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:07.508 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:39.659625+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2},{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f588006ac00 msgr2=0x7f588006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f588006ac00 0x7f588006d0c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f58a00c9d50 tx=0x7f588c009190 comp rx=0 tx=0).stop 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ca7c0 msgr2=0x7f58a01eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ca7c0 0x7f58a01eebd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5890009890 tx=0x7f58900046c0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 shutdown_connections 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a00cf100 0x7f58a0157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58a00ced20 0x7f58a00c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f588006ac00 0x7f588006d0c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 --2- 172.21.15.73:0/2969789610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58a00ca7c0 0x7f58a01eebd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 >> 172.21.15.73:0/2969789610 conn(0x7f58a00713e0 msgr2=0x7f58a01516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 shutdown_connections 2024-03-23T06:22:07.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:07.509+0000 7f589fe00640 1 -- 172.21.15.73:0/2969789610 wait complete. 2024-03-23T06:22:08.529 INFO:tasks.ceph:Scrubbing osd.0 2024-03-23T06:22:08.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-23T06:22:08.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.736+0000 7f9af4a00640 1 Processor -- start 2024-03-23T06:22:08.738 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.737+0000 7f9af4a00640 1 -- start start 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.738+0000 7f9af4a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9af01538e0 0x7f9af00cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.738+0000 7f9af4a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9af00ca840 0x7f9af00713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.738+0000 7f9af4a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af0153cc0 con 0x7f9af0159f70 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.738+0000 7f9af4a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af015a4d0 con 0x7f9af01538e0 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.738+0000 7f9af4a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af015cc00 con 0x7f9af00ca840 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.739+0000 7f9ae7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9af00ca840 0x7f9af00713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.739+0000 7f9ae7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9af00ca840 0x7f9af00713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43102/0 (socket says 172.21.15.73:43102) 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.739+0000 7f9ae7e00640 1 -- 172.21.15.73:0/548056893 learned_addr learned my addr 172.21.15.73:0/548056893 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:08.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.739+0000 7f9aede00640 1 --2- 172.21.15.73:0/548056893 >> v2:172.21.15.73:3300/0 conn(0x7f9af01538e0 0x7f9af00cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:08.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.739+0000 7f9ae7e00640 1 -- 172.21.15.73:0/548056893 >> v2:172.21.15.73:3300/0 conn(0x7f9af01538e0 msgr2=0x7f9af00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:08.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.739+0000 7f9ae7e00640 1 --2- 172.21.15.73:0/548056893 >> v2:172.21.15.73:3300/0 conn(0x7f9af01538e0 0x7f9af00cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:08.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.739+0000 7f9ae7e00640 1 -- 172.21.15.73:0/548056893 >> v1:172.21.15.110:6789/0 conn(0x7f9af0159f70 legacy=0x7f9af015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:08.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.739+0000 7f9ae7e00640 1 -- 172.21.15.73:0/548056893 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af015cea0 con 0x7f9af00ca840 2024-03-23T06:22:08.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.740+0000 7f9ae7e00640 1 --2- 172.21.15.73:0/548056893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af00ca840 0x7f9af00713e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9af00b1ac0 tx=0x7f9ad802ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c28c0c0866a6ea5b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:08.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.740+0000 7f9aed400640 1 -- 172.21.15.73:0/548056893 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad802f850 con 0x7f9af00ca840 2024-03-23T06:22:08.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9aed400640 1 -- 172.21.15.73:0/548056893 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad802f9b0 con 0x7f9af00ca840 2024-03-23T06:22:08.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9aed400640 1 -- 172.21.15.73:0/548056893 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad802fd40 con 0x7f9af00ca840 2024-03-23T06:22:08.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9af4a00640 1 -- 172.21.15.73:0/548056893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af00ca840 msgr2=0x7f9af00713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:08.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9af4a00640 1 --2- 172.21.15.73:0/548056893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af00ca840 0x7f9af00713e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9af00b1ac0 tx=0x7f9ad802ba30 comp rx=0 tx=0).stop 2024-03-23T06:22:08.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9af4a00640 1 -- 172.21.15.73:0/548056893 shutdown_connections 2024-03-23T06:22:08.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9af4a00640 1 --2- 172.21.15.73:0/548056893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af00ca840 0x7f9af00713e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:08.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9af4a00640 1 --2- 172.21.15.73:0/548056893 >> v2:172.21.15.73:3300/0 conn(0x7f9af01538e0 0x7f9af00cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:08.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9af4a00640 1 -- 172.21.15.73:0/548056893 >> 172.21.15.73:0/548056893 conn(0x7f9af006c200 msgr2=0x7f9af006c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:08.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9af4a00640 1 -- 172.21.15.73:0/548056893 shutdown_connections 2024-03-23T06:22:08.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.741+0000 7f9af4a00640 1 -- 172.21.15.73:0/548056893 wait complete. 2024-03-23T06:22:08.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.743+0000 7f9af4a00640 1 Processor -- start 2024-03-23T06:22:08.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.743+0000 7f9af4a00640 1 -- start start 2024-03-23T06:22:08.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9af4a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af00ca840 0x7f9af00c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:08.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9af4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af01538e0 0x7f9af01f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:08.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9af4a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159f70 0x7f9af01f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:08.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9af4a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0158600 con 0x7f9af00ca840 2024-03-23T06:22:08.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9af4a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00b3830 con 0x7f9af01538e0 2024-03-23T06:22:08.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9af4a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01e6af0 con 0x7f9af0159f70 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9ae7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af01538e0 0x7f9af01f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9aede00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af00ca840 0x7f9af00c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9ae7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af01538e0 0x7f9af01f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:43106/0 (socket says 172.21.15.73:43106) 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9aede00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af00ca840 0x7f9af00c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47366/0 (socket says 172.21.15.73:47366) 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9ae7e00640 1 -- 172.21.15.73:0/3565726157 learned_addr learned my addr 172.21.15.73:0/3565726157 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9aee800640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159f70 0x7f9af01f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9ae7e00640 1 -- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159f70 msgr2=0x7f9af01f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9ae7e00640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159f70 0x7f9af01f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9ae7e00640 1 -- 172.21.15.73:0/3565726157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af00ca840 msgr2=0x7f9af00c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9ae7e00640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af00ca840 0x7f9af00c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9ae7e00640 1 -- 172.21.15.73:0/3565726157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80094d0 con 0x7f9af01538e0 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.744+0000 7f9aee800640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af0159f70 0x7f9af01f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.745+0000 7f9ae7e00640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af01538e0 0x7f9af01f2580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ad802ba70 tx=0x7f9ad8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:08.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.745+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8037c40 con 0x7f9af01538e0 2024-03-23T06:22:08.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.745+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8037dc0 con 0x7f9af01538e0 2024-03-23T06:22:08.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.745+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8041640 con 0x7f9af01538e0 2024-03-23T06:22:08.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.745+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af01f30b0 con 0x7f9af01538e0 2024-03-23T06:22:08.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.745+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af0157ac0 con 0x7f9af01538e0 2024-03-23T06:22:08.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.746+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9af015d740 con 0x7f9af01538e0 2024-03-23T06:22:08.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.747+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9ad80417a0 con 0x7f9af01538e0 2024-03-23T06:22:08.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.748+0000 7f9ae6000640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9acc06ac30 0x7f9acc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:08.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.748+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f9ad803c070 con 0x7f9af01538e0 2024-03-23T06:22:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.748+0000 7f9aede00640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9acc06ac30 0x7f9acc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.748+0000 7f9ae6000640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f9acc0743b0 0x7f9acc076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.748+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 --> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9acc076f00 con 0x7f9acc0743b0 2024-03-23T06:22:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.748+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ad80ae8a0 con 0x7f9af01538e0 2024-03-23T06:22:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.748+0000 7f9aee800640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f9acc0743b0 0x7f9acc076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.749+0000 7f9aede00640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9acc06ac30 0x7f9acc06d0f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009b40 tx=0x7f9ae0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:08.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.749+0000 7f9aee800640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f9acc0743b0 0x7f9acc076830 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:08.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.750+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 <== osd.0 v2:172.21.15.73:6817/36879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9acc076f00 con 0x7f9acc0743b0 2024-03-23T06:22:08.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.763+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 --> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9af015d460 con 0x7f9acc0743b0 2024-03-23T06:22:08.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9ae6000640 1 -- 172.21.15.73:0/3565726157 <== osd.0 v2:172.21.15.73:6817/36879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ae8001e90 con 0x7f9acc0743b0 2024-03-23T06:22:08.775 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:22:08.775 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T06:22:08.775 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f9acc0743b0 msgr2=0x7f9acc076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.73:6817/36879,v1:172.21.15.73:6819/36879] conn(0x7f9acc0743b0 0x7f9acc076830 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9acc06ac30 msgr2=0x7f9acc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f9acc06ac30 0x7f9acc06d0f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009b40 tx=0x7f9ae0009190 comp rx=0 tx=0).stop 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af01538e0 msgr2=0x7f9af01f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 --2- 172.21.15.73:0/3565726157 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af01538e0 0x7f9af01f2580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ad802ba70 tx=0x7f9ad8004730 comp rx=0 tx=0).stop 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9aee800640 1 -- 172.21.15.73:0/3565726157 reap_dead start 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 shutdown_connections 2024-03-23T06:22:08.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 >> 172.21.15.73:0/3565726157 conn(0x7f9af006c200 msgr2=0x7f9af00b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:08.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 shutdown_connections 2024-03-23T06:22:08.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:08.774+0000 7f9af4a00640 1 -- 172.21.15.73:0/3565726157 wait complete. 2024-03-23T06:22:08.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-23T06:22:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.005+0000 7f1ec6800640 1 Processor -- start 2024-03-23T06:22:09.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.006+0000 7f1ec6800640 1 -- start start 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.007+0000 7f1ec6800640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ec0159420 0x7f1ec00c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.007+0000 7f1ec6800640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec00c9c80 con 0x7f1ec00ca940 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.007+0000 7f1ec6800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec006a2d0 con 0x7f1ec0153760 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.007+0000 7f1ec6800640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec0159860 con 0x7f1ec0159420 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.007+0000 7f1ebf400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1ec0153760 0x7f1ec00cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47458/0 (socket says 172.21.15.73:47458) 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.007+0000 7f1ebf400640 1 -- 172.21.15.73:0/1840266933 learned_addr learned my addr 172.21.15.73:0/1840266933 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.007+0000 7f1eb6a00640 1 --2- 172.21.15.73:0/1840266933 >> v2:172.21.15.73:3300/0 conn(0x7f1ec0159420 0x7f1ec00c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.008+0000 7f1ebea00640 1 -- 172.21.15.73:0/1840266933 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590891962 0 0) 0x7f1ec006a2d0 con 0x7f1ec0153760 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.008+0000 7f1ebea00640 1 -- 172.21.15.73:0/1840266933 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea4003520 con 0x7f1ec0153760 2024-03-23T06:22:09.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.008+0000 7f1eb6a00640 1 -- 172.21.15.73:0/1840266933 >> v1:172.21.15.110:6789/0 conn(0x7f1ec0153760 legacy=0x7f1ec00cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.008+0000 7f1eb6a00640 1 -- 172.21.15.73:0/1840266933 >> v1:172.21.15.73:6789/0 conn(0x7f1ec00ca940 legacy=0x7f1ec00cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.008+0000 7f1eb6a00640 1 -- 172.21.15.73:0/1840266933 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec006a5b0 con 0x7f1ec0159420 2024-03-23T06:22:09.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.008+0000 7f1ebea00640 1 -- 172.21.15.73:0/1840266933 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813225391 0 0) 0x7f1eb8001110 con 0x7f1ec00ca940 2024-03-23T06:22:09.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.009+0000 7f1eb6a00640 1 --2- 172.21.15.73:0/1840266933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec0159420 0x7f1ec00c9740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80097a0 tx=0x7f1ea802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9671a3bba3dc93f server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.009+0000 7f1ebea00640 1 -- 172.21.15.73:0/1840266933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8030610 con 0x7f1ec0159420 2024-03-23T06:22:09.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.009+0000 7f1ebea00640 1 -- 172.21.15.73:0/1840266933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea8030770 con 0x7f1ec0159420 2024-03-23T06:22:09.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.009+0000 7f1ebea00640 1 -- 172.21.15.73:0/1840266933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8030ae0 con 0x7f1ec0159420 2024-03-23T06:22:09.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.010+0000 7f1ec6800640 1 -- 172.21.15.73:0/1840266933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec0159420 msgr2=0x7f1ec00c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.010+0000 7f1ec6800640 1 --2- 172.21.15.73:0/1840266933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec0159420 0x7f1ec00c9740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80097a0 tx=0x7f1ea802b960 comp rx=0 tx=0).stop 2024-03-23T06:22:09.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.010+0000 7f1ec6800640 1 -- 172.21.15.73:0/1840266933 shutdown_connections 2024-03-23T06:22:09.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.010+0000 7f1ec6800640 1 --2- 172.21.15.73:0/1840266933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec0159420 0x7f1ec00c9740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.010+0000 7f1ec6800640 1 -- 172.21.15.73:0/1840266933 >> 172.21.15.73:0/1840266933 conn(0x7f1ec006c310 msgr2=0x7f1ec00713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:09.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.010+0000 7f1ec6800640 1 -- 172.21.15.73:0/1840266933 shutdown_connections 2024-03-23T06:22:09.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.010+0000 7f1ec6800640 1 -- 172.21.15.73:0/1840266933 wait complete. 2024-03-23T06:22:09.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.012+0000 7f1ec6800640 1 Processor -- start 2024-03-23T06:22:09.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.012+0000 7f1ec6800640 1 -- start start 2024-03-23T06:22:09.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ec6800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec00ca940 0x7f1ec00cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ec6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ec0153760 0x7f1ec01eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ec6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec0159420 0x7f1ec01ef2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ec6800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00c8f40 con 0x7f1ec00ca940 2024-03-23T06:22:09.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ec6800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec015a580 con 0x7f1ec0159420 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ec6800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00c67f0 con 0x7f1ec0153760 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1eb6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ec0153760 0x7f1ec01eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ebf400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec00ca940 0x7f1ec00cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ebfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec0159420 0x7f1ec01ef2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1eb6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ec0153760 0x7f1ec01eedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:52132/0 (socket says 172.21.15.73:52132) 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1eb6a00640 1 -- 172.21.15.73:0/3366212098 learned_addr learned my addr 172.21.15.73:0/3366212098 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1eb6a00640 1 -- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec0159420 msgr2=0x7f1ec01ef2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1eb6a00640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec0159420 0x7f1ec01ef2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1eb6a00640 1 -- 172.21.15.73:0/3366212098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec00ca940 msgr2=0x7f1ec00cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1eb6a00640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec00ca940 0x7f1ec00cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1eb6a00640 1 -- 172.21.15.73:0/3366212098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea8009400 con 0x7f1ec0153760 2024-03-23T06:22:09.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.013+0000 7f1ebf400640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec00ca940 0x7f1ec00cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:09.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.014+0000 7f1eb6a00640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ec0153760 0x7f1ec01eedb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80098c0 tx=0x7f1ea80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.014+0000 7f1eb7e00640 1 -- 172.21.15.73:0/3366212098 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea803e070 con 0x7f1ec0153760 2024-03-23T06:22:09.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.014+0000 7f1eb7e00640 1 -- 172.21.15.73:0/3366212098 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea8030e10 con 0x7f1ec0153760 2024-03-23T06:22:09.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.014+0000 7f1eb7e00640 1 -- 172.21.15.73:0/3366212098 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8039c30 con 0x7f1ec0153760 2024-03-23T06:22:09.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.014+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec00c6550 con 0x7f1ec0153760 2024-03-23T06:22:09.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.014+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec00c8740 con 0x7f1ec0153760 2024-03-23T06:22:09.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.015+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec0150130 con 0x7f1ec0153760 2024-03-23T06:22:09.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.016+0000 7f1eb7e00640 1 -- 172.21.15.73:0/3366212098 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1ea804b400 con 0x7f1ec0153760 2024-03-23T06:22:09.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.017+0000 7f1eb7e00640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e9c06ac00 0x7f1e9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.017+0000 7f1eb7e00640 1 -- 172.21.15.73:0/3366212098 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1ea80ab8c0 con 0x7f1ec0153760 2024-03-23T06:22:09.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.017+0000 7f1ebf400640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e9c06ac00 0x7f1e9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.018+0000 7f1ebf400640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e9c06ac00 0x7f1e9c06d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0005c00 tx=0x7f1eb0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.022+0000 7f1eb7e00640 1 -- 172.21.15.73:0/3366212098 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1ea80767d0 con 0x7f1ec0153760 2024-03-23T06:22:09.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.215+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ec006ae50 con 0x7f1e9c06ac00 2024-03-23T06:22:09.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.216+0000 7f1eb7e00640 1 -- 172.21.15.73:0/3366212098 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1eb0014450 con 0x7f1e9c06ac00 2024-03-23T06:22:09.217 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e9c06ac00 msgr2=0x7f1e9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e9c06ac00 0x7f1e9c06d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0005c00 tx=0x7f1eb0009040 comp rx=0 tx=0).stop 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ec0153760 msgr2=0x7f1ec01eedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ec0153760 0x7f1ec01eedb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80098c0 tx=0x7f1ea80046c0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 shutdown_connections 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ec0159420 0x7f1ec01ef2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1e9c06ac00 0x7f1e9c06d0c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ec0153760 0x7f1ec01eedb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 --2- 172.21.15.73:0/3366212098 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ec00ca940 0x7f1ec00cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.218+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 >> 172.21.15.73:0/3366212098 conn(0x7f1ec006c310 msgr2=0x7f1ec00c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.219+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 shutdown_connections 2024-03-23T06:22:09.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.219+0000 7f1ec6800640 1 -- 172.21.15.73:0/3366212098 wait complete. 2024-03-23T06:22:09.239 INFO:tasks.ceph:Scrubbing osd.1 2024-03-23T06:22:09.240 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-23T06:22:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.444+0000 7f1b1fe00640 1 Processor -- start 2024-03-23T06:22:09.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.444+0000 7f1b1fe00640 1 -- start start 2024-03-23T06:22:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.445+0000 7f1b1fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b201534b0 0x7f1b201592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.445+0000 7f1b1fe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b200cbac0 0x7f1b200cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.445+0000 7f1b1fe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b200c60e0 con 0x7f1b2006a4b0 2024-03-23T06:22:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.445+0000 7f1b1fe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b200c2e40 con 0x7f1b200cbac0 2024-03-23T06:22:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.445+0000 7f1b1fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201599b0 con 0x7f1b201534b0 2024-03-23T06:22:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1f400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b200cbac0 0x7f1b200cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1e000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1b2006a4b0 0x7f1b20071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47462/0 (socket says 172.21.15.73:47462) 2024-03-23T06:22:09.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1e000640 1 -- 172.21.15.73:0/2827505524 learned_addr learned my addr 172.21.15.73:0/2827505524 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:09.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1ea00640 1 --2- 172.21.15.73:0/2827505524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b201534b0 0x7f1b201592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1d600640 1 -- 172.21.15.73:0/2827505524 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754256248 0 0) 0x7f1b200c60e0 con 0x7f1b2006a4b0 2024-03-23T06:22:09.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1f400640 1 -- 172.21.15.73:0/2827505524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b201534b0 msgr2=0x7f1b201592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:09.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1f400640 1 --2- 172.21.15.73:0/2827505524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b201534b0 0x7f1b201592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1f400640 1 -- 172.21.15.73:0/2827505524 >> v1:172.21.15.110:6789/0 conn(0x7f1b2006a4b0 legacy=0x7f1b20071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.446+0000 7f1b1f400640 1 -- 172.21.15.73:0/2827505524 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2015a230 con 0x7f1b200cbac0 2024-03-23T06:22:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.447+0000 7f1b1f400640 1 --2- 172.21.15.73:0/2827505524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b200cbac0 0x7f1b200cbf50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009d90 tx=0x7f1b1802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1981e011d5345705 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.447+0000 7f1b1d600640 1 -- 172.21.15.73:0/2827505524 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1802cce0 con 0x7f1b200cbac0 2024-03-23T06:22:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.447+0000 7f1b1d600640 1 -- 172.21.15.73:0/2827505524 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1802ce40 con 0x7f1b200cbac0 2024-03-23T06:22:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.447+0000 7f1b1d600640 1 -- 172.21.15.73:0/2827505524 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18034660 con 0x7f1b200cbac0 2024-03-23T06:22:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.448+0000 7f1b1fe00640 1 -- 172.21.15.73:0/2827505524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b200cbac0 msgr2=0x7f1b200cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.448+0000 7f1b1fe00640 1 --2- 172.21.15.73:0/2827505524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b200cbac0 0x7f1b200cbf50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009d90 tx=0x7f1b1802bf30 comp rx=0 tx=0).stop 2024-03-23T06:22:09.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.448+0000 7f1b1fe00640 1 -- 172.21.15.73:0/2827505524 shutdown_connections 2024-03-23T06:22:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.448+0000 7f1b1fe00640 1 --2- 172.21.15.73:0/2827505524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b200cbac0 0x7f1b200cbf50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.448+0000 7f1b1fe00640 1 --2- 172.21.15.73:0/2827505524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b201534b0 0x7f1b201592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.448+0000 7f1b1fe00640 1 -- 172.21.15.73:0/2827505524 >> 172.21.15.73:0/2827505524 conn(0x7f1b2006c3b0 msgr2=0x7f1b2006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.448+0000 7f1b1fe00640 1 -- 172.21.15.73:0/2827505524 shutdown_connections 2024-03-23T06:22:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.448+0000 7f1b1fe00640 1 -- 172.21.15.73:0/2827505524 wait complete. 2024-03-23T06:22:09.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.450+0000 7f1b1fe00640 1 Processor -- start 2024-03-23T06:22:09.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.450+0000 7f1b1fe00640 1 -- start start 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b2006a4b0 0x7f1b200c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b200cbac0 0x7f1b201f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b201534b0 0x7f1b20158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1fe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200c9350 con 0x7f1b2006a4b0 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201f1fa0 con 0x7f1b201534b0 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20150170 con 0x7f1b200cbac0 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1e000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b200cbac0 0x7f1b201f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b2006a4b0 0x7f1b200c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1e000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b200cbac0 0x7f1b201f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:52140/0 (socket says 172.21.15.73:52140) 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1e000640 1 -- 172.21.15.73:0/913568922 learned_addr learned my addr 172.21.15.73:0/913568922 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:09.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1f400640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b201534b0 0x7f1b20158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1e000640 1 -- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b201534b0 msgr2=0x7f1b20158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1e000640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b201534b0 0x7f1b20158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1e000640 1 -- 172.21.15.73:0/913568922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b2006a4b0 msgr2=0x7f1b200c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1e000640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b2006a4b0 0x7f1b200c1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1e000640 1 -- 172.21.15.73:0/913568922 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18009a70 con 0x7f1b200cbac0 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.451+0000 7f1b1ea00640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b2006a4b0 0x7f1b200c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.452+0000 7f1b1e000640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b200cbac0 0x7f1b201f2430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00c4d0 tx=0x7f1b0c00c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.452+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0074e0 con 0x7f1b200cbac0 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.452+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c007660 con 0x7f1b200cbac0 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.452+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c004a20 con 0x7f1b200cbac0 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.452+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b20154300 con 0x7f1b200cbac0 2024-03-23T06:22:09.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.452+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200c2040 con 0x7f1b200cbac0 2024-03-23T06:22:09.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.453+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b20070860 con 0x7f1b200cbac0 2024-03-23T06:22:09.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.454+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1b0c004b80 con 0x7f1b200cbac0 2024-03-23T06:22:09.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.454+0000 7f1b16a00640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b0006ac00 0x7f1b0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.455+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f1b0c088950 con 0x7f1b200cbac0 2024-03-23T06:22:09.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.455+0000 7f1b1ea00640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b0006ac00 0x7f1b0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.455+0000 7f1b16a00640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f1b00074380 0x7f1b00076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.455+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 --> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b00076ed0 con 0x7f1b00074380 2024-03-23T06:22:09.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.455+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b0c08d2a0 con 0x7f1b200cbac0 2024-03-23T06:22:09.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.455+0000 7f1b1f400640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f1b00074380 0x7f1b00076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.455+0000 7f1b1ea00640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b0006ac00 0x7f1b0006d0c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e90 tx=0x7f1b10009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.456+0000 7f1b1f400640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f1b00074380 0x7f1b00076800 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.456+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 <== osd.1 v2:172.21.15.73:6805/36878 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f1b00076ed0 con 0x7f1b00074380 2024-03-23T06:22:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.470+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 --> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1b20159f50 con 0x7f1b00074380 2024-03-23T06:22:09.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.470+0000 7f1b16a00640 1 -- 172.21.15.73:0/913568922 <== osd.1 v2:172.21.15.73:6805/36878 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1b1803e440 con 0x7f1b00074380 2024-03-23T06:22:09.471 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:22:09.471 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T06:22:09.472 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:22:09.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f1b00074380 msgr2=0x7f1b00076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.73:6805/36878,v1:172.21.15.73:6807/36878] conn(0x7f1b00074380 0x7f1b00076800 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b0006ac00 msgr2=0x7f1b0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f1b0006ac00 0x7f1b0006d0c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009e90 tx=0x7f1b10009190 comp rx=0 tx=0).stop 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b200cbac0 msgr2=0x7f1b201f2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 --2- 172.21.15.73:0/913568922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b200cbac0 0x7f1b201f2430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00c4d0 tx=0x7f1b0c00c990 comp rx=0 tx=0).stop 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1f400640 1 -- 172.21.15.73:0/913568922 reap_dead start 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 shutdown_connections 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 >> 172.21.15.73:0/913568922 conn(0x7f1b2006c3b0 msgr2=0x7f1b200c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 shutdown_connections 2024-03-23T06:22:09.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.471+0000 7f1b1fe00640 1 -- 172.21.15.73:0/913568922 wait complete. 2024-03-23T06:22:09.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-23T06:22:09.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.683+0000 7fbe32000640 1 Processor -- start 2024-03-23T06:22:09.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.684+0000 7fbe32000640 1 -- start start 2024-03-23T06:22:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.685+0000 7fbe32000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b410 0x7fbe2c06f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.685+0000 7fbe32000640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c0c7af0 con 0x7fbe2c06df30 2024-03-23T06:22:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.685+0000 7fbe32000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c06daa0 con 0x7fbe2c06b030 2024-03-23T06:22:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.685+0000 7fbe32000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c06d740 con 0x7fbe2c06b410 2024-03-23T06:22:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.685+0000 7fbe2b400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbe2c06b030 0x7fbe2c159fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47466/0 (socket says 172.21.15.73:47466) 2024-03-23T06:22:09.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.685+0000 7fbe2b400640 1 -- 172.21.15.73:0/4183836572 learned_addr learned my addr 172.21.15.73:0/4183836572 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.685+0000 7fbe22a00640 1 --2- 172.21.15.73:0/4183836572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b410 0x7fbe2c06f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.686+0000 7fbe22a00640 1 -- 172.21.15.73:0/4183836572 >> v1:172.21.15.110:6789/0 conn(0x7fbe2c06b030 legacy=0x7fbe2c159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.686+0000 7fbe2aa00640 1 -- 172.21.15.73:0/4183836572 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084198272 0 0) 0x7fbe2c06daa0 con 0x7fbe2c06b030 2024-03-23T06:22:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.686+0000 7fbe22a00640 1 -- 172.21.15.73:0/4183836572 >> v1:172.21.15.73:6789/0 conn(0x7fbe2c06df30 legacy=0x7fbe2c1423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.686+0000 7fbe22a00640 1 -- 172.21.15.73:0/4183836572 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c06fab0 con 0x7fbe2c06b410 2024-03-23T06:22:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe22a00640 1 --2- 172.21.15.73:0/4183836572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b410 0x7fbe2c06f270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe140097d0 tx=0x7fbe1402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32096cbd495f1de7 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe2aa00640 1 -- 172.21.15.73:0/4183836572 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14031890 con 0x7fbe2c06b410 2024-03-23T06:22:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe2aa00640 1 -- 172.21.15.73:0/4183836572 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe140319f0 con 0x7fbe2c06b410 2024-03-23T06:22:09.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe2aa00640 1 -- 172.21.15.73:0/4183836572 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14031d80 con 0x7fbe2c06b410 2024-03-23T06:22:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe32000640 1 -- 172.21.15.73:0/4183836572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b410 msgr2=0x7fbe2c06f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe32000640 1 --2- 172.21.15.73:0/4183836572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b410 0x7fbe2c06f270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe140097d0 tx=0x7fbe1402b930 comp rx=0 tx=0).stop 2024-03-23T06:22:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe32000640 1 -- 172.21.15.73:0/4183836572 shutdown_connections 2024-03-23T06:22:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe32000640 1 --2- 172.21.15.73:0/4183836572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b410 0x7fbe2c06f270 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe32000640 1 -- 172.21.15.73:0/4183836572 >> 172.21.15.73:0/4183836572 conn(0x7fbe2c0ccdd0 msgr2=0x7fbe2c0cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:09.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe32000640 1 -- 172.21.15.73:0/4183836572 shutdown_connections 2024-03-23T06:22:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.688+0000 7fbe32000640 1 -- 172.21.15.73:0/4183836572 wait complete. 2024-03-23T06:22:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.689+0000 7fbe32000640 1 Processor -- start 2024-03-23T06:22:09.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.690+0000 7fbe32000640 1 -- start start 2024-03-23T06:22:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.690+0000 7fbe32000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b030 0x7fbe2c1eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.690+0000 7fbe32000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe2c06b410 0x7fbe2c0c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.690+0000 7fbe32000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2c06df30 0x7fbe2c158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.690+0000 7fbe32000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c13a450 con 0x7fbe2c06b410 2024-03-23T06:22:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.690+0000 7fbe32000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0c48d0 con 0x7fbe2c06df30 2024-03-23T06:22:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.690+0000 7fbe32000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0c59f0 con 0x7fbe2c06b030 2024-03-23T06:22:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe2b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b030 0x7fbe2c1eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe22a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe2c06b410 0x7fbe2c0c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe22a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe2c06b410 0x7fbe2c0c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47394/0 (socket says 172.21.15.73:47394) 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe22a00640 1 -- 172.21.15.73:0/1424519331 learned_addr learned my addr 172.21.15.73:0/1424519331 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe2b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b030 0x7fbe2c1eed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:52156/0 (socket says 172.21.15.73:52156) 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe2be00640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2c06df30 0x7fbe2c158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe22a00640 1 -- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b030 msgr2=0x7fbe2c1eed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe22a00640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b030 0x7fbe2c1eed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe22a00640 1 -- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2c06df30 msgr2=0x7fbe2c158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe22a00640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2c06df30 0x7fbe2c158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe22a00640 1 -- 172.21.15.73:0/1424519331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe14009400 con 0x7fbe2c06b410 2024-03-23T06:22:09.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.692+0000 7fbe2be00640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2c06df30 0x7fbe2c158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.693+0000 7fbe22a00640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe2c06b410 0x7fbe2c0c5e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe140098f0 tx=0x7fbe140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.693+0000 7fbe23e00640 1 -- 172.21.15.73:0/1424519331 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14031830 con 0x7fbe2c06b410 2024-03-23T06:22:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.693+0000 7fbe23e00640 1 -- 172.21.15.73:0/1424519331 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe140453f0 con 0x7fbe2c06b410 2024-03-23T06:22:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.693+0000 7fbe23e00640 1 -- 172.21.15.73:0/1424519331 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140457a0 con 0x7fbe2c06b410 2024-03-23T06:22:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.693+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c0c4b00 con 0x7fbe2c06b410 2024-03-23T06:22:09.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.693+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c0c50c0 con 0x7fbe2c06b410 2024-03-23T06:22:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.694+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c067060 con 0x7fbe2c06b410 2024-03-23T06:22:09.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.695+0000 7fbe23e00640 1 -- 172.21.15.73:0/1424519331 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbe1404e450 con 0x7fbe2c06b410 2024-03-23T06:22:09.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.696+0000 7fbe23e00640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe0806ac00 0x7fbe0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:09.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.696+0000 7fbe23e00640 1 -- 172.21.15.73:0/1424519331 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fbe140abe80 con 0x7fbe2c06b410 2024-03-23T06:22:09.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.696+0000 7fbe2b400640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe0806ac00 0x7fbe0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:09.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.697+0000 7fbe2b400640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe0806ac00 0x7fbe0806d0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0012e0 tx=0x7fbe1c001700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:09.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.703+0000 7fbe23e00640 1 -- 172.21.15.73:0/1424519331 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fbe14076d00 con 0x7fbe2c06b410 2024-03-23T06:22:09.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.889+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe2c070350 con 0x7fbe0806ac00 2024-03-23T06:22:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.890+0000 7fbe23e00640 1 -- 172.21.15.73:0/1424519331 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbe1c004de0 con 0x7fbe0806ac00 2024-03-23T06:22:09.890 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-03-23T06:22:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe0806ac00 msgr2=0x7fbe0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe0806ac00 0x7fbe0806d0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0012e0 tx=0x7fbe1c001700 comp rx=0 tx=0).stop 2024-03-23T06:22:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe2c06b410 msgr2=0x7fbe2c0c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe2c06b410 0x7fbe2c0c5e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe140098f0 tx=0x7fbe140046c0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 shutdown_connections 2024-03-23T06:22:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe2c06df30 0x7fbe2c158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe2c06b410 0x7fbe2c0c5e80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fbe0806ac00 0x7fbe0806d0c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 --2- 172.21.15.73:0/1424519331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe2c06b030 0x7fbe2c1eed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:09.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 >> 172.21.15.73:0/1424519331 conn(0x7fbe2c0ccdd0 msgr2=0x7fbe2c0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:09.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 shutdown_connections 2024-03-23T06:22:09.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:09.893+0000 7fbe32000640 1 -- 172.21.15.73:0/1424519331 wait complete. 2024-03-23T06:22:09.912 INFO:tasks.ceph:Scrubbing osd.2 2024-03-23T06:22:09.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-23T06:22:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.111+0000 7fcdb6c00640 1 Processor -- start 2024-03-23T06:22:10.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.111+0000 7fcdb6c00640 1 -- start start 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.112+0000 7fcdb6c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcdb01538e0 0x7fcdb00cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.112+0000 7fcdb6c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb0159f70 0x7fcdb015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.112+0000 7fcdb6c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb0153cc0 con 0x7fcdb00ca840 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.112+0000 7fcdb6c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb015a4d0 con 0x7fcdb01538e0 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.112+0000 7fcdb6c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb015cc00 con 0x7fcdb0159f70 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdb4c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb0159f70 0x7fcdb015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdaf400640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcdb00ca840 0x7fcdb00713e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49252/0 (socket says 172.21.15.73:49252) 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdaf400640 1 -- 172.21.15.73:0/373730448 learned_addr learned my addr 172.21.15.73:0/373730448 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdafe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcdb01538e0 0x7fcdb00cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdb4c00640 1 -- 172.21.15.73:0/373730448 >> v2:172.21.15.110:3300/0 conn(0x7fcdb01538e0 msgr2=0x7fcdb00cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:10.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdb4c00640 1 --2- 172.21.15.73:0/373730448 >> v2:172.21.15.110:3300/0 conn(0x7fcdb01538e0 0x7fcdb00cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdb4c00640 1 -- 172.21.15.73:0/373730448 >> v1:172.21.15.73:6789/0 conn(0x7fcdb00ca840 legacy=0x7fcdb00713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdb4c00640 1 -- 172.21.15.73:0/373730448 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb015cea0 con 0x7fcdb0159f70 2024-03-23T06:22:10.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdafe00640 1 --2- 172.21.15.73:0/373730448 >> v2:172.21.15.110:3300/0 conn(0x7fcdb01538e0 0x7fcdb00cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:10.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.113+0000 7fcdaea00640 1 -- 172.21.15.73:0/373730448 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240261632 0 0) 0x7fcd9c001110 con 0x7fcdb00ca840 2024-03-23T06:22:10.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.114+0000 7fcdb4c00640 1 --2- 172.21.15.73:0/373730448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb0159f70 0x7fcdb015aa60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009d90 tx=0x7fcda802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34234d6322cec065 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.114+0000 7fcdaea00640 1 -- 172.21.15.73:0/373730448 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda802cce0 con 0x7fcdb0159f70 2024-03-23T06:22:10.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.114+0000 7fcdaea00640 1 -- 172.21.15.73:0/373730448 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda802ce40 con 0x7fcdb0159f70 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.114+0000 7fcdaea00640 1 -- 172.21.15.73:0/373730448 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8034660 con 0x7fcdb0159f70 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.115+0000 7fcdb6c00640 1 -- 172.21.15.73:0/373730448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb0159f70 msgr2=0x7fcdb015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.115+0000 7fcdb6c00640 1 --2- 172.21.15.73:0/373730448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb0159f70 0x7fcdb015aa60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009d90 tx=0x7fcda802bf30 comp rx=0 tx=0).stop 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.115+0000 7fcdb6c00640 1 -- 172.21.15.73:0/373730448 shutdown_connections 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.115+0000 7fcdb6c00640 1 --2- 172.21.15.73:0/373730448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb0159f70 0x7fcdb015aa60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.115+0000 7fcdb6c00640 1 --2- 172.21.15.73:0/373730448 >> v2:172.21.15.110:3300/0 conn(0x7fcdb01538e0 0x7fcdb00cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.115+0000 7fcdb6c00640 1 -- 172.21.15.73:0/373730448 >> 172.21.15.73:0/373730448 conn(0x7fcdb006c200 msgr2=0x7fcdb006c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.115+0000 7fcdb6c00640 1 -- 172.21.15.73:0/373730448 shutdown_connections 2024-03-23T06:22:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.115+0000 7fcdb6c00640 1 -- 172.21.15.73:0/373730448 wait complete. 2024-03-23T06:22:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.117+0000 7fcdb6c00640 1 Processor -- start 2024-03-23T06:22:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.117+0000 7fcdb6c00640 1 -- start start 2024-03-23T06:22:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdb6c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb00ca840 0x7fcdb014e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdb6c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdb01538e0 0x7fcdb014ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdb6c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb0159f70 0x7fcdb01f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdb6c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb01524a0 con 0x7fcdb01538e0 2024-03-23T06:22:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdb6c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb01518e0 con 0x7fcdb0159f70 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdb6c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00c91e0 con 0x7fcdb00ca840 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdafe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb00ca840 0x7fcdb014e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdafe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb00ca840 0x7fcdb014e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:54954/0 (socket says 172.21.15.73:54954) 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdafe00640 1 -- 172.21.15.73:0/3762960279 learned_addr learned my addr 172.21.15.73:0/3762960279 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdaf400640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdb01538e0 0x7fcdb014ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdb4c00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb0159f70 0x7fcdb01f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.118+0000 7fcdafe00640 1 -- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb0159f70 msgr2=0x7fcdb01f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcdafe00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdb0159f70 0x7fcdb01f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcdafe00640 1 -- 172.21.15.73:0/3762960279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdb01538e0 msgr2=0x7fcdb014ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcdafe00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdb01538e0 0x7fcdb014ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcdafe00640 1 -- 172.21.15.73:0/3762960279 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0009400 con 0x7fcdb00ca840 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcdafe00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb00ca840 0x7fcdb014e520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcda000ec10 tx=0x7fcda000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0009760 con 0x7fcdb00ca840 2024-03-23T06:22:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda000cc30 con 0x7fcdb00ca840 2024-03-23T06:22:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0013470 con 0x7fcdb00ca840 2024-03-23T06:22:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda8009a70 con 0x7fcdb00ca840 2024-03-23T06:22:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.119+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb00c6120 con 0x7fcdb00ca840 2024-03-23T06:22:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.120+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdb015d740 con 0x7fcdb00ca840 2024-03-23T06:22:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.121+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcda00135d0 con 0x7fcdb00ca840 2024-03-23T06:22:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.122+0000 7fcda7e00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd9006ac30 0x7fcd9006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.122+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fcda00896f0 con 0x7fcdb00ca840 2024-03-23T06:22:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.122+0000 7fcda7e00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fcd900743b0 0x7fcd90076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.122+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 --> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd90076f00 con 0x7fcd900743b0 2024-03-23T06:22:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.122+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcda008bcd0 con 0x7fcdb00ca840 2024-03-23T06:22:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.122+0000 7fcdaf400640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd9006ac30 0x7fcd9006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.122+0000 7fcdb4c00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fcd900743b0 0x7fcd90076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.123+0000 7fcdaf400640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd9006ac30 0x7fcd9006d0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00b1e90 tx=0x7fcd9c007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.123+0000 7fcdb4c00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fcd900743b0 0x7fcd90076830 crc :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.124+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 <== osd.2 v2:172.21.15.73:6800/36881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fcd90076f00 con 0x7fcd900743b0 2024-03-23T06:22:10.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.149+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 --> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcdb015d460 con 0x7fcd900743b0 2024-03-23T06:22:10.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.149+0000 7fcda7e00640 1 -- 172.21.15.73:0/3762960279 <== osd.2 v2:172.21.15.73:6800/36881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcda803e440 con 0x7fcd900743b0 2024-03-23T06:22:10.149 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:22:10.150 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T06:22:10.150 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fcd900743b0 msgr2=0x7fcd90076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb6c00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.73:6800/36881,v1:172.21.15.73:6801/36881] conn(0x7fcd900743b0 0x7fcd90076830 crc :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd9006ac30 msgr2=0x7fcd9006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb6c00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcd9006ac30 0x7fcd9006d0f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00b1e90 tx=0x7fcd9c007b90 comp rx=0 tx=0).stop 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb00ca840 msgr2=0x7fcdb014e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb6c00640 1 --2- 172.21.15.73:0/3762960279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdb00ca840 0x7fcdb014e520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcda000ec10 tx=0x7fcda000c520 comp rx=0 tx=0).stop 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb4c00640 1 -- 172.21.15.73:0/3762960279 reap_dead start 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 shutdown_connections 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.150+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 >> 172.21.15.73:0/3762960279 conn(0x7fcdb006c200 msgr2=0x7fcdb015c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.151+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 shutdown_connections 2024-03-23T06:22:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.151+0000 7fcdb6c00640 1 -- 172.21.15.73:0/3762960279 wait complete. 2024-03-23T06:22:10.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-23T06:22:10.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.372+0000 7fd453e00640 1 Processor -- start 2024-03-23T06:22:10.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.372+0000 7fd453e00640 1 -- start start 2024-03-23T06:22:10.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.373+0000 7fd453e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4540c5050 0x7fd4541592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.373+0000 7fd453e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540b4780 0x7fd4540c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45415a1f0 con 0x7fd4540cb130 2024-03-23T06:22:10.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4540c5430 con 0x7fd4540c5050 2024-03-23T06:22:10.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd454159950 con 0x7fd4540b4780 2024-03-23T06:22:10.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540b4780 0x7fd4540c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540b4780 0x7fd4540c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:54968/0 (socket says 172.21.15.73:54968) 2024-03-23T06:22:10.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453400640 1 -- 172.21.15.73:0/2300772521 learned_addr learned my addr 172.21.15.73:0/2300772521 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:10.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd452a00640 1 --2- 172.21.15.73:0/2300772521 >> v2:172.21.15.73:3300/0 conn(0x7fd4540c5050 0x7fd4541592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453400640 1 -- 172.21.15.73:0/2300772521 >> v2:172.21.15.73:3300/0 conn(0x7fd4540c5050 msgr2=0x7fd4541592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:10.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453400640 1 --2- 172.21.15.73:0/2300772521 >> v2:172.21.15.73:3300/0 conn(0x7fd4540c5050 0x7fd4541592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453400640 1 -- 172.21.15.73:0/2300772521 >> v1:172.21.15.73:6789/0 conn(0x7fd4540cb130 legacy=0x7fd454069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.374+0000 7fd453400640 1 -- 172.21.15.73:0/2300772521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd454159c30 con 0x7fd4540b4780 2024-03-23T06:22:10.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.375+0000 7fd453400640 1 --2- 172.21.15.73:0/2300772521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540b4780 0x7fd4540c9e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009e50 tx=0x7fd44c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84ab2e20f2188c2b server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd451600640 1 -- 172.21.15.73:0/2300772521 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c02ca80 con 0x7fd4540b4780 2024-03-23T06:22:10.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd451600640 1 -- 172.21.15.73:0/2300772521 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c02cbe0 con 0x7fd4540b4780 2024-03-23T06:22:10.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd451600640 1 -- 172.21.15.73:0/2300772521 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0343f0 con 0x7fd4540b4780 2024-03-23T06:22:10.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd453e00640 1 -- 172.21.15.73:0/2300772521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540b4780 msgr2=0x7fd4540c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd453e00640 1 --2- 172.21.15.73:0/2300772521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540b4780 0x7fd4540c9e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009e50 tx=0x7fd44c02bee0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd453e00640 1 -- 172.21.15.73:0/2300772521 shutdown_connections 2024-03-23T06:22:10.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd453e00640 1 --2- 172.21.15.73:0/2300772521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540b4780 0x7fd4540c9e30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd453e00640 1 --2- 172.21.15.73:0/2300772521 >> v2:172.21.15.73:3300/0 conn(0x7fd4540c5050 0x7fd4541592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd453e00640 1 -- 172.21.15.73:0/2300772521 >> 172.21.15.73:0/2300772521 conn(0x7fd4540ceb80 msgr2=0x7fd4540cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:10.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd453e00640 1 -- 172.21.15.73:0/2300772521 shutdown_connections 2024-03-23T06:22:10.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.376+0000 7fd453e00640 1 -- 172.21.15.73:0/2300772521 wait complete. 2024-03-23T06:22:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.378+0000 7fd453e00640 1 Processor -- start 2024-03-23T06:22:10.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.379+0000 7fd453e00640 1 -- start start 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.379+0000 7fd453e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4540b4780 0x7fd454155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.379+0000 7fd453e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4540c5050 0x7fd454154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.379+0000 7fd453e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540cb130 0x7fd4540c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.379+0000 7fd453e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540c7250 con 0x7fd4540c5050 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.379+0000 7fd453e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd454156270 con 0x7fd4540b4780 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.379+0000 7fd453e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540c7000 con 0x7fd4540cb130 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd452a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4540b4780 0x7fd454155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd453400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540cb130 0x7fd4540c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd452a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4540b4780 0x7fd454155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54754/0 (socket says 172.21.15.73:54754) 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd453400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540cb130 0x7fd4540c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:54970/0 (socket says 172.21.15.73:54970) 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd452a00640 1 -- 172.21.15.73:0/3685136289 learned_addr learned my addr 172.21.15.73:0/3685136289 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:10.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd452000640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4540c5050 0x7fd454154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd453400640 1 -- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4540b4780 msgr2=0x7fd454155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd453400640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4540b4780 0x7fd454155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd453400640 1 -- 172.21.15.73:0/3685136289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4540c5050 msgr2=0x7fd454154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd453400640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4540c5050 0x7fd454154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd453400640 1 -- 172.21.15.73:0/3685136289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c009b30 con 0x7fd4540cb130 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.380+0000 7fd453400640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540cb130 0x7fd4540c3bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd44c032000 tx=0x7fd44c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.381+0000 7fd44aa00640 1 -- 172.21.15.73:0/3685136289 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c009510 con 0x7fd4540cb130 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.381+0000 7fd44aa00640 1 -- 172.21.15.73:0/3685136289 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c03e450 con 0x7fd4540cb130 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.381+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd454159400 con 0x7fd4540cb130 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.381+0000 7fd44aa00640 1 -- 172.21.15.73:0/3685136289 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c03e800 con 0x7fd4540cb130 2024-03-23T06:22:10.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.381+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd454150830 con 0x7fd4540cb130 2024-03-23T06:22:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.382+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd454159660 con 0x7fd4540cb130 2024-03-23T06:22:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.383+0000 7fd44aa00640 1 -- 172.21.15.73:0/3685136289 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd44c02cd50 con 0x7fd4540cb130 2024-03-23T06:22:10.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.383+0000 7fd44aa00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd43406ac00 0x7fd43406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.384+0000 7fd44aa00640 1 -- 172.21.15.73:0/3685136289 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd44c0abff0 con 0x7fd4540cb130 2024-03-23T06:22:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.384+0000 7fd452a00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd43406ac00 0x7fd43406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.384+0000 7fd452a00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd43406ac00 0x7fd43406d0c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd444007a60 tx=0x7fd444008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.388+0000 7fd44aa00640 1 -- 172.21.15.73:0/3685136289 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd44c0df580 con 0x7fd4540cb130 2024-03-23T06:22:10.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.578+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4540c9910 con 0x7fd43406ac00 2024-03-23T06:22:10.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.579+0000 7fd44aa00640 1 -- 172.21.15.73:0/3685136289 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd444004020 con 0x7fd43406ac00 2024-03-23T06:22:10.579 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-03-23T06:22:10.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.581+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd43406ac00 msgr2=0x7fd43406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.581+0000 7fd453e00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd43406ac00 0x7fd43406d0c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd444007a60 tx=0x7fd444008040 comp rx=0 tx=0).stop 2024-03-23T06:22:10.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540cb130 msgr2=0x7fd4540c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540cb130 0x7fd4540c3bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd44c032000 tx=0x7fd44c004a40 comp rx=0 tx=0).stop 2024-03-23T06:22:10.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 shutdown_connections 2024-03-23T06:22:10.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd43406ac00 0x7fd43406d0c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4540cb130 0x7fd4540c3bf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4540c5050 0x7fd454154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 --2- 172.21.15.73:0/3685136289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4540b4780 0x7fd454155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 >> 172.21.15.73:0/3685136289 conn(0x7fd4540ceb80 msgr2=0x7fd4541521d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:10.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 shutdown_connections 2024-03-23T06:22:10.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.582+0000 7fd453e00640 1 -- 172.21.15.73:0/3685136289 wait complete. 2024-03-23T06:22:10.599 INFO:tasks.ceph:Scrubbing osd.3 2024-03-23T06:22:10.599 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-23T06:22:10.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.803+0000 7f5226600640 1 Processor -- start 2024-03-23T06:22:10.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.804+0000 7f5226600640 1 -- start start 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5226600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52201539c0 0x7f52200caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5226600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f522015d780 0x7f52200cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5226600640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52200c9b80 con 0x7f52200c9f80 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5226600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52200c5810 con 0x7f52201539c0 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5226600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f522015cbe0 con 0x7f522015d780 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5225200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52201539c0 0x7f52200caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5225c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f522015d780 0x7f52200cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5225c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f522015d780 0x7f52200cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54756/0 (socket says 172.21.15.73:54756) 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5225c00640 1 -- 172.21.15.73:0/3437389608 learned_addr learned my addr 172.21.15.73:0/3437389608 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f5225200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52201539c0 0x7f52200caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58710/0 (socket says 172.21.15.73:58710) 2024-03-23T06:22:10.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.805+0000 7f521fe00640 1 --1- 172.21.15.73:0/3437389608 >> v1:172.21.15.73:6789/0 conn(0x7f52200c9f80 0x7f522015d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49270/0 (socket says 172.21.15.73:49270) 2024-03-23T06:22:10.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.806+0000 7f5225c00640 1 -- 172.21.15.73:0/3437389608 >> v2:172.21.15.73:3300/0 conn(0x7f52201539c0 msgr2=0x7f52200caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:10.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.806+0000 7f5225c00640 1 --2- 172.21.15.73:0/3437389608 >> v2:172.21.15.73:3300/0 conn(0x7f52201539c0 0x7f52200caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.806+0000 7f5225c00640 1 -- 172.21.15.73:0/3437389608 >> v1:172.21.15.73:6789/0 conn(0x7f52200c9f80 legacy=0x7f522015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.806+0000 7f5225c00640 1 -- 172.21.15.73:0/3437389608 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200c4710 con 0x7f522015d780 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.807+0000 7f5225c00640 1 --2- 172.21.15.73:0/3437389608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 0x7f52200cb000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f52200b2360 tx=0x7f521802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240d3a58b0aecf5c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.807+0000 7f521f400640 1 -- 172.21.15.73:0/3437389608 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521802ca80 con 0x7f522015d780 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.807+0000 7f521f400640 1 -- 172.21.15.73:0/3437389608 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521802cbe0 con 0x7f522015d780 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.807+0000 7f521f400640 1 -- 172.21.15.73:0/3437389608 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180343f0 con 0x7f522015d780 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.808+0000 7f5226600640 1 -- 172.21.15.73:0/3437389608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 msgr2=0x7f52200cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.808+0000 7f5226600640 1 --2- 172.21.15.73:0/3437389608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 0x7f52200cb000 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f52200b2360 tx=0x7f521802bee0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.808+0000 7f5226600640 1 -- 172.21.15.73:0/3437389608 shutdown_connections 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.808+0000 7f5226600640 1 --2- 172.21.15.73:0/3437389608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 0x7f52200cb000 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.808+0000 7f5226600640 1 --2- 172.21.15.73:0/3437389608 >> v2:172.21.15.73:3300/0 conn(0x7f52201539c0 0x7f52200caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.808+0000 7f5226600640 1 -- 172.21.15.73:0/3437389608 >> 172.21.15.73:0/3437389608 conn(0x7f5220071c30 msgr2=0x7f522006bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:10.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.808+0000 7f5226600640 1 -- 172.21.15.73:0/3437389608 shutdown_connections 2024-03-23T06:22:10.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.808+0000 7f5226600640 1 -- 172.21.15.73:0/3437389608 wait complete. 2024-03-23T06:22:10.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.809+0000 7f5226600640 1 Processor -- start 2024-03-23T06:22:10.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.810+0000 7f5226600640 1 -- start start 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.810+0000 7f5226600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52200c9f80 0x7f52200cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.810+0000 7f5226600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201539c0 0x7f5220153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5226600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 0x7f52201f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5226600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52201f3000 con 0x7f52201539c0 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5226600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5220152180 con 0x7f522015d780 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5226600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52201f32a0 con 0x7f52200c9f80 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f521fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201539c0 0x7f5220153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5225c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 0x7f52201f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f521fe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201539c0 0x7f5220153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58718/0 (socket says 172.21.15.73:58718) 2024-03-23T06:22:10.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f521fe00640 1 -- 172.21.15.73:0/3094576659 learned_addr learned my addr 172.21.15.73:0/3094576659 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5225200640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52200c9f80 0x7f52200cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5225c00640 1 -- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52200c9f80 msgr2=0x7f52200cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5225c00640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52200c9f80 0x7f52200cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5225c00640 1 -- 172.21.15.73:0/3094576659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201539c0 msgr2=0x7f5220153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5225c00640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52201539c0 0x7f5220153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5225c00640 1 -- 172.21.15.73:0/3094576659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5218009b30 con 0x7f522015d780 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.811+0000 7f5225200640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52200c9f80 0x7f52200cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.812+0000 7f5225c00640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 0x7f52201f2740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5218032000 tx=0x7f5218004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.812+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218009510 con 0x7f522015d780 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.812+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521803e450 con 0x7f522015d780 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.812+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5220152420 con 0x7f522015d780 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.812+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521803e800 con 0x7f522015d780 2024-03-23T06:22:10.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.812+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52201e43a0 con 0x7f522015d780 2024-03-23T06:22:10.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.813+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52200c4fb0 con 0x7f522015d780 2024-03-23T06:22:10.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.814+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f521802cd50 con 0x7f522015d780 2024-03-23T06:22:10.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.814+0000 7f521cc00640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f520006ac30 0x7f520006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.815+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f52180ac060 con 0x7f522015d780 2024-03-23T06:22:10.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.815+0000 7f5225200640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f520006ac30 0x7f520006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.815+0000 7f521cc00640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7f52000743b0 0x7f5200076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:10.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.815+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 --> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5200076f00 con 0x7f52000743b0 2024-03-23T06:22:10.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.815+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52180ae5e0 con 0x7f522015d780 2024-03-23T06:22:10.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.815+0000 7f521fe00640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7f52000743b0 0x7f5200076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.815+0000 7f5225200640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f520006ac30 0x7f520006d0f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5214009f30 tx=0x7f5214009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.816+0000 7f521fe00640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7f52000743b0 0x7f5200076830 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:10.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.816+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 <== osd.3 v2:172.21.15.73:6813/36880 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f5200076f00 con 0x7f52000743b0 2024-03-23T06:22:10.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.830+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 --> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f52200c4cd0 con 0x7f52000743b0 2024-03-23T06:22:10.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f521cc00640 1 -- 172.21.15.73:0/3094576659 <== osd.3 v2:172.21.15.73:6813/36880 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f520c007320 con 0x7f52000743b0 2024-03-23T06:22:10.831 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:22:10.831 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T06:22:10.831 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7f52000743b0 msgr2=0x7f5200076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5226600640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.73:6813/36880,v1:172.21.15.73:6815/36880] conn(0x7f52000743b0 0x7f5200076830 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f520006ac30 msgr2=0x7f520006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5226600640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f520006ac30 0x7f520006d0f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5214009f30 tx=0x7f5214009190 comp rx=0 tx=0).stop 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 msgr2=0x7f52201f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5226600640 1 --2- 172.21.15.73:0/3094576659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f522015d780 0x7f52201f2740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5218032000 tx=0x7f5218004a40 comp rx=0 tx=0).stop 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5225c00640 1 -- 172.21.15.73:0/3094576659 reap_dead start 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 shutdown_connections 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.831+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 >> 172.21.15.73:0/3094576659 conn(0x7f5220071c30 msgr2=0x7f52200ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:10.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.832+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 shutdown_connections 2024-03-23T06:22:10.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:10.832+0000 7f5226600640 1 -- 172.21.15.73:0/3094576659 wait complete. 2024-03-23T06:22:10.847 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-23T06:22:11.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.038+0000 7f5674e00640 1 Processor -- start 2024-03-23T06:22:11.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.038+0000 7f5674e00640 1 -- start start 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.039+0000 7f5674e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c85e0 0x7f56700cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.039+0000 7f5674e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f56700c89c0 0x7f56701530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.039+0000 7f5674e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567015d7e0 con 0x7f56700c6300 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.039+0000 7f5674e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f567015c980 con 0x7f56700c89c0 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.039+0000 7f5674e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567015cc60 con 0x7f56700c85e0 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.040+0000 7f566ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f56700c89c0 0x7f56701530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.040+0000 7f566ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f56700c89c0 0x7f56701530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58726/0 (socket says 172.21.15.73:58726) 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.040+0000 7f566ea00640 1 -- 172.21.15.73:0/3691306675 learned_addr learned my addr 172.21.15.73:0/3691306675 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.040+0000 7f566f400640 1 --2- 172.21.15.73:0/3691306675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c85e0 0x7f56700cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.040+0000 7f566ea00640 1 -- 172.21.15.73:0/3691306675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c85e0 msgr2=0x7f56700cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.040+0000 7f566ea00640 1 --2- 172.21.15.73:0/3691306675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c85e0 0x7f56700cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.040+0000 7f566ea00640 1 -- 172.21.15.73:0/3691306675 >> v1:172.21.15.73:6789/0 conn(0x7f56700c6300 legacy=0x7f5670159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.040+0000 7f566ea00640 1 -- 172.21.15.73:0/3691306675 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567015cf40 con 0x7f56700c89c0 2024-03-23T06:22:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.041+0000 7f566ea00640 1 --2- 172.21.15.73:0/3691306675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c89c0 0x7f56701530f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f565c009870 tx=0x7f565c02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c40b02504d7a164 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.041+0000 7f566e000640 1 -- 172.21.15.73:0/3691306675 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c02f830 con 0x7f56700c89c0 2024-03-23T06:22:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.041+0000 7f566e000640 1 -- 172.21.15.73:0/3691306675 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c02f990 con 0x7f56700c89c0 2024-03-23T06:22:11.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.041+0000 7f566e000640 1 -- 172.21.15.73:0/3691306675 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c02fd20 con 0x7f56700c89c0 2024-03-23T06:22:11.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.042+0000 7f5674e00640 1 -- 172.21.15.73:0/3691306675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c89c0 msgr2=0x7f56701530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.042+0000 7f5674e00640 1 --2- 172.21.15.73:0/3691306675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c89c0 0x7f56701530f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f565c009870 tx=0x7f565c02ba10 comp rx=0 tx=0).stop 2024-03-23T06:22:11.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.042+0000 7f5674e00640 1 -- 172.21.15.73:0/3691306675 shutdown_connections 2024-03-23T06:22:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.042+0000 7f5674e00640 1 --2- 172.21.15.73:0/3691306675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c89c0 0x7f56701530f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.042+0000 7f5674e00640 1 --2- 172.21.15.73:0/3691306675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c85e0 0x7f56700cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.042+0000 7f5674e00640 1 -- 172.21.15.73:0/3691306675 >> 172.21.15.73:0/3691306675 conn(0x7f567006adc0 msgr2=0x7f567006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.042+0000 7f5674e00640 1 -- 172.21.15.73:0/3691306675 shutdown_connections 2024-03-23T06:22:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.042+0000 7f5674e00640 1 -- 172.21.15.73:0/3691306675 wait complete. 2024-03-23T06:22:11.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.044+0000 7f5674e00640 1 Processor -- start 2024-03-23T06:22:11.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.044+0000 7f5674e00640 1 -- start start 2024-03-23T06:22:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f5674e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56700c6300 0x7f5670155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f5674e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c85e0 0x7f56700c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f5674e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c89c0 0x7f56700c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f5674e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56700cb7a0 con 0x7f56700c85e0 2024-03-23T06:22:11.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f5674e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56700c3030 con 0x7f56700c6300 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f5674e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56700cb4c0 con 0x7f56700c89c0 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56700c6300 0x7f5670155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56700c6300 0x7f5670155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54780/0 (socket says 172.21.15.73:54780) 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c85e0 0x7f56700c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566f400640 1 -- 172.21.15.73:0/2565844711 learned_addr learned my addr 172.21.15.73:0/2565844711 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566fe00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c89c0 0x7f56700c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566f400640 1 -- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c89c0 msgr2=0x7f56700c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566f400640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c89c0 0x7f56700c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566f400640 1 -- 172.21.15.73:0/2565844711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c85e0 msgr2=0x7f56700c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566f400640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c85e0 0x7f56700c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566f400640 1 -- 172.21.15.73:0/2565844711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0094d0 con 0x7f56700c6300 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.045+0000 7f566ea00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c85e0 0x7f56700c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.046+0000 7f566f400640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56700c6300 0x7f5670155300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f566000e9b0 tx=0x7f566000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.046+0000 7f5667400640 1 -- 172.21.15.73:0/2565844711 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660009670 con 0x7f56700c6300 2024-03-23T06:22:11.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.046+0000 7f5667400640 1 -- 172.21.15.73:0/2565844711 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566000c9a0 con 0x7f56700c6300 2024-03-23T06:22:11.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.046+0000 7f5667400640 1 -- 172.21.15.73:0/2565844711 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566000cd50 con 0x7f56700c6300 2024-03-23T06:22:11.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.046+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56700c2170 con 0x7f56700c6300 2024-03-23T06:22:11.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.046+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56700c3280 con 0x7f56700c6300 2024-03-23T06:22:11.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.047+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56700c3470 con 0x7f56700c6300 2024-03-23T06:22:11.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.048+0000 7f5667400640 1 -- 172.21.15.73:0/2565844711 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5660013470 con 0x7f56700c6300 2024-03-23T06:22:11.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.048+0000 7f5667400640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f565006ac00 0x7f565006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.049+0000 7f5667400640 1 -- 172.21.15.73:0/2565844711 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f5660089820 con 0x7f56700c6300 2024-03-23T06:22:11.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.049+0000 7f566ea00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f565006ac00 0x7f565006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.049+0000 7f566ea00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f565006ac00 0x7f565006d0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f565c036000 tx=0x7f565c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.053+0000 7f5667400640 1 -- 172.21.15.73:0/2565844711 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f56600547d0 con 0x7f56700c6300 2024-03-23T06:22:11.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.237+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f567015d500 con 0x7f565006ac00 2024-03-23T06:22:11.238 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.238+0000 7f5667400640 1 -- 172.21.15.73:0/2565844711 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f565c042440 con 0x7f565006ac00 2024-03-23T06:22:11.238 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-03-23T06:22:11.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f565006ac00 msgr2=0x7f565006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f565006ac00 0x7f565006d0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f565c036000 tx=0x7f565c008030 comp rx=0 tx=0).stop 2024-03-23T06:22:11.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56700c6300 msgr2=0x7f5670155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56700c6300 0x7f5670155300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f566000e9b0 tx=0x7f566000ee70 comp rx=0 tx=0).stop 2024-03-23T06:22:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 shutdown_connections 2024-03-23T06:22:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f565006ac00 0x7f565006d0c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56700c89c0 0x7f56700c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700c85e0 0x7f56700c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 --2- 172.21.15.73:0/2565844711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56700c6300 0x7f5670155300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 >> 172.21.15.73:0/2565844711 conn(0x7f567006adc0 msgr2=0x7f5670157130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 shutdown_connections 2024-03-23T06:22:11.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.241+0000 7f5674e00640 1 -- 172.21.15.73:0/2565844711 wait complete. 2024-03-23T06:22:11.259 INFO:tasks.ceph:Scrubbing osd.4 2024-03-23T06:22:11.259 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-23T06:22:11.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.454+0000 7fa1afe00640 1 Processor -- start 2024-03-23T06:22:11.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.454+0000 7fa1afe00640 1 -- start start 2024-03-23T06:22:11.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.455+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b0139a80 0x7fa1b00cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1afe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa1b00cc050 0x7fa1b0157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1afe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1b0157b60 0x7fa1b00c5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1afe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b00cc490 con 0x7fa1b00cc050 2024-03-23T06:22:11.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1afe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b006a7b0 con 0x7fa1b0157b60 2024-03-23T06:22:11.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1afe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0157fb0 con 0x7fa1b0139a80 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1aea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b0139a80 0x7fa1b00cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1aea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b0139a80 0x7fa1b00cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55010/0 (socket says 172.21.15.73:55010) 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1aea00640 1 -- 172.21.15.73:0/8083272 learned_addr learned my addr 172.21.15.73:0/8083272 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1af400640 1 --2- 172.21.15.73:0/8083272 >> v2:172.21.15.110:3300/0 conn(0x7fa1b0157b60 0x7fa1b00c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1ae000640 1 --2- 172.21.15.73:0/8083272 >> v2:172.21.15.73:3300/0 conn(0x7fa1b00cc050 0x7fa1b0157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1aea00640 1 -- 172.21.15.73:0/8083272 >> v2:172.21.15.110:3300/0 conn(0x7fa1b0157b60 msgr2=0x7fa1b00c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1aea00640 1 --2- 172.21.15.73:0/8083272 >> v2:172.21.15.110:3300/0 conn(0x7fa1b0157b60 0x7fa1b00c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1aea00640 1 -- 172.21.15.73:0/8083272 >> v2:172.21.15.73:3300/0 conn(0x7fa1b00cc050 msgr2=0x7fa1b0157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1aea00640 1 --2- 172.21.15.73:0/8083272 >> v2:172.21.15.73:3300/0 conn(0x7fa1b00cc050 0x7fa1b0157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.456+0000 7fa1aea00640 1 -- 172.21.15.73:0/8083272 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b015a970 con 0x7fa1b0139a80 2024-03-23T06:22:11.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.457+0000 7fa1aea00640 1 --2- 172.21.15.73:0/8083272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b0139a80 0x7fa1b00cbb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa1b013d330 tx=0x7fa1a002b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd7974500ba3f261 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1ad600640 1 -- 172.21.15.73:0/8083272 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0030850 con 0x7fa1b0139a80 2024-03-23T06:22:11.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1ad600640 1 -- 172.21.15.73:0/8083272 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a00309b0 con 0x7fa1b0139a80 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1ad600640 1 -- 172.21.15.73:0/8083272 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0030d40 con 0x7fa1b0139a80 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 -- 172.21.15.73:0/8083272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b0139a80 msgr2=0x7fa1b00cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 --2- 172.21.15.73:0/8083272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b0139a80 0x7fa1b00cbb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa1b013d330 tx=0x7fa1a002b990 comp rx=0 tx=0).stop 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 -- 172.21.15.73:0/8083272 shutdown_connections 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 --2- 172.21.15.73:0/8083272 >> v2:172.21.15.110:3300/0 conn(0x7fa1b0157b60 0x7fa1b00c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 --2- 172.21.15.73:0/8083272 >> v2:172.21.15.73:3300/0 conn(0x7fa1b00cc050 0x7fa1b0157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 --2- 172.21.15.73:0/8083272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b0139a80 0x7fa1b00cbb10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 -- 172.21.15.73:0/8083272 >> 172.21.15.73:0/8083272 conn(0x7fa1b006c3b0 msgr2=0x7fa1b006c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 -- 172.21.15.73:0/8083272 shutdown_connections 2024-03-23T06:22:11.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.458+0000 7fa1afe00640 1 -- 172.21.15.73:0/8083272 wait complete. 2024-03-23T06:22:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.460+0000 7fa1afe00640 1 Processor -- start 2024-03-23T06:22:11.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.460+0000 7fa1afe00640 1 -- start start 2024-03-23T06:22:11.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b00cc050 0x7fa1b01efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1b0139a80 0x7fa1b0133660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b0157b60 0x7fa1b0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1afe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0154a40 con 0x7fa1b0139a80 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1afe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01526e0 con 0x7fa1b0157b60 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1afe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0138840 con 0x7fa1b00cc050 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1aea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b00cc050 0x7fa1b01efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1ae000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1b0139a80 0x7fa1b0133660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1af400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b0157b60 0x7fa1b0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1aea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b00cc050 0x7fa1b01efad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55020/0 (socket says 172.21.15.73:55020) 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.461+0000 7fa1aea00640 1 -- 172.21.15.73:0/1643846292 learned_addr learned my addr 172.21.15.73:0/1643846292 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1aea00640 1 -- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b0157b60 msgr2=0x7fa1b0155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1aea00640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1b0157b60 0x7fa1b0155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1aea00640 1 -- 172.21.15.73:0/1643846292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1b0139a80 msgr2=0x7fa1b0133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1aea00640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1b0139a80 0x7fa1b0133660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1aea00640 1 -- 172.21.15.73:0/1643846292 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00094d0 con 0x7fa1b00cc050 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1aea00640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b00cc050 0x7fa1b01efad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0000c00 tx=0x7fa1a0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0039c10 con 0x7fa1b00cc050 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0039d90 con 0x7fa1b00cc050 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b01382c0 con 0x7fa1b00cc050 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.462+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00446c0 con 0x7fa1b00cc050 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.463+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b0152370 con 0x7fa1b00cc050 2024-03-23T06:22:11.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.463+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1b015b210 con 0x7fa1b00cc050 2024-03-23T06:22:11.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.465+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa1a002e070 con 0x7fa1b00cc050 2024-03-23T06:22:11.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.466+0000 7fa1a6a00640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa19006ac30 0x7fa19006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.466+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fa1a003e070 con 0x7fa1b00cc050 2024-03-23T06:22:11.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.466+0000 7fa1ae000640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa19006ac30 0x7fa19006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.466+0000 7fa1a6a00640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fa1900743b0 0x7fa190076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.466+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 --> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa190076f00 con 0x7fa1900743b0 2024-03-23T06:22:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.466+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1a00b02c0 con 0x7fa1b00cc050 2024-03-23T06:22:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.466+0000 7fa1af400640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fa1900743b0 0x7fa190076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.467+0000 7fa1ae000640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa19006ac30 0x7fa19006d0f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa1b013d330 tx=0x7fa19c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.467+0000 7fa1af400640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fa1900743b0 0x7fa190076830 crc :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.468+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 <== osd.4 v2:172.21.15.110:6800/38266 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fa190076f00 con 0x7fa1900743b0 2024-03-23T06:22:11.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.480+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 --> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa1b015af30 con 0x7fa1900743b0 2024-03-23T06:22:11.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.481+0000 7fa1a6a00640 1 -- 172.21.15.73:0/1643846292 <== osd.4 v2:172.21.15.110:6800/38266 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa1a8016040 con 0x7fa1900743b0 2024-03-23T06:22:11.481 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:22:11.481 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T06:22:11.481 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:22:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.481+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fa1900743b0 msgr2=0x7fa190076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.481+0000 7fa1afe00640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6800/38266,v1:172.21.15.110:6801/38266] conn(0x7fa1900743b0 0x7fa190076830 crc :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.481+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa19006ac30 msgr2=0x7fa19006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.481+0000 7fa1afe00640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa19006ac30 0x7fa19006d0f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa1b013d330 tx=0x7fa19c009190 comp rx=0 tx=0).stop 2024-03-23T06:22:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.481+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b00cc050 msgr2=0x7fa1b01efad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.481+0000 7fa1afe00640 1 --2- 172.21.15.73:0/1643846292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1b00cc050 0x7fa1b01efad0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0000c00 tx=0x7fa1a0004730 comp rx=0 tx=0).stop 2024-03-23T06:22:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.481+0000 7fa1af400640 1 -- 172.21.15.73:0/1643846292 reap_dead start 2024-03-23T06:22:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.482+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 shutdown_connections 2024-03-23T06:22:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.482+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 >> 172.21.15.73:0/1643846292 conn(0x7fa1b006c3b0 msgr2=0x7fa1b0134150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.482+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 shutdown_connections 2024-03-23T06:22:11.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.482+0000 7fa1afe00640 1 -- 172.21.15.73:0/1643846292 wait complete. 2024-03-23T06:22:11.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-23T06:22:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.684+0000 7f8407e00640 1 Processor -- start 2024-03-23T06:22:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.684+0000 7f8407e00640 1 -- start start 2024-03-23T06:22:11.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8407e00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84080c5050 0x7f84081592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8407e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8407e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840815a1f0 con 0x7f84080cb130 2024-03-23T06:22:11.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8407e00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84080c5430 con 0x7f84080c5050 2024-03-23T06:22:11.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8407e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8408159950 con 0x7f84080b4780 2024-03-23T06:22:11.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8407400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8406a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84080c5050 0x7f84081592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8407400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55034/0 (socket says 172.21.15.73:55034) 2024-03-23T06:22:11.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8406000640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f84080cb130 0x7f8408069cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49298/0 (socket says 172.21.15.73:49298) 2024-03-23T06:22:11.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.686+0000 7f8407400640 1 -- 172.21.15.73:0/1063597858 learned_addr learned my addr 172.21.15.73:0/1063597858 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.687+0000 7f8406a00640 1 -- 172.21.15.73:0/1063597858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 msgr2=0x7f84080c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.687+0000 7f8406a00640 1 --2- 172.21.15.73:0/1063597858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.687+0000 7f8406a00640 1 -- 172.21.15.73:0/1063597858 >> v1:172.21.15.73:6789/0 conn(0x7f84080cb130 legacy=0x7f8408069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.687+0000 7f8406a00640 1 -- 172.21.15.73:0/1063597858 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8408159c30 con 0x7f84080c5050 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.687+0000 7f8405600640 1 -- 172.21.15.73:0/1063597858 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17709021 0 0) 0x7f840815a1f0 con 0x7f84080cb130 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.687+0000 7f8407400640 1 --2- 172.21.15.73:0/1063597858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.688+0000 7f8406a00640 1 --2- 172.21.15.73:0/1063597858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 0x7f84081592a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f83f80097a0 tx=0x7f83f802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867c2c866ab007df server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.688+0000 7f8405600640 1 -- 172.21.15.73:0/1063597858 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8031780 con 0x7f84080c5050 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.688+0000 7f8405600640 1 -- 172.21.15.73:0/1063597858 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80318e0 con 0x7f84080c5050 2024-03-23T06:22:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.688+0000 7f8405600640 1 -- 172.21.15.73:0/1063597858 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8031c70 con 0x7f84080c5050 2024-03-23T06:22:11.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.688+0000 7f8407e00640 1 -- 172.21.15.73:0/1063597858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 msgr2=0x7f84081592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.688+0000 7f8407e00640 1 --2- 172.21.15.73:0/1063597858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 0x7f84081592a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f83f80097a0 tx=0x7f83f802b820 comp rx=0 tx=0).stop 2024-03-23T06:22:11.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.689+0000 7f8407e00640 1 -- 172.21.15.73:0/1063597858 shutdown_connections 2024-03-23T06:22:11.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.689+0000 7f8407e00640 1 --2- 172.21.15.73:0/1063597858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.689+0000 7f8407e00640 1 --2- 172.21.15.73:0/1063597858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 0x7f84081592a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.689+0000 7f8407e00640 1 -- 172.21.15.73:0/1063597858 >> 172.21.15.73:0/1063597858 conn(0x7f84080ceb80 msgr2=0x7f84080cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:11.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.689+0000 7f8407e00640 1 -- 172.21.15.73:0/1063597858 shutdown_connections 2024-03-23T06:22:11.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.689+0000 7f8407e00640 1 -- 172.21.15.73:0/1063597858 wait complete. 2024-03-23T06:22:11.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.690+0000 7f8407e00640 1 Processor -- start 2024-03-23T06:22:11.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.690+0000 7f8407e00640 1 -- start start 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.691+0000 7f8407e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.691+0000 7f8407e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 0x7f8408152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.691+0000 7f8407e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84080cb130 0x7f8408146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.691+0000 7f8407e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408150b20 con 0x7f84080c5050 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.691+0000 7f8407e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408151660 con 0x7f84080cb130 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.691+0000 7f8407e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840814f130 con 0x7f84080b4780 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.691+0000 7f8406000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 0x7f8408152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8406a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8407400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84080cb130 0x7f8408146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8406a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55038/0 (socket says 172.21.15.73:55038) 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8407400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84080cb130 0x7f8408146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54808/0 (socket says 172.21.15.73:54808) 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8406000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 0x7f8408152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58778/0 (socket says 172.21.15.73:58778) 2024-03-23T06:22:11.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8406a00640 1 -- 172.21.15.73:0/2023080534 learned_addr learned my addr 172.21.15.73:0/2023080534 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8407400640 1 -- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 msgr2=0x7f84080cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8407400640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8407400640 1 -- 172.21.15.73:0/2023080534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 msgr2=0x7f8408152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8407400640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 0x7f8408152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8407400640 1 -- 172.21.15.73:0/2023080534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400009b30 con 0x7f84080cb130 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8406a00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f8407400640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84080cb130 0x7f8408146250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f840000efc0 tx=0x7f840000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f83ff400640 1 -- 172.21.15.73:0/2023080534 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400018070 con 0x7f84080cb130 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.692+0000 7f83ff400640 1 -- 172.21.15.73:0/2023080534 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840000f040 con 0x7f84080cb130 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.693+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f8009400 con 0x7f84080cb130 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.693+0000 7f83ff400640 1 -- 172.21.15.73:0/2023080534 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000cce0 con 0x7f84080cb130 2024-03-23T06:22:11.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.693+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840814f900 con 0x7f84080cb130 2024-03-23T06:22:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.694+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8408069310 con 0x7f84080cb130 2024-03-23T06:22:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.695+0000 7f83ff400640 1 -- 172.21.15.73:0/2023080534 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8400014480 con 0x7f84080cb130 2024-03-23T06:22:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.695+0000 7f83ff400640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83e806ac30 0x7f83e806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:11.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.696+0000 7f83ff400640 1 -- 172.21.15.73:0/2023080534 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f84000897f0 con 0x7f84080cb130 2024-03-23T06:22:11.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.696+0000 7f8406a00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83e806ac30 0x7f83e806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:11.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.696+0000 7f8406a00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83e806ac30 0x7f83e806d0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000c00 tx=0x7f83f803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:11.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.700+0000 7f83ff400640 1 -- 172.21.15.73:0/2023080534 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8400054700 con 0x7f84080cb130 2024-03-23T06:22:11.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.889+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f84080c9910 con 0x7f83e806ac30 2024-03-23T06:22:11.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.890+0000 7f83ff400640 1 -- 172.21.15.73:0/2023080534 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83f8031ad0 con 0x7f83e806ac30 2024-03-23T06:22:11.890 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-03-23T06:22:11.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83e806ac30 msgr2=0x7f83e806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83e806ac30 0x7f83e806d0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f83f8000c00 tx=0x7f83f803d040 comp rx=0 tx=0).stop 2024-03-23T06:22:11.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84080cb130 msgr2=0x7f8408146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:11.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84080cb130 0x7f8408146250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f840000efc0 tx=0x7f840000c490 comp rx=0 tx=0).stop 2024-03-23T06:22:11.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 shutdown_connections 2024-03-23T06:22:11.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84080cb130 0x7f8408146250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080c5050 0x7f8408152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f83e806ac30 0x7f83e806d0f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 --2- 172.21.15.73:0/2023080534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84080b4780 0x7f84080cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:11.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 >> 172.21.15.73:0/2023080534 conn(0x7f84080ceb80 msgr2=0x7f84081e5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:11.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 shutdown_connections 2024-03-23T06:22:11.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:11.893+0000 7f8407e00640 1 -- 172.21.15.73:0/2023080534 wait complete. 2024-03-23T06:22:11.910 INFO:tasks.ceph:Scrubbing osd.5 2024-03-23T06:22:11.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-23T06:22:12.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.108+0000 7fcc13200640 1 Processor -- start 2024-03-23T06:22:12.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.108+0000 7fcc13200640 1 -- start start 2024-03-23T06:22:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.110+0000 7fcc13200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c8df0 0x7fcc1406adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.110+0000 7fcc13200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1415a020 con 0x7fcc141535d0 2024-03-23T06:22:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.110+0000 7fcc13200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc14159170 con 0x7fcc140c3b90 2024-03-23T06:22:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.110+0000 7fcc13200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1406cdd0 con 0x7fcc140c8df0 2024-03-23T06:22:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.110+0000 7fcc11e00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcc141535d0 0x7fcc14159910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49310/0 (socket says 172.21.15.73:49310) 2024-03-23T06:22:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.110+0000 7fcc11e00640 1 -- 172.21.15.73:0/2055080976 learned_addr learned my addr 172.21.15.73:0/2055080976 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:12.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.111+0000 7fcc0be00640 1 --2- 172.21.15.73:0/2055080976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c8df0 0x7fcc1406adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.111+0000 7fcc11400640 1 -- 172.21.15.73:0/2055080976 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224744935 0 0) 0x7fcc14159170 con 0x7fcc140c3b90 2024-03-23T06:22:12.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.111+0000 7fcc11400640 1 -- 172.21.15.73:0/2055080976 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf8003520 con 0x7fcc140c3b90 2024-03-23T06:22:12.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.111+0000 7fcc11400640 1 -- 172.21.15.73:0/2055080976 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188910434 0 0) 0x7fcc1415a020 con 0x7fcc141535d0 2024-03-23T06:22:12.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.111+0000 7fcc11400640 1 -- 172.21.15.73:0/2055080976 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc14159170 con 0x7fcc141535d0 2024-03-23T06:22:12.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.111+0000 7fcc0be00640 1 -- 172.21.15.73:0/2055080976 >> v1:172.21.15.110:6789/0 conn(0x7fcc140c3b90 legacy=0x7fcc14163af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.111+0000 7fcc0be00640 1 -- 172.21.15.73:0/2055080976 >> v1:172.21.15.73:6789/0 conn(0x7fcc141535d0 legacy=0x7fcc14159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.111+0000 7fcc0be00640 1 -- 172.21.15.73:0/2055080976 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140c9350 con 0x7fcc140c8df0 2024-03-23T06:22:12.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.112+0000 7fcc0be00640 1 --2- 172.21.15.73:0/2055080976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c8df0 0x7fcc1406adc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0097c0 tx=0x7fcbfc02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20cf4dfd90d5e8bb server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.112+0000 7fcc11400640 1 -- 172.21.15.73:0/2055080976 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc030880 con 0x7fcc140c8df0 2024-03-23T06:22:12.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.112+0000 7fcc11400640 1 -- 172.21.15.73:0/2055080976 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0309e0 con 0x7fcc140c8df0 2024-03-23T06:22:12.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.112+0000 7fcc11400640 1 -- 172.21.15.73:0/2055080976 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc030d70 con 0x7fcc140c8df0 2024-03-23T06:22:12.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.113+0000 7fcc13200640 1 -- 172.21.15.73:0/2055080976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c8df0 msgr2=0x7fcc1406adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.113+0000 7fcc13200640 1 --2- 172.21.15.73:0/2055080976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c8df0 0x7fcc1406adc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0097c0 tx=0x7fcbfc02b9c0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.113+0000 7fcc13200640 1 -- 172.21.15.73:0/2055080976 shutdown_connections 2024-03-23T06:22:12.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.113+0000 7fcc13200640 1 --2- 172.21.15.73:0/2055080976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c8df0 0x7fcc1406adc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.113+0000 7fcc13200640 1 -- 172.21.15.73:0/2055080976 >> 172.21.15.73:0/2055080976 conn(0x7fcc14066080 msgr2=0x7fcc1406da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:12.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.113+0000 7fcc13200640 1 -- 172.21.15.73:0/2055080976 shutdown_connections 2024-03-23T06:22:12.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.113+0000 7fcc13200640 1 -- 172.21.15.73:0/2055080976 wait complete. 2024-03-23T06:22:12.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.115+0000 7fcc13200640 1 Processor -- start 2024-03-23T06:22:12.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.115+0000 7fcc13200640 1 -- start start 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc13200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c3b90 0x7fcc14150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc13200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140c8df0 0x7fcc1415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc13200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc141535d0 0x7fcc14155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc13200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1415a330 con 0x7fcc140c8df0 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc13200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc140c6290 con 0x7fcc141535d0 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc13200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1415b120 con 0x7fcc140c3b90 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc11e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c3b90 0x7fcc14150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc0be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140c8df0 0x7fcc1415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc11e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c3b90 0x7fcc14150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55052/0 (socket says 172.21.15.73:55052) 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc11e00640 1 -- 172.21.15.73:0/3068515411 learned_addr learned my addr 172.21.15.73:0/3068515411 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc12800640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc141535d0 0x7fcc14155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc11e00640 1 -- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc141535d0 msgr2=0x7fcc14155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc11e00640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc141535d0 0x7fcc14155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc11e00640 1 -- 172.21.15.73:0/3068515411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140c8df0 msgr2=0x7fcc1415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc11e00640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc140c8df0 0x7fcc1415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.116+0000 7fcc11e00640 1 -- 172.21.15.73:0/3068515411 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc0093a0 con 0x7fcc140c3b90 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.117+0000 7fcc11e00640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c3b90 0x7fcc14150780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c430 tx=0x7fcc0400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.117+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04005ce0 con 0x7fcc140c3b90 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.117+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04005e40 con 0x7fcc140c3b90 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.117+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1415a510 con 0x7fcc140c3b90 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.117+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04007310 con 0x7fcc140c3b90 2024-03-23T06:22:12.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.117+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1415aad0 con 0x7fcc140c3b90 2024-03-23T06:22:12.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.118+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc14071e70 con 0x7fcc140c3b90 2024-03-23T06:22:12.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.119+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcc04007470 con 0x7fcc140c3b90 2024-03-23T06:22:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.120+0000 7fcc0a000640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcbf006ac30 0x7fcbf006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.120+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fcc04088c70 con 0x7fcc140c3b90 2024-03-23T06:22:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.120+0000 7fcc0be00640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcbf006ac30 0x7fcbf006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.120+0000 7fcc0a000640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7fcbf00743b0 0x7fcbf0076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.120+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 --> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcbf0076f00 con 0x7fcbf00743b0 2024-03-23T06:22:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.120+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc0408d2a0 con 0x7fcc140c3b90 2024-03-23T06:22:12.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.120+0000 7fcc12800640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7fcbf00743b0 0x7fcbf0076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.121+0000 7fcc0be00640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcbf006ac30 0x7fcbf006d0f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc036000 tx=0x7fcbfc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.121+0000 7fcc12800640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7fcbf00743b0 0x7fcbf0076830 crc :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.121+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 <== osd.5 v2:172.21.15.110:6816/38268 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fcbf0076f00 con 0x7fcbf00743b0 2024-03-23T06:22:12.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.135+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 --> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcc14071b90 con 0x7fcbf00743b0 2024-03-23T06:22:12.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.135+0000 7fcc0a000640 1 -- 172.21.15.73:0/3068515411 <== osd.5 v2:172.21.15.110:6816/38268 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcc0c001b80 con 0x7fcbf00743b0 2024-03-23T06:22:12.136 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:22:12.136 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T06:22:12.136 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7fcbf00743b0 msgr2=0x7fcbf0076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6816/38268,v1:172.21.15.110:6817/38268] conn(0x7fcbf00743b0 0x7fcbf0076830 crc :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcbf006ac30 msgr2=0x7fcbf006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fcbf006ac30 0x7fcbf006d0f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc036000 tx=0x7fcbfc008030 comp rx=0 tx=0).stop 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c3b90 msgr2=0x7fcc14150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 --2- 172.21.15.73:0/3068515411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc140c3b90 0x7fcc14150780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400c430 tx=0x7fcc0400c8f0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc12800640 1 -- 172.21.15.73:0/3068515411 reap_dead start 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 shutdown_connections 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 >> 172.21.15.73:0/3068515411 conn(0x7fcc14066080 msgr2=0x7fcc140c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 shutdown_connections 2024-03-23T06:22:12.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.136+0000 7fcc13200640 1 -- 172.21.15.73:0/3068515411 wait complete. 2024-03-23T06:22:12.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-23T06:22:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.340+0000 7f88cfe00640 1 Processor -- start 2024-03-23T06:22:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.340+0000 7f88cfe00640 1 -- start start 2024-03-23T06:22:12.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cfe00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88d00c5050 0x7f88d01592a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d0069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cfe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88d00b4780 0x7f88d006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cfe00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d015a1f0 con 0x7f88d00c5050 2024-03-23T06:22:12.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cfe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d00c5430 con 0x7f88d00b4780 2024-03-23T06:22:12.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cfe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0159950 con 0x7f88d00cb130 2024-03-23T06:22:12.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cf400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88d00b4780 0x7f88d006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88ce000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d0069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88d00c5050 0x7f88d01592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cf400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88d00b4780 0x7f88d006a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54820/0 (socket says 172.21.15.73:54820) 2024-03-23T06:22:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cf400640 1 -- 172.21.15.73:0/1456183380 learned_addr learned my addr 172.21.15.73:0/1456183380 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88ce000640 1 -- 172.21.15.73:0/1456183380 >> v2:172.21.15.110:3300/0 conn(0x7f88d00b4780 msgr2=0x7f88d006a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:12.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88ce000640 1 --2- 172.21.15.73:0/1456183380 >> v2:172.21.15.110:3300/0 conn(0x7f88d00b4780 0x7f88d006a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88ce000640 1 -- 172.21.15.73:0/1456183380 >> v2:172.21.15.73:3300/0 conn(0x7f88d00c5050 msgr2=0x7f88d01592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:12.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88ce000640 1 --2- 172.21.15.73:0/1456183380 >> v2:172.21.15.73:3300/0 conn(0x7f88d00c5050 0x7f88d01592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88ce000640 1 -- 172.21.15.73:0/1456183380 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0159c30 con 0x7f88d00cb130 2024-03-23T06:22:12.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.342+0000 7f88cf400640 1 --2- 172.21.15.73:0/1456183380 >> v2:172.21.15.110:3300/0 conn(0x7f88d00b4780 0x7f88d006a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:12.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.343+0000 7f88cea00640 1 --2- 172.21.15.73:0/1456183380 >> v2:172.21.15.73:3300/0 conn(0x7f88d00c5050 0x7f88d01592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:12.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.344+0000 7f88ce000640 1 --2- 172.21.15.73:0/1456183380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d0069cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f88d0066720 tx=0x7f88bc02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0eff0cc0d97555d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.344+0000 7f88cd600640 1 -- 172.21.15.73:0/1456183380 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc02f050 con 0x7f88d00cb130 2024-03-23T06:22:12.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.344+0000 7f88cd600640 1 -- 172.21.15.73:0/1456183380 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88bc031700 con 0x7f88d00cb130 2024-03-23T06:22:12.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.344+0000 7f88cd600640 1 -- 172.21.15.73:0/1456183380 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88bc031a90 con 0x7f88d00cb130 2024-03-23T06:22:12.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 -- 172.21.15.73:0/1456183380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 msgr2=0x7f88d0069cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1456183380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d0069cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f88d0066720 tx=0x7f88bc02b7a0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 -- 172.21.15.73:0/1456183380 shutdown_connections 2024-03-23T06:22:12.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1456183380 >> v2:172.21.15.110:3300/0 conn(0x7f88d00b4780 0x7f88d006a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1456183380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d0069cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1456183380 >> v2:172.21.15.73:3300/0 conn(0x7f88d00c5050 0x7f88d01592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 -- 172.21.15.73:0/1456183380 >> 172.21.15.73:0/1456183380 conn(0x7f88d00ceb80 msgr2=0x7f88d00cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 -- 172.21.15.73:0/1456183380 shutdown_connections 2024-03-23T06:22:12.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.345+0000 7f88cfe00640 1 -- 172.21.15.73:0/1456183380 wait complete. 2024-03-23T06:22:12.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.347+0000 7f88cfe00640 1 Processor -- start 2024-03-23T06:22:12.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.348+0000 7f88cfe00640 1 -- start start 2024-03-23T06:22:12.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88cfe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88d00b4780 0x7f88d00cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88cfe00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d00c5050 0x7f88d00c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88cfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d014b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88cfe00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d01f1de0 con 0x7f88d00c5050 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88cfe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0155f20 con 0x7f88d00b4780 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88cfe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0156bd0 con 0x7f88d00cb130 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88ce000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d00c5050 0x7f88d00c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88cf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d014b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88cea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88d00b4780 0x7f88d00cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88ce000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d00c5050 0x7f88d00c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58810/0 (socket says 172.21.15.73:58810) 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.349+0000 7f88ce000640 1 -- 172.21.15.73:0/1521049711 learned_addr learned my addr 172.21.15.73:0/1521049711 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cf400640 1 -- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88d00b4780 msgr2=0x7f88d00cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cf400640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88d00b4780 0x7f88d00cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cf400640 1 -- 172.21.15.73:0/1521049711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d00c5050 msgr2=0x7f88d00c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cf400640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d00c5050 0x7f88d00c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cf400640 1 -- 172.21.15.73:0/1521049711 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8009b30 con 0x7f88d00cb130 2024-03-23T06:22:12.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88ce000640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d00c5050 0x7f88d00c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cea00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88d00b4780 0x7f88d00cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cf400640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d014b5d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f88c800eed0 tx=0x7f88c800b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88c6a00640 1 -- 172.21.15.73:0/1521049711 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8018070 con 0x7f88d00cb130 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88c6a00640 1 -- 172.21.15.73:0/1521049711 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c800bab0 con 0x7f88d00cb130 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88c6a00640 1 -- 172.21.15.73:0/1521049711 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8010040 con 0x7f88d00cb130 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c0009400 con 0x7f88d00cb130 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.350+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc009400 con 0x7f88d00cb130 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.351+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d00c4960 con 0x7f88d00cb130 2024-03-23T06:22:12.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.352+0000 7f88c6a00640 1 -- 172.21.15.73:0/1521049711 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f88c801d410 con 0x7f88d00cb130 2024-03-23T06:22:12.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.353+0000 7f88c6a00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f88b006ac30 0x7f88b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.353+0000 7f88c6a00640 1 -- 172.21.15.73:0/1521049711 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f88c8089270 con 0x7f88d00cb130 2024-03-23T06:22:12.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.354+0000 7f88cea00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f88b006ac30 0x7f88b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.354+0000 7f88cea00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f88b006ac30 0x7f88b006d0f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f88c0011380 tx=0x7f88c0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.358+0000 7f88c6a00640 1 -- 172.21.15.73:0/1521049711 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f88c8054220 con 0x7f88d00cb130 2024-03-23T06:22:12.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.550+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f88d00c9910 con 0x7f88b006ac30 2024-03-23T06:22:12.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.550+0000 7f88c6a00640 1 -- 172.21.15.73:0/1521049711 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f88c0004020 con 0x7f88b006ac30 2024-03-23T06:22:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f88b006ac30 msgr2=0x7f88b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f88b006ac30 0x7f88b006d0f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f88c0011380 tx=0x7f88c0009190 comp rx=0 tx=0).stop 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 msgr2=0x7f88d014b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d014b5d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f88c800eed0 tx=0x7f88c800b480 comp rx=0 tx=0).stop 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 shutdown_connections 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f88b006ac30 0x7f88b006d0f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d00cb130 0x7f88d014b5d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d00c5050 0x7f88d00c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 --2- 172.21.15.73:0/1521049711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88d00b4780 0x7f88d00cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 >> 172.21.15.73:0/1521049711 conn(0x7f88d00ceb80 msgr2=0x7f88d00c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:12.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 shutdown_connections 2024-03-23T06:22:12.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.553+0000 7f88cfe00640 1 -- 172.21.15.73:0/1521049711 wait complete. 2024-03-23T06:22:12.570 INFO:tasks.ceph:Scrubbing osd.6 2024-03-23T06:22:12.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-23T06:22:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.770+0000 7fd463e00640 1 Processor -- start 2024-03-23T06:22:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.770+0000 7fd463e00640 1 -- start start 2024-03-23T06:22:12.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd463e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd4640c9f80 0x7fd46415d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd463e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 0x7fd46415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd463e00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640c9b80 con 0x7fd4641539c0 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd463e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4640c5810 con 0x7fd4640c9f80 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd463e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46415cbe0 con 0x7fd4640c95b0 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd462000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd4640c9f80 0x7fd46415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd462a00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd4641539c0 0x7fd4640caac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49324/0 (socket says 172.21.15.73:49324) 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd462a00640 1 -- 172.21.15.73:0/739462905 learned_addr learned my addr 172.21.15.73:0/739462905 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd463400640 1 --2- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 0x7fd46415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd462000640 1 -- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 msgr2=0x7fd46415d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd462000640 1 --2- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 0x7fd46415d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd462000640 1 -- 172.21.15.73:0/739462905 >> v1:172.21.15.73:6789/0 conn(0x7fd4641539c0 legacy=0x7fd4640caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd461600640 1 -- 172.21.15.73:0/739462905 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162091122 0 0) 0x7fd4640c9b80 con 0x7fd4641539c0 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd462000640 1 -- 172.21.15.73:0/739462905 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640c4710 con 0x7fd4640c9f80 2024-03-23T06:22:12.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.772+0000 7fd463400640 1 --2- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 0x7fd46415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd462000640 1 --2- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640c9f80 0x7fd46415d070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4500097a0 tx=0x7fd45002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ebc96b2a3ab27c server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd461600640 1 -- 172.21.15.73:0/739462905 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45002e070 con 0x7fd4640c9f80 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd461600640 1 -- 172.21.15.73:0/739462905 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4500315a0 con 0x7fd4640c9f80 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd461600640 1 -- 172.21.15.73:0/739462905 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450031930 con 0x7fd4640c9f80 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd463e00640 1 -- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640c9f80 msgr2=0x7fd46415d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd463e00640 1 --2- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640c9f80 0x7fd46415d070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4500097a0 tx=0x7fd45002b840 comp rx=0 tx=0).stop 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd463e00640 1 -- 172.21.15.73:0/739462905 shutdown_connections 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd463e00640 1 --2- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 0x7fd46415d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd463e00640 1 --2- 172.21.15.73:0/739462905 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4640c9f80 0x7fd46415d070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.774+0000 7fd463e00640 1 -- 172.21.15.73:0/739462905 >> 172.21.15.73:0/739462905 conn(0x7fd464071c30 msgr2=0x7fd46406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.775+0000 7fd463e00640 1 -- 172.21.15.73:0/739462905 shutdown_connections 2024-03-23T06:22:12.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.775+0000 7fd463e00640 1 -- 172.21.15.73:0/739462905 wait complete. 2024-03-23T06:22:12.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.776+0000 7fd463e00640 1 Processor -- start 2024-03-23T06:22:12.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.776+0000 7fd463e00640 1 -- start start 2024-03-23T06:22:12.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 0x7fd46415b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4640c9f80 0x7fd4641f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4641539c0 0x7fd4641f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640c6280 con 0x7fd4640c9f80 2024-03-23T06:22:12.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4641ef570 con 0x7fd4641539c0 2024-03-23T06:22:12.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640c87a0 con 0x7fd4640c95b0 2024-03-23T06:22:12.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd462000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4640c9f80 0x7fd4641f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4641539c0 0x7fd4641f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4641539c0 0x7fd4641f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54826/0 (socket says 172.21.15.73:54826) 2024-03-23T06:22:12.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd462a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 0x7fd46415b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.777+0000 7fd463400640 1 -- 172.21.15.73:0/2588120928 learned_addr learned my addr 172.21.15.73:0/2588120928 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:12.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd463400640 1 -- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 msgr2=0x7fd46415b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd463400640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4640c95b0 0x7fd46415b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd463400640 1 -- 172.21.15.73:0/2588120928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4640c9f80 msgr2=0x7fd4641f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd463400640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4640c9f80 0x7fd4641f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd463400640 1 -- 172.21.15.73:0/2588120928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c009a70 con 0x7fd4641539c0 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd463400640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4641539c0 0x7fd4641f2390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009e60 tx=0x7fd45c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c009cd0 con 0x7fd4641539c0 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c00f040 con 0x7fd4641539c0 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd450009400 con 0x7fd4641539c0 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c003990 con 0x7fd4641539c0 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.778+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4641ee960 con 0x7fd4641539c0 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.779+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4640c4fb0 con 0x7fd4641539c0 2024-03-23T06:22:12.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.780+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd45c014480 con 0x7fd4641539c0 2024-03-23T06:22:12.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.781+0000 7fd45b400640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd44406ac30 0x7fd44406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.781+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fd45c08a2d0 con 0x7fd4641539c0 2024-03-23T06:22:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.781+0000 7fd462a00640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd44406ac30 0x7fd44406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.782+0000 7fd45b400640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fd4440743b0 0x7fd444076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.782+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 --> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd444076f00 con 0x7fd4440743b0 2024-03-23T06:22:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.782+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd45c08a640 con 0x7fd4641539c0 2024-03-23T06:22:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.782+0000 7fd462000640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fd4440743b0 0x7fd444076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.782+0000 7fd462a00640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd44406ac30 0x7fd44406d0f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd454000f60 tx=0x7fd454007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.782+0000 7fd462000640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fd4440743b0 0x7fd444076830 crc :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:12.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.783+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 <== osd.6 v2:172.21.15.110:6802/38267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fd444076f00 con 0x7fd4440743b0 2024-03-23T06:22:12.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.797+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 --> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd4640c4cd0 con 0x7fd4440743b0 2024-03-23T06:22:12.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.797+0000 7fd45b400640 1 -- 172.21.15.73:0/2588120928 <== osd.6 v2:172.21.15.110:6802/38267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd450031aa0 con 0x7fd4440743b0 2024-03-23T06:22:12.797 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:22:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T06:22:12.797 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:22:12.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.797+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fd4440743b0 msgr2=0x7fd444076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.797+0000 7fd463e00640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6802/38267,v1:172.21.15.110:6804/38267] conn(0x7fd4440743b0 0x7fd444076830 crc :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:12.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.797+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd44406ac30 msgr2=0x7fd44406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.797+0000 7fd463e00640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fd44406ac30 0x7fd44406d0f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd454000f60 tx=0x7fd454007d50 comp rx=0 tx=0).stop 2024-03-23T06:22:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.798+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4641539c0 msgr2=0x7fd4641f2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.798+0000 7fd463e00640 1 --2- 172.21.15.73:0/2588120928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4641539c0 0x7fd4641f2390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009e60 tx=0x7fd45c00c490 comp rx=0 tx=0).stop 2024-03-23T06:22:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.798+0000 7fd463400640 1 -- 172.21.15.73:0/2588120928 reap_dead start 2024-03-23T06:22:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.798+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 shutdown_connections 2024-03-23T06:22:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.798+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 >> 172.21.15.73:0/2588120928 conn(0x7fd464071c30 msgr2=0x7fd4640cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.798+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 shutdown_connections 2024-03-23T06:22:12.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:12.798+0000 7fd463e00640 1 -- 172.21.15.73:0/2588120928 wait complete. 2024-03-23T06:22:12.813 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-23T06:22:13.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.004+0000 7f1641a00640 1 Processor -- start 2024-03-23T06:22:13.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.004+0000 7f1641a00640 1 -- start start 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f1641a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f163c0c3e80 0x7f163c071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f1641a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c072490 0x7f163c0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f1641a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163c15b670 con 0x7f163c151310 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f1641a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c0c43e0 con 0x7f163c0c3e80 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f1641a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0c46c0 con 0x7f163c072490 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f163be00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f163c151310 0x7f163c15af60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:35276/0 (socket says 172.21.15.73:35276) 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f163be00640 1 -- 172.21.15.73:0/3905318916 learned_addr learned my addr 172.21.15.73:0/3905318916 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f163b400640 1 --2- 172.21.15.73:0/3905318916 >> v2:172.21.15.110:3300/0 conn(0x7f163c0c3e80 0x7f163c071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f1641000640 1 --2- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c072490 0x7f163c0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f163aa00640 1 -- 172.21.15.73:0/3905318916 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184250408 0 0) 0x7f162c001110 con 0x7f163c151310 2024-03-23T06:22:13.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f163aa00640 1 -- 172.21.15.73:0/3905318916 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1620003520 con 0x7f163c151310 2024-03-23T06:22:13.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f163b400640 1 -- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c072490 msgr2=0x7f163c0c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:13.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.006+0000 7f163b400640 1 --2- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c072490 0x7f163c0c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.007+0000 7f163b400640 1 -- 172.21.15.73:0/3905318916 >> v1:172.21.15.110:6789/0 conn(0x7f163c151310 legacy=0x7f163c15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.007+0000 7f163b400640 1 -- 172.21.15.73:0/3905318916 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0c49a0 con 0x7f163c0c3e80 2024-03-23T06:22:13.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.007+0000 7f1641000640 1 --2- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c072490 0x7f163c0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f163b400640 1 --2- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c0c3e80 0x7f163c071f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1624009d90 tx=0x7f162402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=645bc44f77fd1cab server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f163aa00640 1 -- 172.21.15.73:0/3905318916 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162402cc50 con 0x7f163c0c3e80 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f163aa00640 1 -- 172.21.15.73:0/3905318916 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162402cdb0 con 0x7f163c0c3e80 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f163aa00640 1 -- 172.21.15.73:0/3905318916 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624034660 con 0x7f163c0c3e80 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f1641a00640 1 -- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c0c3e80 msgr2=0x7f163c071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f1641a00640 1 --2- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c0c3e80 0x7f163c071f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1624009d90 tx=0x7f162402bea0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f1641a00640 1 -- 172.21.15.73:0/3905318916 shutdown_connections 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f1641a00640 1 --2- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c072490 0x7f163c0c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f1641a00640 1 --2- 172.21.15.73:0/3905318916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c0c3e80 0x7f163c071f50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.008+0000 7f1641a00640 1 -- 172.21.15.73:0/3905318916 >> 172.21.15.73:0/3905318916 conn(0x7f163c065a50 msgr2=0x7f163c065e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:13.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.009+0000 7f1641a00640 1 -- 172.21.15.73:0/3905318916 shutdown_connections 2024-03-23T06:22:13.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.009+0000 7f1641a00640 1 -- 172.21.15.73:0/3905318916 wait complete. 2024-03-23T06:22:13.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.010+0000 7f1641a00640 1 Processor -- start 2024-03-23T06:22:13.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.010+0000 7f1641a00640 1 -- start start 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.011+0000 7f1641a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f163c072490 0x7f163c1efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.011+0000 7f1641a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c0c3e80 0x7f163c1f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.011+0000 7f1641a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c151310 0x7f163c14b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.011+0000 7f1641a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c14f280 con 0x7f163c072490 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.011+0000 7f1641a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c1f2c30 con 0x7f163c151310 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.011+0000 7f1641a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c1f2990 con 0x7f163c0c3e80 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.011+0000 7f163be00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f163c072490 0x7f163c1efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.011+0000 7f163b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c0c3e80 0x7f163c1f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c0c3e80 0x7f163c1f2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55086/0 (socket says 172.21.15.73:55086) 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f1641000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c151310 0x7f163c14b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163b400640 1 -- 172.21.15.73:0/1045565472 learned_addr learned my addr 172.21.15.73:0/1045565472 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163b400640 1 -- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c151310 msgr2=0x7f163c14b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163b400640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c151310 0x7f163c14b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163b400640 1 -- 172.21.15.73:0/1045565472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f163c072490 msgr2=0x7f163c1efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163b400640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f163c072490 0x7f163c1efcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163b400640 1 -- 172.21.15.73:0/1045565472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1634009400 con 0x7f163c0c3e80 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f1641000640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c151310 0x7f163c14b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:13.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163be00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f163c072490 0x7f163c1efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:13.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.012+0000 7f163b400640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c0c3e80 0x7f163c1f2060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1624009d90 tx=0x7f1624004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.013+0000 7f1633e00640 1 -- 172.21.15.73:0/1045565472 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624040650 con 0x7f163c0c3e80 2024-03-23T06:22:13.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.013+0000 7f1633e00640 1 -- 172.21.15.73:0/1045565472 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16240407b0 con 0x7f163c0c3e80 2024-03-23T06:22:13.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.013+0000 7f1633e00640 1 -- 172.21.15.73:0/1045565472 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1624040b60 con 0x7f163c0c3e80 2024-03-23T06:22:13.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.013+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1624009a70 con 0x7f163c0c3e80 2024-03-23T06:22:13.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.013+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c154700 con 0x7f163c0c3e80 2024-03-23T06:22:13.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.014+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c14e4a0 con 0x7f163c0c3e80 2024-03-23T06:22:13.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.016+0000 7f1633e00640 1 -- 172.21.15.73:0/1045565472 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1624040cc0 con 0x7f163c0c3e80 2024-03-23T06:22:13.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.016+0000 7f1633e00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f161806ac00 0x7f161806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.017+0000 7f1633e00640 1 -- 172.21.15.73:0/1045565472 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f16240ac330 con 0x7f163c0c3e80 2024-03-23T06:22:13.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.017+0000 7f163be00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f161806ac00 0x7f161806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.017+0000 7f163be00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f161806ac00 0x7f161806d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f162c001270 tx=0x7f162c007bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.021+0000 7f1633e00640 1 -- 172.21.15.73:0/1045565472 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1624077210 con 0x7f163c0c3e80 2024-03-23T06:22:13.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.222+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f163c15aa40 con 0x7f161806ac00 2024-03-23T06:22:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.223+0000 7f1633e00640 1 -- 172.21.15.73:0/1045565472 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f162c001970 con 0x7f161806ac00 2024-03-23T06:22:13.223 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f161806ac00 msgr2=0x7f161806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f161806ac00 0x7f161806d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f162c001270 tx=0x7f162c007bb0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c0c3e80 msgr2=0x7f163c1f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c0c3e80 0x7f163c1f2060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1624009d90 tx=0x7f1624004a40 comp rx=0 tx=0).stop 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 shutdown_connections 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f163c151310 0x7f163c14b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f161806ac00 0x7f161806d0c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f163c0c3e80 0x7f163c1f2060 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 --2- 172.21.15.73:0/1045565472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f163c072490 0x7f163c1efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.225+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 >> 172.21.15.73:0/1045565472 conn(0x7f163c065a50 msgr2=0x7f163c065e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.226+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 shutdown_connections 2024-03-23T06:22:13.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.226+0000 7f1641a00640 1 -- 172.21.15.73:0/1045565472 wait complete. 2024-03-23T06:22:13.247 INFO:tasks.ceph:Scrubbing osd.7 2024-03-23T06:22:13.247 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-23T06:22:13.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.437+0000 7f77bf200640 1 Processor -- start 2024-03-23T06:22:13.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.438+0000 7f77bf200640 1 -- start start 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.439+0000 7f77bf200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c00c8950 0x7f77c015c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.439+0000 7f77bf200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c00c8510 con 0x7f77c01502e0 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.439+0000 7f77bf200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c0071ca0 con 0x7f77c00c7f70 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.439+0000 7f77bf200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c00c7960 con 0x7f77c00c8950 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.440+0000 7f77be800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f77c00c7f70 0x7f77c0163bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:35290/0 (socket says 172.21.15.73:35290) 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.439+0000 7f77b7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c00c8950 0x7f77c015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.439+0000 7f77bde00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f77c01502e0 0x7f77c00ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49338/0 (socket says 172.21.15.73:49338) 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.440+0000 7f77be800640 1 -- 172.21.15.73:0/2029755996 learned_addr learned my addr 172.21.15.73:0/2029755996 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:13.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.440+0000 7f77bd400640 1 -- 172.21.15.73:0/2029755996 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350454875 0 0) 0x7f77c0071ca0 con 0x7f77c00c7f70 2024-03-23T06:22:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.440+0000 7f77bd400640 1 -- 172.21.15.73:0/2029755996 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77a4003520 con 0x7f77c00c7f70 2024-03-23T06:22:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.440+0000 7f77b7e00640 1 -- 172.21.15.73:0/2029755996 >> v1:172.21.15.110:6789/0 conn(0x7f77c00c7f70 legacy=0x7f77c0163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.440+0000 7f77bd400640 1 -- 172.21.15.73:0/2029755996 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195410414 0 0) 0x7f77c00c8510 con 0x7f77c01502e0 2024-03-23T06:22:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.440+0000 7f77b7e00640 1 -- 172.21.15.73:0/2029755996 >> v1:172.21.15.73:6789/0 conn(0x7f77c01502e0 legacy=0x7f77c00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.440+0000 7f77b7e00640 1 -- 172.21.15.73:0/2029755996 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0071f80 con 0x7f77c00c8950 2024-03-23T06:22:13.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.442+0000 7f77b7e00640 1 --2- 172.21.15.73:0/2029755996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c00c8950 0x7f77c015c850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77a80097c0 tx=0x7f77a802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=561860655c612cc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.442+0000 7f77bd400640 1 -- 172.21.15.73:0/2029755996 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8031800 con 0x7f77c00c8950 2024-03-23T06:22:13.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.442+0000 7f77bd400640 1 -- 172.21.15.73:0/2029755996 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a8031960 con 0x7f77c00c8950 2024-03-23T06:22:13.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.442+0000 7f77bd400640 1 -- 172.21.15.73:0/2029755996 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8031cf0 con 0x7f77c00c8950 2024-03-23T06:22:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.442+0000 7f77bf200640 1 -- 172.21.15.73:0/2029755996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c00c8950 msgr2=0x7f77c015c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.442+0000 7f77bf200640 1 --2- 172.21.15.73:0/2029755996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c00c8950 0x7f77c015c850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f77a80097c0 tx=0x7f77a802b8a0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.443+0000 7f77bf200640 1 -- 172.21.15.73:0/2029755996 shutdown_connections 2024-03-23T06:22:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.443+0000 7f77bf200640 1 --2- 172.21.15.73:0/2029755996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c00c8950 0x7f77c015c850 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.443+0000 7f77bf200640 1 -- 172.21.15.73:0/2029755996 >> 172.21.15.73:0/2029755996 conn(0x7f77c0066080 msgr2=0x7f77c006da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.443+0000 7f77bf200640 1 -- 172.21.15.73:0/2029755996 shutdown_connections 2024-03-23T06:22:13.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.443+0000 7f77bf200640 1 -- 172.21.15.73:0/2029755996 wait complete. 2024-03-23T06:22:13.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.444+0000 7f77bf200640 1 Processor -- start 2024-03-23T06:22:13.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.444+0000 7f77bf200640 1 -- start start 2024-03-23T06:22:13.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77bf200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c00c7f70 0x7f77c014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77bf200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c00c8950 0x7f77c00c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77bf200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c01502e0 0x7f77c014c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77bf200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c014ea10 con 0x7f77c00c8950 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77bf200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c014d930 con 0x7f77c00c7f70 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77bf200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c014f100 con 0x7f77c01502e0 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77b7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c00c8950 0x7f77c00c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77bde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c00c7f70 0x7f77c014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77b7e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c00c8950 0x7f77c00c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:58842/0 (socket says 172.21.15.73:58842) 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b7e00640 1 -- 172.21.15.73:0/3820002660 learned_addr learned my addr 172.21.15.73:0/3820002660 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77be800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c01502e0 0x7f77c014c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.445+0000 7f77bde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c00c7f70 0x7f77c014e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54840/0 (socket says 172.21.15.73:54840) 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b7e00640 1 -- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c01502e0 msgr2=0x7f77c014c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b7e00640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c01502e0 0x7f77c014c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b7e00640 1 -- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c00c7f70 msgr2=0x7f77c014e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b7e00640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c00c7f70 0x7f77c014e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b7e00640 1 -- 172.21.15.73:0/3820002660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80093a0 con 0x7f77c00c8950 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77bde00640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c00c7f70 0x7f77c014e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b7e00640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c00c8950 0x7f77c00c60e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f77a8034040 tx=0x7f77a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a8005b90 con 0x7f77c00c8950 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a8005cf0 con 0x7f77c00c8950 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a803aa10 con 0x7f77c00c8950 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.446+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c00724d0 con 0x7f77c00c8950 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.447+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c01ef8f0 con 0x7f77c00c8950 2024-03-23T06:22:13.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.448+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77c0072350 con 0x7f77c00c8950 2024-03-23T06:22:13.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.449+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f77a8042070 con 0x7f77c00c8950 2024-03-23T06:22:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.449+0000 7f77b6000640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f779c06ac00 0x7f779c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.449+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f77a802e070 con 0x7f77c00c8950 2024-03-23T06:22:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.450+0000 7f77bde00640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f779c06ac00 0x7f779c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.450+0000 7f77b6000640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7f779c074380 0x7f779c076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.450+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 --> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f779c076ed0 con 0x7f779c074380 2024-03-23T06:22:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.450+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77a80ad9b0 con 0x7f77c00c8950 2024-03-23T06:22:13.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.450+0000 7f77be800640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7f779c074380 0x7f779c076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.450+0000 7f77bde00640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f779c06ac00 0x7f779c06d0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f77b0007fd0 tx=0x7f77b0007de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.450+0000 7f77be800640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7f779c074380 0x7f779c076800 crc :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.451+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 <== osd.7 v2:172.21.15.110:6824/38285 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f779c076ed0 con 0x7f779c074380 2024-03-23T06:22:13.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.465+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 --> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f77c00cd2b0 con 0x7f779c074380 2024-03-23T06:22:13.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.465+0000 7f77b6000640 1 -- 172.21.15.73:0/3820002660 <== osd.7 v2:172.21.15.110:6824/38285 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f77b8001e40 con 0x7f779c074380 2024-03-23T06:22:13.465 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-23T06:22:13.465 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-23T06:22:13.465 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-23T06:22:13.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.465+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7f779c074380 msgr2=0x7f779c076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.465+0000 7f77bf200640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6824/38285,v1:172.21.15.110:6825/38285] conn(0x7f779c074380 0x7f779c076800 crc :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f779c06ac00 msgr2=0x7f779c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77bf200640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f779c06ac00 0x7f779c06d0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f77b0007fd0 tx=0x7f77b0007de0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c00c8950 msgr2=0x7f77c00c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77bf200640 1 --2- 172.21.15.73:0/3820002660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77c00c8950 0x7f77c00c60e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f77a8034040 tx=0x7f77a80046c0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77be800640 1 -- 172.21.15.73:0/3820002660 reap_dead start 2024-03-23T06:22:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 shutdown_connections 2024-03-23T06:22:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 >> 172.21.15.73:0/3820002660 conn(0x7f77c0066080 msgr2=0x7f77c00cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 shutdown_connections 2024-03-23T06:22:13.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.466+0000 7f77bf200640 1 -- 172.21.15.73:0/3820002660 wait complete. 2024-03-23T06:22:13.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-23T06:22:13.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.674+0000 7f34d4a00640 1 Processor -- start 2024-03-23T06:22:13.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.674+0000 7f34d4a00640 1 -- start start 2024-03-23T06:22:13.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.675+0000 7f34d4a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34d0151480 0x7f34d0157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.675+0000 7f34d4a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f34d00c7e40 0x7f34d0071b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.675+0000 7f34d4a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d0072090 0x7f34d00c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.675+0000 7f34d4a00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d01588d0 con 0x7f34d0151480 2024-03-23T06:22:13.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.675+0000 7f34d4a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d015b710 con 0x7f34d00c7e40 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.675+0000 7f34d4a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d015ab90 con 0x7f34d0072090 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34c5400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f34d00c7e40 0x7f34d0071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34cde00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34d0151480 0x7f34d0157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34ce800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d0072090 0x7f34d00c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34c5400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f34d00c7e40 0x7f34d0071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54850/0 (socket says 172.21.15.73:54850) 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34c5400640 1 -- 172.21.15.73:0/950573180 learned_addr learned my addr 172.21.15.73:0/950573180 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34c5400640 1 -- 172.21.15.73:0/950573180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d0072090 msgr2=0x7f34d00c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34c5400640 1 --2- 172.21.15.73:0/950573180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d0072090 0x7f34d00c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34c5400640 1 -- 172.21.15.73:0/950573180 >> v2:172.21.15.73:3300/0 conn(0x7f34d0151480 msgr2=0x7f34d0157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34c5400640 1 --2- 172.21.15.73:0/950573180 >> v2:172.21.15.73:3300/0 conn(0x7f34d0151480 0x7f34d0157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34c5400640 1 -- 172.21.15.73:0/950573180 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d015ae70 con 0x7f34d00c7e40 2024-03-23T06:22:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.676+0000 7f34ce800640 1 --2- 172.21.15.73:0/950573180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d0072090 0x7f34d00c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.677+0000 7f34c5400640 1 --2- 172.21.15.73:0/950573180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d00c7e40 0x7f34d0071b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34d00c7b90 tx=0x7f34b802b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ede1fad766b28ef0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.678+0000 7f34cd400640 1 -- 172.21.15.73:0/950573180 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8030850 con 0x7f34d00c7e40 2024-03-23T06:22:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.678+0000 7f34cd400640 1 -- 172.21.15.73:0/950573180 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b80309b0 con 0x7f34d00c7e40 2024-03-23T06:22:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.678+0000 7f34cd400640 1 -- 172.21.15.73:0/950573180 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8030d40 con 0x7f34d00c7e40 2024-03-23T06:22:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.678+0000 7f34d4a00640 1 -- 172.21.15.73:0/950573180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d00c7e40 msgr2=0x7f34d0071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.678+0000 7f34d4a00640 1 --2- 172.21.15.73:0/950573180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d00c7e40 0x7f34d0071b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f34d00c7b90 tx=0x7f34b802b990 comp rx=0 tx=0).stop 2024-03-23T06:22:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.679+0000 7f34d4a00640 1 -- 172.21.15.73:0/950573180 shutdown_connections 2024-03-23T06:22:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.679+0000 7f34d4a00640 1 --2- 172.21.15.73:0/950573180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d0072090 0x7f34d00c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.679+0000 7f34d4a00640 1 --2- 172.21.15.73:0/950573180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d00c7e40 0x7f34d0071b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.679+0000 7f34d4a00640 1 --2- 172.21.15.73:0/950573180 >> v2:172.21.15.73:3300/0 conn(0x7f34d0151480 0x7f34d0157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.679+0000 7f34d4a00640 1 -- 172.21.15.73:0/950573180 >> 172.21.15.73:0/950573180 conn(0x7f34d0069cb0 msgr2=0x7f34d006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.679+0000 7f34d4a00640 1 -- 172.21.15.73:0/950573180 shutdown_connections 2024-03-23T06:22:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.679+0000 7f34d4a00640 1 -- 172.21.15.73:0/950573180 wait complete. 2024-03-23T06:22:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.681+0000 7f34d4a00640 1 Processor -- start 2024-03-23T06:22:13.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.681+0000 7f34d4a00640 1 -- start start 2024-03-23T06:22:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34d4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d0072090 0x7f34d00c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34d4a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d00c7e40 0x7f34d01eece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34d4a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d0151480 0x7f34d01e60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34d4a00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d006f9d0 con 0x7f34d0151480 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34d4a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00c97f0 con 0x7f34d0072090 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34d4a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00c9a80 con 0x7f34d00c7e40 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34cde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d0072090 0x7f34d00c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34cde00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d0072090 0x7f34d00c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54860/0 (socket says 172.21.15.73:54860) 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34cde00640 1 -- 172.21.15.73:0/2455453024 learned_addr learned my addr 172.21.15.73:0/2455453024 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34c5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d00c7e40 0x7f34d01eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34ce800640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d0151480 0x7f34d01e60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34cde00640 1 -- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d00c7e40 msgr2=0x7f34d01eece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34cde00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d00c7e40 0x7f34d01eece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34cde00640 1 -- 172.21.15.73:0/2455453024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d0151480 msgr2=0x7f34d01e60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34cde00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d0151480 0x7f34d01e60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.682+0000 7f34cde00640 1 -- 172.21.15.73:0/2455453024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c8009a70 con 0x7f34d0072090 2024-03-23T06:22:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.683+0000 7f34cde00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d0072090 0x7f34d00c92b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34c000e9b0 tx=0x7f34c000edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.683+0000 7f34c6a00640 1 -- 172.21.15.73:0/2455453024 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0009670 con 0x7f34d0072090 2024-03-23T06:22:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.683+0000 7f34c6a00640 1 -- 172.21.15.73:0/2455453024 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c000c940 con 0x7f34d0072090 2024-03-23T06:22:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.683+0000 7f34c6a00640 1 -- 172.21.15.73:0/2455453024 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c000ccf0 con 0x7f34d0072090 2024-03-23T06:22:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.683+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b80094d0 con 0x7f34d0072090 2024-03-23T06:22:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.683+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d01f23f0 con 0x7f34d0072090 2024-03-23T06:22:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.684+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d01f2250 con 0x7f34d0072090 2024-03-23T06:22:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.685+0000 7f34c6a00640 1 -- 172.21.15.73:0/2455453024 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f34c0013470 con 0x7f34d0072090 2024-03-23T06:22:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.686+0000 7f34c6a00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34ac06ac00 0x7f34ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.686+0000 7f34c6a00640 1 -- 172.21.15.73:0/2455453024 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f34c0089ca0 con 0x7f34d0072090 2024-03-23T06:22:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.686+0000 7f34c5400640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34ac06ac00 0x7f34ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.686+0000 7f34c5400640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34ac06ac00 0x7f34ac06d0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f34b8036000 tx=0x7f34b8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:13.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.690+0000 7f34c6a00640 1 -- 172.21.15.73:0/2455453024 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f34d01f2250 con 0x7f34d0072090 2024-03-23T06:22:13.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.882+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f34d015a830 con 0x7f34ac06ac00 2024-03-23T06:22:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.882+0000 7f34c6a00640 1 -- 172.21.15.73:0/2455453024 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f34b8030650 con 0x7f34ac06ac00 2024-03-23T06:22:13.883 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34ac06ac00 msgr2=0x7f34ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34ac06ac00 0x7f34ac06d0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f34b8036000 tx=0x7f34b8008030 comp rx=0 tx=0).stop 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d0072090 msgr2=0x7f34d00c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d0072090 0x7f34d00c92b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34c000e9b0 tx=0x7f34c000edb0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 shutdown_connections 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d0151480 0x7f34d01e60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34ac06ac00 0x7f34ac06d0c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34d00c7e40 0x7f34d01eece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 --2- 172.21.15.73:0/2455453024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34d0072090 0x7f34d00c92b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 >> 172.21.15.73:0/2455453024 conn(0x7f34d0069cb0 msgr2=0x7f34d00c0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.885+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 shutdown_connections 2024-03-23T06:22:13.886 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:13.886+0000 7f34d4a00640 1 -- 172.21.15.73:0/2455453024 wait complete. 2024-03-23T06:22:13.902 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:22:14.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.097+0000 7fc1ed200640 1 Processor -- start 2024-03-23T06:22:14.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.097+0000 7fc1ed200640 1 -- start start 2024-03-23T06:22:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.098+0000 7fc1ed200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e80cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.098+0000 7fc1ed200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1e81594f0 0x7fc1e80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.098+0000 7fc1ed200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e81599a0 con 0x7fc1e81536a0 2024-03-23T06:22:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1ed200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e815a520 con 0x7fc1e81594f0 2024-03-23T06:22:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1ed200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8159c80 con 0x7fc1e8153a80 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e80cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e5e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc1e81536a0 0x7fc1e80ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:35298/0 (socket says 172.21.15.73:35298) 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e5e00640 1 -- 172.21.15.73:0/2464974595 learned_addr learned my addr 172.21.15.73:0/2464974595 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e6800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1e81594f0 0x7fc1e80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e4a00640 1 -- 172.21.15.73:0/2464974595 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697971784 0 0) 0x7fc1e81599a0 con 0x7fc1e81536a0 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e5400640 1 -- 172.21.15.73:0/2464974595 >> v2:172.21.15.110:3300/0 conn(0x7fc1e81594f0 msgr2=0x7fc1e80cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e5400640 1 --2- 172.21.15.73:0/2464974595 >> v2:172.21.15.110:3300/0 conn(0x7fc1e81594f0 0x7fc1e80cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e5400640 1 -- 172.21.15.73:0/2464974595 >> v1:172.21.15.110:6789/0 conn(0x7fc1e81536a0 legacy=0x7fc1e80ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e5400640 1 -- 172.21.15.73:0/2464974595 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e8159f60 con 0x7fc1e8153a80 2024-03-23T06:22:14.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.099+0000 7fc1e6800640 1 --2- 172.21.15.73:0/2464974595 >> v2:172.21.15.110:3300/0 conn(0x7fc1e81594f0 0x7fc1e80cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:14.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.100+0000 7fc1e5400640 1 --2- 172.21.15.73:0/2464974595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e80cbe90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40097a0 tx=0x7fc1d402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=977c0813c1fef8b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:14.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1e4a00640 1 -- 172.21.15.73:0/2464974595 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d402d040 con 0x7fc1e8153a80 2024-03-23T06:22:14.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1e4a00640 1 -- 172.21.15.73:0/2464974595 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d4031810 con 0x7fc1e8153a80 2024-03-23T06:22:14.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1e4a00640 1 -- 172.21.15.73:0/2464974595 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4031ba0 con 0x7fc1e8153a80 2024-03-23T06:22:14.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1ed200640 1 -- 172.21.15.73:0/2464974595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 msgr2=0x7fc1e80cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:14.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1ed200640 1 --2- 172.21.15.73:0/2464974595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e80cbe90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40097a0 tx=0x7fc1d402b8b0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1ed200640 1 -- 172.21.15.73:0/2464974595 shutdown_connections 2024-03-23T06:22:14.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1ed200640 1 --2- 172.21.15.73:0/2464974595 >> v2:172.21.15.110:3300/0 conn(0x7fc1e81594f0 0x7fc1e80cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1ed200640 1 --2- 172.21.15.73:0/2464974595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e80cbe90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1ed200640 1 -- 172.21.15.73:0/2464974595 >> 172.21.15.73:0/2464974595 conn(0x7fc1e806a060 msgr2=0x7fc1e806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:14.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1ed200640 1 -- 172.21.15.73:0/2464974595 shutdown_connections 2024-03-23T06:22:14.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.101+0000 7fc1ed200640 1 -- 172.21.15.73:0/2464974595 wait complete. 2024-03-23T06:22:14.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.103+0000 7fc1ed200640 1 Processor -- start 2024-03-23T06:22:14.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.103+0000 7fc1ed200640 1 -- start start 2024-03-23T06:22:14.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1ed200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e81536a0 0x7fc1e80ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1ed200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e8152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1ed200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81594f0 0x7fc1e8146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1ed200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80b34d0 con 0x7fc1e81594f0 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1ed200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80b40f0 con 0x7fc1e81536a0 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1ed200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e814c4c0 con 0x7fc1e8153a80 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1e5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e81536a0 0x7fc1e80ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1e5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e81536a0 0x7fc1e80ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:54878/0 (socket says 172.21.15.73:54878) 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1e5e00640 1 -- 172.21.15.73:0/1125098066 learned_addr learned my addr 172.21.15.73:0/1125098066 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1e5400640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.104+0000 7fc1e6800640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81594f0 0x7fc1e8146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1e5e00640 1 -- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 msgr2=0x7fc1e8152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1e5e00640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e8152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1e5e00640 1 -- 172.21.15.73:0/1125098066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81594f0 msgr2=0x7fc1e8146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:14.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1e5e00640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81594f0 0x7fc1e8146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1e5e00640 1 -- 172.21.15.73:0/1125098066 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e0009a70 con 0x7fc1e81536a0 2024-03-23T06:22:14.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1e5400640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e8152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:14.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1e5e00640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e81536a0 0x7fc1e80ccf10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800c430 tx=0x7fc1d800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:14.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1de000640 1 -- 172.21.15.73:0/1125098066 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80074e0 con 0x7fc1e81536a0 2024-03-23T06:22:14.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1de000640 1 -- 172.21.15.73:0/1125098066 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d8007660 con 0x7fc1e81536a0 2024-03-23T06:22:14.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1de000640 1 -- 172.21.15.73:0/1125098066 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d8004a20 con 0x7fc1e81536a0 2024-03-23T06:22:14.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d4009400 con 0x7fc1e81536a0 2024-03-23T06:22:14.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.105+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e80b3720 con 0x7fc1e81536a0 2024-03-23T06:22:14.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.106+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e80c9810 con 0x7fc1e81536a0 2024-03-23T06:22:14.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.107+0000 7fc1de000640 1 -- 172.21.15.73:0/1125098066 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc1d8004b80 con 0x7fc1e81536a0 2024-03-23T06:22:14.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.108+0000 7fc1de000640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc1c806ac30 0x7fc1c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:14.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.108+0000 7fc1de000640 1 -- 172.21.15.73:0/1125098066 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fc1d8089380 con 0x7fc1e81536a0 2024-03-23T06:22:14.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.108+0000 7fc1e5400640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc1c806ac30 0x7fc1c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:14.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.109+0000 7fc1e5400640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc1c806ac30 0x7fc1c806d0f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4036000 tx=0x7fc1d403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:14.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.112+0000 7fc1de000640 1 -- 172.21.15.73:0/1125098066 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc1d8054260 con 0x7fc1e81536a0 2024-03-23T06:22:14.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.305+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1e80cb970 con 0x7fc1c806ac30 2024-03-23T06:22:14.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.315+0000 7fc1de000640 1 -- 172.21.15.73:0/1125098066 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369601 (secure 0 0 0) 0x7fc1d4031610 con 0x7fc1c806ac30 2024-03-23T06:22:14.320 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:14.322 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:22:14.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc1c806ac30 msgr2=0x7fc1c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc1c806ac30 0x7fc1c806d0f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4036000 tx=0x7fc1d403c040 comp rx=0 tx=0).stop 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e81536a0 msgr2=0x7fc1e80ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e81536a0 0x7fc1e80ccf10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800c430 tx=0x7fc1d800c830 comp rx=0 tx=0).stop 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 shutdown_connections 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1e81594f0 0x7fc1e8146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fc1c806ac30 0x7fc1c806d0f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e8153a80 0x7fc1e8152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 --2- 172.21.15.73:0/1125098066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e81536a0 0x7fc1e80ccf10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 >> 172.21.15.73:0/1125098066 conn(0x7fc1e806a060 msgr2=0x7fc1e8158200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 shutdown_connections 2024-03-23T06:22:14.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:14.322+0000 7fc1ed200640 1 -- 172.21.15.73:0/1125098066 wait complete. 2024-03-23T06:22:14.339 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-03-23T06:22:12.823036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402572,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469605,"num_write_kb":34184419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171110,"ondisk_log_size":171110,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10077296,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9900211,"kb_avail":744897424,"statfs":{"total":773094113280,"available":762774962176,"internally_reserved":0,"allocated":181256192,"data_stored":179741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10137816632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":563,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002519"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:20.806395+0000","last_change":"2024-03-23T06:09:57.470749+0000","last_active":"2024-03-23T06:20:20.806395+0000","last_peered":"2024-03-23T06:20:20.806395+0000","last_clean":"2024-03-23T06:20:20.806395+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:20:20.806395+0000","last_undegraded":"2024-03-23T06:20:20.806395+0000","last_fullsized":"2024-03-23T06:20:20.806395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:22:18.463188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.076677+0000","last_change":"2024-03-23T06:09:57.953802+0000","last_active":"2024-03-23T06:22:05.076677+0000","last_peered":"2024-03-23T06:22:05.076677+0000","last_clean":"2024-03-23T06:22:05.076677+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:22:05.076677+0000","last_undegraded":"2024-03-23T06:22:05.076677+0000","last_fullsized":"2024-03-23T06:22:05.076677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:26.621886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4667,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.014941+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:21:28.014941+0000","last_peered":"2024-03-23T06:21:28.014941+0000","last_clean":"2024-03-23T06:21:28.014941+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:21:28.014941+0000","last_undegraded":"2024-03-23T06:21:28.014941+0000","last_fullsized":"2024-03-23T06:21:28.014941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:52:30.843166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'12","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.027749+0000","last_change":"2024-03-23T06:09:57.453861+0000","last_active":"2024-03-23T06:21:28.027749+0000","last_peered":"2024-03-23T06:21:28.027749+0000","last_clean":"2024-03-23T06:21:28.027749+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:21:28.027749+0000","last_undegraded":"2024-03-23T06:21:28.027749+0000","last_fullsized":"2024-03-23T06:21:28.027749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:58:17.530396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.085086+0000","last_change":"2024-03-23T06:09:57.946854+0000","last_active":"2024-03-23T06:22:05.085086+0000","last_peered":"2024-03-23T06:22:05.085086+0000","last_clean":"2024-03-23T06:22:05.085086+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:22:05.085086+0000","last_undegraded":"2024-03-23T06:22:05.085086+0000","last_fullsized":"2024-03-23T06:22:05.085086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:43:55.080877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.237479+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:21:28.237479+0000","last_peered":"2024-03-23T06:21:28.237479+0000","last_clean":"2024-03-23T06:21:28.237479+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:21:28.237479+0000","last_undegraded":"2024-03-23T06:21:28.237479+0000","last_fullsized":"2024-03-23T06:21:28.237479+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'160","reported_seq":180,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.998561+0000","last_change":"2024-03-23T06:09:57.469497+0000","last_active":"2024-03-23T06:21:27.998561+0000","last_peered":"2024-03-23T06:21:27.998561+0000","last_clean":"2024-03-23T06:21:27.998561+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:21:27.998561+0000","last_undegraded":"2024-03-23T06:21:27.998561+0000","last_fullsized":"2024-03-23T06:21:27.998561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:55:13.453900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.071525+0000","last_change":"2024-03-23T06:10:39.674095+0000","last_active":"2024-03-23T06:22:05.071525+0000","last_peered":"2024-03-23T06:22:05.071525+0000","last_clean":"2024-03-23T06:22:05.071525+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:22:05.071525+0000","last_undegraded":"2024-03-23T06:22:05.071525+0000","last_fullsized":"2024-03-23T06:22:05.071525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.154769+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:21:28.154769+0000","last_peered":"2024-03-23T06:21:28.154769+0000","last_clean":"2024-03-23T06:21:28.154769+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:21:28.154769+0000","last_undegraded":"2024-03-23T06:21:28.154769+0000","last_fullsized":"2024-03-23T06:21:28.154769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'21","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:58.144198+0000","last_change":"2024-03-23T06:09:57.475147+0000","last_active":"2024-03-23T06:19:58.144198+0000","last_peered":"2024-03-23T06:19:58.144198+0000","last_clean":"2024-03-23T06:19:58.144198+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:19:58.144198+0000","last_undegraded":"2024-03-23T06:19:58.144198+0000","last_fullsized":"2024-03-23T06:19:58.144198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:29:49.507402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'29","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.108662+0000","last_change":"2024-03-23T06:09:57.946449+0000","last_active":"2024-03-23T06:22:05.108662+0000","last_peered":"2024-03-23T06:22:05.108662+0000","last_clean":"2024-03-23T06:22:05.108662+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:22:05.108662+0000","last_undegraded":"2024-03-23T06:22:05.108662+0000","last_fullsized":"2024-03-23T06:22:05.108662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:27.650241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.203630+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:21:28.203630+0000","last_peered":"2024-03-23T06:21:28.203630+0000","last_clean":"2024-03-23T06:21:28.203630+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:21:28.203630+0000","last_undegraded":"2024-03-23T06:21:28.203630+0000","last_fullsized":"2024-03-23T06:21:28.203630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.103071+0000","last_change":"2024-03-23T06:09:57.952873+0000","last_active":"2024-03-23T06:22:05.103071+0000","last_peered":"2024-03-23T06:22:05.103071+0000","last_clean":"2024-03-23T06:22:05.103071+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:22:05.103071+0000","last_undegraded":"2024-03-23T06:22:05.103071+0000","last_fullsized":"2024-03-23T06:22:05.103071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:20.267297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'397","reported_seq":419,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.108327+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:21:28.108327+0000","last_peered":"2024-03-23T06:21:28.108327+0000","last_clean":"2024-03-23T06:21:28.108327+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:21:28.108327+0000","last_undegraded":"2024-03-23T06:21:28.108327+0000","last_fullsized":"2024-03-23T06:21:28.108327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:32.687424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5382,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.115760+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:21:28.115760+0000","last_peered":"2024-03-23T06:21:28.115760+0000","last_clean":"2024-03-23T06:21:28.115760+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:21:28.115760+0000","last_undegraded":"2024-03-23T06:21:28.115760+0000","last_fullsized":"2024-03-23T06:21:28.115760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:59.255305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.075289+0000","last_change":"2024-03-23T06:09:57.940533+0000","last_active":"2024-03-23T06:22:05.075289+0000","last_peered":"2024-03-23T06:22:05.075289+0000","last_clean":"2024-03-23T06:22:05.075289+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:22:05.075289+0000","last_undegraded":"2024-03-23T06:22:05.075289+0000","last_fullsized":"2024-03-23T06:22:05.075289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:04:52.313195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.053221+0000","last_change":"2024-03-23T06:09:57.454821+0000","last_active":"2024-03-23T06:21:28.053221+0000","last_peered":"2024-03-23T06:21:28.053221+0000","last_clean":"2024-03-23T06:21:28.053221+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:21:28.053221+0000","last_undegraded":"2024-03-23T06:21:28.053221+0000","last_fullsized":"2024-03-23T06:21:28.053221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:30:56.800847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5252,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.118953+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:21:28.118953+0000","last_peered":"2024-03-23T06:21:28.118953+0000","last_clean":"2024-03-23T06:21:28.118953+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:21:28.118953+0000","last_undegraded":"2024-03-23T06:21:28.118953+0000","last_fullsized":"2024-03-23T06:21:28.118953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:41.307368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'19","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.074649+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:22:05.074649+0000","last_peered":"2024-03-23T06:22:05.074649+0000","last_clean":"2024-03-23T06:22:05.074649+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:22:05.074649+0000","last_undegraded":"2024-03-23T06:22:05.074649+0000","last_fullsized":"2024-03-23T06:22:05.074649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:03.919845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.043901+0000","last_change":"2024-03-23T06:09:57.459053+0000","last_active":"2024-03-23T06:21:28.043901+0000","last_peered":"2024-03-23T06:21:28.043901+0000","last_clean":"2024-03-23T06:21:28.043901+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:21:28.043901+0000","last_undegraded":"2024-03-23T06:21:28.043901+0000","last_fullsized":"2024-03-23T06:21:28.043901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:19.622727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6036,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.971677+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:21:27.971677+0000","last_peered":"2024-03-23T06:21:27.971677+0000","last_clean":"2024-03-23T06:21:27.971677+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:21:27.971677+0000","last_undegraded":"2024-03-23T06:21:27.971677+0000","last_fullsized":"2024-03-23T06:21:27.971677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:48:06.600309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.100080+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:22:05.100080+0000","last_peered":"2024-03-23T06:22:05.100080+0000","last_clean":"2024-03-23T06:22:05.100080+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:22:05.100080+0000","last_undegraded":"2024-03-23T06:22:05.100080+0000","last_fullsized":"2024-03-23T06:22:05.100080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:49:41.041159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.994466+0000","last_change":"2024-03-23T06:09:57.466051+0000","last_active":"2024-03-23T06:21:27.994466+0000","last_peered":"2024-03-23T06:21:27.994466+0000","last_clean":"2024-03-23T06:21:27.994466+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:21:27.994466+0000","last_undegraded":"2024-03-23T06:21:27.994466+0000","last_fullsized":"2024-03-23T06:21:27.994466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:25:33.889091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.234190+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:21:28.234190+0000","last_peered":"2024-03-23T06:21:28.234190+0000","last_clean":"2024-03-23T06:21:28.234190+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:21:28.234190+0000","last_undegraded":"2024-03-23T06:21:28.234190+0000","last_fullsized":"2024-03-23T06:21:28.234190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.073325+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:22:05.073325+0000","last_peered":"2024-03-23T06:22:05.073325+0000","last_clean":"2024-03-23T06:22:05.073325+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:22:05.073325+0000","last_undegraded":"2024-03-23T06:22:05.073325+0000","last_fullsized":"2024-03-23T06:22:05.073325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:27:16.562075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.096336+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:21:28.096336+0000","last_peered":"2024-03-23T06:21:28.096336+0000","last_clean":"2024-03-23T06:21:28.096336+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:21:28.096336+0000","last_undegraded":"2024-03-23T06:21:28.096336+0000","last_fullsized":"2024-03-23T06:21:28.096336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:24:58.728189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.182618+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:21:28.182618+0000","last_peered":"2024-03-23T06:21:28.182618+0000","last_clean":"2024-03-23T06:21:28.182618+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:21:28.182618+0000","last_undegraded":"2024-03-23T06:21:28.182618+0000","last_fullsized":"2024-03-23T06:21:28.182618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'17","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.077716+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:22:05.077716+0000","last_peered":"2024-03-23T06:22:05.077716+0000","last_clean":"2024-03-23T06:22:05.077716+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:22:05.077716+0000","last_undegraded":"2024-03-23T06:22:05.077716+0000","last_fullsized":"2024-03-23T06:22:05.077716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:34:13.547507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'98","reported_seq":120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.147318+0000","last_change":"2024-03-23T06:09:57.461928+0000","last_active":"2024-03-23T06:21:28.147318+0000","last_peered":"2024-03-23T06:21:28.147318+0000","last_clean":"2024-03-23T06:21:28.147318+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:21:28.147318+0000","last_undegraded":"2024-03-23T06:21:28.147318+0000","last_fullsized":"2024-03-23T06:21:28.147318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4676,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.229260+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:21:28.229260+0000","last_peered":"2024-03-23T06:21:28.229260+0000","last_clean":"2024-03-23T06:21:28.229260+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:21:28.229260+0000","last_undegraded":"2024-03-23T06:21:28.229260+0000","last_fullsized":"2024-03-23T06:21:28.229260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:35:46.223720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.068530+0000","last_change":"2024-03-23T06:09:57.940073+0000","last_active":"2024-03-23T06:22:05.068530+0000","last_peered":"2024-03-23T06:22:05.068530+0000","last_clean":"2024-03-23T06:22:05.068530+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:22:05.068530+0000","last_undegraded":"2024-03-23T06:22:05.068530+0000","last_fullsized":"2024-03-23T06:22:05.068530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:43:20.139467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.014027+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:21:28.014027+0000","last_peered":"2024-03-23T06:21:28.014027+0000","last_clean":"2024-03-23T06:21:28.014027+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:21:28.014027+0000","last_undegraded":"2024-03-23T06:21:28.014027+0000","last_fullsized":"2024-03-23T06:21:28.014027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:37:27.034063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159961+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:21:28.159961+0000","last_peered":"2024-03-23T06:21:28.159961+0000","last_clean":"2024-03-23T06:21:28.159961+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:21:28.159961+0000","last_undegraded":"2024-03-23T06:21:28.159961+0000","last_fullsized":"2024-03-23T06:21:28.159961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:11:22.652718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.078002+0000","last_change":"2024-03-23T06:09:57.949419+0000","last_active":"2024-03-23T06:22:05.078002+0000","last_peered":"2024-03-23T06:22:05.078002+0000","last_clean":"2024-03-23T06:22:05.078002+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:22:05.078002+0000","last_undegraded":"2024-03-23T06:22:05.078002+0000","last_fullsized":"2024-03-23T06:22:05.078002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:20:29.338317+0000","last_change":"2024-03-23T06:09:57.453019+0000","last_active":"2024-03-23T06:20:29.338317+0000","last_peered":"2024-03-23T06:20:29.338317+0000","last_clean":"2024-03-23T06:20:29.338317+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:20:29.338317+0000","last_undegraded":"2024-03-23T06:20:29.338317+0000","last_fullsized":"2024-03-23T06:20:29.338317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:01:41.592293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4625,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.124327+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:21:28.124327+0000","last_peered":"2024-03-23T06:21:28.124327+0000","last_clean":"2024-03-23T06:21:28.124327+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:21:28.124327+0000","last_undegraded":"2024-03-23T06:21:28.124327+0000","last_fullsized":"2024-03-23T06:21:28.124327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:11:26.730336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'15","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.097158+0000","last_change":"2024-03-23T06:09:57.953921+0000","last_active":"2024-03-23T06:22:05.097158+0000","last_peered":"2024-03-23T06:22:05.097158+0000","last_clean":"2024-03-23T06:22:05.097158+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:22:05.097158+0000","last_undegraded":"2024-03-23T06:22:05.097158+0000","last_fullsized":"2024-03-23T06:22:05.097158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:10:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'26","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.964155+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:21:27.964155+0000","last_peered":"2024-03-23T06:21:27.964155+0000","last_clean":"2024-03-23T06:21:27.964155+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:21:27.964155+0000","last_undegraded":"2024-03-23T06:21:27.964155+0000","last_fullsized":"2024-03-23T06:21:27.964155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:45:55.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.999073+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:21:27.999073+0000","last_peered":"2024-03-23T06:21:27.999073+0000","last_clean":"2024-03-23T06:21:27.999073+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:21:27.999073+0000","last_undegraded":"2024-03-23T06:21:27.999073+0000","last_fullsized":"2024-03-23T06:21:27.999073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:26:07.788966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.080126+0000","last_change":"2024-03-23T06:09:57.938596+0000","last_active":"2024-03-23T06:22:05.080126+0000","last_peered":"2024-03-23T06:22:05.080126+0000","last_clean":"2024-03-23T06:22:05.080126+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:22:05.080126+0000","last_undegraded":"2024-03-23T06:22:05.080126+0000","last_fullsized":"2024-03-23T06:22:05.080126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:19.234908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'40","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.015115+0000","last_change":"2024-03-23T06:09:57.452895+0000","last_active":"2024-03-23T06:21:28.015115+0000","last_peered":"2024-03-23T06:21:28.015115+0000","last_clean":"2024-03-23T06:21:28.015115+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:21:28.015115+0000","last_undegraded":"2024-03-23T06:21:28.015115+0000","last_fullsized":"2024-03-23T06:21:28.015115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:28:15.286620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":38,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.063846+0000","last_change":"2024-03-23T06:10:39.799662+0000","last_active":"2024-03-23T06:21:28.063846+0000","last_peered":"2024-03-23T06:21:28.063846+0000","last_clean":"2024-03-23T06:21:28.063846+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:21:28.063846+0000","last_undegraded":"2024-03-23T06:21:28.063846+0000","last_fullsized":"2024-03-23T06:21:28.063846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:17:27.260098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.079200+0000","last_change":"2024-03-23T06:09:57.951610+0000","last_active":"2024-03-23T06:22:05.079200+0000","last_peered":"2024-03-23T06:22:05.079200+0000","last_clean":"2024-03-23T06:22:05.079200+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:05.079200+0000","last_undegraded":"2024-03-23T06:22:05.079200+0000","last_fullsized":"2024-03-23T06:22:05.079200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:03:22.935029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'50","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.074362+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:21:28.074362+0000","last_peered":"2024-03-23T06:21:28.074362+0000","last_clean":"2024-03-23T06:21:28.074362+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:21:28.074362+0000","last_undegraded":"2024-03-23T06:21:28.074362+0000","last_fullsized":"2024-03-23T06:21:28.074362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:32:35.298621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5351,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.197863+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:21:28.197863+0000","last_peered":"2024-03-23T06:21:28.197863+0000","last_clean":"2024-03-23T06:21:28.197863+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:21:28.197863+0000","last_undegraded":"2024-03-23T06:21:28.197863+0000","last_fullsized":"2024-03-23T06:21:28.197863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:08:22.984245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.094797+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:22:05.094797+0000","last_peered":"2024-03-23T06:22:05.094797+0000","last_clean":"2024-03-23T06:22:05.094797+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:22:05.094797+0000","last_undegraded":"2024-03-23T06:22:05.094797+0000","last_fullsized":"2024-03-23T06:22:05.094797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:40.388226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.005245+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:21:28.005245+0000","last_peered":"2024-03-23T06:21:28.005245+0000","last_clean":"2024-03-23T06:21:28.005245+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:21:28.005245+0000","last_undegraded":"2024-03-23T06:21:28.005245+0000","last_fullsized":"2024-03-23T06:21:28.005245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:38:11.929622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.434497+0000","last_change":"2024-03-23T06:22:10.434689+0000","last_active":"2024-03-23T06:22:10.434497+0000","last_peered":"2024-03-23T06:22:10.434497+0000","last_clean":"2024-03-23T06:22:10.434497+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:22:10.434497+0000","last_undegraded":"2024-03-23T06:22:10.434497+0000","last_fullsized":"2024-03-23T06:22:10.434497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.434445+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:53:51.345697+0000","scrub_duration":0.011047585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5854,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.076122+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:21:28.076122+0000","last_peered":"2024-03-23T06:21:28.076122+0000","last_clean":"2024-03-23T06:21:28.076122+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:21:28.076122+0000","last_undegraded":"2024-03-23T06:21:28.076122+0000","last_fullsized":"2024-03-23T06:21:28.076122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:04:22.757725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'19","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.105758+0000","last_change":"2024-03-23T06:09:57.956483+0000","last_active":"2024-03-23T06:22:05.105758+0000","last_peered":"2024-03-23T06:22:05.105758+0000","last_clean":"2024-03-23T06:22:05.105758+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:22:05.105758+0000","last_undegraded":"2024-03-23T06:22:05.105758+0000","last_fullsized":"2024-03-23T06:22:05.105758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:09:55.688367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.079874+0000","last_change":"2024-03-23T06:09:57.458001+0000","last_active":"2024-03-23T06:21:28.079874+0000","last_peered":"2024-03-23T06:21:28.079874+0000","last_clean":"2024-03-23T06:21:28.079874+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:21:28.079874+0000","last_undegraded":"2024-03-23T06:21:28.079874+0000","last_fullsized":"2024-03-23T06:21:28.079874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:59:42.111710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.179384+0000","last_change":"2024-03-23T06:10:39.804956+0000","last_active":"2024-03-23T06:21:28.179384+0000","last_peered":"2024-03-23T06:21:28.179384+0000","last_clean":"2024-03-23T06:21:28.179384+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:21:28.179384+0000","last_undegraded":"2024-03-23T06:21:28.179384+0000","last_fullsized":"2024-03-23T06:21:28.179384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'17","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.096376+0000","last_change":"2024-03-23T06:09:57.942373+0000","last_active":"2024-03-23T06:22:05.096376+0000","last_peered":"2024-03-23T06:22:05.096376+0000","last_clean":"2024-03-23T06:22:05.096376+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:22:05.096376+0000","last_undegraded":"2024-03-23T06:22:05.096376+0000","last_fullsized":"2024-03-23T06:22:05.096376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:46:26.733164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:19.369022+0000","last_change":"2024-03-23T06:09:57.467734+0000","last_active":"2024-03-23T06:21:19.369022+0000","last_peered":"2024-03-23T06:21:19.369022+0000","last_clean":"2024-03-23T06:21:19.369022+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:21:19.369022+0000","last_undegraded":"2024-03-23T06:21:19.369022+0000","last_fullsized":"2024-03-23T06:21:19.369022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:53:36.793967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4815,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.219047+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:21:28.219047+0000","last_peered":"2024-03-23T06:21:28.219047+0000","last_clean":"2024-03-23T06:21:28.219047+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:21:28.219047+0000","last_undegraded":"2024-03-23T06:21:28.219047+0000","last_fullsized":"2024-03-23T06:21:28.219047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:57:35.034061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'19","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.089551+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:22:05.089551+0000","last_peered":"2024-03-23T06:22:05.089551+0000","last_clean":"2024-03-23T06:22:05.089551+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:22:05.089551+0000","last_undegraded":"2024-03-23T06:22:05.089551+0000","last_fullsized":"2024-03-23T06:22:05.089551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:35.457034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'23","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.052456+0000","last_change":"2024-03-23T06:09:57.453719+0000","last_active":"2024-03-23T06:21:28.052456+0000","last_peered":"2024-03-23T06:21:28.052456+0000","last_clean":"2024-03-23T06:21:28.052456+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:21:28.052456+0000","last_undegraded":"2024-03-23T06:21:28.052456+0000","last_fullsized":"2024-03-23T06:21:28.052456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:27:17.713592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5573,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.176007+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:21:28.176007+0000","last_peered":"2024-03-23T06:21:28.176007+0000","last_clean":"2024-03-23T06:21:28.176007+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:21:28.176007+0000","last_undegraded":"2024-03-23T06:21:28.176007+0000","last_fullsized":"2024-03-23T06:21:28.176007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:25:07.612892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'13","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.098844+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:22:05.098844+0000","last_peered":"2024-03-23T06:22:05.098844+0000","last_clean":"2024-03-23T06:22:05.098844+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:22:05.098844+0000","last_undegraded":"2024-03-23T06:22:05.098844+0000","last_fullsized":"2024-03-23T06:22:05.098844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'52","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.051128+0000","last_change":"2024-03-23T06:09:57.458083+0000","last_active":"2024-03-23T06:22:05.051128+0000","last_peered":"2024-03-23T06:22:05.051128+0000","last_clean":"2024-03-23T06:22:05.051128+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:22:05.051128+0000","last_undegraded":"2024-03-23T06:22:05.051128+0000","last_fullsized":"2024-03-23T06:22:05.051128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:28:15.230185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632815,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4586,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.228397+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:21:28.228397+0000","last_peered":"2024-03-23T06:21:28.228397+0000","last_clean":"2024-03-23T06:21:28.228397+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:21:28.228397+0000","last_undegraded":"2024-03-23T06:21:28.228397+0000","last_fullsized":"2024-03-23T06:21:28.228397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'19","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.102862+0000","last_change":"2024-03-23T06:09:57.954056+0000","last_active":"2024-03-23T06:22:05.102862+0000","last_peered":"2024-03-23T06:22:05.102862+0000","last_clean":"2024-03-23T06:22:05.102862+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:22:05.102862+0000","last_undegraded":"2024-03-23T06:22:05.102862+0000","last_fullsized":"2024-03-23T06:22:05.102862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:39:49.575813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.237214+0000","last_change":"2024-03-23T06:09:57.445987+0000","last_active":"2024-03-23T06:21:28.237214+0000","last_peered":"2024-03-23T06:21:28.237214+0000","last_clean":"2024-03-23T06:21:28.237214+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:21:28.237214+0000","last_undegraded":"2024-03-23T06:21:28.237214+0000","last_fullsized":"2024-03-23T06:21:28.237214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:28:54.958216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5959,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.199315+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:21:28.199315+0000","last_peered":"2024-03-23T06:21:28.199315+0000","last_clean":"2024-03-23T06:21:28.199315+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:21:28.199315+0000","last_undegraded":"2024-03-23T06:21:28.199315+0000","last_fullsized":"2024-03-23T06:21:28.199315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:49:19.076010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.081581+0000","last_change":"2024-03-23T06:09:57.938851+0000","last_active":"2024-03-23T06:22:05.081581+0000","last_peered":"2024-03-23T06:22:05.081581+0000","last_clean":"2024-03-23T06:22:05.081581+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:22:05.081581+0000","last_undegraded":"2024-03-23T06:22:05.081581+0000","last_fullsized":"2024-03-23T06:22:05.081581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:38.400937+0000","last_change":"2024-03-23T06:09:57.478296+0000","last_active":"2024-03-23T06:21:38.400937+0000","last_peered":"2024-03-23T06:21:38.400937+0000","last_clean":"2024-03-23T06:21:38.400937+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:21:38.400937+0000","last_undegraded":"2024-03-23T06:21:38.400937+0000","last_fullsized":"2024-03-23T06:21:38.400937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:06:49.255125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5327,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.129118+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:21:28.129118+0000","last_peered":"2024-03-23T06:21:28.129118+0000","last_clean":"2024-03-23T06:21:28.129118+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:21:28.129118+0000","last_undegraded":"2024-03-23T06:21:28.129118+0000","last_fullsized":"2024-03-23T06:21:28.129118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:56:41.941626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'27","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.104345+0000","last_change":"2024-03-23T06:09:57.947043+0000","last_active":"2024-03-23T06:22:05.104345+0000","last_peered":"2024-03-23T06:22:05.104345+0000","last_clean":"2024-03-23T06:22:05.104345+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:22:05.104345+0000","last_undegraded":"2024-03-23T06:22:05.104345+0000","last_fullsized":"2024-03-23T06:22:05.104345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.235104+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:21:28.235104+0000","last_peered":"2024-03-23T06:21:28.235104+0000","last_clean":"2024-03-23T06:21:28.235104+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:21:28.235104+0000","last_undegraded":"2024-03-23T06:21:28.235104+0000","last_fullsized":"2024-03-23T06:21:28.235104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:23:37.121192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5271,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.233362+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:21:28.233362+0000","last_peered":"2024-03-23T06:21:28.233362+0000","last_clean":"2024-03-23T06:21:28.233362+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:21:28.233362+0000","last_undegraded":"2024-03-23T06:21:28.233362+0000","last_fullsized":"2024-03-23T06:21:28.233362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:55:41.007478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'22","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.097935+0000","last_change":"2024-03-23T06:09:57.940317+0000","last_active":"2024-03-23T06:22:05.097935+0000","last_peered":"2024-03-23T06:22:05.097935+0000","last_clean":"2024-03-23T06:22:05.097935+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:22:05.097935+0000","last_undegraded":"2024-03-23T06:22:05.097935+0000","last_fullsized":"2024-03-23T06:22:05.097935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:43:00.434387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'40","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.141491+0000","last_change":"2024-03-23T06:09:57.464704+0000","last_active":"2024-03-23T06:21:28.141491+0000","last_peered":"2024-03-23T06:21:28.141491+0000","last_clean":"2024-03-23T06:21:28.141491+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:21:28.141491+0000","last_undegraded":"2024-03-23T06:21:28.141491+0000","last_fullsized":"2024-03-23T06:21:28.141491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:54.015784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4888,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.933026+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:21:27.933026+0000","last_peered":"2024-03-23T06:21:27.933026+0000","last_clean":"2024-03-23T06:21:27.933026+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:21:27.933026+0000","last_undegraded":"2024-03-23T06:21:27.933026+0000","last_fullsized":"2024-03-23T06:21:27.933026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:19.149747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'16","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.088498+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:22:05.088498+0000","last_peered":"2024-03-23T06:22:05.088498+0000","last_clean":"2024-03-23T06:22:05.088498+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:22:05.088498+0000","last_undegraded":"2024-03-23T06:22:05.088498+0000","last_fullsized":"2024-03-23T06:22:05.088498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:08.734452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'231","reported_seq":254,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.051421+0000","last_change":"2024-03-23T06:09:57.450264+0000","last_active":"2024-03-23T06:22:05.051421+0000","last_peered":"2024-03-23T06:22:05.051421+0000","last_clean":"2024-03-23T06:22:05.051421+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:22:05.051421+0000","last_undegraded":"2024-03-23T06:22:05.051421+0000","last_fullsized":"2024-03-23T06:22:05.051421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.232433+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:21:28.232433+0000","last_peered":"2024-03-23T06:21:28.232433+0000","last_clean":"2024-03-23T06:21:28.232433+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:21:28.232433+0000","last_undegraded":"2024-03-23T06:21:28.232433+0000","last_fullsized":"2024-03-23T06:21:28.232433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:03:57.385781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'18","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.095827+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:22:05.095827+0000","last_peered":"2024-03-23T06:22:05.095827+0000","last_clean":"2024-03-23T06:22:05.095827+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:22:05.095827+0000","last_undegraded":"2024-03-23T06:22:05.095827+0000","last_fullsized":"2024-03-23T06:22:05.095827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:07:45.873316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:29.064848+0000","last_change":"2024-03-23T06:09:57.447935+0000","last_active":"2024-03-23T06:21:29.064848+0000","last_peered":"2024-03-23T06:21:29.064848+0000","last_clean":"2024-03-23T06:21:29.064848+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:21:29.064848+0000","last_undegraded":"2024-03-23T06:21:29.064848+0000","last_fullsized":"2024-03-23T06:21:29.064848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:21:57.628677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:50.979259+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:21:50.979259+0000","last_peered":"2024-03-23T06:21:50.979259+0000","last_clean":"2024-03-23T06:21:50.979259+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:21:50.979259+0000","last_undegraded":"2024-03-23T06:21:50.979259+0000","last_fullsized":"2024-03-23T06:21:50.979259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'22","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.362219+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:22:05.362219+0000","last_peered":"2024-03-23T06:22:05.362219+0000","last_clean":"2024-03-23T06:22:05.362219+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:22:05.362219+0000","last_undegraded":"2024-03-23T06:22:05.362219+0000","last_fullsized":"2024-03-23T06:22:05.362219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:39.966700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'5","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.145165+0000","last_change":"2024-03-23T06:09:57.476772+0000","last_active":"2024-03-23T06:21:28.145165+0000","last_peered":"2024-03-23T06:21:28.145165+0000","last_clean":"2024-03-23T06:21:28.145165+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:21:28.145165+0000","last_undegraded":"2024-03-23T06:21:28.145165+0000","last_fullsized":"2024-03-23T06:21:28.145165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:24:00.761054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.212540+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:21:28.212540+0000","last_peered":"2024-03-23T06:21:28.212540+0000","last_clean":"2024-03-23T06:21:28.212540+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:21:28.212540+0000","last_undegraded":"2024-03-23T06:21:28.212540+0000","last_fullsized":"2024-03-23T06:21:28.212540+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:43:30.415477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.103864+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:22:05.103864+0000","last_peered":"2024-03-23T06:22:05.103864+0000","last_clean":"2024-03-23T06:22:05.103864+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:22:05.103864+0000","last_undegraded":"2024-03-23T06:22:05.103864+0000","last_fullsized":"2024-03-23T06:22:05.103864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:06.825337+0000","last_change":"2024-03-23T06:09:57.468320+0000","last_active":"2024-03-23T06:22:06.825337+0000","last_peered":"2024-03-23T06:22:06.825337+0000","last_clean":"2024-03-23T06:22:06.825337+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:22:06.825337+0000","last_undegraded":"2024-03-23T06:22:06.825337+0000","last_fullsized":"2024-03-23T06:22:06.825337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5633,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.172172+0000","last_change":"2024-03-23T06:10:39.801920+0000","last_active":"2024-03-23T06:21:28.172172+0000","last_peered":"2024-03-23T06:21:28.172172+0000","last_clean":"2024-03-23T06:21:28.172172+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:21:28.172172+0000","last_undegraded":"2024-03-23T06:21:28.172172+0000","last_fullsized":"2024-03-23T06:21:28.172172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:39:07.343046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4715,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.209017+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:21:28.209017+0000","last_peered":"2024-03-23T06:21:28.209017+0000","last_clean":"2024-03-23T06:21:28.209017+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:21:28.209017+0000","last_undegraded":"2024-03-23T06:21:28.209017+0000","last_fullsized":"2024-03-23T06:21:28.209017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:08:59.237072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'19","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.084617+0000","last_change":"2024-03-23T06:09:57.938816+0000","last_active":"2024-03-23T06:22:05.084617+0000","last_peered":"2024-03-23T06:22:05.084617+0000","last_clean":"2024-03-23T06:22:05.084617+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:22:05.084617+0000","last_undegraded":"2024-03-23T06:22:05.084617+0000","last_fullsized":"2024-03-23T06:22:05.084617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:10:02.239520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'33","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.862220+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:21:27.862220+0000","last_peered":"2024-03-23T06:21:27.862220+0000","last_clean":"2024-03-23T06:21:27.862220+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:21:27.862220+0000","last_undegraded":"2024-03-23T06:21:27.862220+0000","last_fullsized":"2024-03-23T06:21:27.862220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:08:58.105779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5553,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.159725+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:21:28.159725+0000","last_peered":"2024-03-23T06:21:28.159725+0000","last_clean":"2024-03-23T06:21:28.159725+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:21:28.159725+0000","last_undegraded":"2024-03-23T06:21:28.159725+0000","last_fullsized":"2024-03-23T06:21:28.159725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:47.824802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'25","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.078559+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:22:05.078559+0000","last_peered":"2024-03-23T06:22:05.078559+0000","last_clean":"2024-03-23T06:22:05.078559+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:22:05.078559+0000","last_undegraded":"2024-03-23T06:22:05.078559+0000","last_fullsized":"2024-03-23T06:22:05.078559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:00:17.570068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'6","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.144088+0000","last_change":"2024-03-23T06:09:57.461217+0000","last_active":"2024-03-23T06:21:28.144088+0000","last_peered":"2024-03-23T06:21:28.144088+0000","last_clean":"2024-03-23T06:21:28.144088+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:21:28.144088+0000","last_undegraded":"2024-03-23T06:21:28.144088+0000","last_fullsized":"2024-03-23T06:21:28.144088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:16:46.046918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:19:55.674981+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:19:55.674981+0000","last_peered":"2024-03-23T06:19:55.674981+0000","last_clean":"2024-03-23T06:19:55.674981+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:19:55.674981+0000","last_undegraded":"2024-03-23T06:19:55.674981+0000","last_fullsized":"2024-03-23T06:19:55.674981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:31.057153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.092445+0000","last_change":"2024-03-23T06:09:57.931868+0000","last_active":"2024-03-23T06:22:05.092445+0000","last_peered":"2024-03-23T06:22:05.092445+0000","last_clean":"2024-03-23T06:22:05.092445+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:22:05.092445+0000","last_undegraded":"2024-03-23T06:22:05.092445+0000","last_fullsized":"2024-03-23T06:22:05.092445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:26:46.886986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:27.921034+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:21:27.921034+0000","last_peered":"2024-03-23T06:21:27.921034+0000","last_clean":"2024-03-23T06:21:27.921034+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:21:27.921034+0000","last_undegraded":"2024-03-23T06:21:27.921034+0000","last_fullsized":"2024-03-23T06:21:27.921034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:46.818941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'985","reported_seq":1005,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.149957+0000","last_change":"2024-03-23T06:09:57.451910+0000","last_active":"2024-03-23T06:21:28.149957+0000","last_peered":"2024-03-23T06:21:28.149957+0000","last_clean":"2024-03-23T06:21:28.149957+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:21:28.149957+0000","last_undegraded":"2024-03-23T06:21:28.149957+0000","last_fullsized":"2024-03-23T06:21:28.149957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":985,"log_dups_size":0,"ondisk_log_size":985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:54:15.554792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195273,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":4980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.081068+0000","last_change":"2024-03-23T06:09:57.939111+0000","last_active":"2024-03-23T06:22:05.081068+0000","last_peered":"2024-03-23T06:22:05.081068+0000","last_clean":"2024-03-23T06:22:05.081068+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:22:05.081068+0000","last_undegraded":"2024-03-23T06:22:05.081068+0000","last_fullsized":"2024-03-23T06:22:05.081068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4750,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.145556+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:21:28.145556+0000","last_peered":"2024-03-23T06:21:28.145556+0000","last_clean":"2024-03-23T06:21:28.145556+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:21:28.145556+0000","last_undegraded":"2024-03-23T06:21:28.145556+0000","last_fullsized":"2024-03-23T06:21:28.145556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:57:29.787658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'23","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.360807+0000","last_change":"2024-03-23T06:09:57.948095+0000","last_active":"2024-03-23T06:22:05.360807+0000","last_peered":"2024-03-23T06:22:05.360807+0000","last_clean":"2024-03-23T06:22:05.360807+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:22:05.360807+0000","last_undegraded":"2024-03-23T06:22:05.360807+0000","last_fullsized":"2024-03-23T06:22:05.360807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.071264+0000","last_change":"2024-03-23T06:09:57.946152+0000","last_active":"2024-03-23T06:22:05.071264+0000","last_peered":"2024-03-23T06:22:05.071264+0000","last_clean":"2024-03-23T06:22:05.071264+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:22:05.071264+0000","last_undegraded":"2024-03-23T06:22:05.071264+0000","last_fullsized":"2024-03-23T06:22:05.071264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:36:22.834027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.098606+0000","last_change":"2024-03-23T06:09:57.945193+0000","last_active":"2024-03-23T06:22:05.098606+0000","last_peered":"2024-03-23T06:22:05.098606+0000","last_clean":"2024-03-23T06:22:05.098606+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:22:05.098606+0000","last_undegraded":"2024-03-23T06:22:05.098606+0000","last_fullsized":"2024-03-23T06:22:05.098606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:54:43.660709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'17","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.080195+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:22:05.080195+0000","last_peered":"2024-03-23T06:22:05.080195+0000","last_clean":"2024-03-23T06:22:05.080195+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:22:05.080195+0000","last_undegraded":"2024-03-23T06:22:05.080195+0000","last_fullsized":"2024-03-23T06:22:05.080195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:59:31.741447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.092060+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:22:05.092060+0000","last_peered":"2024-03-23T06:22:05.092060+0000","last_clean":"2024-03-23T06:22:05.092060+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:22:05.092060+0000","last_undegraded":"2024-03-23T06:22:05.092060+0000","last_fullsized":"2024-03-23T06:22:05.092060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:03:00.282986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'13","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.067695+0000","last_change":"2024-03-23T06:09:57.936414+0000","last_active":"2024-03-23T06:22:05.067695+0000","last_peered":"2024-03-23T06:22:05.067695+0000","last_clean":"2024-03-23T06:22:05.067695+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:22:05.067695+0000","last_undegraded":"2024-03-23T06:22:05.067695+0000","last_fullsized":"2024-03-23T06:22:05.067695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:46:52.047734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.105574+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:22:05.105574+0000","last_peered":"2024-03-23T06:22:05.105574+0000","last_clean":"2024-03-23T06:22:05.105574+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:22:05.105574+0000","last_undegraded":"2024-03-23T06:22:05.105574+0000","last_fullsized":"2024-03-23T06:22:05.105574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'15","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.085188+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:22:05.085188+0000","last_peered":"2024-03-23T06:22:05.085188+0000","last_clean":"2024-03-23T06:22:05.085188+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:22:05.085188+0000","last_undegraded":"2024-03-23T06:22:05.085188+0000","last_fullsized":"2024-03-23T06:22:05.085188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:08:40.945972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'16","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.100408+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:22:05.100408+0000","last_peered":"2024-03-23T06:22:05.100408+0000","last_clean":"2024-03-23T06:22:05.100408+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:22:05.100408+0000","last_undegraded":"2024-03-23T06:22:05.100408+0000","last_fullsized":"2024-03-23T06:22:05.100408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:31:20.488406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.090123+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:22:05.090123+0000","last_peered":"2024-03-23T06:22:05.090123+0000","last_clean":"2024-03-23T06:22:05.090123+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:05.090123+0000","last_undegraded":"2024-03-23T06:22:05.090123+0000","last_fullsized":"2024-03-23T06:22:05.090123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:35.235059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.092744+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:22:05.092744+0000","last_peered":"2024-03-23T06:22:05.092744+0000","last_clean":"2024-03-23T06:22:05.092744+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:22:05.092744+0000","last_undegraded":"2024-03-23T06:22:05.092744+0000","last_fullsized":"2024-03-23T06:22:05.092744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'27","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.095011+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:22:05.095011+0000","last_peered":"2024-03-23T06:22:05.095011+0000","last_clean":"2024-03-23T06:22:05.095011+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:22:05.095011+0000","last_undegraded":"2024-03-23T06:22:05.095011+0000","last_fullsized":"2024-03-23T06:22:05.095011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:34:28.200066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'18","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.093823+0000","last_change":"2024-03-23T06:09:57.947422+0000","last_active":"2024-03-23T06:22:05.093823+0000","last_peered":"2024-03-23T06:22:05.093823+0000","last_clean":"2024-03-23T06:22:05.093823+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:22:05.093823+0000","last_undegraded":"2024-03-23T06:22:05.093823+0000","last_fullsized":"2024-03-23T06:22:05.093823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:53:11.227321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'18","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.101551+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:22:05.101551+0000","last_peered":"2024-03-23T06:22:05.101551+0000","last_clean":"2024-03-23T06:22:05.101551+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:22:05.101551+0000","last_undegraded":"2024-03-23T06:22:05.101551+0000","last_fullsized":"2024-03-23T06:22:05.101551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:33:30.132447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'30","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.085975+0000","last_change":"2024-03-23T06:09:57.953152+0000","last_active":"2024-03-23T06:22:05.085975+0000","last_peered":"2024-03-23T06:22:05.085975+0000","last_clean":"2024-03-23T06:22:05.085975+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:22:05.085975+0000","last_undegraded":"2024-03-23T06:22:05.085975+0000","last_fullsized":"2024-03-23T06:22:05.085975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:07:29.378460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.103158+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:22:05.103158+0000","last_peered":"2024-03-23T06:22:05.103158+0000","last_clean":"2024-03-23T06:22:05.103158+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:22:05.103158+0000","last_undegraded":"2024-03-23T06:22:05.103158+0000","last_fullsized":"2024-03-23T06:22:05.103158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:35:23.356456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'21","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.106666+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:22:05.106666+0000","last_peered":"2024-03-23T06:22:05.106666+0000","last_clean":"2024-03-23T06:22:05.106666+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:22:05.106666+0000","last_undegraded":"2024-03-23T06:22:05.106666+0000","last_fullsized":"2024-03-23T06:22:05.106666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:31:52.326728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'20","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.094924+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:22:05.094924+0000","last_peered":"2024-03-23T06:22:05.094924+0000","last_clean":"2024-03-23T06:22:05.094924+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:22:05.094924+0000","last_undegraded":"2024-03-23T06:22:05.094924+0000","last_fullsized":"2024-03-23T06:22:05.094924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:02:04.527722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'22","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.069453+0000","last_change":"2024-03-23T06:09:57.934679+0000","last_active":"2024-03-23T06:22:05.069453+0000","last_peered":"2024-03-23T06:22:05.069453+0000","last_clean":"2024-03-23T06:22:05.069453+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:22:05.069453+0000","last_undegraded":"2024-03-23T06:22:05.069453+0000","last_fullsized":"2024-03-23T06:22:05.069453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:47:21.402988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.089355+0000","last_change":"2024-03-23T06:09:57.946543+0000","last_active":"2024-03-23T06:22:05.089355+0000","last_peered":"2024-03-23T06:22:05.089355+0000","last_clean":"2024-03-23T06:22:05.089355+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:22:05.089355+0000","last_undegraded":"2024-03-23T06:22:05.089355+0000","last_fullsized":"2024-03-23T06:22:05.089355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:34:05.141124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.096697+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:22:05.096697+0000","last_peered":"2024-03-23T06:22:05.096697+0000","last_clean":"2024-03-23T06:22:05.096697+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:22:05.096697+0000","last_undegraded":"2024-03-23T06:22:05.096697+0000","last_fullsized":"2024-03-23T06:22:05.096697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:55:55.120913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.100970+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:22:05.100970+0000","last_peered":"2024-03-23T06:22:05.100970+0000","last_clean":"2024-03-23T06:22:05.100970+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:22:05.100970+0000","last_undegraded":"2024-03-23T06:22:05.100970+0000","last_fullsized":"2024-03-23T06:22:05.100970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:37:49.001465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'28","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.090685+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:22:05.090685+0000","last_peered":"2024-03-23T06:22:05.090685+0000","last_clean":"2024-03-23T06:22:05.090685+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:22:05.090685+0000","last_undegraded":"2024-03-23T06:22:05.090685+0000","last_fullsized":"2024-03-23T06:22:05.090685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:53:09.573886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'22","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.104481+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:22:05.104481+0000","last_peered":"2024-03-23T06:22:05.104481+0000","last_clean":"2024-03-23T06:22:05.104481+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:22:05.104481+0000","last_undegraded":"2024-03-23T06:22:05.104481+0000","last_fullsized":"2024-03-23T06:22:05.104481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.094145+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:22:05.094145+0000","last_peered":"2024-03-23T06:22:05.094145+0000","last_clean":"2024-03-23T06:22:05.094145+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:22:05.094145+0000","last_undegraded":"2024-03-23T06:22:05.094145+0000","last_fullsized":"2024-03-23T06:22:05.094145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:21:51.619730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.089874+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:22:05.089874+0000","last_peered":"2024-03-23T06:22:05.089874+0000","last_clean":"2024-03-23T06:22:05.089874+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:22:05.089874+0000","last_undegraded":"2024-03-23T06:22:05.089874+0000","last_fullsized":"2024-03-23T06:22:05.089874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:05:07.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.090579+0000","last_change":"2024-03-23T06:09:57.944496+0000","last_active":"2024-03-23T06:22:05.090579+0000","last_peered":"2024-03-23T06:22:05.090579+0000","last_clean":"2024-03-23T06:22:05.090579+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:22:05.090579+0000","last_undegraded":"2024-03-23T06:22:05.090579+0000","last_fullsized":"2024-03-23T06:22:05.090579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'15","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.093174+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:22:05.093174+0000","last_peered":"2024-03-23T06:22:05.093174+0000","last_clean":"2024-03-23T06:22:05.093174+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:22:05.093174+0000","last_undegraded":"2024-03-23T06:22:05.093174+0000","last_fullsized":"2024-03-23T06:22:05.093174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:53.160859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'12","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.580678+0000","last_change":"2024-03-23T06:09:57.945769+0000","last_active":"2024-03-23T06:22:10.580678+0000","last_peered":"2024-03-23T06:22:10.580678+0000","last_clean":"2024-03-23T06:22:10.580678+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:22:10.580678+0000","last_undegraded":"2024-03-23T06:22:10.580678+0000","last_fullsized":"2024-03-23T06:22:10.580678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'16","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.079619+0000","last_change":"2024-03-23T06:09:57.941723+0000","last_active":"2024-03-23T06:22:05.079619+0000","last_peered":"2024-03-23T06:22:05.079619+0000","last_clean":"2024-03-23T06:22:05.079619+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:22:05.079619+0000","last_undegraded":"2024-03-23T06:22:05.079619+0000","last_fullsized":"2024-03-23T06:22:05.079619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:43:15.649455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'9","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.070371+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:22:05.070371+0000","last_peered":"2024-03-23T06:22:05.070371+0000","last_clean":"2024-03-23T06:22:05.070371+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:22:05.070371+0000","last_undegraded":"2024-03-23T06:22:05.070371+0000","last_fullsized":"2024-03-23T06:22:05.070371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:44:24.957396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'17","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.100777+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:22:05.100777+0000","last_peered":"2024-03-23T06:22:05.100777+0000","last_clean":"2024-03-23T06:22:05.100777+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:22:05.100777+0000","last_undegraded":"2024-03-23T06:22:05.100777+0000","last_fullsized":"2024-03-23T06:22:05.100777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:44:34.589460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88812204,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2360,"num_write_kb":88570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177624408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2357,"ondisk_log_size":2357,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542291,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1363056,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1325886,"kb_avail":93008784,"statfs":{"total":96636764160,"available":95240994816,"internally_reserved":0,"allocated":38051840,"data_stored":37867372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1357707720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.8239999999999998,"5min":7.4420000000000002,"15min":4.649},"min":{"1min":0.32700000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":16.913,"5min":170.84299999999999,"15min":309.57499999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":2.3100000000000001,"5min":7.2069999999999999,"15min":4.5540000000000003},"min":{"1min":0.38600000000000001,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":11.553000000000001,"5min":178.934,"15min":300.98500000000001},"last":1.0580000000000001}]},{"osd":1,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":10.808,"15min":5.3719999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":16.82,"5min":359.48599999999999,"15min":359.48599999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":1.1859999999999999,"5min":9.3800000000000008,"15min":5.0759999999999996},"min":{"1min":0.29899999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.6440000000000001,"5min":359.20299999999997,"15min":359.20299999999997},"last":0.53700000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":3.8599999999999999,"5min":8.2759999999999998,"15min":4.4409999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":29.532,"5min":56.805999999999997,"15min":58.277000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":3.2959999999999998,"5min":9.9809999999999999,"15min":5.1310000000000002},"min":{"1min":0.57399999999999995,"5min":0.52100000000000002,"15min":0.32900000000000001},"max":{"1min":17.776,"5min":89.454999999999998,"15min":119.176},"last":0.70699999999999996}]},{"osd":4,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":2.738,"5min":6.4829999999999997,"15min":3.1899999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":20.178999999999998,"5min":36.270000000000003,"15min":36.270000000000003},"last":0.71899999999999997},{"interface":"front","average":{"1min":2.8889999999999998,"5min":6.9240000000000004,"15min":3.8929999999999998},"min":{"1min":0.48499999999999999,"5min":0.38600000000000001,"15min":0.32800000000000001},"max":{"1min":21.093,"5min":38.718000000000004,"15min":64.325000000000003},"last":0.627}]},{"osd":5,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":1.867,"5min":6.7060000000000004,"15min":3.8039999999999998},"min":{"1min":0.46100000000000002,"5min":0.36399999999999999,"15min":0.36299999999999999},"max":{"1min":9.423,"5min":38.759999999999998,"15min":58.317},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.9379999999999999,"5min":6.5640000000000001,"15min":3.5569999999999999},"min":{"1min":0.53300000000000003,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":9.4529999999999994,"5min":33.854999999999997,"15min":33.854999999999997},"last":0.90400000000000003}]},{"osd":6,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":1.609,"5min":6.9930000000000003,"15min":3.7410000000000001},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":5.1539999999999999,"5min":31.623999999999999,"15min":31.623999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":2.2829999999999999,"5min":6.4189999999999996,"15min":3.2559999999999998},"min":{"1min":0.67100000000000004,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":9.3900000000000006,"5min":37.179000000000002,"15min":37.179000000000002},"last":0.67000000000000004}]},{"osd":7,"last update":"Sat Mar 23 06:21:17 2024","interfaces":[{"interface":"back","average":{"1min":4.0960000000000001,"5min":7.9029999999999996,"15min":4.218},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":19.388000000000002,"5min":38.621000000000002,"15min":58.344000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":3.4430000000000001,"5min":7.4119999999999999,"15min":3.6880000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":19.349,"5min":38.680999999999997,"15min":38.680999999999997},"last":1.004}]}]},{"osd":2,"up_from":14,"seq":60129542292,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.2490000000000001,"5min":5.1079999999999997,"15min":3.8050000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.252},"max":{"1min":23.753,"5min":49.142000000000003,"15min":126.152},"last":0.59899999999999998},{"interface":"front","average":{"1min":2.7669999999999999,"5min":4.7169999999999996,"15min":3.2450000000000001},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":23.312000000000001,"5min":29.206,"15min":143.14099999999999},"last":0.72599999999999998}]},{"osd":1,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.379,"5min":6.9400000000000004,"15min":4.3390000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":23.280000000000001,"5min":55.564999999999998,"15min":55.564999999999998},"last":0.84599999999999997},{"interface":"front","average":{"1min":4.1859999999999999,"5min":7.2030000000000003,"15min":3.8119999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.31900000000000001},"max":{"1min":18.187999999999999,"5min":55.354999999999997,"15min":55.354999999999997},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":5.2240000000000002,"5min":17.103000000000002,"15min":7.4960000000000004},"min":{"1min":0.379,"5min":0.33700000000000002,"15min":0.27600000000000002},"max":{"1min":38.366,"5min":529.81799999999998,"15min":529.81799999999998},"last":0.69499999999999995},{"interface":"front","average":{"1min":4.6539999999999999,"5min":11.901,"15min":5.7839999999999998},"min":{"1min":0.64000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":14.378,"5min":528.94200000000001,"15min":528.94200000000001},"last":0.61399999999999999}]},{"osd":4,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":6.7610000000000001,"5min":6.6779999999999999,"15min":3.431},"min":{"1min":0.37,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":31.062999999999999,"5min":49.430999999999997,"15min":49.430999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":9.0259999999999998,"5min":7.7889999999999997,"15min":4.5250000000000004},"min":{"1min":0.45600000000000002,"5min":0.36899999999999999,"15min":0.312},"max":{"1min":44.173000000000002,"5min":60.298000000000002,"15min":83.525999999999996},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":5.1829999999999998,"5min":6.0490000000000004,"15min":3.9649999999999999},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":35.433999999999997,"5min":35.433999999999997,"15min":82.456000000000003},"last":0.80400000000000005},{"interface":"front","average":{"1min":4.9980000000000002,"5min":6.1539999999999999,"15min":3.7599999999999998},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.35199999999999998},"max":{"1min":35.472999999999999,"5min":35.472999999999999,"15min":82.971000000000004},"last":0.76500000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":3.2559999999999998,"5min":6.1280000000000001,"15min":3.6469999999999998},"min":{"1min":0.39700000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":13.169,"5min":57.420999999999999,"15min":83.007999999999996},"last":0.67000000000000004},{"interface":"front","average":{"1min":4.0679999999999996,"5min":6.6769999999999996,"15min":3.629},"min":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.914,"5min":49.768000000000001,"15min":49.768000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Mar 23 06:21:06 2024","interfaces":[{"interface":"back","average":{"1min":6.5250000000000004,"5min":6.6390000000000002,"15min":4.2789999999999999},"min":{"1min":0.51400000000000001,"5min":0.44900000000000001,"15min":0.35099999999999998},"max":{"1min":23.207000000000001,"5min":43.113,"15min":77.353999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":6.1520000000000001,"5min":8.2750000000000004,"15min":4.2640000000000002},"min":{"1min":0.56200000000000006,"5min":0.38,"15min":0.38},"max":{"1min":28.085000000000001,"5min":83.406999999999996,"15min":83.406999999999996},"last":0.95599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542294,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":3.5470000000000002,"15min":2.8149999999999999},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.221},"max":{"1min":1.484,"5min":38.363,"15min":70.713999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1379999999999999,"5min":3.9529999999999998,"15min":2.7010000000000001},"min":{"1min":0.48299999999999998,"5min":0.247,"15min":0.247},"max":{"1min":5.7389999999999999,"5min":30.41,"15min":30.41},"last":1.175}]},{"osd":2,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":7.2889999999999997,"15min":4.5990000000000002},"min":{"1min":0.432,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0910000000000002,"5min":127.342,"15min":127.342},"last":1.391},{"interface":"front","average":{"1min":1.3819999999999999,"5min":5.5220000000000002,"15min":4.2629999999999999},"min":{"1min":0.46500000000000002,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":5.1210000000000004,"5min":107.748,"15min":107.748},"last":1.4570000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":5.8600000000000003,"15min":4.0119999999999996},"min":{"1min":0.505,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":4.2649999999999997,"5min":31.780000000000001,"15min":31.780000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.7070000000000001,"5min":4.5839999999999996,"15min":4.0449999999999999},"min":{"1min":0.45100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.835000000000001,"5min":31.821999999999999,"15min":175.29300000000001},"last":0.95199999999999996}]},{"osd":4,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":4.101,"15min":3.1600000000000001},"min":{"1min":0.56000000000000005,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":4.21,"5min":24.856999999999999,"15min":78.060000000000002},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.361,"5min":4.5519999999999996,"15min":3.1619999999999999},"min":{"1min":0.53200000000000003,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":4.2359999999999998,"5min":26.184999999999999,"15min":80.959999999999994},"last":1.054}]},{"osd":5,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":4.3460000000000001,"15min":3.262},"min":{"1min":0.52100000000000002,"5min":0.37,"15min":0.35899999999999999},"max":{"1min":3.3450000000000002,"5min":23.234000000000002,"15min":70.670000000000002},"last":0.875},{"interface":"front","average":{"1min":1.2010000000000001,"5min":4.0069999999999997,"15min":2.7010000000000001},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":3.1509999999999998,"5min":26.341000000000001,"15min":30.431000000000001},"last":0.92800000000000005}]},{"osd":6,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":5.4779999999999998,"15min":3.3079999999999998},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.375},"max":{"1min":4.3230000000000004,"5min":40.606999999999999,"15min":40.606999999999999},"last":1.25},{"interface":"front","average":{"1min":1.4470000000000001,"5min":5.2670000000000003,"15min":3.6230000000000002},"min":{"1min":0.57999999999999996,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.1749999999999998,"5min":36.905999999999999,"15min":68.369},"last":1.087}]},{"osd":7,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":5.6680000000000001,"15min":3.9870000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":5.6660000000000004,"5min":31.044,"15min":90.965999999999994},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.7509999999999999,"5min":6.3369999999999997,"15min":4.1520000000000001},"min":{"1min":0.54400000000000004,"5min":0.48099999999999998,"15min":0.38700000000000001},"max":{"1min":5.6970000000000001,"5min":35.256,"15min":84.465000000000003},"last":1.347}]}]},{"osd":0,"up_from":14,"seq":60129542296,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":12.144,"15min":5.3419999999999996},"min":{"1min":0.439,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":9.5180000000000007,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":2.3730000000000002,"5min":5.7039999999999997,"15min":3.1099999999999999},"min":{"1min":0.33000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":11.704000000000001,"5min":76.515000000000001,"15min":76.515000000000001},"last":1.302}]},{"osd":2,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.649,"5min":6.0780000000000003,"15min":3.4350000000000001},"min":{"1min":0.38600000000000001,"5min":0.34100000000000003,"15min":0.33300000000000002},"max":{"1min":14.335000000000001,"5min":58.996000000000002,"15min":58.996000000000002},"last":0.71299999999999997},{"interface":"front","average":{"1min":2.1549999999999998,"5min":4.9809999999999999,"15min":3.54},"min":{"1min":0.48099999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":6.641,"5min":50.271000000000001,"15min":62.466000000000001},"last":0.999}]},{"osd":3,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.9430000000000001,"5min":5.8799999999999999,"15min":3.5550000000000002},"min":{"1min":0.5,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":15.768000000000001,"5min":44.116999999999997,"15min":44.360999999999997},"last":1.1499999999999999},{"interface":"front","average":{"1min":3.5670000000000002,"5min":5.8019999999999996,"15min":3.4409999999999998},"min":{"1min":0.502,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":14.231999999999999,"5min":44.212000000000003,"15min":81.251000000000005},"last":0.82999999999999996}]},{"osd":4,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":4.7030000000000003,"5min":6.8630000000000004,"15min":3.2450000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":37.588000000000001,"5min":72.588999999999999,"15min":72.588999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":4.3410000000000002,"5min":6.3609999999999998,"15min":3.3490000000000002},"min":{"1min":0.59199999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":34.561999999999998,"5min":69.566000000000003,"15min":69.566000000000003},"last":0.96799999999999997}]},{"osd":5,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.645,"5min":6.1849999999999996,"15min":3.1709999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":22.946999999999999,"5min":72.552000000000007,"15min":72.552000000000007},"last":1.351},{"interface":"front","average":{"1min":2.2410000000000001,"5min":5.6740000000000004,"15min":3.0859999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":13.670999999999999,"5min":72.626999999999995,"15min":72.626999999999995},"last":1.4019999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6539999999999999,"5min":5.1310000000000002,"15min":2.9319999999999999},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":9.0310000000000006,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.0089999999999999,"5min":5.806,"15min":3.1459999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":8.9760000000000009,"5min":72.656999999999996,"15min":72.656999999999996},"last":1.4470000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":3.2799999999999998,"5min":6.7050000000000001,"15min":3.3900000000000001},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":18.199000000000002,"5min":69.662000000000006,"15min":69.662000000000006},"last":0.89300000000000002},{"interface":"front","average":{"1min":3.2189999999999999,"5min":5.2279999999999998,"15min":2.96},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.38700000000000001},"max":{"1min":18.236000000000001,"5min":69.632000000000005,"15min":69.632000000000005},"last":0.92800000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":3.6920000000000002,"15min":2.3029999999999999},"min":{"1min":0.34699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":4.4470000000000001,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.375},{"interface":"front","average":{"1min":0.69699999999999995,"5min":3.347,"15min":2.0449999999999999},"min":{"1min":0.30199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":2.706,"5min":33.662999999999997,"15min":42.582000000000001},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":6.79,"15min":4.2699999999999996},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":2.806,"5min":95.497,"15min":310.09300000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.85599999999999998,"5min":6.867,"15min":4.3200000000000003},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.8740000000000001,"5min":95.531999999999996,"15min":309.70999999999998},"last":0.72899999999999998}]},{"osd":2,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":3.8380000000000001,"15min":2.544},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":4.976,"5min":33.454999999999998,"15min":63.014000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":4.407,"15min":3.0009999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.9169999999999998,"5min":32.755000000000003,"15min":73.218000000000004},"last":0.435}]},{"osd":3,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":6.4009999999999998,"15min":3.331},"min":{"1min":0.372,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":5.2249999999999996,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":1.556,"5min":4.617,"15min":2.7970000000000002},"min":{"1min":0.51600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":8.7590000000000003,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.78800000000000003}]},{"osd":4,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":5.1420000000000003,"15min":2.246},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.46600000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":5.3289999999999997,"15min":2.2480000000000002},"min":{"1min":0.27700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":2.8439999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.316}]},{"osd":5,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":4.4269999999999996,"15min":1.9219999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":4.5609999999999999,"5min":35.884,"15min":35.884},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":4.8209999999999997,"15min":2.0630000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.24399999999999999},"max":{"1min":2.899,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.38500000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":3.6259999999999999,"15min":1.742},"min":{"1min":0.27000000000000002,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":2.6160000000000001,"5min":32.799999999999997,"15min":32.799999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":3.79,"15min":1.7470000000000001},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":2.6579999999999999,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.41199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575000,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":3.3109999999999999,"15min":1.794},"min":{"1min":0.376,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":6.1440000000000001,"5min":47.136000000000003,"15min":47.136000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":2.2989999999999999,"5min":3.8450000000000002,"15min":2.0950000000000002},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":16.620000000000001,"5min":43.140000000000001,"15min":43.140000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":4.3319999999999999,"15min":2.7610000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":10.538,"5min":77.959000000000003,"15min":96.375},"last":0.624},{"interface":"front","average":{"1min":2.0049999999999999,"5min":6.0259999999999998,"15min":3.3839999999999999},"min":{"1min":0.38600000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":7.4690000000000003,"5min":96.034000000000006,"15min":96.034000000000006},"last":0.73599999999999999}]},{"osd":2,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":4.3659999999999997,"15min":3.3969999999999998},"min":{"1min":0.38,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":7.9370000000000003,"5min":53.225000000000001,"15min":91.947999999999993},"last":0.63600000000000001},{"interface":"front","average":{"1min":2.1619999999999999,"5min":5.165,"15min":3.202},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":18.454000000000001,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.61599999999999999}]},{"osd":3,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":3.645,"5min":5.9880000000000004,"15min":3.657},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":24.745999999999999,"5min":73.837000000000003,"15min":107.29000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":4.1669999999999998,"5min":5.907,"15min":3.766},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":26.498000000000001,"5min":73.692999999999998,"15min":107.27200000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":7.9210000000000003,"5min":4.6600000000000001,"15min":2.1440000000000001},"min":{"1min":0.252,"5min":0.216,"15min":0.216},"max":{"1min":45.302,"5min":45.302,"15min":45.302},"last":0.253},{"interface":"front","average":{"1min":8.0129999999999999,"5min":4.7249999999999996,"15min":2.202},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.251},"max":{"1min":45.408000000000001,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.32000000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":4.1669999999999998,"15min":1.8400000000000001},"min":{"1min":0.27700000000000002,"5min":0.25800000000000001,"15min":0.247},"max":{"1min":24.779,"5min":39.625,"15min":39.625},"last":0.34999999999999998},{"interface":"front","average":{"1min":1.9470000000000001,"5min":3.3639999999999999,"15min":1.6719999999999999},"min":{"1min":0.28699999999999998,"5min":0.25800000000000001,"15min":0.25600000000000001},"max":{"1min":26.454999999999998,"5min":37.686,"15min":37.686},"last":0.30399999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:21:10 2024","interfaces":[{"interface":"back","average":{"1min":3.3300000000000001,"5min":3.4580000000000002,"15min":1.6479999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":24.359999999999999,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.38},{"interface":"front","average":{"1min":4.1609999999999996,"5min":3.3300000000000001,"15min":1.5680000000000001},"min":{"1min":0.34300000000000003,"5min":0.29799999999999999,"15min":0.27900000000000003},"max":{"1min":26.521000000000001,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.29199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575001,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26601250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":3.1200000000000001,"15min":1.6619999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.9969999999999999,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":3.4079999999999999,"15min":1.7390000000000001},"min":{"1min":0.32700000000000001,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":3.871,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":4.8319999999999999,"15min":2.3069999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27900000000000003},"max":{"1min":16.021000000000001,"5min":69.873999999999995,"15min":69.873999999999995},"last":0.379},{"interface":"front","average":{"1min":2.1299999999999999,"5min":4.8410000000000002,"15min":2.383},"min":{"1min":0.41399999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":11.035,"5min":50.758000000000003,"15min":50.758000000000003},"last":0.46999999999999997}]},{"osd":2,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":2.423,"5min":5.1059999999999999,"15min":2.726},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":18.189,"5min":100.931,"15min":100.931},"last":0.80100000000000005},{"interface":"front","average":{"1min":2.6219999999999999,"5min":6.4400000000000004,"15min":3.1269999999999998},"min":{"1min":0.34200000000000003,"5min":0.253,"15min":0.253},"max":{"1min":18.815000000000001,"5min":142.041,"15min":142.041},"last":0.59699999999999998}]},{"osd":3,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":6.0490000000000004,"15min":2.9369999999999998},"min":{"1min":0.33000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":9.6340000000000003,"5min":63.905999999999999,"15min":63.905999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.7250000000000001,"5min":5.9930000000000003,"15min":3.0310000000000001},"min":{"1min":0.38800000000000001,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":9.6210000000000004,"5min":61.076000000000001,"15min":61.076000000000001},"last":0.73599999999999999}]},{"osd":4,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":3.4700000000000002,"15min":1.603},"min":{"1min":0.248,"5min":0.219,"15min":0.219},"max":{"1min":2.5539999999999998,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.249},{"interface":"front","average":{"1min":0.68200000000000005,"5min":3.8370000000000002,"15min":1.7350000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":3.9540000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.33700000000000002}]},{"osd":6,"last update":"Sat Mar 23 06:21:11 2024","interfaces":[{"interface":"back","average":{"1min":3.5579999999999998,"5min":5.1699999999999999,"15min":2.1110000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":32.395000000000003,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.35399999999999998},{"interface":"front","average":{"1min":3.681,"5min":5.3890000000000002,"15min":2.3250000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":32.616999999999997,"5min":40.314,"15min":40.314},"last":0.28100000000000003}]},{"osd":7,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":3.859,"15min":1.819},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.25700000000000001},"max":{"1min":3.8570000000000002,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.309},{"interface":"front","average":{"1min":0.72599999999999998,"5min":4.7720000000000002,"15min":2.0630000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":4.0019999999999998,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.36799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":3.0249999999999999,"15min":1.716},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":26.696000000000002,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":2.6600000000000001,"5min":3.2610000000000001,"15min":1.8999999999999999},"min":{"1min":0.38700000000000001,"5min":0.32300000000000001,"15min":0.318},"max":{"1min":26.655000000000001,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.45900000000000002}]},{"osd":1,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":5.3780000000000001,"15min":2.7290000000000001},"min":{"1min":0.314,"5min":0.29499999999999998,"15min":0.27400000000000002},"max":{"1min":6.5529999999999999,"5min":51.387999999999998,"15min":51.387999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":1.393,"5min":3.75,"15min":2.1640000000000001},"min":{"1min":0.39600000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":6.633,"5min":50.207000000000001,"15min":50.207000000000001},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":5.056,"5min":10.506,"15min":4.6859999999999999},"min":{"1min":0.29099999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":40.793999999999997,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.438},{"interface":"front","average":{"1min":1.26,"5min":9.3879999999999999,"15min":4.2000000000000002},"min":{"1min":0.34599999999999997,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":4.6870000000000003,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":5.3319999999999999,"15min":2.762},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.5220000000000002,"5min":53.134999999999998,"15min":53.134999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":2.137,"5min":6.9210000000000003,"15min":4.3179999999999996},"min":{"1min":0.33300000000000002,"5min":0.32100000000000001,"15min":0.30399999999999999},"max":{"1min":5.633,"5min":62.134,"15min":161.191},"last":0.38100000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":3.75,"15min":1.647},"min":{"1min":0.23499999999999999,"5min":0.23400000000000001,"15min":0.22700000000000001},"max":{"1min":2.8519999999999999,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":3.8119999999999998,"15min":1.7230000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.22800000000000001},"max":{"1min":3.0259999999999998,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.35699999999999998}]},{"osd":6,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":6.6719999999999997,"15min":2.6389999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.22900000000000001},"max":{"1min":3.137,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.28599999999999998},{"interface":"front","average":{"1min":1.151,"5min":6.2510000000000003,"15min":2.5510000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":6.3899999999999997,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.32800000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:21:20 2024","interfaces":[{"interface":"back","average":{"1min":2.3769999999999998,"5min":5.0099999999999998,"15min":2.101},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.24299999999999999},"max":{"1min":26.707999999999998,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":2.4129999999999998,"5min":4.4450000000000003,"15min":1.9179999999999999},"min":{"1min":0.30399999999999999,"5min":0.29899999999999999,"15min":0.28999999999999998},"max":{"1min":26.725999999999999,"5min":51.997,"15min":51.997},"last":0.44600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:22:14.347 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.347 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.348 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.349 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.350 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.351 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.352 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.353 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.354 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.355 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.356 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.357 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.358 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.359 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.360 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.360 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.360 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.360 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.360 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.360 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.360 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:14.360 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T06:22:34.361 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:22:34.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.574+0000 7f7625600640 1 Processor -- start 2024-03-23T06:22:34.575 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.575+0000 7f7625600640 1 -- start start 2024-03-23T06:22:34.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f7625600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76201513f0 0x7f76200c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:34.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f7625600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76201586b0 0x7f76200bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:34.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f7625600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76200c03a0 0x7f7620071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f7625600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76200c5f50 con 0x7f76201513f0 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f7625600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7620157b60 con 0x7f76201586b0 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f7625600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200c0830 con 0x7f76200c03a0 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f761ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76201513f0 0x7f76200c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f761f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76200c03a0 0x7f7620071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f761ea00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76201513f0 0x7f76200c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46526/0 (socket says 172.21.15.73:46526) 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f7616000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76201586b0 0x7f76200bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.576+0000 7f761ea00640 1 -- 172.21.15.73:0/393651903 learned_addr learned my addr 172.21.15.73:0/393651903 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:34.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.577+0000 7f761ea00640 1 -- 172.21.15.73:0/393651903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76200c03a0 msgr2=0x7f7620071bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.577+0000 7f761ea00640 1 --2- 172.21.15.73:0/393651903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76200c03a0 0x7f7620071bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.577+0000 7f761ea00640 1 -- 172.21.15.73:0/393651903 >> v2:172.21.15.110:3300/0 conn(0x7f76201586b0 msgr2=0x7f76200bfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.577+0000 7f761ea00640 1 --2- 172.21.15.73:0/393651903 >> v2:172.21.15.110:3300/0 conn(0x7f76201586b0 0x7f76200bfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.577+0000 7f761ea00640 1 -- 172.21.15.73:0/393651903 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200c0b10 con 0x7f76201513f0 2024-03-23T06:22:34.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.577+0000 7f7616000640 1 --2- 172.21.15.73:0/393651903 >> v2:172.21.15.110:3300/0 conn(0x7f76201586b0 0x7f76200bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.578+0000 7f761ea00640 1 --2- 172.21.15.73:0/393651903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f76200c5a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7620072880 tx=0x7f761002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e1359df38b17c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.578+0000 7f761e000640 1 -- 172.21.15.73:0/393651903 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761002cb00 con 0x7f76201513f0 2024-03-23T06:22:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.578+0000 7f761e000640 1 -- 172.21.15.73:0/393651903 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761002cc60 con 0x7f76201513f0 2024-03-23T06:22:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.578+0000 7f761e000640 1 -- 172.21.15.73:0/393651903 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76100343f0 con 0x7f76201513f0 2024-03-23T06:22:34.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 -- 172.21.15.73:0/393651903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 msgr2=0x7f76200c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 --2- 172.21.15.73:0/393651903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f76200c5a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7620072880 tx=0x7f761002bf60 comp rx=0 tx=0).stop 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 -- 172.21.15.73:0/393651903 shutdown_connections 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 --2- 172.21.15.73:0/393651903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76200c03a0 0x7f7620071bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 --2- 172.21.15.73:0/393651903 >> v2:172.21.15.110:3300/0 conn(0x7f76201586b0 0x7f76200bfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 --2- 172.21.15.73:0/393651903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f76200c5a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 -- 172.21.15.73:0/393651903 >> 172.21.15.73:0/393651903 conn(0x7f762006bb40 msgr2=0x7f762006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 -- 172.21.15.73:0/393651903 shutdown_connections 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.579+0000 7f7625600640 1 -- 172.21.15.73:0/393651903 wait complete. 2024-03-23T06:22:34.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.581+0000 7f7625600640 1 Processor -- start 2024-03-23T06:22:34.581 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.581+0000 7f7625600640 1 -- start start 2024-03-23T06:22:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f7625600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f7620153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f7625600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76201586b0 0x7f76200c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f7625600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201f26b0 0x7f76201f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f7625600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620152fe0 con 0x7f76201513f0 2024-03-23T06:22:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f7625600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76201f2260 con 0x7f76201f26b0 2024-03-23T06:22:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f7625600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76200c3490 con 0x7f76201586b0 2024-03-23T06:22:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f7620153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:34.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201f26b0 0x7f76201f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761ea00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f7620153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46540/0 (socket says 172.21.15.73:46540) 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761ea00640 1 -- 172.21.15.73:0/3195009689 learned_addr learned my addr 172.21.15.73:0/3195009689 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f7616000640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76201586b0 0x7f76200c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761ea00640 1 -- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76201586b0 msgr2=0x7f76200c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761ea00640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76201586b0 0x7f76200c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761ea00640 1 -- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201f26b0 msgr2=0x7f76201f2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761ea00640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201f26b0 0x7f76201f2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761ea00640 1 -- 172.21.15.73:0/3195009689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7608009400 con 0x7f76201513f0 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.582+0000 7f761f400640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201f26b0 0x7f76201f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.583+0000 7f761ea00640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f7620153a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7610000f80 tx=0x7f7610004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.583+0000 7f7617400640 1 -- 172.21.15.73:0/3195009689 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7610009510 con 0x7f76201513f0 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.583+0000 7f7617400640 1 -- 172.21.15.73:0/3195009689 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761003e450 con 0x7f76201513f0 2024-03-23T06:22:34.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.583+0000 7f7617400640 1 -- 172.21.15.73:0/3195009689 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761003e800 con 0x7f76201513f0 2024-03-23T06:22:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.583+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7610009b30 con 0x7f76201513f0 2024-03-23T06:22:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.583+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76201f30a0 con 0x7f76201513f0 2024-03-23T06:22:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.585+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76201f23d0 con 0x7f76201513f0 2024-03-23T06:22:34.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.585+0000 7f7617400640 1 -- 172.21.15.73:0/3195009689 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f761003e960 con 0x7f76201513f0 2024-03-23T06:22:34.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.586+0000 7f7617400640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f75fc06ac00 0x7f75fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:34.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.587+0000 7f7617400640 1 -- 172.21.15.73:0/3195009689 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f76100ac1f0 con 0x7f76201513f0 2024-03-23T06:22:34.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.587+0000 7f7616000640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f75fc06ac00 0x7f75fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:34.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.587+0000 7f7616000640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f75fc06ac00 0x7f75fc06d0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f76200c2ef0 tx=0x7f7608009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:34.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.591+0000 7f7617400640 1 -- 172.21.15.73:0/3195009689 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7610077110 con 0x7f76201513f0 2024-03-23T06:22:34.783 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.783+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76201571c0 con 0x7f75fc06ac00 2024-03-23T06:22:34.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.794+0000 7f7617400640 1 -- 172.21.15.73:0/3195009689 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368431 (secure 0 0 0) 0x7f7608009920 con 0x7f75fc06ac00 2024-03-23T06:22:34.799 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:34.801 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:22:34.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f75fc06ac00 msgr2=0x7f75fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f75fc06ac00 0x7f75fc06d0c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f76200c2ef0 tx=0x7f7608009190 comp rx=0 tx=0).stop 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 msgr2=0x7f7620153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f7620153a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7610000f80 tx=0x7f7610004a40 comp rx=0 tx=0).stop 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 shutdown_connections 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76201f26b0 0x7f76201f2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f75fc06ac00 0x7f75fc06d0c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76201586b0 0x7f76200c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 --2- 172.21.15.73:0/3195009689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76201513f0 0x7f7620153a60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 >> 172.21.15.73:0/3195009689 conn(0x7f762006bb40 msgr2=0x7f7620155eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 shutdown_connections 2024-03-23T06:22:34.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:34.800+0000 7f7625600640 1 -- 172.21.15.73:0/3195009689 wait complete. 2024-03-23T06:22:34.818 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2024-03-23T06:22:32.827605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402572,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469605,"num_write_kb":34184419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171166,"ondisk_log_size":171166,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10077296,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9900211,"kb_avail":744897424,"statfs":{"total":773094113280,"available":762774962176,"internally_reserved":0,"allocated":181256192,"data_stored":179741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10137816632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002531"},"pg_stats":[{"pgid":"2.1f","version":"27'18","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.234338+0000","last_change":"2024-03-23T06:22:24.234338+0000","last_active":"2024-03-23T06:22:24.234338+0000","last_peered":"2024-03-23T06:22:24.234338+0000","last_clean":"2024-03-23T06:22:24.234338+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:22:24.234338+0000","last_undegraded":"2024-03-23T06:22:24.234338+0000","last_fullsized":"2024-03-23T06:22:24.234338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.234241+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:53.812998+0000","scrub_duration":0.016306496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.301797+0000","last_change":"2024-03-23T06:22:16.301887+0000","last_active":"2024-03-23T06:22:16.301797+0000","last_peered":"2024-03-23T06:22:16.301797+0000","last_clean":"2024-03-23T06:22:16.301797+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:22:16.301797+0000","last_undegraded":"2024-03-23T06:22:16.301797+0000","last_fullsized":"2024-03-23T06:22:16.301797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.301777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:37:55.431944+0000","scrub_duration":0.0022956500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4669,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:13.883739+0000","last_change":"2024-03-23T06:10:01.958503+0000","last_active":"2024-03-23T06:22:13.883739+0000","last_peered":"2024-03-23T06:22:13.883739+0000","last_clean":"2024-03-23T06:22:13.883739+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:22:13.883739+0000","last_undegraded":"2024-03-23T06:22:13.883739+0000","last_fullsized":"2024-03-23T06:22:13.883739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.340695+0000","last_change":"2024-03-23T06:22:28.340766+0000","last_active":"2024-03-23T06:22:28.340695+0000","last_peered":"2024-03-23T06:22:28.340695+0000","last_clean":"2024-03-23T06:22:28.340695+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:22:28.340695+0000","last_undegraded":"2024-03-23T06:22:28.340695+0000","last_fullsized":"2024-03-23T06:22:28.340695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.340675+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:05:53.500984+0000","scrub_duration":0.0074425539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.402809+0000","last_change":"2024-03-23T06:22:20.402809+0000","last_active":"2024-03-23T06:22:20.402809+0000","last_peered":"2024-03-23T06:22:20.402809+0000","last_clean":"2024-03-23T06:22:20.402809+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:22:20.402809+0000","last_undegraded":"2024-03-23T06:22:20.402809+0000","last_fullsized":"2024-03-23T06:22:20.402809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.402677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:48.099293+0000","scrub_duration":0.064311640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.580756+0000","last_change":"2024-03-23T06:10:01.969478+0000","last_active":"2024-03-23T06:22:10.580756+0000","last_peered":"2024-03-23T06:22:10.580756+0000","last_clean":"2024-03-23T06:22:10.580756+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:22:10.580756+0000","last_undegraded":"2024-03-23T06:22:10.580756+0000","last_fullsized":"2024-03-23T06:22:10.580756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'165","reported_seq":197,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.665507+0000","last_change":"2024-03-23T06:22:26.665632+0000","last_active":"2024-03-23T06:22:26.665507+0000","last_peered":"2024-03-23T06:22:26.665507+0000","last_clean":"2024-03-23T06:22:26.665507+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:22:26.665507+0000","last_undegraded":"2024-03-23T06:22:26.665507+0000","last_fullsized":"2024-03-23T06:22:26.665507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.665468+0000","objects_scrubbed":5,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:40:12.950569+0000","scrub_duration":0.059269850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.071525+0000","last_change":"2024-03-23T06:10:39.674095+0000","last_active":"2024-03-23T06:22:05.071525+0000","last_peered":"2024-03-23T06:22:05.071525+0000","last_clean":"2024-03-23T06:22:05.071525+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:22:05.071525+0000","last_undegraded":"2024-03-23T06:22:05.071525+0000","last_fullsized":"2024-03-23T06:22:05.071525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.580866+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:22:10.580866+0000","last_peered":"2024-03-23T06:22:10.580866+0000","last_clean":"2024-03-23T06:22:10.580866+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:22:10.580866+0000","last_undegraded":"2024-03-23T06:22:10.580866+0000","last_fullsized":"2024-03-23T06:22:10.580866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:18.622320+0000","last_change":"2024-03-23T06:22:18.622320+0000","last_active":"2024-03-23T06:22:18.622320+0000","last_peered":"2024-03-23T06:22:18.622320+0000","last_clean":"2024-03-23T06:22:18.622320+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:22:18.622320+0000","last_undegraded":"2024-03-23T06:22:18.622320+0000","last_fullsized":"2024-03-23T06:22:18.622320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_clean_scrub_stamp":"2024-03-23T06:22:18.622074+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:17:57.132801+0000","scrub_duration":0.022310751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'29","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.278728+0000","last_change":"2024-03-23T06:22:17.278949+0000","last_active":"2024-03-23T06:22:17.278728+0000","last_peered":"2024-03-23T06:22:17.278728+0000","last_clean":"2024-03-23T06:22:17.278728+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:22:17.278728+0000","last_undegraded":"2024-03-23T06:22:17.278728+0000","last_fullsized":"2024-03-23T06:22:17.278728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.278677+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:35:44.193734+0000","scrub_duration":0.003489125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.580975+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:22:10.580975+0000","last_peered":"2024-03-23T06:22:10.580975+0000","last_clean":"2024-03-23T06:22:10.580975+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:22:10.580975+0000","last_undegraded":"2024-03-23T06:22:10.580975+0000","last_fullsized":"2024-03-23T06:22:10.580975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.263553+0000","last_change":"2024-03-23T06:22:27.263737+0000","last_active":"2024-03-23T06:22:27.263553+0000","last_peered":"2024-03-23T06:22:27.263553+0000","last_clean":"2024-03-23T06:22:27.263553+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:22:27.263553+0000","last_undegraded":"2024-03-23T06:22:27.263553+0000","last_fullsized":"2024-03-23T06:22:27.263553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.263503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:55:00.258025+0000","scrub_duration":0.0032643260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'397","reported_seq":420,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.108429+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:21:28.108429+0000","last_peered":"2024-03-23T06:21:28.108429+0000","last_clean":"2024-03-23T06:21:28.108429+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:21:28.108429+0000","last_undegraded":"2024-03-23T06:21:28.108429+0000","last_fullsized":"2024-03-23T06:21:28.108429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.212676+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:21:28.212676+0000","last_peered":"2024-03-23T06:21:28.212676+0000","last_clean":"2024-03-23T06:21:28.212676+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:21:28.212676+0000","last_undegraded":"2024-03-23T06:21:28.212676+0000","last_fullsized":"2024-03-23T06:21:28.212676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.117390+0000","last_change":"2024-03-23T06:22:25.117488+0000","last_active":"2024-03-23T06:22:25.117390+0000","last_peered":"2024-03-23T06:22:25.117390+0000","last_clean":"2024-03-23T06:22:25.117390+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:22:25.117390+0000","last_undegraded":"2024-03-23T06:22:25.117390+0000","last_fullsized":"2024-03-23T06:22:25.117390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.117368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:18:30.718640+0000","scrub_duration":0.020924191000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:13.438650+0000","last_change":"2024-03-23T06:22:13.438725+0000","last_active":"2024-03-23T06:22:13.438650+0000","last_peered":"2024-03-23T06:22:13.438650+0000","last_clean":"2024-03-23T06:22:13.438650+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:22:13.438650+0000","last_undegraded":"2024-03-23T06:22:13.438650+0000","last_fullsized":"2024-03-23T06:22:13.438650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_clean_scrub_stamp":"2024-03-23T06:22:13.438631+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:34:21.050171+0000","scrub_duration":0.001784012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5253,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.208874+0000","last_change":"2024-03-23T06:10:01.969069+0000","last_active":"2024-03-23T06:21:28.208874+0000","last_peered":"2024-03-23T06:21:28.208874+0000","last_clean":"2024-03-23T06:21:28.208874+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:21:28.208874+0000","last_undegraded":"2024-03-23T06:21:28.208874+0000","last_fullsized":"2024-03-23T06:21:28.208874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'19","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.075624+0000","last_change":"2024-03-23T06:09:57.933918+0000","last_active":"2024-03-23T06:22:05.075624+0000","last_peered":"2024-03-23T06:22:05.075624+0000","last_clean":"2024-03-23T06:22:05.075624+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:22:05.075624+0000","last_undegraded":"2024-03-23T06:22:05.075624+0000","last_fullsized":"2024-03-23T06:22:05.075624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.301841+0000","last_change":"2024-03-23T06:22:22.301934+0000","last_active":"2024-03-23T06:22:22.301841+0000","last_peered":"2024-03-23T06:22:22.301841+0000","last_clean":"2024-03-23T06:22:22.301841+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:22:22.301841+0000","last_undegraded":"2024-03-23T06:22:22.301841+0000","last_fullsized":"2024-03-23T06:22:22.301841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.301822+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:51:57.846454+0000","scrub_duration":0.0052301179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6037,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.003389+0000","last_change":"2024-03-23T06:10:01.980523+0000","last_active":"2024-03-23T06:21:28.003389+0000","last_peered":"2024-03-23T06:21:28.003389+0000","last_clean":"2024-03-23T06:21:28.003389+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:21:28.003389+0000","last_undegraded":"2024-03-23T06:21:28.003389+0000","last_fullsized":"2024-03-23T06:21:28.003389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.104366+0000","last_change":"2024-03-23T06:09:57.930094+0000","last_active":"2024-03-23T06:22:05.104366+0000","last_peered":"2024-03-23T06:22:05.104366+0000","last_clean":"2024-03-23T06:22:05.104366+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:22:05.104366+0000","last_undegraded":"2024-03-23T06:22:05.104366+0000","last_fullsized":"2024-03-23T06:22:05.104366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.434083+0000","last_change":"2024-03-23T06:22:12.434207+0000","last_active":"2024-03-23T06:22:12.434083+0000","last_peered":"2024-03-23T06:22:12.434083+0000","last_clean":"2024-03-23T06:22:12.434083+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:22:12.434083+0000","last_undegraded":"2024-03-23T06:22:12.434083+0000","last_fullsized":"2024-03-23T06:22:12.434083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_clean_scrub_stamp":"2024-03-23T06:22:12.434048+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:01:00.920036+0000","scrub_duration":0.016801480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4183,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.234190+0000","last_change":"2024-03-23T06:10:01.976097+0000","last_active":"2024-03-23T06:21:28.234190+0000","last_peered":"2024-03-23T06:21:28.234190+0000","last_clean":"2024-03-23T06:21:28.234190+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:21:28.234190+0000","last_undegraded":"2024-03-23T06:21:28.234190+0000","last_fullsized":"2024-03-23T06:21:28.234190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.074233+0000","last_change":"2024-03-23T06:09:57.933929+0000","last_active":"2024-03-23T06:22:05.074233+0000","last_peered":"2024-03-23T06:22:05.074233+0000","last_clean":"2024-03-23T06:22:05.074233+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:22:05.074233+0000","last_undegraded":"2024-03-23T06:22:05.074233+0000","last_fullsized":"2024-03-23T06:22:05.074233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'11","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.234154+0000","last_change":"2024-03-23T06:09:57.482415+0000","last_active":"2024-03-23T06:21:28.234154+0000","last_peered":"2024-03-23T06:21:28.234154+0000","last_clean":"2024-03-23T06:21:28.234154+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:21:28.234154+0000","last_undegraded":"2024-03-23T06:21:28.234154+0000","last_fullsized":"2024-03-23T06:21:28.234154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.580749+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:22:10.580749+0000","last_peered":"2024-03-23T06:22:10.580749+0000","last_clean":"2024-03-23T06:22:10.580749+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:22:10.580749+0000","last_undegraded":"2024-03-23T06:22:10.580749+0000","last_fullsized":"2024-03-23T06:22:10.580749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'17","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.077804+0000","last_change":"2024-03-23T06:09:57.933934+0000","last_active":"2024-03-23T06:22:05.077804+0000","last_peered":"2024-03-23T06:22:05.077804+0000","last_clean":"2024-03-23T06:22:05.077804+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:22:05.077804+0000","last_undegraded":"2024-03-23T06:22:05.077804+0000","last_fullsized":"2024-03-23T06:22:05.077804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'99","reported_seq":133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.219020+0000","last_change":"2024-03-23T06:22:26.219128+0000","last_active":"2024-03-23T06:22:26.219020+0000","last_peered":"2024-03-23T06:22:26.219020+0000","last_clean":"2024-03-23T06:22:26.219020+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:22:26.219020+0000","last_undegraded":"2024-03-23T06:22:26.219020+0000","last_fullsized":"2024-03-23T06:22:26.219020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_deep_scrub":"27'99","last_deep_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.218984+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:35:47.992609+0000","scrub_duration":0.005800571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4677,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.278570+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:22:11.278570+0000","last_peered":"2024-03-23T06:22:11.278570+0000","last_clean":"2024-03-23T06:22:11.278570+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:22:11.278570+0000","last_undegraded":"2024-03-23T06:22:11.278570+0000","last_fullsized":"2024-03-23T06:22:11.278570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.407932+0000","last_change":"2024-03-23T06:22:25.408014+0000","last_active":"2024-03-23T06:22:25.407932+0000","last_peered":"2024-03-23T06:22:25.407932+0000","last_clean":"2024-03-23T06:22:25.407932+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:22:25.407932+0000","last_undegraded":"2024-03-23T06:22:25.407932+0000","last_fullsized":"2024-03-23T06:22:25.407932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.407913+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:33:56.177740+0000","scrub_duration":0.0011927579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.060647+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:21:28.060647+0000","last_peered":"2024-03-23T06:21:28.060647+0000","last_clean":"2024-03-23T06:21:28.060647+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:21:28.060647+0000","last_undegraded":"2024-03-23T06:21:28.060647+0000","last_fullsized":"2024-03-23T06:21:28.060647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.193223+0000","last_change":"2024-03-23T06:10:01.978180+0000","last_active":"2024-03-23T06:21:28.193223+0000","last_peered":"2024-03-23T06:21:28.193223+0000","last_clean":"2024-03-23T06:21:28.193223+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:21:28.193223+0000","last_undegraded":"2024-03-23T06:21:28.193223+0000","last_fullsized":"2024-03-23T06:21:28.193223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.892950+0000","last_change":"2024-03-23T06:22:24.893219+0000","last_active":"2024-03-23T06:22:24.892950+0000","last_peered":"2024-03-23T06:22:24.892950+0000","last_clean":"2024-03-23T06:22:24.892950+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:22:24.892950+0000","last_undegraded":"2024-03-23T06:22:24.892950+0000","last_fullsized":"2024-03-23T06:22:24.892950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.892857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:06.651897+0000","scrub_duration":0.020052960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.273728+0000","last_change":"2024-03-23T06:22:25.273805+0000","last_active":"2024-03-23T06:22:25.273728+0000","last_peered":"2024-03-23T06:22:25.273728+0000","last_clean":"2024-03-23T06:22:25.273728+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:22:25.273728+0000","last_undegraded":"2024-03-23T06:22:25.273728+0000","last_fullsized":"2024-03-23T06:22:25.273728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.273709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:28:04.429353+0000","scrub_duration":0.001195563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4626,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.124467+0000","last_change":"2024-03-23T06:10:01.957766+0000","last_active":"2024-03-23T06:21:28.124467+0000","last_peered":"2024-03-23T06:21:28.124467+0000","last_clean":"2024-03-23T06:21:28.124467+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:21:28.124467+0000","last_undegraded":"2024-03-23T06:21:28.124467+0000","last_fullsized":"2024-03-23T06:21:28.124467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:09.438397+0000","last_change":"2024-03-23T06:22:09.438536+0000","last_active":"2024-03-23T06:22:09.438397+0000","last_peered":"2024-03-23T06:22:09.438397+0000","last_clean":"2024-03-23T06:22:09.438397+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:22:09.438397+0000","last_undegraded":"2024-03-23T06:22:09.438397+0000","last_fullsized":"2024-03-23T06:22:09.438397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_clean_scrub_stamp":"2024-03-23T06:22:09.438361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:00:16.089523+0000","scrub_duration":0.017467308000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'26","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.239314+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:22:11.239314+0000","last_peered":"2024-03-23T06:22:11.239314+0000","last_clean":"2024-03-23T06:22:11.239314+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:22:11.239314+0000","last_undegraded":"2024-03-23T06:22:11.239314+0000","last_fullsized":"2024-03-23T06:22:11.239314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5403,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.087560+0000","last_change":"2024-03-23T06:10:01.964670+0000","last_active":"2024-03-23T06:21:28.087560+0000","last_peered":"2024-03-23T06:21:28.087560+0000","last_clean":"2024-03-23T06:21:28.087560+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:21:28.087560+0000","last_undegraded":"2024-03-23T06:21:28.087560+0000","last_fullsized":"2024-03-23T06:21:28.087560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'22","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.342913+0000","last_change":"2024-03-23T06:22:23.342993+0000","last_active":"2024-03-23T06:22:23.342913+0000","last_peered":"2024-03-23T06:22:23.342913+0000","last_clean":"2024-03-23T06:22:23.342913+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:22:23.342913+0000","last_undegraded":"2024-03-23T06:22:23.342913+0000","last_fullsized":"2024-03-23T06:22:23.342913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.342894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:13:31.019943+0000","scrub_duration":0.001171252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'42","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.117526+0000","last_change":"2024-03-23T06:22:15.117526+0000","last_active":"2024-03-23T06:22:15.117526+0000","last_peered":"2024-03-23T06:22:15.117526+0000","last_clean":"2024-03-23T06:22:15.117526+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:22:15.117526+0000","last_undegraded":"2024-03-23T06:22:15.117526+0000","last_fullsized":"2024-03-23T06:22:15.117526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.117424+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:23:48.285959+0000","scrub_duration":0.003100383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":38,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5543,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.189788+0000","last_change":"2024-03-23T06:10:39.799662+0000","last_active":"2024-03-23T06:21:28.189788+0000","last_peered":"2024-03-23T06:21:28.189788+0000","last_clean":"2024-03-23T06:21:28.189788+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:21:28.189788+0000","last_undegraded":"2024-03-23T06:21:28.189788+0000","last_fullsized":"2024-03-23T06:21:28.189788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.444706+0000","last_change":"2024-03-23T06:22:20.444706+0000","last_active":"2024-03-23T06:22:20.444706+0000","last_peered":"2024-03-23T06:22:20.444706+0000","last_clean":"2024-03-23T06:22:20.444706+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:20.444706+0000","last_undegraded":"2024-03-23T06:22:20.444706+0000","last_fullsized":"2024-03-23T06:22:20.444706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.444597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:38:16.085029+0000","scrub_duration":0.0020820489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'50","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:07.841562+0000","last_change":"2024-03-23T06:09:57.471738+0000","last_active":"2024-03-23T06:22:07.841562+0000","last_peered":"2024-03-23T06:22:07.841562+0000","last_clean":"2024-03-23T06:22:07.841562+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:22:07.841562+0000","last_undegraded":"2024-03-23T06:22:07.841562+0000","last_fullsized":"2024-03-23T06:22:07.841562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.228091+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:21:28.228091+0000","last_peered":"2024-03-23T06:21:28.228091+0000","last_clean":"2024-03-23T06:21:28.228091+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:21:28.228091+0000","last_undegraded":"2024-03-23T06:21:28.228091+0000","last_fullsized":"2024-03-23T06:21:28.228091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'14","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.891534+0000","last_change":"2024-03-23T06:09:57.946470+0000","last_active":"2024-03-23T06:22:11.891534+0000","last_peered":"2024-03-23T06:22:11.891534+0000","last_clean":"2024-03-23T06:22:11.891534+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:22:11.891534+0000","last_undegraded":"2024-03-23T06:22:11.891534+0000","last_fullsized":"2024-03-23T06:22:11.891534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.239315+0000","last_change":"2024-03-23T06:09:57.479563+0000","last_active":"2024-03-23T06:22:11.239315+0000","last_peered":"2024-03-23T06:22:11.239315+0000","last_clean":"2024-03-23T06:22:11.239315+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:22:11.239315+0000","last_undegraded":"2024-03-23T06:22:11.239315+0000","last_fullsized":"2024-03-23T06:22:11.239315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.434497+0000","last_change":"2024-03-23T06:22:10.434689+0000","last_active":"2024-03-23T06:22:10.434497+0000","last_peered":"2024-03-23T06:22:10.434497+0000","last_clean":"2024-03-23T06:22:10.434497+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:22:10.434497+0000","last_undegraded":"2024-03-23T06:22:10.434497+0000","last_fullsized":"2024-03-23T06:22:10.434497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.434445+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:53:51.345697+0000","scrub_duration":0.011047585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5855,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.136025+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:21:28.136025+0000","last_peered":"2024-03-23T06:21:28.136025+0000","last_clean":"2024-03-23T06:21:28.136025+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:21:28.136025+0000","last_undegraded":"2024-03-23T06:21:28.136025+0000","last_fullsized":"2024-03-23T06:21:28.136025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.264179+0000","last_change":"2024-03-23T06:22:19.264433+0000","last_active":"2024-03-23T06:22:19.264179+0000","last_peered":"2024-03-23T06:22:19.264179+0000","last_clean":"2024-03-23T06:22:19.264179+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:22:19.264179+0000","last_undegraded":"2024-03-23T06:22:19.264179+0000","last_fullsized":"2024-03-23T06:22:19.264179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.264125+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:41:16.245860+0000","scrub_duration":0.0035297940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.434033+0000","last_change":"2024-03-23T06:22:16.434139+0000","last_active":"2024-03-23T06:22:16.434033+0000","last_peered":"2024-03-23T06:22:16.434033+0000","last_clean":"2024-03-23T06:22:16.434033+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:22:16.434033+0000","last_undegraded":"2024-03-23T06:22:16.434033+0000","last_fullsized":"2024-03-23T06:22:16.434033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.433996+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:13:36.235706+0000","scrub_duration":0.0057335859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.179384+0000","last_change":"2024-03-23T06:10:39.804956+0000","last_active":"2024-03-23T06:21:28.179384+0000","last_peered":"2024-03-23T06:21:28.179384+0000","last_clean":"2024-03-23T06:21:28.179384+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:21:28.179384+0000","last_undegraded":"2024-03-23T06:21:28.179384+0000","last_fullsized":"2024-03-23T06:21:28.179384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.593784+0000","last_change":"2024-03-23T06:22:27.594039+0000","last_active":"2024-03-23T06:22:27.593784+0000","last_peered":"2024-03-23T06:22:27.593784+0000","last_clean":"2024-03-23T06:22:27.593784+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:22:27.593784+0000","last_undegraded":"2024-03-23T06:22:27.593784+0000","last_fullsized":"2024-03-23T06:22:27.593784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.593735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:10.812412+0000","scrub_duration":0.0028611280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'25","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.313526+0000","last_change":"2024-03-23T06:22:24.313601+0000","last_active":"2024-03-23T06:22:24.313526+0000","last_peered":"2024-03-23T06:22:24.313526+0000","last_clean":"2024-03-23T06:22:24.313526+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:22:24.313526+0000","last_undegraded":"2024-03-23T06:22:24.313526+0000","last_fullsized":"2024-03-23T06:22:24.313526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.313505+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:32:44.992621+0000","scrub_duration":0.020603684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4816,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.223646+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:21:28.223646+0000","last_peered":"2024-03-23T06:21:28.223646+0000","last_clean":"2024-03-23T06:21:28.223646+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:21:28.223646+0000","last_undegraded":"2024-03-23T06:21:28.223646+0000","last_fullsized":"2024-03-23T06:21:28.223646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'19","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.091661+0000","last_change":"2024-03-23T06:09:57.946782+0000","last_active":"2024-03-23T06:22:05.091661+0000","last_peered":"2024-03-23T06:22:05.091661+0000","last_clean":"2024-03-23T06:22:05.091661+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:22:05.091661+0000","last_undegraded":"2024-03-23T06:22:05.091661+0000","last_fullsized":"2024-03-23T06:22:05.091661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.160352+0000","last_change":"2024-03-23T06:22:29.160458+0000","last_active":"2024-03-23T06:22:29.160352+0000","last_peered":"2024-03-23T06:22:29.160352+0000","last_clean":"2024-03-23T06:22:29.160352+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:22:29.160352+0000","last_undegraded":"2024-03-23T06:22:29.160352+0000","last_fullsized":"2024-03-23T06:22:29.160352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.160317+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:53:12.339833+0000","scrub_duration":0.0076372239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.240283+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:21:28.240283+0000","last_peered":"2024-03-23T06:21:28.240283+0000","last_clean":"2024-03-23T06:21:28.240283+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:21:28.240283+0000","last_undegraded":"2024-03-23T06:21:28.240283+0000","last_fullsized":"2024-03-23T06:21:28.240283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'13","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.098844+0000","last_change":"2024-03-23T06:09:57.951441+0000","last_active":"2024-03-23T06:22:05.098844+0000","last_peered":"2024-03-23T06:22:05.098844+0000","last_clean":"2024-03-23T06:22:05.098844+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:22:05.098844+0000","last_undegraded":"2024-03-23T06:22:05.098844+0000","last_fullsized":"2024-03-23T06:22:05.098844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'54","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.584347+0000","last_change":"2024-03-23T06:22:20.584461+0000","last_active":"2024-03-23T06:22:20.584347+0000","last_peered":"2024-03-23T06:22:20.584347+0000","last_clean":"2024-03-23T06:22:20.584347+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:22:20.584347+0000","last_undegraded":"2024-03-23T06:22:20.584347+0000","last_fullsized":"2024-03-23T06:22:20.584347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.584313+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:03:42.668360+0000","scrub_duration":0.010912419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632815,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4586,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.228397+0000","last_change":"2024-03-23T06:10:01.982306+0000","last_active":"2024-03-23T06:21:28.228397+0000","last_peered":"2024-03-23T06:21:28.228397+0000","last_clean":"2024-03-23T06:21:28.228397+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:21:28.228397+0000","last_undegraded":"2024-03-23T06:21:28.228397+0000","last_fullsized":"2024-03-23T06:21:28.228397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.294321+0000","last_change":"2024-03-23T06:22:15.294560+0000","last_active":"2024-03-23T06:22:15.294321+0000","last_peered":"2024-03-23T06:22:15.294321+0000","last_clean":"2024-03-23T06:22:15.294321+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:22:15.294321+0000","last_undegraded":"2024-03-23T06:22:15.294321+0000","last_fullsized":"2024-03-23T06:22:15.294321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.294273+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:05:44.698199+0000","scrub_duration":0.013606521999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.270315+0000","last_change":"2024-03-23T06:22:19.270416+0000","last_active":"2024-03-23T06:22:19.270315+0000","last_peered":"2024-03-23T06:22:19.270315+0000","last_clean":"2024-03-23T06:22:19.270315+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:22:19.270315+0000","last_undegraded":"2024-03-23T06:22:19.270315+0000","last_fullsized":"2024-03-23T06:22:19.270315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.270293+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:42:03.814587+0000","scrub_duration":0.0055263279999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5961,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.552121+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:22:12.552121+0000","last_peered":"2024-03-23T06:22:12.552121+0000","last_clean":"2024-03-23T06:22:12.552121+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:22:12.552121+0000","last_undegraded":"2024-03-23T06:22:12.552121+0000","last_fullsized":"2024-03-23T06:22:12.552121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.311858+0000","last_change":"2024-03-23T06:22:30.312073+0000","last_active":"2024-03-23T06:22:30.311858+0000","last_peered":"2024-03-23T06:22:30.311858+0000","last_clean":"2024-03-23T06:22:30.311858+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:22:30.311858+0000","last_undegraded":"2024-03-23T06:22:30.311858+0000","last_fullsized":"2024-03-23T06:22:30.311858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.311808+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:24:48.713636+0000","scrub_duration":0.0026864620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.567867+0000","last_change":"2024-03-23T06:22:21.568095+0000","last_active":"2024-03-23T06:22:21.567867+0000","last_peered":"2024-03-23T06:22:21.567867+0000","last_clean":"2024-03-23T06:22:21.567867+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:22:21.567867+0000","last_undegraded":"2024-03-23T06:22:21.567867+0000","last_fullsized":"2024-03-23T06:22:21.567867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.567817+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:27.726121+0000","scrub_duration":0.0064138650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.552079+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:22:12.552079+0000","last_peered":"2024-03-23T06:22:12.552079+0000","last_clean":"2024-03-23T06:22:12.552079+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:22:12.552079+0000","last_undegraded":"2024-03-23T06:22:12.552079+0000","last_fullsized":"2024-03-23T06:22:12.552079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.408474+0000","last_change":"2024-03-23T06:22:11.408732+0000","last_active":"2024-03-23T06:22:11.408474+0000","last_peered":"2024-03-23T06:22:11.408474+0000","last_clean":"2024-03-23T06:22:11.408474+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:22:11.408474+0000","last_undegraded":"2024-03-23T06:22:11.408474+0000","last_fullsized":"2024-03-23T06:22:11.408474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.408422+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:21:16.861147+0000","scrub_duration":0.0032855250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:42.835977+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:21:42.835977+0000","last_peered":"2024-03-23T06:21:42.835977+0000","last_clean":"2024-03-23T06:21:42.835977+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:21:42.835977+0000","last_undegraded":"2024-03-23T06:21:42.835977+0000","last_fullsized":"2024-03-23T06:21:42.835977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:50.251176+0000","last_change":"2024-03-23T06:10:01.960181+0000","last_active":"2024-03-23T06:21:50.251176+0000","last_peered":"2024-03-23T06:21:50.251176+0000","last_clean":"2024-03-23T06:21:50.251176+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:21:50.251176+0000","last_undegraded":"2024-03-23T06:21:50.251176+0000","last_fullsized":"2024-03-23T06:21:50.251176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.389413+0000","last_change":"2024-03-23T06:22:23.389530+0000","last_active":"2024-03-23T06:22:23.389413+0000","last_peered":"2024-03-23T06:22:23.389413+0000","last_clean":"2024-03-23T06:22:23.389413+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:22:23.389413+0000","last_undegraded":"2024-03-23T06:22:23.389413+0000","last_fullsized":"2024-03-23T06:22:23.389413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.389377+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:57:35.577088+0000","scrub_duration":0.0020420400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'46","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.174186+0000","last_change":"2024-03-23T06:22:17.174270+0000","last_active":"2024-03-23T06:22:17.174186+0000","last_peered":"2024-03-23T06:22:17.174186+0000","last_clean":"2024-03-23T06:22:17.174186+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:22:17.174186+0000","last_undegraded":"2024-03-23T06:22:17.174186+0000","last_fullsized":"2024-03-23T06:22:17.174186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.174166+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:43.279079+0000","scrub_duration":0.036150521999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:02.840502+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:22:02.840502+0000","last_peered":"2024-03-23T06:22:02.840502+0000","last_clean":"2024-03-23T06:22:02.840502+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:22:02.840502+0000","last_undegraded":"2024-03-23T06:22:02.840502+0000","last_fullsized":"2024-03-23T06:22:02.840502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'16","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.092053+0000","last_change":"2024-03-23T06:09:57.943504+0000","last_active":"2024-03-23T06:22:05.092053+0000","last_peered":"2024-03-23T06:22:05.092053+0000","last_clean":"2024-03-23T06:22:05.092053+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:22:05.092053+0000","last_undegraded":"2024-03-23T06:22:05.092053+0000","last_fullsized":"2024-03-23T06:22:05.092053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'235","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.849123+0000","last_change":"2024-03-23T06:22:11.849229+0000","last_active":"2024-03-23T06:22:11.849123+0000","last_peered":"2024-03-23T06:22:11.849123+0000","last_clean":"2024-03-23T06:22:11.849123+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:22:11.849123+0000","last_undegraded":"2024-03-23T06:22:11.849123+0000","last_fullsized":"2024-03-23T06:22:11.849123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'235","last_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_deep_scrub":"27'235","last_deep_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.849094+0000","objects_scrubbed":5,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:39.149866+0000","scrub_duration":0.018805761000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5475,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:51.276857+0000","last_change":"2024-03-23T06:10:01.960771+0000","last_active":"2024-03-23T06:21:51.276857+0000","last_peered":"2024-03-23T06:21:51.276857+0000","last_clean":"2024-03-23T06:21:51.276857+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:21:51.276857+0000","last_undegraded":"2024-03-23T06:21:51.276857+0000","last_fullsized":"2024-03-23T06:21:51.276857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'18","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.095914+0000","last_change":"2024-03-23T06:09:57.954004+0000","last_active":"2024-03-23T06:22:05.095914+0000","last_peered":"2024-03-23T06:22:05.095914+0000","last_clean":"2024-03-23T06:22:05.095914+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:22:05.095914+0000","last_undegraded":"2024-03-23T06:22:05.095914+0000","last_fullsized":"2024-03-23T06:22:05.095914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.081823+0000","last_change":"2024-03-23T06:22:24.081903+0000","last_active":"2024-03-23T06:22:24.081823+0000","last_peered":"2024-03-23T06:22:24.081823+0000","last_clean":"2024-03-23T06:22:24.081823+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:22:24.081823+0000","last_undegraded":"2024-03-23T06:22:24.081823+0000","last_fullsized":"2024-03-23T06:22:24.081823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.081802+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:52.223689+0000","scrub_duration":0.0031724399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5718,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:50.979259+0000","last_change":"2024-03-23T06:10:01.973850+0000","last_active":"2024-03-23T06:21:50.979259+0000","last_peered":"2024-03-23T06:21:50.979259+0000","last_clean":"2024-03-23T06:21:50.979259+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:21:50.979259+0000","last_undegraded":"2024-03-23T06:21:50.979259+0000","last_fullsized":"2024-03-23T06:21:50.979259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:09.375692+0000","last_change":"2024-03-23T06:09:57.943844+0000","last_active":"2024-03-23T06:22:09.375692+0000","last_peered":"2024-03-23T06:22:09.375692+0000","last_clean":"2024-03-23T06:22:09.375692+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:22:09.375692+0000","last_undegraded":"2024-03-23T06:22:09.375692+0000","last_fullsized":"2024-03-23T06:22:09.375692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.544964+0000","last_change":"2024-03-23T06:22:23.545071+0000","last_active":"2024-03-23T06:22:23.544964+0000","last_peered":"2024-03-23T06:22:23.544964+0000","last_clean":"2024-03-23T06:22:23.544964+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:22:23.544964+0000","last_undegraded":"2024-03-23T06:22:23.544964+0000","last_fullsized":"2024-03-23T06:22:23.544964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.544931+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:19:48.158158+0000","scrub_duration":0.0052986079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5430,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:42.305920+0000","last_change":"2024-03-23T06:10:01.973601+0000","last_active":"2024-03-23T06:21:42.305920+0000","last_peered":"2024-03-23T06:21:42.305920+0000","last_clean":"2024-03-23T06:21:42.305920+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:21:42.305920+0000","last_undegraded":"2024-03-23T06:21:42.305920+0000","last_fullsized":"2024-03-23T06:21:42.305920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.103864+0000","last_change":"2024-03-23T06:09:57.955875+0000","last_active":"2024-03-23T06:22:05.103864+0000","last_peered":"2024-03-23T06:22:05.103864+0000","last_clean":"2024-03-23T06:22:05.103864+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:22:05.103864+0000","last_undegraded":"2024-03-23T06:22:05.103864+0000","last_fullsized":"2024-03-23T06:22:05.103864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.344399+0000","last_change":"2024-03-23T06:22:21.344504+0000","last_active":"2024-03-23T06:22:21.344399+0000","last_peered":"2024-03-23T06:22:21.344399+0000","last_clean":"2024-03-23T06:22:21.344399+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:22:21.344399+0000","last_undegraded":"2024-03-23T06:22:21.344399+0000","last_fullsized":"2024-03-23T06:22:21.344399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.344365+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:36:55.229393+0000","scrub_duration":0.0036549210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5634,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:41.275740+0000","last_change":"2024-03-23T06:10:39.801920+0000","last_active":"2024-03-23T06:21:41.275740+0000","last_peered":"2024-03-23T06:21:41.275740+0000","last_clean":"2024-03-23T06:21:41.275740+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:21:41.275740+0000","last_undegraded":"2024-03-23T06:21:41.275740+0000","last_fullsized":"2024-03-23T06:21:41.275740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4716,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.278650+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:22:11.278650+0000","last_peered":"2024-03-23T06:22:11.278650+0000","last_clean":"2024-03-23T06:22:11.278650+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:22:11.278650+0000","last_undegraded":"2024-03-23T06:22:11.278650+0000","last_fullsized":"2024-03-23T06:22:11.278650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.192359+0000","last_change":"2024-03-23T06:22:16.192455+0000","last_active":"2024-03-23T06:22:16.192359+0000","last_peered":"2024-03-23T06:22:16.192359+0000","last_clean":"2024-03-23T06:22:16.192359+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:22:16.192359+0000","last_undegraded":"2024-03-23T06:22:16.192359+0000","last_fullsized":"2024-03-23T06:22:16.192359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.192340+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:36:59.548342+0000","scrub_duration":0.0022608480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'33","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:07.841508+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:22:07.841508+0000","last_peered":"2024-03-23T06:22:07.841508+0000","last_clean":"2024-03-23T06:22:07.841508+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:22:07.841508+0000","last_undegraded":"2024-03-23T06:22:07.841508+0000","last_fullsized":"2024-03-23T06:22:07.841508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.240426+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:22:11.240426+0000","last_peered":"2024-03-23T06:22:11.240426+0000","last_clean":"2024-03-23T06:22:11.240426+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:22:11.240426+0000","last_undegraded":"2024-03-23T06:22:11.240426+0000","last_fullsized":"2024-03-23T06:22:11.240426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'25","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:09.375541+0000","last_change":"2024-03-23T06:09:57.941981+0000","last_active":"2024-03-23T06:22:09.375541+0000","last_peered":"2024-03-23T06:22:09.375541+0000","last_clean":"2024-03-23T06:22:09.375541+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:22:09.375541+0000","last_undegraded":"2024-03-23T06:22:09.375541+0000","last_fullsized":"2024-03-23T06:22:09.375541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'7","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.404159+0000","last_change":"2024-03-23T06:22:17.404227+0000","last_active":"2024-03-23T06:22:17.404159+0000","last_peered":"2024-03-23T06:22:17.404159+0000","last_clean":"2024-03-23T06:22:17.404159+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:22:17.404159+0000","last_undegraded":"2024-03-23T06:22:17.404159+0000","last_fullsized":"2024-03-23T06:22:17.404159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.404138+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:22:05.019725+0000","scrub_duration":0.0043990399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'14","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.239917+0000","last_change":"2024-03-23T06:09:57.482755+0000","last_active":"2024-03-23T06:22:11.239917+0000","last_peered":"2024-03-23T06:22:11.239917+0000","last_clean":"2024-03-23T06:22:11.239917+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:22:11.239917+0000","last_undegraded":"2024-03-23T06:22:11.239917+0000","last_fullsized":"2024-03-23T06:22:11.239917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:31.156271+0000","last_change":"2024-03-23T06:22:31.156271+0000","last_active":"2024-03-23T06:22:31.156271+0000","last_peered":"2024-03-23T06:22:31.156271+0000","last_clean":"2024-03-23T06:22:31.156271+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:22:31.156271+0000","last_undegraded":"2024-03-23T06:22:31.156271+0000","last_fullsized":"2024-03-23T06:22:31.156271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_clean_scrub_stamp":"2024-03-23T06:22:31.156172+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:36.346305+0000","scrub_duration":0.0027602590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5560,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.180765+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:21:28.180765+0000","last_peered":"2024-03-23T06:21:28.180765+0000","last_clean":"2024-03-23T06:21:28.180765+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:21:28.180765+0000","last_undegraded":"2024-03-23T06:21:28.180765+0000","last_fullsized":"2024-03-23T06:21:28.180765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'987","reported_seq":1020,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.331383+0000","last_change":"2024-03-23T06:22:27.331383+0000","last_active":"2024-03-23T06:22:27.331383+0000","last_peered":"2024-03-23T06:22:27.331383+0000","last_clean":"2024-03-23T06:22:27.331383+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:22:27.331383+0000","last_undegraded":"2024-03-23T06:22:27.331383+0000","last_fullsized":"2024-03-23T06:22:27.331383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'987","last_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_deep_scrub":"27'987","last_deep_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.331273+0000","objects_scrubbed":3,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:32:55.613936+0000","scrub_duration":0.012878013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195273,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":4980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.345944+0000","last_change":"2024-03-23T06:22:23.345944+0000","last_active":"2024-03-23T06:22:23.345944+0000","last_peered":"2024-03-23T06:22:23.345944+0000","last_clean":"2024-03-23T06:22:23.345944+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:22:23.345944+0000","last_undegraded":"2024-03-23T06:22:23.345944+0000","last_fullsized":"2024-03-23T06:22:23.345944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.345675+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:57:48.142305+0000","scrub_duration":0.0030686540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4751,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.170313+0000","last_change":"2024-03-23T06:10:01.967077+0000","last_active":"2024-03-23T06:21:28.170313+0000","last_peered":"2024-03-23T06:21:28.170313+0000","last_clean":"2024-03-23T06:21:28.170313+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:21:28.170313+0000","last_undegraded":"2024-03-23T06:21:28.170313+0000","last_fullsized":"2024-03-23T06:21:28.170313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.801563+0000","last_change":"2024-03-23T06:22:17.801751+0000","last_active":"2024-03-23T06:22:17.801563+0000","last_peered":"2024-03-23T06:22:17.801563+0000","last_clean":"2024-03-23T06:22:17.801563+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:22:17.801563+0000","last_undegraded":"2024-03-23T06:22:17.801563+0000","last_fullsized":"2024-03-23T06:22:17.801563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.801514+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:07.169700+0000","scrub_duration":0.0027127649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.038128+0000","last_change":"2024-03-23T06:22:30.038128+0000","last_active":"2024-03-23T06:22:30.038128+0000","last_peered":"2024-03-23T06:22:30.038128+0000","last_clean":"2024-03-23T06:22:30.038128+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:22:30.038128+0000","last_undegraded":"2024-03-23T06:22:30.038128+0000","last_fullsized":"2024-03-23T06:22:30.038128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.038036+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:00.263151+0000","scrub_duration":0.0018525620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'22","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.296479+0000","last_change":"2024-03-23T06:22:26.296590+0000","last_active":"2024-03-23T06:22:26.296479+0000","last_peered":"2024-03-23T06:22:26.296479+0000","last_clean":"2024-03-23T06:22:26.296479+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:22:26.296479+0000","last_undegraded":"2024-03-23T06:22:26.296479+0000","last_fullsized":"2024-03-23T06:22:26.296479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.296445+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:27:30.354398+0000","scrub_duration":0.001966677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'17","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.080246+0000","last_change":"2024-03-23T06:09:57.938636+0000","last_active":"2024-03-23T06:22:05.080246+0000","last_peered":"2024-03-23T06:22:05.080246+0000","last_clean":"2024-03-23T06:22:05.080246+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:22:05.080246+0000","last_undegraded":"2024-03-23T06:22:05.080246+0000","last_fullsized":"2024-03-23T06:22:05.080246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.092174+0000","last_change":"2024-03-23T06:09:57.948659+0000","last_active":"2024-03-23T06:22:05.092174+0000","last_peered":"2024-03-23T06:22:05.092174+0000","last_clean":"2024-03-23T06:22:05.092174+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:22:05.092174+0000","last_undegraded":"2024-03-23T06:22:05.092174+0000","last_fullsized":"2024-03-23T06:22:05.092174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'13","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.448008+0000","last_change":"2024-03-23T06:22:21.448141+0000","last_active":"2024-03-23T06:22:21.448008+0000","last_peered":"2024-03-23T06:22:21.448008+0000","last_clean":"2024-03-23T06:22:21.448008+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:22:21.448008+0000","last_undegraded":"2024-03-23T06:22:21.448008+0000","last_fullsized":"2024-03-23T06:22:21.448008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.447969+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:08:29.179604+0000","scrub_duration":0.012766777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.105574+0000","last_change":"2024-03-23T06:09:57.955793+0000","last_active":"2024-03-23T06:22:05.105574+0000","last_peered":"2024-03-23T06:22:05.105574+0000","last_clean":"2024-03-23T06:22:05.105574+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:22:05.105574+0000","last_undegraded":"2024-03-23T06:22:05.105574+0000","last_fullsized":"2024-03-23T06:22:05.105574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'15","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.085258+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:22:05.085258+0000","last_peered":"2024-03-23T06:22:05.085258+0000","last_clean":"2024-03-23T06:22:05.085258+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:22:05.085258+0000","last_undegraded":"2024-03-23T06:22:05.085258+0000","last_fullsized":"2024-03-23T06:22:05.085258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'16","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.105389+0000","last_change":"2024-03-23T06:09:57.943876+0000","last_active":"2024-03-23T06:22:05.105389+0000","last_peered":"2024-03-23T06:22:05.105389+0000","last_clean":"2024-03-23T06:22:05.105389+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:22:05.105389+0000","last_undegraded":"2024-03-23T06:22:05.105389+0000","last_fullsized":"2024-03-23T06:22:05.105389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'20","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.090225+0000","last_change":"2024-03-23T06:09:57.951583+0000","last_active":"2024-03-23T06:22:05.090225+0000","last_peered":"2024-03-23T06:22:05.090225+0000","last_clean":"2024-03-23T06:22:05.090225+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:05.090225+0000","last_undegraded":"2024-03-23T06:22:05.090225+0000","last_fullsized":"2024-03-23T06:22:05.090225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.092744+0000","last_change":"2024-03-23T06:09:57.937812+0000","last_active":"2024-03-23T06:22:05.092744+0000","last_peered":"2024-03-23T06:22:05.092744+0000","last_clean":"2024-03-23T06:22:05.092744+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:22:05.092744+0000","last_undegraded":"2024-03-23T06:22:05.092744+0000","last_fullsized":"2024-03-23T06:22:05.092744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'27","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.095130+0000","last_change":"2024-03-23T06:09:57.946352+0000","last_active":"2024-03-23T06:22:05.095130+0000","last_peered":"2024-03-23T06:22:05.095130+0000","last_clean":"2024-03-23T06:22:05.095130+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:22:05.095130+0000","last_undegraded":"2024-03-23T06:22:05.095130+0000","last_fullsized":"2024-03-23T06:22:05.095130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'18","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.443596+0000","last_change":"2024-03-23T06:22:10.443727+0000","last_active":"2024-03-23T06:22:10.443596+0000","last_peered":"2024-03-23T06:22:10.443596+0000","last_clean":"2024-03-23T06:22:10.443596+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:22:10.443596+0000","last_undegraded":"2024-03-23T06:22:10.443596+0000","last_fullsized":"2024-03-23T06:22:10.443596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.443557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:54:38.092496+0000","scrub_duration":0.002201901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'18","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.104113+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:22:05.104113+0000","last_peered":"2024-03-23T06:22:05.104113+0000","last_clean":"2024-03-23T06:22:05.104113+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:22:05.104113+0000","last_undegraded":"2024-03-23T06:22:05.104113+0000","last_fullsized":"2024-03-23T06:22:05.104113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'30","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.102123+0000","last_change":"2024-03-23T06:22:27.102202+0000","last_active":"2024-03-23T06:22:27.102123+0000","last_peered":"2024-03-23T06:22:27.102123+0000","last_clean":"2024-03-23T06:22:27.102123+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:22:27.102123+0000","last_undegraded":"2024-03-23T06:22:27.102123+0000","last_fullsized":"2024-03-23T06:22:27.102123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.102103+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:44:04.072008+0000","scrub_duration":0.0025710630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.103424+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:22:05.103424+0000","last_peered":"2024-03-23T06:22:05.103424+0000","last_clean":"2024-03-23T06:22:05.103424+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:22:05.103424+0000","last_undegraded":"2024-03-23T06:22:05.103424+0000","last_fullsized":"2024-03-23T06:22:05.103424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.106720+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:22:05.106720+0000","last_peered":"2024-03-23T06:22:05.106720+0000","last_clean":"2024-03-23T06:22:05.106720+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:22:05.106720+0000","last_undegraded":"2024-03-23T06:22:05.106720+0000","last_fullsized":"2024-03-23T06:22:05.106720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'20","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.095038+0000","last_change":"2024-03-23T06:09:57.945991+0000","last_active":"2024-03-23T06:22:05.095038+0000","last_peered":"2024-03-23T06:22:05.095038+0000","last_clean":"2024-03-23T06:22:05.095038+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:22:05.095038+0000","last_undegraded":"2024-03-23T06:22:05.095038+0000","last_fullsized":"2024-03-23T06:22:05.095038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.386651+0000","last_change":"2024-03-23T06:22:24.386758+0000","last_active":"2024-03-23T06:22:24.386651+0000","last_peered":"2024-03-23T06:22:24.386651+0000","last_clean":"2024-03-23T06:22:24.386651+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:22:24.386651+0000","last_undegraded":"2024-03-23T06:22:24.386651+0000","last_fullsized":"2024-03-23T06:22:24.386651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.386615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:00:08.664042+0000","scrub_duration":0.001409698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.440089+0000","last_change":"2024-03-23T06:22:19.440191+0000","last_active":"2024-03-23T06:22:19.440089+0000","last_peered":"2024-03-23T06:22:19.440089+0000","last_clean":"2024-03-23T06:22:19.440089+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:22:19.440089+0000","last_undegraded":"2024-03-23T06:22:19.440089+0000","last_fullsized":"2024-03-23T06:22:19.440089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.440064+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:38:00.327848+0000","scrub_duration":0.0063548980000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:08.405055+0000","last_change":"2024-03-23T06:09:57.947621+0000","last_active":"2024-03-23T06:22:08.405055+0000","last_peered":"2024-03-23T06:22:08.405055+0000","last_clean":"2024-03-23T06:22:08.405055+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:22:08.405055+0000","last_undegraded":"2024-03-23T06:22:08.405055+0000","last_fullsized":"2024-03-23T06:22:08.405055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:08.405114+0000","last_change":"2024-03-23T06:09:57.950243+0000","last_active":"2024-03-23T06:22:08.405114+0000","last_peered":"2024-03-23T06:22:08.405114+0000","last_clean":"2024-03-23T06:22:08.405114+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:22:08.405114+0000","last_undegraded":"2024-03-23T06:22:08.405114+0000","last_fullsized":"2024-03-23T06:22:08.405114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'28","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:08.405159+0000","last_change":"2024-03-23T06:09:57.954558+0000","last_active":"2024-03-23T06:22:08.405159+0000","last_peered":"2024-03-23T06:22:08.405159+0000","last_clean":"2024-03-23T06:22:08.405159+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:22:08.405159+0000","last_undegraded":"2024-03-23T06:22:08.405159+0000","last_fullsized":"2024-03-23T06:22:08.405159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'22","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:09.891280+0000","last_change":"2024-03-23T06:09:57.944106+0000","last_active":"2024-03-23T06:22:09.891280+0000","last_peered":"2024-03-23T06:22:09.891280+0000","last_clean":"2024-03-23T06:22:09.891280+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:22:09.891280+0000","last_undegraded":"2024-03-23T06:22:09.891280+0000","last_fullsized":"2024-03-23T06:22:09.891280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.552021+0000","last_change":"2024-03-23T06:09:57.949101+0000","last_active":"2024-03-23T06:22:12.552021+0000","last_peered":"2024-03-23T06:22:12.552021+0000","last_clean":"2024-03-23T06:22:12.552021+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:22:12.552021+0000","last_undegraded":"2024-03-23T06:22:12.552021+0000","last_fullsized":"2024-03-23T06:22:12.552021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.089942+0000","last_change":"2024-03-23T06:09:57.936978+0000","last_active":"2024-03-23T06:22:05.089942+0000","last_peered":"2024-03-23T06:22:05.089942+0000","last_clean":"2024-03-23T06:22:05.089942+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:22:05.089942+0000","last_undegraded":"2024-03-23T06:22:05.089942+0000","last_fullsized":"2024-03-23T06:22:05.089942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.918359+0000","last_change":"2024-03-23T06:22:26.918359+0000","last_active":"2024-03-23T06:22:26.918359+0000","last_peered":"2024-03-23T06:22:26.918359+0000","last_clean":"2024-03-23T06:22:26.918359+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:22:26.918359+0000","last_undegraded":"2024-03-23T06:22:26.918359+0000","last_fullsized":"2024-03-23T06:22:26.918359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.918218+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:31:45.597928+0000","scrub_duration":0.0018645039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'15","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.514028+0000","last_change":"2024-03-23T06:09:57.942383+0000","last_active":"2024-03-23T06:22:05.514028+0000","last_peered":"2024-03-23T06:22:05.514028+0000","last_clean":"2024-03-23T06:22:05.514028+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:22:05.514028+0000","last_undegraded":"2024-03-23T06:22:05.514028+0000","last_fullsized":"2024-03-23T06:22:05.514028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.845004+0000","last_change":"2024-03-23T06:22:22.845326+0000","last_active":"2024-03-23T06:22:22.845004+0000","last_peered":"2024-03-23T06:22:22.845004+0000","last_clean":"2024-03-23T06:22:22.845004+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:22:22.845004+0000","last_undegraded":"2024-03-23T06:22:22.845004+0000","last_fullsized":"2024-03-23T06:22:22.845004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.844870+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:07.539336+0000","scrub_duration":0.002224925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'16","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:14.305222+0000","last_change":"2024-03-23T06:22:14.305222+0000","last_active":"2024-03-23T06:22:14.305222+0000","last_peered":"2024-03-23T06:22:14.305222+0000","last_clean":"2024-03-23T06:22:14.305222+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:22:14.305222+0000","last_undegraded":"2024-03-23T06:22:14.305222+0000","last_fullsized":"2024-03-23T06:22:14.305222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_clean_scrub_stamp":"2024-03-23T06:22:14.305062+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:19:26.641546+0000","scrub_duration":0.0018171369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'9","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.552052+0000","last_change":"2024-03-23T06:09:57.941935+0000","last_active":"2024-03-23T06:22:12.552052+0000","last_peered":"2024-03-23T06:22:12.552052+0000","last_clean":"2024-03-23T06:22:12.552052+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:22:12.552052+0000","last_undegraded":"2024-03-23T06:22:12.552052+0000","last_fullsized":"2024-03-23T06:22:12.552052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'17","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.100866+0000","last_change":"2024-03-23T06:09:57.948910+0000","last_active":"2024-03-23T06:22:05.100866+0000","last_peered":"2024-03-23T06:22:05.100866+0000","last_clean":"2024-03-23T06:22:05.100866+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:22:05.100866+0000","last_undegraded":"2024-03-23T06:22:05.100866+0000","last_fullsized":"2024-03-23T06:22:05.100866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88812204,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2360,"num_write_kb":88570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177624408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2413,"ondisk_log_size":2413,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542295,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1363056,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1325886,"kb_avail":93008784,"statfs":{"total":96636764160,"available":95240994816,"internally_reserved":0,"allocated":38051840,"data_stored":37867372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1357707720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":6.492,"15min":4.7000000000000002},"min":{"1min":0.43099999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":9.6159999999999997,"5min":170.84299999999999,"15min":309.57499999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.633,"5min":6.1420000000000003,"15min":4.5910000000000002},"min":{"1min":0.54000000000000004,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":7.4489999999999998,"5min":178.934,"15min":300.98500000000001},"last":1.2290000000000001}]},{"osd":1,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.5190000000000001,"5min":9.6910000000000007,"15min":5.4710000000000001},"min":{"1min":0.51300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":12.593999999999999,"5min":359.48599999999999,"15min":359.48599999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.488,"5min":8.4410000000000007,"15min":5.0999999999999996},"min":{"1min":0.51300000000000001,"5min":0.29899999999999999,"15min":0.28899999999999998},"max":{"1min":4.4580000000000002,"5min":359.20299999999997,"15min":359.20299999999997},"last":0.90600000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":7.21,"15min":4.5289999999999999},"min":{"1min":0.60799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":12.273999999999999,"5min":56.805999999999997,"15min":58.277000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":2.4809999999999999,"5min":8.4540000000000006,"15min":5.2050000000000001},"min":{"1min":0.65000000000000002,"5min":0.52100000000000002,"15min":0.32900000000000001},"max":{"1min":12.347,"5min":89.454999999999998,"15min":119.176},"last":1.244}]},{"osd":4,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":1.9930000000000001,"5min":5.835,"15min":3.2509999999999999},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.605,"5min":36.270000000000003,"15min":36.270000000000003},"last":0.79700000000000004},{"interface":"front","average":{"1min":2.0329999999999999,"5min":6.4989999999999997,"15min":3.9460000000000002},"min":{"1min":0.627,"5min":0.48499999999999999,"15min":0.32800000000000001},"max":{"1min":12.708,"5min":38.718000000000004,"15min":64.325000000000003},"last":1.5369999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.2650000000000001,"5min":6.3109999999999999,"15min":3.8700000000000001},"min":{"1min":0.58999999999999997,"5min":0.46100000000000002,"15min":0.36299999999999999},"max":{"1min":12.76,"5min":38.759999999999998,"15min":58.317},"last":1.651},{"interface":"front","average":{"1min":2.2799999999999998,"5min":5.875,"15min":3.6179999999999999},"min":{"1min":0.77200000000000002,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":12.794,"5min":33.854999999999997,"15min":33.854999999999997},"last":0.96799999999999997}]},{"osd":6,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":6.1989999999999998,"15min":3.7829999999999999},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.116,"5min":29.777000000000001,"15min":31.623999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.645,"5min":5.8620000000000001,"15min":3.2850000000000001},"min":{"1min":0.67000000000000004,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":5.7359999999999998,"5min":37.179000000000002,"15min":37.179000000000002},"last":1.6000000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":7.4889999999999999,"15min":4.3090000000000002},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":11.808999999999999,"5min":38.621000000000002,"15min":58.344000000000001},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.8109999999999999,"5min":6.931,"15min":3.7799999999999998},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":11.846,"5min":38.680999999999997,"15min":38.680999999999997},"last":1.276}]}]},{"osd":2,"up_from":14,"seq":60129542296,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":4.9050000000000002,"15min":3.831},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":5.4939999999999998,"5min":49.142000000000003,"15min":126.152},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.224,"5min":4.2370000000000001,"15min":3.2690000000000001},"min":{"1min":0.40500000000000003,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":5.9589999999999996,"5min":29.206,"15min":143.14099999999999},"last":1.008}]},{"osd":1,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":2.387,"5min":6.4160000000000004,"15min":4.4349999999999996},"min":{"1min":0.48999999999999999,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":15.194000000000001,"5min":55.564999999999998,"15min":55.564999999999998},"last":1.2},{"interface":"front","average":{"1min":1.359,"5min":6.7750000000000004,"15min":3.835},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":6.0049999999999999,"5min":55.354999999999997,"15min":55.354999999999997},"last":0.70499999999999996}]},{"osd":3,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":15.656000000000001,"15min":7.5529999999999999},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.27600000000000002},"max":{"1min":12.198,"5min":529.81799999999998,"15min":529.81799999999998},"last":1.077},{"interface":"front","average":{"1min":2.1549999999999998,"5min":11.345000000000001,"15min":5.8490000000000002},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":10.757,"5min":528.94200000000001,"15min":528.94200000000001},"last":1.353}]},{"osd":4,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":6.1520000000000001,"15min":3.4359999999999999},"min":{"1min":0.40899999999999997,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":5.7649999999999997,"5min":49.430999999999997,"15min":49.430999999999997},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.319,"5min":7.4089999999999998,"15min":4.5410000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.312},"max":{"1min":5.8639999999999999,"5min":60.298000000000002,"15min":83.525999999999996},"last":1.1180000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":5.7759999999999998,"15min":3.988},"min":{"1min":0.52100000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":5.8979999999999997,"5min":35.433999999999997,"15min":82.456000000000003},"last":1.163},{"interface":"front","average":{"1min":1.488,"5min":5.8710000000000004,"15min":3.7810000000000001},"min":{"1min":0.51000000000000001,"5min":0.439,"15min":0.35199999999999998},"max":{"1min":5.9290000000000003,"5min":35.472999999999999,"15min":82.971000000000004},"last":1.24}]},{"osd":6,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":5.782,"15min":3.6669999999999998},"min":{"1min":0.60299999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.9539999999999997,"5min":57.420999999999999,"15min":83.007999999999996},"last":0.88},{"interface":"front","average":{"1min":1.6719999999999999,"5min":5.9779999999999998,"15min":3.657},"min":{"1min":0.56799999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.204000000000001,"5min":49.768000000000001,"15min":49.768000000000001},"last":0.95799999999999996}]},{"osd":7,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":6.3410000000000002,"15min":4.3049999999999997},"min":{"1min":0.63700000000000001,"5min":0.51400000000000001,"15min":0.35099999999999998},"max":{"1min":5.8159999999999998,"5min":43.113,"15min":77.353999999999999},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.492,"5min":6.9809999999999999,"15min":4.2759999999999998},"min":{"1min":0.51800000000000002,"5min":0.44900000000000001,"15min":0.38},"max":{"1min":5.8339999999999996,"5min":69.606999999999999,"15min":83.406999999999996},"last":0.91600000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542298,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":3.5470000000000002,"15min":2.8149999999999999},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.221},"max":{"1min":1.484,"5min":38.363,"15min":70.713999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":3.9529999999999998,"15min":2.7010000000000001},"min":{"1min":0.48299999999999998,"5min":0.247,"15min":0.247},"max":{"1min":5.7389999999999999,"5min":30.41,"15min":30.41},"last":0.65900000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":7.2889999999999997,"15min":4.5990000000000002},"min":{"1min":0.432,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0910000000000002,"5min":127.342,"15min":127.342},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.3819999999999999,"5min":5.5220000000000002,"15min":4.2629999999999999},"min":{"1min":0.46500000000000002,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":5.1210000000000004,"5min":107.748,"15min":107.748},"last":1.1850000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":5.8600000000000003,"15min":4.0119999999999996},"min":{"1min":0.505,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":4.2649999999999997,"5min":31.780000000000001,"15min":31.780000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.7070000000000001,"5min":4.5839999999999996,"15min":4.0449999999999999},"min":{"1min":0.45100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.835000000000001,"5min":31.821999999999999,"15min":175.29300000000001},"last":1.423}]},{"osd":4,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":4.101,"15min":3.1600000000000001},"min":{"1min":0.56000000000000005,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":4.21,"5min":24.856999999999999,"15min":78.060000000000002},"last":1.276},{"interface":"front","average":{"1min":1.361,"5min":4.5519999999999996,"15min":3.1619999999999999},"min":{"1min":0.53200000000000003,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":4.2359999999999998,"5min":26.184999999999999,"15min":80.959999999999994},"last":1.3620000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":4.3460000000000001,"15min":3.262},"min":{"1min":0.52100000000000002,"5min":0.37,"15min":0.35899999999999999},"max":{"1min":3.3450000000000002,"5min":23.234000000000002,"15min":70.670000000000002},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.2010000000000001,"5min":4.0069999999999997,"15min":2.7010000000000001},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":3.1509999999999998,"5min":26.341000000000001,"15min":30.431000000000001},"last":1.01}]},{"osd":6,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":5.4779999999999998,"15min":3.3079999999999998},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.375},"max":{"1min":4.3230000000000004,"5min":40.606999999999999,"15min":40.606999999999999},"last":1.393},{"interface":"front","average":{"1min":1.4470000000000001,"5min":5.2670000000000003,"15min":3.6230000000000002},"min":{"1min":0.57999999999999996,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.1749999999999998,"5min":36.905999999999999,"15min":68.369},"last":1.478}]},{"osd":7,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":5.6680000000000001,"15min":3.9870000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":5.6660000000000004,"5min":31.044,"15min":90.965999999999994},"last":1.339},{"interface":"front","average":{"1min":1.7509999999999999,"5min":6.3369999999999997,"15min":4.1520000000000001},"min":{"1min":0.54400000000000004,"5min":0.48099999999999998,"15min":0.38700000000000001},"max":{"1min":5.6970000000000001,"5min":35.256,"15min":84.465000000000003},"last":1.4359999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542300,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":11.427,"15min":5.3700000000000001},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.773,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.3879999999999999,"5min":5.3680000000000003,"15min":3.1360000000000001},"min":{"1min":0.47199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":7.1449999999999996,"5min":76.515000000000001,"15min":76.515000000000001},"last":0.749}]},{"osd":2,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":5.766,"15min":3.484},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.33300000000000002},"max":{"1min":10.554,"5min":58.996000000000002,"15min":58.996000000000002},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.337,"5min":4.2939999999999996,"15min":3.5579999999999998},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.9089999999999998,"5min":50.271000000000001,"15min":62.466000000000001},"last":0.91400000000000003}]},{"osd":3,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":5.1989999999999998,"15min":3.569},"min":{"1min":0.57699999999999996,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.4400000000000004,"5min":44.116999999999997,"15min":44.360999999999997},"last":1.669},{"interface":"front","average":{"1min":1.655,"5min":5.3209999999999997,"15min":3.4750000000000001},"min":{"1min":0.55800000000000005,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":9.9160000000000004,"5min":44.212000000000003,"15min":81.251000000000005},"last":1.244}]},{"osd":4,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":6.516,"15min":3.258},"min":{"1min":0.71799999999999997,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":2.5190000000000001,"5min":72.588999999999999,"15min":72.588999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":5.9459999999999997,"15min":3.3570000000000002},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.9660000000000002,"5min":69.566000000000003,"15min":69.566000000000003},"last":1.0049999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":5.9450000000000003,"15min":3.2050000000000001},"min":{"1min":0.755,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":7.1890000000000001,"5min":72.552000000000007,"15min":72.552000000000007},"last":1.756},{"interface":"front","average":{"1min":1.6930000000000001,"5min":5.3949999999999996,"15min":3.1070000000000002},"min":{"1min":0.80800000000000005,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":7.2190000000000003,"5min":72.626999999999995,"15min":72.626999999999995},"last":1.8360000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":4.718,"15min":2.923},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":3.2160000000000002,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":5.4530000000000003,"15min":3.1440000000000001},"min":{"1min":0.75800000000000001,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":3.8159999999999998,"5min":72.656999999999996,"15min":72.656999999999996},"last":1.9370000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":6.0810000000000004,"15min":3.383},"min":{"1min":0.40699999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.653,"5min":69.662000000000006,"15min":69.662000000000006},"last":1.097},{"interface":"front","average":{"1min":1.3240000000000001,"5min":4.9240000000000004,"15min":2.9620000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.38700000000000001},"max":{"1min":2.6840000000000002,"5min":69.632000000000005,"15min":69.632000000000005},"last":1.179}]}]},{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":3.6920000000000002,"15min":2.3029999999999999},"min":{"1min":0.34699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":4.4470000000000001,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":3.347,"15min":2.0449999999999999},"min":{"1min":0.30199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":2.706,"5min":33.662999999999997,"15min":42.582000000000001},"last":0.50700000000000001}]},{"osd":1,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":6.79,"15min":4.2699999999999996},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":2.806,"5min":95.497,"15min":310.09300000000002},"last":0.5},{"interface":"front","average":{"1min":0.85599999999999998,"5min":6.867,"15min":4.3200000000000003},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.8740000000000001,"5min":95.531999999999996,"15min":309.70999999999998},"last":0.56100000000000005}]},{"osd":2,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":3.8380000000000001,"15min":2.544},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":4.976,"5min":33.454999999999998,"15min":63.014000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":4.407,"15min":3.0009999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.9169999999999998,"5min":32.755000000000003,"15min":73.218000000000004},"last":0.47799999999999998}]},{"osd":3,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":6.4009999999999998,"15min":3.331},"min":{"1min":0.372,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":5.2249999999999996,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.556,"5min":4.617,"15min":2.7970000000000002},"min":{"1min":0.51600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":8.7590000000000003,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.34499999999999997}]},{"osd":4,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":5.1420000000000003,"15min":2.246},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.46600000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":5.3289999999999997,"15min":2.2480000000000002},"min":{"1min":0.27700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":2.8439999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.32100000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":4.4269999999999996,"15min":1.9219999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":4.5609999999999999,"5min":35.884,"15min":35.884},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":4.8209999999999997,"15min":2.0630000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.24399999999999999},"max":{"1min":2.899,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.308}]},{"osd":6,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":3.6259999999999999,"15min":1.742},"min":{"1min":0.27000000000000002,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":2.6160000000000001,"5min":32.799999999999997,"15min":32.799999999999997},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":3.79,"15min":1.7470000000000001},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":2.6579999999999999,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.37}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":2.4399999999999999,"15min":1.7969999999999999},"min":{"1min":0.372,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":3.4660000000000002,"5min":34.573999999999998,"15min":47.136000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":3.1960000000000002,"15min":2.1150000000000002},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":4.9619999999999997,"5min":34.573,"15min":43.140000000000001},"last":0.58999999999999997}]},{"osd":1,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":3.016,"15min":2.7829999999999999},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":5.976,"5min":77.959000000000003,"15min":96.375},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.92300000000000004,"5min":4.5330000000000004,"15min":3.4020000000000001},"min":{"1min":0.308,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.6779999999999999,"5min":96.034000000000006,"15min":96.034000000000006},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":3.2320000000000002,"15min":3.3849999999999998},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.95799999999999996,"5min":39.534999999999997,"15min":91.947999999999993},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":3.9249999999999998,"15min":3.202},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.964,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.48299999999999998}]},{"osd":3,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":4.8550000000000004,"15min":3.6829999999999998},"min":{"1min":0.41899999999999998,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":7.7569999999999997,"5min":73.837000000000003,"15min":107.29000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.48,"5min":4.9199999999999999,"15min":3.8149999999999999},"min":{"1min":0.39400000000000002,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":14.351000000000001,"5min":73.692999999999998,"15min":107.27200000000001},"last":0.29699999999999999}]},{"osd":4,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":4.4900000000000002,"15min":2.157},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":5.1139999999999999,"5min":45.302,"15min":45.302},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":4.5609999999999999,"15min":2.2170000000000001},"min":{"1min":0.314,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":5.1369999999999996,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.373}]},{"osd":5,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":4.0659999999999998,"15min":1.857},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.8129999999999997,"5min":39.625,"15min":39.625},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.621,"5min":3.2250000000000001,"15min":1.6830000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":5.1609999999999996,"5min":37.686,"15min":37.686},"last":0.35499999999999998}]},{"osd":7,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":3.117,"15min":1.649},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.419,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":3.2170000000000001,"15min":1.5780000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":5.0759999999999996,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.33900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26601250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":2.7730000000000001,"15min":1.663},"min":{"1min":0.28299999999999997,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":2.8959999999999999,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.755,"5min":3.1499999999999999,"15min":1.7450000000000001},"min":{"1min":0.32200000000000001,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":3.1989999999999998,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.376}]},{"osd":1,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":4.5709999999999997,"15min":2.3100000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.8879999999999999,"5min":69.873999999999995,"15min":69.873999999999995},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":4.625,"15min":2.4100000000000001},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.30099999999999999},"max":{"1min":9.0440000000000005,"5min":50.758000000000003,"15min":50.758000000000003},"last":0.73899999999999999}]},{"osd":2,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":4.3200000000000003,"15min":2.7309999999999999},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":2.9689999999999999,"5min":100.931,"15min":100.931},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":5.9039999999999999,"15min":3.1360000000000001},"min":{"1min":0.34599999999999997,"5min":0.253,"15min":0.253},"max":{"1min":5.7279999999999998,"5min":142.041,"15min":142.041},"last":0.69799999999999995}]},{"osd":3,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":5.3049999999999997,"15min":2.9359999999999999},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.6360000000000001,"5min":63.905999999999999,"15min":63.905999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":5.524,"15min":3.0299999999999998},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":3.6440000000000001,"5min":61.076000000000001,"15min":61.076000000000001},"last":0.72399999999999998}]},{"osd":4,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":3.4700000000000002,"15min":1.603},"min":{"1min":0.248,"5min":0.219,"15min":0.219},"max":{"1min":2.5539999999999998,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":3.8370000000000002,"15min":1.7350000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":3.9540000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.245}]},{"osd":6,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":4.9969999999999999,"15min":2.1120000000000001},"min":{"1min":0.23400000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":3.0209999999999999,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":5.3150000000000004,"15min":2.3260000000000001},"min":{"1min":0.28100000000000003,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":3.3900000000000001,"5min":40.314,"15min":40.314},"last":0.32000000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":3.859,"15min":1.819},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.25700000000000001},"max":{"1min":3.8570000000000002,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":4.7720000000000002,"15min":2.0630000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":4.0019999999999998,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.28199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":2.7229999999999999,"15min":1.752},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":13.686,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":2.8450000000000002,"15min":1.901},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.359,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.30499999999999999}]},{"osd":1,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":4.0389999999999997,"15min":2.7349999999999999},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":3.3370000000000002,"5min":51.387999999999998,"15min":51.387999999999998},"last":0.747},{"interface":"front","average":{"1min":0.80600000000000005,"5min":2.8220000000000001,"15min":2.173},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.351,"5min":29.23,"15min":50.207000000000001},"last":0.70599999999999996}]},{"osd":2,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":10.051,"15min":4.7119999999999997},"min":{"1min":0.38800000000000001,"5min":0.28399999999999997,"15min":0.26900000000000002},"max":{"1min":6.3780000000000001,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.627},{"interface":"front","average":{"1min":1.022,"5min":9.0939999999999994,"15min":4.226},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":6.2069999999999999,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.53100000000000003}]},{"osd":3,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":4.1289999999999996,"15min":2.7549999999999999},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.99299999999999999,"5min":38.656999999999996,"15min":53.134999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":5.0910000000000002,"15min":4.3300000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.694,"5min":51.314,"15min":161.191},"last":0.58899999999999997}]},{"osd":5,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":3.4740000000000002,"15min":1.639},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.0960000000000001,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.432,"5min":3.5390000000000001,"15min":1.7190000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":1.4790000000000001,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.33900000000000002}]},{"osd":6,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":6.2350000000000003,"15min":2.637},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.056,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.38},{"interface":"front","average":{"1min":0.50900000000000001,"5min":5.8010000000000002,"15min":2.552},"min":{"1min":0.28499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.089,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.40600000000000003}]},{"osd":7,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":4.8140000000000001,"15min":2.097},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.24299999999999999},"max":{"1min":1.694,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.316},{"interface":"front","average":{"1min":0.48999999999999999,"5min":4.2460000000000004,"15min":1.919},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28999999999999998},"max":{"1min":1.7190000000000001,"5min":51.997,"15min":51.997},"last":0.36599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:22:34.824 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.824 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.824 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.824 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.824 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.824 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.825 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.826 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.826 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.826 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.826 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.826 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.826 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.826 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.826 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.827 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.828 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.829 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.830 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.830 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.830 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.830 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.830 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.830 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.830 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.830 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.831 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:34.832 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T06:22:54.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:22:55.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.031+0000 7fa56ac00640 1 Processor -- start 2024-03-23T06:22:55.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.032+0000 7fa56ac00640 1 -- start start 2024-03-23T06:22:55.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa56ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa5640cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:55.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa56ac00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5641594f0 0x7fa5640cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:55.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa56ac00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5641599a0 con 0x7fa5641536a0 2024-03-23T06:22:55.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa56ac00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56415a520 con 0x7fa5641594f0 2024-03-23T06:22:55.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa56ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa564159c80 con 0x7fa564153a80 2024-03-23T06:22:55.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa55b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa5640cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:55.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa568c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa5641594f0 0x7fa5640cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:55.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa55b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa5640cbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:55570/0 (socket says 172.21.15.73:55570) 2024-03-23T06:22:55.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.033+0000 7fa55b400640 1 -- 172.21.15.73:0/3950832595 learned_addr learned my addr 172.21.15.73:0/3950832595 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.034+0000 7fa55b400640 1 -- 172.21.15.73:0/3950832595 >> v2:172.21.15.73:3300/0 conn(0x7fa5641594f0 msgr2=0x7fa5640cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:22:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.034+0000 7fa55b400640 1 --2- 172.21.15.73:0/3950832595 >> v2:172.21.15.73:3300/0 conn(0x7fa5641594f0 0x7fa5640cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.034+0000 7fa55b400640 1 -- 172.21.15.73:0/3950832595 >> v1:172.21.15.73:6789/0 conn(0x7fa5641536a0 legacy=0x7fa5640ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.034+0000 7fa55b400640 1 -- 172.21.15.73:0/3950832595 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564159f60 con 0x7fa564153a80 2024-03-23T06:22:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.035+0000 7fa55b400640 1 --2- 172.21.15.73:0/3950832595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa5640cbe90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009870 tx=0x7fa54c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c01b6f3d91e0c80 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.035+0000 7fa563400640 1 -- 172.21.15.73:0/3950832595 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c030840 con 0x7fa564153a80 2024-03-23T06:22:55.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.035+0000 7fa563400640 1 -- 172.21.15.73:0/3950832595 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c0309a0 con 0x7fa564153a80 2024-03-23T06:22:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.035+0000 7fa563400640 1 -- 172.21.15.73:0/3950832595 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c030d30 con 0x7fa564153a80 2024-03-23T06:22:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.036+0000 7fa56ac00640 1 -- 172.21.15.73:0/3950832595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 msgr2=0x7fa5640cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:55.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.036+0000 7fa56ac00640 1 --2- 172.21.15.73:0/3950832595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa5640cbe90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009870 tx=0x7fa54c02b980 comp rx=0 tx=0).stop 2024-03-23T06:22:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.036+0000 7fa56ac00640 1 -- 172.21.15.73:0/3950832595 shutdown_connections 2024-03-23T06:22:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.036+0000 7fa56ac00640 1 --2- 172.21.15.73:0/3950832595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa5640cbe90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.036+0000 7fa56ac00640 1 --2- 172.21.15.73:0/3950832595 >> v2:172.21.15.73:3300/0 conn(0x7fa5641594f0 0x7fa5640cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.036+0000 7fa56ac00640 1 -- 172.21.15.73:0/3950832595 >> 172.21.15.73:0/3950832595 conn(0x7fa56406a060 msgr2=0x7fa56406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.036+0000 7fa56ac00640 1 -- 172.21.15.73:0/3950832595 shutdown_connections 2024-03-23T06:22:55.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.036+0000 7fa56ac00640 1 -- 172.21.15.73:0/3950832595 wait complete. 2024-03-23T06:22:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.038+0000 7fa56ac00640 1 Processor -- start 2024-03-23T06:22:55.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.038+0000 7fa56ac00640 1 -- start start 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa56ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5641536a0 0x7fa5641efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa56ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa56414e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa56ac00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5641594f0 0x7fa56414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa56ac00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56406c240 con 0x7fa5641594f0 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa56ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56406ca60 con 0x7fa5641536a0 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa56ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640b3dc0 con 0x7fa564153a80 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa563e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5641536a0 0x7fa5641efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa55b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa56414e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa568c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5641594f0 0x7fa56414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa563e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5641536a0 0x7fa5641efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:48502/0 (socket says 172.21.15.73:48502) 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.039+0000 7fa563e00640 1 -- 172.21.15.73:0/2085805413 learned_addr learned my addr 172.21.15.73:0/2085805413 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:22:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa563e00640 1 -- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 msgr2=0x7fa56414e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa563e00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa56414e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa563e00640 1 -- 172.21.15.73:0/2085805413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5641594f0 msgr2=0x7fa56414b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa563e00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5641594f0 0x7fa56414b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa563e00640 1 -- 172.21.15.73:0/2085805413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0094d0 con 0x7fa5641536a0 2024-03-23T06:22:55.041 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa563e00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5641536a0 0x7fa5641efcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c730 tx=0x7fa55400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa560c00640 1 -- 172.21.15.73:0/2085805413 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554003b70 con 0x7fa5641536a0 2024-03-23T06:22:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa560c00640 1 -- 172.21.15.73:0/2085805413 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa554003cf0 con 0x7fa5641536a0 2024-03-23T06:22:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56406c4a0 con 0x7fa5641536a0 2024-03-23T06:22:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa560c00640 1 -- 172.21.15.73:0/2085805413 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554003ea0 con 0x7fa5641536a0 2024-03-23T06:22:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.040+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56414aed0 con 0x7fa5641536a0 2024-03-23T06:22:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.042+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa564152600 con 0x7fa5641536a0 2024-03-23T06:22:55.042 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.042+0000 7fa560c00640 1 -- 172.21.15.73:0/2085805413 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa55400aa90 con 0x7fa5641536a0 2024-03-23T06:22:55.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.043+0000 7fa560c00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa54006ac00 0x7fa54006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:22:55.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.043+0000 7fa560c00640 1 -- 172.21.15.73:0/2085805413 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fa554089300 con 0x7fa5641536a0 2024-03-23T06:22:55.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.043+0000 7fa55b400640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa54006ac00 0x7fa54006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:22:55.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.044+0000 7fa55b400640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa54006ac00 0x7fa54006d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa54c036000 tx=0x7fa54c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:22:55.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.051+0000 7fa560c00640 1 -- 172.21.15.73:0/2085805413 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa5540542b0 con 0x7fa5641536a0 2024-03-23T06:22:55.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.245+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5640cb970 con 0x7fa54006ac00 2024-03-23T06:22:55.255 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.255+0000 7fa560c00640 1 -- 172.21.15.73:0/2085805413 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371338 (secure 0 0 0) 0x7fa54c030b90 con 0x7fa54006ac00 2024-03-23T06:22:55.260 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:22:55.263 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:22:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.262+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa54006ac00 msgr2=0x7fa54006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.262+0000 7fa56ac00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa54006ac00 0x7fa54006d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa54c036000 tx=0x7fa54c008030 comp rx=0 tx=0).stop 2024-03-23T06:22:55.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.262+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5641536a0 msgr2=0x7fa5641efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.262+0000 7fa56ac00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5641536a0 0x7fa5641efcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa55400c730 tx=0x7fa55400cbf0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.262+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 shutdown_connections 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.262+0000 7fa56ac00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5641594f0 0x7fa56414b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.263+0000 7fa56ac00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa54006ac00 0x7fa54006d0c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.263+0000 7fa56ac00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa564153a80 0x7fa56414e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.263+0000 7fa56ac00640 1 --2- 172.21.15.73:0/2085805413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5641536a0 0x7fa5641efcd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.263+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 >> 172.21.15.73:0/2085805413 conn(0x7fa56406a060 msgr2=0x7fa5640cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.263+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 shutdown_connections 2024-03-23T06:22:55.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:22:55.263+0000 7fa56ac00640 1 -- 172.21.15.73:0/2085805413 wait complete. 2024-03-23T06:22:55.281 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":415,"stamp":"2024-03-23T06:22:54.832424+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402572,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469605,"num_write_kb":34184419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171176,"ondisk_log_size":171176,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10077296,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9900211,"kb_avail":744897424,"statfs":{"total":773094113280,"available":762774962176,"internally_reserved":0,"allocated":181256192,"data_stored":179741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10137816632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002783"},"pg_stats":[{"pgid":"2.1f","version":"27'18","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.234338+0000","last_change":"2024-03-23T06:22:24.234338+0000","last_active":"2024-03-23T06:22:24.234338+0000","last_peered":"2024-03-23T06:22:24.234338+0000","last_clean":"2024-03-23T06:22:24.234338+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:22:24.234338+0000","last_undegraded":"2024-03-23T06:22:24.234338+0000","last_fullsized":"2024-03-23T06:22:24.234338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.234241+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:53.812998+0000","scrub_duration":0.016306496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.301797+0000","last_change":"2024-03-23T06:22:16.301887+0000","last_active":"2024-03-23T06:22:16.301797+0000","last_peered":"2024-03-23T06:22:16.301797+0000","last_clean":"2024-03-23T06:22:16.301797+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:22:16.301797+0000","last_undegraded":"2024-03-23T06:22:16.301797+0000","last_fullsized":"2024-03-23T06:22:16.301797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.301777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:37:55.431944+0000","scrub_duration":0.0022956500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:43.004409+0000","last_change":"2024-03-23T06:22:43.004574+0000","last_active":"2024-03-23T06:22:43.004409+0000","last_peered":"2024-03-23T06:22:43.004409+0000","last_clean":"2024-03-23T06:22:43.004409+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:22:43.004409+0000","last_undegraded":"2024-03-23T06:22:43.004409+0000","last_fullsized":"2024-03-23T06:22:43.004409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4649","last_scrub_stamp":"2024-03-23T06:22:43.004368+0000","last_deep_scrub":"27'4649","last_deep_scrub_stamp":"2024-03-23T06:22:43.004368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:43.004368+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:42:59.644058+0000","scrub_duration":0.043741127999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.340695+0000","last_change":"2024-03-23T06:22:28.340766+0000","last_active":"2024-03-23T06:22:28.340695+0000","last_peered":"2024-03-23T06:22:28.340695+0000","last_clean":"2024-03-23T06:22:28.340695+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:22:28.340695+0000","last_undegraded":"2024-03-23T06:22:28.340695+0000","last_fullsized":"2024-03-23T06:22:28.340695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.340675+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:05:53.500984+0000","scrub_duration":0.0074425539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.402809+0000","last_change":"2024-03-23T06:22:20.402809+0000","last_active":"2024-03-23T06:22:20.402809+0000","last_peered":"2024-03-23T06:22:20.402809+0000","last_clean":"2024-03-23T06:22:20.402809+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:22:20.402809+0000","last_undegraded":"2024-03-23T06:22:20.402809+0000","last_fullsized":"2024-03-23T06:22:20.402809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.402677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:48.099293+0000","scrub_duration":0.064311640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5587,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:38.960781+0000","last_change":"2024-03-23T06:22:38.960973+0000","last_active":"2024-03-23T06:22:38.960781+0000","last_peered":"2024-03-23T06:22:38.960781+0000","last_clean":"2024-03-23T06:22:38.960781+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:22:38.960781+0000","last_undegraded":"2024-03-23T06:22:38.960781+0000","last_fullsized":"2024-03-23T06:22:38.960781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5556","last_scrub_stamp":"2024-03-23T06:22:38.960753+0000","last_deep_scrub":"27'5556","last_deep_scrub_stamp":"2024-03-23T06:22:38.960753+0000","last_clean_scrub_stamp":"2024-03-23T06:22:38.960753+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:01.641630+0000","scrub_duration":0.14834329199999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'165","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.665632+0000","last_change":"2024-03-23T06:22:26.665632+0000","last_active":"2024-03-23T06:22:26.665632+0000","last_peered":"2024-03-23T06:22:26.665632+0000","last_clean":"2024-03-23T06:22:26.665632+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:22:26.665632+0000","last_undegraded":"2024-03-23T06:22:26.665632+0000","last_fullsized":"2024-03-23T06:22:26.665632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.665468+0000","objects_scrubbed":5,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:40:12.950569+0000","scrub_duration":0.059269850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.334167+0000","last_change":"2024-03-23T06:22:41.334291+0000","last_active":"2024-03-23T06:22:41.334167+0000","last_peered":"2024-03-23T06:22:41.334167+0000","last_clean":"2024-03-23T06:22:41.334167+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:22:41.334167+0000","last_undegraded":"2024-03-23T06:22:41.334167+0000","last_fullsized":"2024-03-23T06:22:41.334167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:41.334129+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:41.334129+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.334129+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:09:30.931263+0000","scrub_duration":0.0028427529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.580866+0000","last_change":"2024-03-23T06:10:01.975861+0000","last_active":"2024-03-23T06:22:10.580866+0000","last_peered":"2024-03-23T06:22:10.580866+0000","last_clean":"2024-03-23T06:22:10.580866+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:22:10.580866+0000","last_undegraded":"2024-03-23T06:22:10.580866+0000","last_fullsized":"2024-03-23T06:22:10.580866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:18.622320+0000","last_change":"2024-03-23T06:22:18.622320+0000","last_active":"2024-03-23T06:22:18.622320+0000","last_peered":"2024-03-23T06:22:18.622320+0000","last_clean":"2024-03-23T06:22:18.622320+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:22:18.622320+0000","last_undegraded":"2024-03-23T06:22:18.622320+0000","last_fullsized":"2024-03-23T06:22:18.622320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_clean_scrub_stamp":"2024-03-23T06:22:18.622074+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:17:57.132801+0000","scrub_duration":0.022310751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'29","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.278949+0000","last_change":"2024-03-23T06:22:17.278949+0000","last_active":"2024-03-23T06:22:17.278949+0000","last_peered":"2024-03-23T06:22:17.278949+0000","last_clean":"2024-03-23T06:22:17.278949+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:22:17.278949+0000","last_undegraded":"2024-03-23T06:22:17.278949+0000","last_fullsized":"2024-03-23T06:22:17.278949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.278677+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:35:44.193734+0000","scrub_duration":0.003489125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.580975+0000","last_change":"2024-03-23T06:10:01.979377+0000","last_active":"2024-03-23T06:22:10.580975+0000","last_peered":"2024-03-23T06:22:10.580975+0000","last_clean":"2024-03-23T06:22:10.580975+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:22:10.580975+0000","last_undegraded":"2024-03-23T06:22:10.580975+0000","last_fullsized":"2024-03-23T06:22:10.580975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.263553+0000","last_change":"2024-03-23T06:22:27.263737+0000","last_active":"2024-03-23T06:22:27.263553+0000","last_peered":"2024-03-23T06:22:27.263553+0000","last_clean":"2024-03-23T06:22:27.263553+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:22:27.263553+0000","last_undegraded":"2024-03-23T06:22:27.263553+0000","last_fullsized":"2024-03-23T06:22:27.263553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.263503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:55:00.258025+0000","scrub_duration":0.0032643260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'397","reported_seq":420,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.108429+0000","last_change":"2024-03-23T06:09:57.480755+0000","last_active":"2024-03-23T06:21:28.108429+0000","last_peered":"2024-03-23T06:21:28.108429+0000","last_clean":"2024-03-23T06:21:28.108429+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:21:28.108429+0000","last_undegraded":"2024-03-23T06:21:28.108429+0000","last_fullsized":"2024-03-23T06:21:28.108429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.212676+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:21:28.212676+0000","last_peered":"2024-03-23T06:21:28.212676+0000","last_clean":"2024-03-23T06:21:28.212676+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:21:28.212676+0000","last_undegraded":"2024-03-23T06:21:28.212676+0000","last_fullsized":"2024-03-23T06:21:28.212676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.117390+0000","last_change":"2024-03-23T06:22:25.117488+0000","last_active":"2024-03-23T06:22:25.117390+0000","last_peered":"2024-03-23T06:22:25.117390+0000","last_clean":"2024-03-23T06:22:25.117390+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:22:25.117390+0000","last_undegraded":"2024-03-23T06:22:25.117390+0000","last_fullsized":"2024-03-23T06:22:25.117390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.117368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:18:30.718640+0000","scrub_duration":0.020924191000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:13.438650+0000","last_change":"2024-03-23T06:22:13.438725+0000","last_active":"2024-03-23T06:22:13.438650+0000","last_peered":"2024-03-23T06:22:13.438650+0000","last_clean":"2024-03-23T06:22:13.438650+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:22:13.438650+0000","last_undegraded":"2024-03-23T06:22:13.438650+0000","last_fullsized":"2024-03-23T06:22:13.438650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_clean_scrub_stamp":"2024-03-23T06:22:13.438631+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:34:21.050171+0000","scrub_duration":0.001784012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5264,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.647795+0000","last_change":"2024-03-23T06:22:47.647951+0000","last_active":"2024-03-23T06:22:47.647795+0000","last_peered":"2024-03-23T06:22:47.647795+0000","last_clean":"2024-03-23T06:22:47.647795+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:22:47.647795+0000","last_undegraded":"2024-03-23T06:22:47.647795+0000","last_fullsized":"2024-03-23T06:22:47.647795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5233","last_scrub_stamp":"2024-03-23T06:22:47.647769+0000","last_deep_scrub":"27'5233","last_deep_scrub_stamp":"2024-03-23T06:22:47.647769+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.647769+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:17:44.076130+0000","scrub_duration":0.091590610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.087631+0000","last_change":"2024-03-23T06:22:45.087701+0000","last_active":"2024-03-23T06:22:45.087631+0000","last_peered":"2024-03-23T06:22:45.087631+0000","last_clean":"2024-03-23T06:22:45.087631+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:22:45.087631+0000","last_undegraded":"2024-03-23T06:22:45.087631+0000","last_fullsized":"2024-03-23T06:22:45.087631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:45.087612+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:45.087612+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.087612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:01:32.916486+0000","scrub_duration":0.001285736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.301841+0000","last_change":"2024-03-23T06:22:22.301934+0000","last_active":"2024-03-23T06:22:22.301841+0000","last_peered":"2024-03-23T06:22:22.301841+0000","last_clean":"2024-03-23T06:22:22.301841+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:22:22.301841+0000","last_undegraded":"2024-03-23T06:22:22.301841+0000","last_fullsized":"2024-03-23T06:22:22.301841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.301822+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:51:57.846454+0000","scrub_duration":0.0052301179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6048,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.010347+0000","last_change":"2024-03-23T06:22:41.010512+0000","last_active":"2024-03-23T06:22:41.010347+0000","last_peered":"2024-03-23T06:22:41.010347+0000","last_clean":"2024-03-23T06:22:41.010347+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:22:41.010347+0000","last_undegraded":"2024-03-23T06:22:41.010347+0000","last_fullsized":"2024-03-23T06:22:41.010347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6017","last_scrub_stamp":"2024-03-23T06:22:41.010309+0000","last_deep_scrub":"27'6017","last_deep_scrub_stamp":"2024-03-23T06:22:41.010309+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.010309+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:49:02.530772+0000","scrub_duration":0.049541337999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'8","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:34.230469+0000","last_change":"2024-03-23T06:22:34.230582+0000","last_active":"2024-03-23T06:22:34.230469+0000","last_peered":"2024-03-23T06:22:34.230469+0000","last_clean":"2024-03-23T06:22:34.230469+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:22:34.230469+0000","last_undegraded":"2024-03-23T06:22:34.230469+0000","last_fullsized":"2024-03-23T06:22:34.230469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:34.230436+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:34.230436+0000","last_clean_scrub_stamp":"2024-03-23T06:22:34.230436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:09:56.885484+0000","scrub_duration":0.0018145329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.434083+0000","last_change":"2024-03-23T06:22:12.434207+0000","last_active":"2024-03-23T06:22:12.434083+0000","last_peered":"2024-03-23T06:22:12.434083+0000","last_clean":"2024-03-23T06:22:12.434083+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:22:12.434083+0000","last_undegraded":"2024-03-23T06:22:12.434083+0000","last_fullsized":"2024-03-23T06:22:12.434083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_clean_scrub_stamp":"2024-03-23T06:22:12.434048+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:01:00.920036+0000","scrub_duration":0.016801480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.905567+0000","last_change":"2024-03-23T06:22:48.905761+0000","last_active":"2024-03-23T06:22:48.905567+0000","last_peered":"2024-03-23T06:22:48.905567+0000","last_clean":"2024-03-23T06:22:48.905567+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:22:48.905567+0000","last_undegraded":"2024-03-23T06:22:48.905567+0000","last_fullsized":"2024-03-23T06:22:48.905567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4163","last_scrub_stamp":"2024-03-23T06:22:48.905532+0000","last_deep_scrub":"27'4163","last_deep_scrub_stamp":"2024-03-23T06:22:48.905532+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.905532+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:08:02.183029+0000","scrub_duration":0.107138319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.083131+0000","last_change":"2024-03-23T06:22:41.083203+0000","last_active":"2024-03-23T06:22:41.083131+0000","last_peered":"2024-03-23T06:22:41.083131+0000","last_clean":"2024-03-23T06:22:41.083131+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:22:41.083131+0000","last_undegraded":"2024-03-23T06:22:41.083131+0000","last_fullsized":"2024-03-23T06:22:41.083131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:41.083112+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:41.083112+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.083112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:51:20.359506+0000","scrub_duration":0.0017080439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.080995+0000","last_change":"2024-03-23T06:22:48.081197+0000","last_active":"2024-03-23T06:22:48.080995+0000","last_peered":"2024-03-23T06:22:48.080995+0000","last_clean":"2024-03-23T06:22:48.080995+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:22:48.080995+0000","last_undegraded":"2024-03-23T06:22:48.080995+0000","last_fullsized":"2024-03-23T06:22:48.080995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:48.080936+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:48.080936+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.080936+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:55:08.878167+0000","scrub_duration":0.0060221670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6173,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.580749+0000","last_change":"2024-03-23T06:10:01.973964+0000","last_active":"2024-03-23T06:22:10.580749+0000","last_peered":"2024-03-23T06:22:10.580749+0000","last_clean":"2024-03-23T06:22:10.580749+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:22:10.580749+0000","last_undegraded":"2024-03-23T06:22:10.580749+0000","last_fullsized":"2024-03-23T06:22:10.580749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.134765+0000","last_change":"2024-03-23T06:22:35.134899+0000","last_active":"2024-03-23T06:22:35.134765+0000","last_peered":"2024-03-23T06:22:35.134765+0000","last_clean":"2024-03-23T06:22:35.134765+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:22:35.134765+0000","last_undegraded":"2024-03-23T06:22:35.134765+0000","last_fullsized":"2024-03-23T06:22:35.134765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:35.134728+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:35.134728+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.134728+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:30.334770+0000","scrub_duration":0.012842018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'99","reported_seq":133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.219020+0000","last_change":"2024-03-23T06:22:26.219128+0000","last_active":"2024-03-23T06:22:26.219020+0000","last_peered":"2024-03-23T06:22:26.219020+0000","last_clean":"2024-03-23T06:22:26.219020+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:22:26.219020+0000","last_undegraded":"2024-03-23T06:22:26.219020+0000","last_fullsized":"2024-03-23T06:22:26.219020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_deep_scrub":"27'99","last_deep_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.218984+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:35:47.992609+0000","scrub_duration":0.005800571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4677,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.278570+0000","last_change":"2024-03-23T06:10:01.962064+0000","last_active":"2024-03-23T06:22:11.278570+0000","last_peered":"2024-03-23T06:22:11.278570+0000","last_clean":"2024-03-23T06:22:11.278570+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:22:11.278570+0000","last_undegraded":"2024-03-23T06:22:11.278570+0000","last_fullsized":"2024-03-23T06:22:11.278570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.408014+0000","last_change":"2024-03-23T06:22:25.408014+0000","last_active":"2024-03-23T06:22:25.408014+0000","last_peered":"2024-03-23T06:22:25.408014+0000","last_clean":"2024-03-23T06:22:25.408014+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:22:25.408014+0000","last_undegraded":"2024-03-23T06:22:25.408014+0000","last_fullsized":"2024-03-23T06:22:25.408014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.407913+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:33:56.177740+0000","scrub_duration":0.0011927579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'7","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.239402+0000","last_change":"2024-03-23T06:09:57.472173+0000","last_active":"2024-03-23T06:22:11.239402+0000","last_peered":"2024-03-23T06:22:11.239402+0000","last_clean":"2024-03-23T06:22:11.239402+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:22:11.239402+0000","last_undegraded":"2024-03-23T06:22:11.239402+0000","last_fullsized":"2024-03-23T06:22:11.239402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:38.295151+0000","last_change":"2024-03-23T06:22:38.295151+0000","last_active":"2024-03-23T06:22:38.295151+0000","last_peered":"2024-03-23T06:22:38.295151+0000","last_clean":"2024-03-23T06:22:38.295151+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:22:38.295151+0000","last_undegraded":"2024-03-23T06:22:38.295151+0000","last_fullsized":"2024-03-23T06:22:38.295151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4347","last_scrub_stamp":"2024-03-23T06:22:38.294940+0000","last_deep_scrub":"27'4347","last_deep_scrub_stamp":"2024-03-23T06:22:38.294940+0000","last_clean_scrub_stamp":"2024-03-23T06:22:38.294940+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:07.533511+0000","scrub_duration":0.086332040999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.893219+0000","last_change":"2024-03-23T06:22:24.893219+0000","last_active":"2024-03-23T06:22:24.893219+0000","last_peered":"2024-03-23T06:22:24.893219+0000","last_clean":"2024-03-23T06:22:24.893219+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:22:24.893219+0000","last_undegraded":"2024-03-23T06:22:24.893219+0000","last_fullsized":"2024-03-23T06:22:24.893219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.892857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:06.651897+0000","scrub_duration":0.020052960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.273805+0000","last_change":"2024-03-23T06:22:25.273805+0000","last_active":"2024-03-23T06:22:25.273805+0000","last_peered":"2024-03-23T06:22:25.273805+0000","last_clean":"2024-03-23T06:22:25.273805+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:22:25.273805+0000","last_undegraded":"2024-03-23T06:22:25.273805+0000","last_fullsized":"2024-03-23T06:22:25.273805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.273709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:28:04.429353+0000","scrub_duration":0.001195563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4638,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:39.210898+0000","last_change":"2024-03-23T06:22:39.211048+0000","last_active":"2024-03-23T06:22:39.210898+0000","last_peered":"2024-03-23T06:22:39.210898+0000","last_clean":"2024-03-23T06:22:39.210898+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:22:39.210898+0000","last_undegraded":"2024-03-23T06:22:39.210898+0000","last_fullsized":"2024-03-23T06:22:39.210898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4606","last_scrub_stamp":"2024-03-23T06:22:39.210876+0000","last_deep_scrub":"27'4606","last_deep_scrub_stamp":"2024-03-23T06:22:39.210876+0000","last_clean_scrub_stamp":"2024-03-23T06:22:39.210876+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:47:08.464172+0000","scrub_duration":0.047816294000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:09.438536+0000","last_change":"2024-03-23T06:22:09.438536+0000","last_active":"2024-03-23T06:22:09.438536+0000","last_peered":"2024-03-23T06:22:09.438536+0000","last_clean":"2024-03-23T06:22:09.438536+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:22:09.438536+0000","last_undegraded":"2024-03-23T06:22:09.438536+0000","last_fullsized":"2024-03-23T06:22:09.438536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_clean_scrub_stamp":"2024-03-23T06:22:09.438361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:00:16.089523+0000","scrub_duration":0.017467308000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'26","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.239314+0000","last_change":"2024-03-23T06:09:57.474853+0000","last_active":"2024-03-23T06:22:11.239314+0000","last_peered":"2024-03-23T06:22:11.239314+0000","last_clean":"2024-03-23T06:22:11.239314+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:22:11.239314+0000","last_undegraded":"2024-03-23T06:22:11.239314+0000","last_fullsized":"2024-03-23T06:22:11.239314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5415,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:40.167031+0000","last_change":"2024-03-23T06:22:40.167031+0000","last_active":"2024-03-23T06:22:40.167031+0000","last_peered":"2024-03-23T06:22:40.167031+0000","last_clean":"2024-03-23T06:22:40.167031+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:22:40.167031+0000","last_undegraded":"2024-03-23T06:22:40.167031+0000","last_fullsized":"2024-03-23T06:22:40.167031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5383","last_scrub_stamp":"2024-03-23T06:22:40.166855+0000","last_deep_scrub":"27'5383","last_deep_scrub_stamp":"2024-03-23T06:22:40.166855+0000","last_clean_scrub_stamp":"2024-03-23T06:22:40.166855+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:44:26.975670+0000","scrub_duration":0.050518577000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'22","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.342913+0000","last_change":"2024-03-23T06:22:23.342993+0000","last_active":"2024-03-23T06:22:23.342913+0000","last_peered":"2024-03-23T06:22:23.342913+0000","last_clean":"2024-03-23T06:22:23.342913+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:22:23.342913+0000","last_undegraded":"2024-03-23T06:22:23.342913+0000","last_fullsized":"2024-03-23T06:22:23.342913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.342894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:13:31.019943+0000","scrub_duration":0.001171252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'42","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.117526+0000","last_change":"2024-03-23T06:22:15.117526+0000","last_active":"2024-03-23T06:22:15.117526+0000","last_peered":"2024-03-23T06:22:15.117526+0000","last_clean":"2024-03-23T06:22:15.117526+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:22:15.117526+0000","last_undegraded":"2024-03-23T06:22:15.117526+0000","last_fullsized":"2024-03-23T06:22:15.117526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.117424+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:23:48.285959+0000","scrub_duration":0.003100383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":38,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5554,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.348207+0000","last_change":"2024-03-23T06:22:32.348324+0000","last_active":"2024-03-23T06:22:32.348207+0000","last_peered":"2024-03-23T06:22:32.348207+0000","last_clean":"2024-03-23T06:22:32.348207+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:22:32.348207+0000","last_undegraded":"2024-03-23T06:22:32.348207+0000","last_fullsized":"2024-03-23T06:22:32.348207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5513","last_scrub_stamp":"2024-03-23T06:22:32.348185+0000","last_deep_scrub":"27'5513","last_deep_scrub_stamp":"2024-03-23T06:22:32.348185+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.348185+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:49:59.107739+0000","scrub_duration":0.088163792000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.444706+0000","last_change":"2024-03-23T06:22:20.444706+0000","last_active":"2024-03-23T06:22:20.444706+0000","last_peered":"2024-03-23T06:22:20.444706+0000","last_clean":"2024-03-23T06:22:20.444706+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:20.444706+0000","last_undegraded":"2024-03-23T06:22:20.444706+0000","last_fullsized":"2024-03-23T06:22:20.444706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.444597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:38:16.085029+0000","scrub_duration":0.0020820489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'53","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:44.218789+0000","last_change":"2024-03-23T06:22:44.219077+0000","last_active":"2024-03-23T06:22:44.218789+0000","last_peered":"2024-03-23T06:22:44.218789+0000","last_clean":"2024-03-23T06:22:44.218789+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:22:44.218789+0000","last_undegraded":"2024-03-23T06:22:44.218789+0000","last_fullsized":"2024-03-23T06:22:44.218789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-03-23T06:22:44.218735+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-03-23T06:22:44.218735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:44.218735+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:16.319369+0000","scrub_duration":0.032610752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5352,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.228091+0000","last_change":"2024-03-23T06:10:01.961333+0000","last_active":"2024-03-23T06:21:28.228091+0000","last_peered":"2024-03-23T06:21:28.228091+0000","last_clean":"2024-03-23T06:21:28.228091+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:21:28.228091+0000","last_undegraded":"2024-03-23T06:21:28.228091+0000","last_fullsized":"2024-03-23T06:21:28.228091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'14","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:34.131745+0000","last_change":"2024-03-23T06:22:34.131836+0000","last_active":"2024-03-23T06:22:34.131745+0000","last_peered":"2024-03-23T06:22:34.131745+0000","last_clean":"2024-03-23T06:22:34.131745+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:22:34.131745+0000","last_undegraded":"2024-03-23T06:22:34.131745+0000","last_fullsized":"2024-03-23T06:22:34.131745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:34.131727+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:34.131727+0000","last_clean_scrub_stamp":"2024-03-23T06:22:34.131727+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:21:23.166528+0000","scrub_duration":0.001854968,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:52.135634+0000","last_change":"2024-03-23T06:22:52.135840+0000","last_active":"2024-03-23T06:22:52.135634+0000","last_peered":"2024-03-23T06:22:52.135634+0000","last_clean":"2024-03-23T06:22:52.135634+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:22:52.135634+0000","last_undegraded":"2024-03-23T06:22:52.135634+0000","last_fullsized":"2024-03-23T06:22:52.135634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:52.135580+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:52.135580+0000","last_clean_scrub_stamp":"2024-03-23T06:22:52.135580+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:45.624273+0000","scrub_duration":0.0067533489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.434497+0000","last_change":"2024-03-23T06:22:10.434689+0000","last_active":"2024-03-23T06:22:10.434497+0000","last_peered":"2024-03-23T06:22:10.434497+0000","last_clean":"2024-03-23T06:22:10.434497+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:22:10.434497+0000","last_undegraded":"2024-03-23T06:22:10.434497+0000","last_fullsized":"2024-03-23T06:22:10.434497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.434445+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:53:51.345697+0000","scrub_duration":0.011047585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.240335+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:22:11.240335+0000","last_peered":"2024-03-23T06:22:11.240335+0000","last_clean":"2024-03-23T06:22:11.240335+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:22:11.240335+0000","last_undegraded":"2024-03-23T06:22:11.240335+0000","last_fullsized":"2024-03-23T06:22:11.240335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.264179+0000","last_change":"2024-03-23T06:22:19.264433+0000","last_active":"2024-03-23T06:22:19.264179+0000","last_peered":"2024-03-23T06:22:19.264179+0000","last_clean":"2024-03-23T06:22:19.264179+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:22:19.264179+0000","last_undegraded":"2024-03-23T06:22:19.264179+0000","last_fullsized":"2024-03-23T06:22:19.264179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.264125+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:41:16.245860+0000","scrub_duration":0.0035297940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.434033+0000","last_change":"2024-03-23T06:22:16.434139+0000","last_active":"2024-03-23T06:22:16.434033+0000","last_peered":"2024-03-23T06:22:16.434033+0000","last_clean":"2024-03-23T06:22:16.434033+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:22:16.434033+0000","last_undegraded":"2024-03-23T06:22:16.434033+0000","last_fullsized":"2024-03-23T06:22:16.434033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.433996+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:13:36.235706+0000","scrub_duration":0.0057335859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5292,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:39.907237+0000","last_change":"2024-03-23T06:22:39.907512+0000","last_active":"2024-03-23T06:22:39.907237+0000","last_peered":"2024-03-23T06:22:39.907237+0000","last_clean":"2024-03-23T06:22:39.907237+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:22:39.907237+0000","last_undegraded":"2024-03-23T06:22:39.907237+0000","last_fullsized":"2024-03-23T06:22:39.907237+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5251","last_scrub_stamp":"2024-03-23T06:22:39.907179+0000","last_deep_scrub":"27'5251","last_deep_scrub_stamp":"2024-03-23T06:22:39.907179+0000","last_clean_scrub_stamp":"2024-03-23T06:22:39.907179+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:08:53.331286+0000","scrub_duration":0.13370536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.593784+0000","last_change":"2024-03-23T06:22:27.594039+0000","last_active":"2024-03-23T06:22:27.593784+0000","last_peered":"2024-03-23T06:22:27.593784+0000","last_clean":"2024-03-23T06:22:27.593784+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:22:27.593784+0000","last_undegraded":"2024-03-23T06:22:27.593784+0000","last_fullsized":"2024-03-23T06:22:27.593784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.593735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:10.812412+0000","scrub_duration":0.0028611280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'25","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.313526+0000","last_change":"2024-03-23T06:22:24.313601+0000","last_active":"2024-03-23T06:22:24.313526+0000","last_peered":"2024-03-23T06:22:24.313526+0000","last_clean":"2024-03-23T06:22:24.313526+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:22:24.313526+0000","last_undegraded":"2024-03-23T06:22:24.313526+0000","last_fullsized":"2024-03-23T06:22:24.313526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.313505+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:32:44.992621+0000","scrub_duration":0.020603684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4816,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.223646+0000","last_change":"2024-03-23T06:10:01.962384+0000","last_active":"2024-03-23T06:21:28.223646+0000","last_peered":"2024-03-23T06:21:28.223646+0000","last_clean":"2024-03-23T06:21:28.223646+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:21:28.223646+0000","last_undegraded":"2024-03-23T06:21:28.223646+0000","last_fullsized":"2024-03-23T06:21:28.223646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'19","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.691023+0000","last_change":"2024-03-23T06:22:35.691338+0000","last_active":"2024-03-23T06:22:35.691023+0000","last_peered":"2024-03-23T06:22:35.691023+0000","last_clean":"2024-03-23T06:22:35.691023+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:22:35.691023+0000","last_undegraded":"2024-03-23T06:22:35.691023+0000","last_fullsized":"2024-03-23T06:22:35.691023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:35.690945+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:35.690945+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.690945+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:55.846631+0000","scrub_duration":0.025112247000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.160352+0000","last_change":"2024-03-23T06:22:29.160458+0000","last_active":"2024-03-23T06:22:29.160352+0000","last_peered":"2024-03-23T06:22:29.160352+0000","last_clean":"2024-03-23T06:22:29.160352+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:22:29.160352+0000","last_undegraded":"2024-03-23T06:22:29.160352+0000","last_fullsized":"2024-03-23T06:22:29.160352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.160317+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:53:12.339833+0000","scrub_duration":0.0076372239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5574,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.240283+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:21:28.240283+0000","last_peered":"2024-03-23T06:21:28.240283+0000","last_clean":"2024-03-23T06:21:28.240283+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:21:28.240283+0000","last_undegraded":"2024-03-23T06:21:28.240283+0000","last_fullsized":"2024-03-23T06:21:28.240283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:33.907005+0000","last_change":"2024-03-23T06:22:33.907193+0000","last_active":"2024-03-23T06:22:33.907005+0000","last_peered":"2024-03-23T06:22:33.907005+0000","last_clean":"2024-03-23T06:22:33.907005+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:22:33.907005+0000","last_undegraded":"2024-03-23T06:22:33.907005+0000","last_fullsized":"2024-03-23T06:22:33.907005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:33.906955+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:33.906955+0000","last_clean_scrub_stamp":"2024-03-23T06:22:33.906955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:59:33.711376+0000","scrub_duration":0.0030598840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'54","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.584347+0000","last_change":"2024-03-23T06:22:20.584461+0000","last_active":"2024-03-23T06:22:20.584347+0000","last_peered":"2024-03-23T06:22:20.584347+0000","last_clean":"2024-03-23T06:22:20.584347+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:22:20.584347+0000","last_undegraded":"2024-03-23T06:22:20.584347+0000","last_fullsized":"2024-03-23T06:22:20.584347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.584313+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:03:42.668360+0000","scrub_duration":0.010912419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632815,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4597,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.361876+0000","last_change":"2024-03-23T06:22:45.362204+0000","last_active":"2024-03-23T06:22:45.361876+0000","last_peered":"2024-03-23T06:22:45.361876+0000","last_clean":"2024-03-23T06:22:45.361876+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:22:45.361876+0000","last_undegraded":"2024-03-23T06:22:45.361876+0000","last_fullsized":"2024-03-23T06:22:45.361876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4566","last_scrub_stamp":"2024-03-23T06:22:45.361824+0000","last_deep_scrub":"27'4566","last_deep_scrub_stamp":"2024-03-23T06:22:45.361824+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.361824+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:05:22.604742+0000","scrub_duration":0.049166682000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.294321+0000","last_change":"2024-03-23T06:22:15.294560+0000","last_active":"2024-03-23T06:22:15.294321+0000","last_peered":"2024-03-23T06:22:15.294321+0000","last_clean":"2024-03-23T06:22:15.294321+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:22:15.294321+0000","last_undegraded":"2024-03-23T06:22:15.294321+0000","last_fullsized":"2024-03-23T06:22:15.294321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.294273+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:05:44.698199+0000","scrub_duration":0.013606521999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.270315+0000","last_change":"2024-03-23T06:22:19.270416+0000","last_active":"2024-03-23T06:22:19.270315+0000","last_peered":"2024-03-23T06:22:19.270315+0000","last_clean":"2024-03-23T06:22:19.270315+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:22:19.270315+0000","last_undegraded":"2024-03-23T06:22:19.270315+0000","last_fullsized":"2024-03-23T06:22:19.270315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.270293+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:42:03.814587+0000","scrub_duration":0.0055263279999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5961,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.552121+0000","last_change":"2024-03-23T06:10:01.963259+0000","last_active":"2024-03-23T06:22:12.552121+0000","last_peered":"2024-03-23T06:22:12.552121+0000","last_clean":"2024-03-23T06:22:12.552121+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:22:12.552121+0000","last_undegraded":"2024-03-23T06:22:12.552121+0000","last_fullsized":"2024-03-23T06:22:12.552121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.311858+0000","last_change":"2024-03-23T06:22:30.312073+0000","last_active":"2024-03-23T06:22:30.311858+0000","last_peered":"2024-03-23T06:22:30.311858+0000","last_clean":"2024-03-23T06:22:30.311858+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:22:30.311858+0000","last_undegraded":"2024-03-23T06:22:30.311858+0000","last_fullsized":"2024-03-23T06:22:30.311858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.311808+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:24:48.713636+0000","scrub_duration":0.0026864620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.567867+0000","last_change":"2024-03-23T06:22:21.568095+0000","last_active":"2024-03-23T06:22:21.567867+0000","last_peered":"2024-03-23T06:22:21.567867+0000","last_clean":"2024-03-23T06:22:21.567867+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:22:21.567867+0000","last_undegraded":"2024-03-23T06:22:21.567867+0000","last_fullsized":"2024-03-23T06:22:21.567867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.567817+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:27.726121+0000","scrub_duration":0.0064138650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.552079+0000","last_change":"2024-03-23T06:10:01.968150+0000","last_active":"2024-03-23T06:22:12.552079+0000","last_peered":"2024-03-23T06:22:12.552079+0000","last_clean":"2024-03-23T06:22:12.552079+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:22:12.552079+0000","last_undegraded":"2024-03-23T06:22:12.552079+0000","last_fullsized":"2024-03-23T06:22:12.552079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.408474+0000","last_change":"2024-03-23T06:22:11.408732+0000","last_active":"2024-03-23T06:22:11.408474+0000","last_peered":"2024-03-23T06:22:11.408474+0000","last_clean":"2024-03-23T06:22:11.408474+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:22:11.408474+0000","last_undegraded":"2024-03-23T06:22:11.408474+0000","last_fullsized":"2024-03-23T06:22:11.408474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.408422+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:21:16.861147+0000","scrub_duration":0.0032855250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:42.835977+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:21:42.835977+0000","last_peered":"2024-03-23T06:21:42.835977+0000","last_clean":"2024-03-23T06:21:42.835977+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:21:42.835977+0000","last_undegraded":"2024-03-23T06:21:42.835977+0000","last_fullsized":"2024-03-23T06:21:42.835977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:46.247751+0000","last_change":"2024-03-23T06:22:46.247864+0000","last_active":"2024-03-23T06:22:46.247751+0000","last_peered":"2024-03-23T06:22:46.247751+0000","last_clean":"2024-03-23T06:22:46.247751+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:22:46.247751+0000","last_undegraded":"2024-03-23T06:22:46.247751+0000","last_fullsized":"2024-03-23T06:22:46.247751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5252","last_scrub_stamp":"2024-03-23T06:22:46.247730+0000","last_deep_scrub":"27'5252","last_deep_scrub_stamp":"2024-03-23T06:22:46.247730+0000","last_clean_scrub_stamp":"2024-03-23T06:22:46.247730+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:58:39.050927+0000","scrub_duration":0.055585051000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.389413+0000","last_change":"2024-03-23T06:22:23.389530+0000","last_active":"2024-03-23T06:22:23.389413+0000","last_peered":"2024-03-23T06:22:23.389413+0000","last_clean":"2024-03-23T06:22:23.389413+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:22:23.389413+0000","last_undegraded":"2024-03-23T06:22:23.389413+0000","last_fullsized":"2024-03-23T06:22:23.389413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.389377+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:57:35.577088+0000","scrub_duration":0.0020420400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'46","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.174186+0000","last_change":"2024-03-23T06:22:17.174270+0000","last_active":"2024-03-23T06:22:17.174186+0000","last_peered":"2024-03-23T06:22:17.174186+0000","last_clean":"2024-03-23T06:22:17.174186+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:22:17.174186+0000","last_undegraded":"2024-03-23T06:22:17.174186+0000","last_fullsized":"2024-03-23T06:22:17.174186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.174166+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:43.279079+0000","scrub_duration":0.036150521999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:02.840502+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:22:02.840502+0000","last_peered":"2024-03-23T06:22:02.840502+0000","last_clean":"2024-03-23T06:22:02.840502+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:22:02.840502+0000","last_undegraded":"2024-03-23T06:22:02.840502+0000","last_fullsized":"2024-03-23T06:22:02.840502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.628830+0000","last_change":"2024-03-23T06:22:28.628962+0000","last_active":"2024-03-23T06:22:28.628830+0000","last_peered":"2024-03-23T06:22:28.628830+0000","last_clean":"2024-03-23T06:22:28.628830+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:22:28.628830+0000","last_undegraded":"2024-03-23T06:22:28.628830+0000","last_fullsized":"2024-03-23T06:22:28.628830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:28.628795+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:28.628795+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.628795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:54:54.770817+0000","scrub_duration":0.0036585469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'235","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.849123+0000","last_change":"2024-03-23T06:22:11.849229+0000","last_active":"2024-03-23T06:22:11.849123+0000","last_peered":"2024-03-23T06:22:11.849123+0000","last_clean":"2024-03-23T06:22:11.849123+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:22:11.849123+0000","last_undegraded":"2024-03-23T06:22:11.849123+0000","last_fullsized":"2024-03-23T06:22:11.849123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'235","last_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_deep_scrub":"27'235","last_deep_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.849094+0000","objects_scrubbed":5,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:39.149866+0000","scrub_duration":0.018805761000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.038075+0000","last_change":"2024-03-23T06:22:51.038220+0000","last_active":"2024-03-23T06:22:51.038075+0000","last_peered":"2024-03-23T06:22:51.038075+0000","last_clean":"2024-03-23T06:22:51.038075+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:22:51.038075+0000","last_undegraded":"2024-03-23T06:22:51.038075+0000","last_fullsized":"2024-03-23T06:22:51.038075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5454","last_scrub_stamp":"2024-03-23T06:22:51.038053+0000","last_deep_scrub":"27'5454","last_deep_scrub_stamp":"2024-03-23T06:22:51.038053+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.038053+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:44:27.997214+0000","scrub_duration":0.040048050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'18","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.296103+0000","last_change":"2024-03-23T06:22:28.296211+0000","last_active":"2024-03-23T06:22:28.296103+0000","last_peered":"2024-03-23T06:22:28.296103+0000","last_clean":"2024-03-23T06:22:28.296103+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:22:28.296103+0000","last_undegraded":"2024-03-23T06:22:28.296103+0000","last_fullsized":"2024-03-23T06:22:28.296103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:28.296069+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:28.296069+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.296069+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:07:55.030356+0000","scrub_duration":0.0028074770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.081823+0000","last_change":"2024-03-23T06:22:24.081903+0000","last_active":"2024-03-23T06:22:24.081823+0000","last_peered":"2024-03-23T06:22:24.081823+0000","last_clean":"2024-03-23T06:22:24.081823+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:22:24.081823+0000","last_undegraded":"2024-03-23T06:22:24.081823+0000","last_fullsized":"2024-03-23T06:22:24.081823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.081802+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:52.223689+0000","scrub_duration":0.0031724399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:46.927300+0000","last_change":"2024-03-23T06:22:46.927435+0000","last_active":"2024-03-23T06:22:46.927300+0000","last_peered":"2024-03-23T06:22:46.927300+0000","last_clean":"2024-03-23T06:22:46.927300+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:22:46.927300+0000","last_undegraded":"2024-03-23T06:22:46.927300+0000","last_fullsized":"2024-03-23T06:22:46.927300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5697","last_scrub_stamp":"2024-03-23T06:22:46.927277+0000","last_deep_scrub":"27'5697","last_deep_scrub_stamp":"2024-03-23T06:22:46.927277+0000","last_clean_scrub_stamp":"2024-03-23T06:22:46.927277+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:21:05.900325+0000","scrub_duration":0.10768414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:42.417823+0000","last_change":"2024-03-23T06:22:42.417958+0000","last_active":"2024-03-23T06:22:42.417823+0000","last_peered":"2024-03-23T06:22:42.417823+0000","last_clean":"2024-03-23T06:22:42.417823+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:22:42.417823+0000","last_undegraded":"2024-03-23T06:22:42.417823+0000","last_fullsized":"2024-03-23T06:22:42.417823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:42.417802+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:42.417802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:42.417802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:45:28.791609+0000","scrub_duration":0.044168832999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.544964+0000","last_change":"2024-03-23T06:22:23.545071+0000","last_active":"2024-03-23T06:22:23.544964+0000","last_peered":"2024-03-23T06:22:23.544964+0000","last_clean":"2024-03-23T06:22:23.544964+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:22:23.544964+0000","last_undegraded":"2024-03-23T06:22:23.544964+0000","last_fullsized":"2024-03-23T06:22:23.544964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.544931+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:19:48.158158+0000","scrub_duration":0.0052986079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5441,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.111027+0000","last_change":"2024-03-23T06:22:35.111149+0000","last_active":"2024-03-23T06:22:35.111027+0000","last_peered":"2024-03-23T06:22:35.111027+0000","last_clean":"2024-03-23T06:22:35.111027+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:22:35.111027+0000","last_undegraded":"2024-03-23T06:22:35.111027+0000","last_fullsized":"2024-03-23T06:22:35.111027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5410","last_scrub_stamp":"2024-03-23T06:22:35.111007+0000","last_deep_scrub":"27'5410","last_deep_scrub_stamp":"2024-03-23T06:22:35.111007+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.111007+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:18:26.289653+0000","scrub_duration":0.081376517999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.789158+0000","last_change":"2024-03-23T06:22:36.789460+0000","last_active":"2024-03-23T06:22:36.789158+0000","last_peered":"2024-03-23T06:22:36.789158+0000","last_clean":"2024-03-23T06:22:36.789158+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:22:36.789158+0000","last_undegraded":"2024-03-23T06:22:36.789158+0000","last_fullsized":"2024-03-23T06:22:36.789158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:36.789091+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:36.789091+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.789091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:20:32.423764+0000","scrub_duration":0.0039367719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.344399+0000","last_change":"2024-03-23T06:22:21.344504+0000","last_active":"2024-03-23T06:22:21.344399+0000","last_peered":"2024-03-23T06:22:21.344399+0000","last_clean":"2024-03-23T06:22:21.344399+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:22:21.344399+0000","last_undegraded":"2024-03-23T06:22:21.344399+0000","last_fullsized":"2024-03-23T06:22:21.344399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.344365+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:36:55.229393+0000","scrub_duration":0.0036549210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5634,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:41.275740+0000","last_change":"2024-03-23T06:10:39.801920+0000","last_active":"2024-03-23T06:21:41.275740+0000","last_peered":"2024-03-23T06:21:41.275740+0000","last_clean":"2024-03-23T06:21:41.275740+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:21:41.275740+0000","last_undegraded":"2024-03-23T06:21:41.275740+0000","last_fullsized":"2024-03-23T06:21:41.275740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4716,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.278650+0000","last_change":"2024-03-23T06:10:01.961683+0000","last_active":"2024-03-23T06:22:11.278650+0000","last_peered":"2024-03-23T06:22:11.278650+0000","last_clean":"2024-03-23T06:22:11.278650+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:22:11.278650+0000","last_undegraded":"2024-03-23T06:22:11.278650+0000","last_fullsized":"2024-03-23T06:22:11.278650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.192359+0000","last_change":"2024-03-23T06:22:16.192455+0000","last_active":"2024-03-23T06:22:16.192359+0000","last_peered":"2024-03-23T06:22:16.192359+0000","last_clean":"2024-03-23T06:22:16.192359+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:22:16.192359+0000","last_undegraded":"2024-03-23T06:22:16.192359+0000","last_fullsized":"2024-03-23T06:22:16.192359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.192340+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:36:59.548342+0000","scrub_duration":0.0022608480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'33","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:07.841508+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:22:07.841508+0000","last_peered":"2024-03-23T06:22:07.841508+0000","last_clean":"2024-03-23T06:22:07.841508+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:22:07.841508+0000","last_undegraded":"2024-03-23T06:22:07.841508+0000","last_fullsized":"2024-03-23T06:22:07.841508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.240426+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:22:11.240426+0000","last_peered":"2024-03-23T06:22:11.240426+0000","last_clean":"2024-03-23T06:22:11.240426+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:22:11.240426+0000","last_undegraded":"2024-03-23T06:22:11.240426+0000","last_fullsized":"2024-03-23T06:22:11.240426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'25","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.394919+0000","last_change":"2024-03-23T06:22:36.395013+0000","last_active":"2024-03-23T06:22:36.394919+0000","last_peered":"2024-03-23T06:22:36.394919+0000","last_clean":"2024-03-23T06:22:36.394919+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:22:36.394919+0000","last_undegraded":"2024-03-23T06:22:36.394919+0000","last_fullsized":"2024-03-23T06:22:36.394919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:36.394897+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:36.394897+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.394897+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:58:46.898461+0000","scrub_duration":0.00127731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'7","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.404159+0000","last_change":"2024-03-23T06:22:17.404227+0000","last_active":"2024-03-23T06:22:17.404159+0000","last_peered":"2024-03-23T06:22:17.404159+0000","last_clean":"2024-03-23T06:22:17.404159+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:22:17.404159+0000","last_undegraded":"2024-03-23T06:22:17.404159+0000","last_fullsized":"2024-03-23T06:22:17.404159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.404138+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:22:05.019725+0000","scrub_duration":0.0043990399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.233394+0000","last_change":"2024-03-23T06:22:41.233488+0000","last_active":"2024-03-23T06:22:41.233394+0000","last_peered":"2024-03-23T06:22:41.233394+0000","last_clean":"2024-03-23T06:22:41.233394+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:22:41.233394+0000","last_undegraded":"2024-03-23T06:22:41.233394+0000","last_fullsized":"2024-03-23T06:22:41.233394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:41.233370+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:41.233370+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.233370+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:56:30.911476+0000","scrub_duration":0.018389154000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:31.156271+0000","last_change":"2024-03-23T06:22:31.156271+0000","last_active":"2024-03-23T06:22:31.156271+0000","last_peered":"2024-03-23T06:22:31.156271+0000","last_clean":"2024-03-23T06:22:31.156271+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:22:31.156271+0000","last_undegraded":"2024-03-23T06:22:31.156271+0000","last_fullsized":"2024-03-23T06:22:31.156271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_clean_scrub_stamp":"2024-03-23T06:22:31.156172+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:36.346305+0000","scrub_duration":0.0027602590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5561,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.891762+0000","last_change":"2024-03-23T06:10:01.948915+0000","last_active":"2024-03-23T06:22:11.891762+0000","last_peered":"2024-03-23T06:22:11.891762+0000","last_clean":"2024-03-23T06:22:11.891762+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:22:11.891762+0000","last_undegraded":"2024-03-23T06:22:11.891762+0000","last_fullsized":"2024-03-23T06:22:11.891762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'987","reported_seq":1020,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.331383+0000","last_change":"2024-03-23T06:22:27.331383+0000","last_active":"2024-03-23T06:22:27.331383+0000","last_peered":"2024-03-23T06:22:27.331383+0000","last_clean":"2024-03-23T06:22:27.331383+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:22:27.331383+0000","last_undegraded":"2024-03-23T06:22:27.331383+0000","last_fullsized":"2024-03-23T06:22:27.331383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'987","last_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_deep_scrub":"27'987","last_deep_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.331273+0000","objects_scrubbed":3,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:32:55.613936+0000","scrub_duration":0.012878013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195273,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":4980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.345944+0000","last_change":"2024-03-23T06:22:23.345944+0000","last_active":"2024-03-23T06:22:23.345944+0000","last_peered":"2024-03-23T06:22:23.345944+0000","last_clean":"2024-03-23T06:22:23.345944+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:22:23.345944+0000","last_undegraded":"2024-03-23T06:22:23.345944+0000","last_fullsized":"2024-03-23T06:22:23.345944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.345675+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:57:48.142305+0000","scrub_duration":0.0030686540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.076006+0000","last_change":"2024-03-23T06:22:37.076006+0000","last_active":"2024-03-23T06:22:37.076006+0000","last_peered":"2024-03-23T06:22:37.076006+0000","last_clean":"2024-03-23T06:22:37.076006+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:22:37.076006+0000","last_undegraded":"2024-03-23T06:22:37.076006+0000","last_fullsized":"2024-03-23T06:22:37.076006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4732","last_scrub_stamp":"2024-03-23T06:22:37.075828+0000","last_deep_scrub":"27'4732","last_deep_scrub_stamp":"2024-03-23T06:22:37.075828+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.075828+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:35:19.836743+0000","scrub_duration":0.084933690000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'23","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.801751+0000","last_change":"2024-03-23T06:22:17.801751+0000","last_active":"2024-03-23T06:22:17.801751+0000","last_peered":"2024-03-23T06:22:17.801751+0000","last_clean":"2024-03-23T06:22:17.801751+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:22:17.801751+0000","last_undegraded":"2024-03-23T06:22:17.801751+0000","last_fullsized":"2024-03-23T06:22:17.801751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.801514+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:07.169700+0000","scrub_duration":0.0027127649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.038128+0000","last_change":"2024-03-23T06:22:30.038128+0000","last_active":"2024-03-23T06:22:30.038128+0000","last_peered":"2024-03-23T06:22:30.038128+0000","last_clean":"2024-03-23T06:22:30.038128+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:22:30.038128+0000","last_undegraded":"2024-03-23T06:22:30.038128+0000","last_fullsized":"2024-03-23T06:22:30.038128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.038036+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:00.263151+0000","scrub_duration":0.0018525620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'22","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.296590+0000","last_change":"2024-03-23T06:22:26.296590+0000","last_active":"2024-03-23T06:22:26.296590+0000","last_peered":"2024-03-23T06:22:26.296590+0000","last_clean":"2024-03-23T06:22:26.296590+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:22:26.296590+0000","last_undegraded":"2024-03-23T06:22:26.296590+0000","last_fullsized":"2024-03-23T06:22:26.296590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.296445+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:27:30.354398+0000","scrub_duration":0.001966677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.430809+0000","last_change":"2024-03-23T06:22:37.430899+0000","last_active":"2024-03-23T06:22:37.430809+0000","last_peered":"2024-03-23T06:22:37.430809+0000","last_clean":"2024-03-23T06:22:37.430809+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:22:37.430809+0000","last_undegraded":"2024-03-23T06:22:37.430809+0000","last_fullsized":"2024-03-23T06:22:37.430809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:37.430790+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:37.430790+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.430790+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:54:12.996368+0000","scrub_duration":0.0069039490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.280908+0000","last_change":"2024-03-23T06:22:30.280994+0000","last_active":"2024-03-23T06:22:30.280908+0000","last_peered":"2024-03-23T06:22:30.280908+0000","last_clean":"2024-03-23T06:22:30.280908+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:22:30.280908+0000","last_undegraded":"2024-03-23T06:22:30.280908+0000","last_fullsized":"2024-03-23T06:22:30.280908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:30.280888+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:30.280888+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.280888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:12:40.399188+0000","scrub_duration":0.002164539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'13","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.448008+0000","last_change":"2024-03-23T06:22:21.448141+0000","last_active":"2024-03-23T06:22:21.448008+0000","last_peered":"2024-03-23T06:22:21.448008+0000","last_clean":"2024-03-23T06:22:21.448008+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:22:21.448008+0000","last_undegraded":"2024-03-23T06:22:21.448008+0000","last_fullsized":"2024-03-23T06:22:21.448008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.447969+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:08:29.179604+0000","scrub_duration":0.012766777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.813789+0000","last_change":"2024-03-23T06:22:37.814058+0000","last_active":"2024-03-23T06:22:37.813789+0000","last_peered":"2024-03-23T06:22:37.813789+0000","last_clean":"2024-03-23T06:22:37.813789+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:22:37.813789+0000","last_undegraded":"2024-03-23T06:22:37.813789+0000","last_fullsized":"2024-03-23T06:22:37.813789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:37.813738+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:37.813738+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.813738+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:44.682405+0000","scrub_duration":0.0033203070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.442229+0000","last_change":"2024-03-23T06:22:51.442345+0000","last_active":"2024-03-23T06:22:51.442229+0000","last_peered":"2024-03-23T06:22:51.442229+0000","last_clean":"2024-03-23T06:22:51.442229+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:22:51.442229+0000","last_undegraded":"2024-03-23T06:22:51.442229+0000","last_fullsized":"2024-03-23T06:22:51.442229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:51.442207+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:51.442207+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.442207+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:17:56.327553+0000","scrub_duration":0.029129189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'16","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:40.207186+0000","last_change":"2024-03-23T06:22:40.207309+0000","last_active":"2024-03-23T06:22:40.207186+0000","last_peered":"2024-03-23T06:22:40.207186+0000","last_clean":"2024-03-23T06:22:40.207186+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:22:40.207186+0000","last_undegraded":"2024-03-23T06:22:40.207186+0000","last_fullsized":"2024-03-23T06:22:40.207186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:40.207151+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:40.207151+0000","last_clean_scrub_stamp":"2024-03-23T06:22:40.207151+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:14.602763+0000","scrub_duration":0.002043114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.347993+0000","last_change":"2024-03-23T06:22:41.348067+0000","last_active":"2024-03-23T06:22:41.347993+0000","last_peered":"2024-03-23T06:22:41.347993+0000","last_clean":"2024-03-23T06:22:41.347993+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:41.347993+0000","last_undegraded":"2024-03-23T06:22:41.347993+0000","last_fullsized":"2024-03-23T06:22:41.347993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:41.347972+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:41.347972+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.347972+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:56.700950+0000","scrub_duration":0.002267458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.343037+0000","last_change":"2024-03-23T06:22:32.343157+0000","last_active":"2024-03-23T06:22:32.343037+0000","last_peered":"2024-03-23T06:22:32.343037+0000","last_clean":"2024-03-23T06:22:32.343037+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:22:32.343037+0000","last_undegraded":"2024-03-23T06:22:32.343037+0000","last_fullsized":"2024-03-23T06:22:32.343037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:32.343003+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:32.343003+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.343003+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:12:33.068970+0000","scrub_duration":0.0030932540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.023577+0000","last_change":"2024-03-23T06:22:47.023655+0000","last_active":"2024-03-23T06:22:47.023577+0000","last_peered":"2024-03-23T06:22:47.023577+0000","last_clean":"2024-03-23T06:22:47.023577+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:22:47.023577+0000","last_undegraded":"2024-03-23T06:22:47.023577+0000","last_fullsized":"2024-03-23T06:22:47.023577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:47.023557+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:47.023557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.023557+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:04:00.947841+0000","scrub_duration":0.00272047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'18","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.443596+0000","last_change":"2024-03-23T06:22:10.443727+0000","last_active":"2024-03-23T06:22:10.443596+0000","last_peered":"2024-03-23T06:22:10.443596+0000","last_clean":"2024-03-23T06:22:10.443596+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:22:10.443596+0000","last_undegraded":"2024-03-23T06:22:10.443596+0000","last_fullsized":"2024-03-23T06:22:10.443596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.443557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:54:38.092496+0000","scrub_duration":0.002201901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'18","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.104113+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:22:05.104113+0000","last_peered":"2024-03-23T06:22:05.104113+0000","last_clean":"2024-03-23T06:22:05.104113+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:22:05.104113+0000","last_undegraded":"2024-03-23T06:22:05.104113+0000","last_fullsized":"2024-03-23T06:22:05.104113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'30","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.102123+0000","last_change":"2024-03-23T06:22:27.102202+0000","last_active":"2024-03-23T06:22:27.102123+0000","last_peered":"2024-03-23T06:22:27.102123+0000","last_clean":"2024-03-23T06:22:27.102123+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:22:27.102123+0000","last_undegraded":"2024-03-23T06:22:27.102123+0000","last_fullsized":"2024-03-23T06:22:27.102123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.102103+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:44:04.072008+0000","scrub_duration":0.0025710630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.103424+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:22:05.103424+0000","last_peered":"2024-03-23T06:22:05.103424+0000","last_clean":"2024-03-23T06:22:05.103424+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:22:05.103424+0000","last_undegraded":"2024-03-23T06:22:05.103424+0000","last_fullsized":"2024-03-23T06:22:05.103424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.106720+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:22:05.106720+0000","last_peered":"2024-03-23T06:22:05.106720+0000","last_clean":"2024-03-23T06:22:05.106720+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:22:05.106720+0000","last_undegraded":"2024-03-23T06:22:05.106720+0000","last_fullsized":"2024-03-23T06:22:05.106720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.438685+0000","last_change":"2024-03-23T06:22:48.438794+0000","last_active":"2024-03-23T06:22:48.438685+0000","last_peered":"2024-03-23T06:22:48.438685+0000","last_clean":"2024-03-23T06:22:48.438685+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:22:48.438685+0000","last_undegraded":"2024-03-23T06:22:48.438685+0000","last_fullsized":"2024-03-23T06:22:48.438685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:48.438650+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:48.438650+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.438650+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:28:09.247927+0000","scrub_duration":0.0023472229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.386651+0000","last_change":"2024-03-23T06:22:24.386758+0000","last_active":"2024-03-23T06:22:24.386651+0000","last_peered":"2024-03-23T06:22:24.386651+0000","last_clean":"2024-03-23T06:22:24.386651+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:22:24.386651+0000","last_undegraded":"2024-03-23T06:22:24.386651+0000","last_fullsized":"2024-03-23T06:22:24.386651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.386615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:00:08.664042+0000","scrub_duration":0.001409698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.440089+0000","last_change":"2024-03-23T06:22:19.440191+0000","last_active":"2024-03-23T06:22:19.440089+0000","last_peered":"2024-03-23T06:22:19.440089+0000","last_clean":"2024-03-23T06:22:19.440089+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:22:19.440089+0000","last_undegraded":"2024-03-23T06:22:19.440089+0000","last_fullsized":"2024-03-23T06:22:19.440089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.440064+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:38:00.327848+0000","scrub_duration":0.0063548980000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.580201+0000","last_change":"2024-03-23T06:22:32.580405+0000","last_active":"2024-03-23T06:22:32.580201+0000","last_peered":"2024-03-23T06:22:32.580201+0000","last_clean":"2024-03-23T06:22:32.580201+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:22:32.580201+0000","last_undegraded":"2024-03-23T06:22:32.580201+0000","last_fullsized":"2024-03-23T06:22:32.580201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:32.580152+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:32.580152+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.580152+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:40.490005+0000","scrub_duration":0.0034550919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.616396+0000","last_change":"2024-03-23T06:22:29.616594+0000","last_active":"2024-03-23T06:22:29.616396+0000","last_peered":"2024-03-23T06:22:29.616396+0000","last_clean":"2024-03-23T06:22:29.616396+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:22:29.616396+0000","last_undegraded":"2024-03-23T06:22:29.616396+0000","last_fullsized":"2024-03-23T06:22:29.616396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:29.616345+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:29.616345+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.616345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:37:40.215388+0000","scrub_duration":0.0029405429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'28","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.553208+0000","last_change":"2024-03-23T06:22:45.553313+0000","last_active":"2024-03-23T06:22:45.553208+0000","last_peered":"2024-03-23T06:22:45.553208+0000","last_clean":"2024-03-23T06:22:45.553208+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:22:45.553208+0000","last_undegraded":"2024-03-23T06:22:45.553208+0000","last_fullsized":"2024-03-23T06:22:45.553208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T06:22:45.553173+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T06:22:45.553173+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.553173+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:02:25.066585+0000","scrub_duration":0.0023626020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.430836+0000","last_change":"2024-03-23T06:22:36.431118+0000","last_active":"2024-03-23T06:22:36.430836+0000","last_peered":"2024-03-23T06:22:36.430836+0000","last_clean":"2024-03-23T06:22:36.430836+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:22:36.430836+0000","last_undegraded":"2024-03-23T06:22:36.430836+0000","last_fullsized":"2024-03-23T06:22:36.430836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:36.430773+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:36.430773+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.430773+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:30.283889+0000","scrub_duration":0.089320603999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.409452+0000","last_change":"2024-03-23T06:22:47.409530+0000","last_active":"2024-03-23T06:22:47.409452+0000","last_peered":"2024-03-23T06:22:47.409452+0000","last_clean":"2024-03-23T06:22:47.409452+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:22:47.409452+0000","last_undegraded":"2024-03-23T06:22:47.409452+0000","last_fullsized":"2024-03-23T06:22:47.409452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:47.409432+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:47.409432+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.409432+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:48.032843+0000","scrub_duration":0.0021214770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.660512+0000","last_change":"2024-03-23T06:22:36.660657+0000","last_active":"2024-03-23T06:22:36.660512+0000","last_peered":"2024-03-23T06:22:36.660512+0000","last_clean":"2024-03-23T06:22:36.660512+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:22:36.660512+0000","last_undegraded":"2024-03-23T06:22:36.660512+0000","last_fullsized":"2024-03-23T06:22:36.660512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:36.660474+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:36.660474+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.660474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:09:05.409598+0000","scrub_duration":0.0021533379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.918359+0000","last_change":"2024-03-23T06:22:26.918359+0000","last_active":"2024-03-23T06:22:26.918359+0000","last_peered":"2024-03-23T06:22:26.918359+0000","last_clean":"2024-03-23T06:22:26.918359+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:22:26.918359+0000","last_undegraded":"2024-03-23T06:22:26.918359+0000","last_fullsized":"2024-03-23T06:22:26.918359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.918218+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:31:45.597928+0000","scrub_duration":0.0018645039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:42.561975+0000","last_change":"2024-03-23T06:22:42.562121+0000","last_active":"2024-03-23T06:22:42.561975+0000","last_peered":"2024-03-23T06:22:42.561975+0000","last_clean":"2024-03-23T06:22:42.561975+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:22:42.561975+0000","last_undegraded":"2024-03-23T06:22:42.561975+0000","last_fullsized":"2024-03-23T06:22:42.561975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:42.561881+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:42.561881+0000","last_clean_scrub_stamp":"2024-03-23T06:22:42.561881+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:15:32.590635+0000","scrub_duration":0.014718835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.845004+0000","last_change":"2024-03-23T06:22:22.845326+0000","last_active":"2024-03-23T06:22:22.845004+0000","last_peered":"2024-03-23T06:22:22.845004+0000","last_clean":"2024-03-23T06:22:22.845004+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:22:22.845004+0000","last_undegraded":"2024-03-23T06:22:22.845004+0000","last_fullsized":"2024-03-23T06:22:22.845004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.844870+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:07.539336+0000","scrub_duration":0.002224925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'16","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:14.305222+0000","last_change":"2024-03-23T06:22:14.305222+0000","last_active":"2024-03-23T06:22:14.305222+0000","last_peered":"2024-03-23T06:22:14.305222+0000","last_clean":"2024-03-23T06:22:14.305222+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:22:14.305222+0000","last_undegraded":"2024-03-23T06:22:14.305222+0000","last_fullsized":"2024-03-23T06:22:14.305222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_clean_scrub_stamp":"2024-03-23T06:22:14.305062+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:19:26.641546+0000","scrub_duration":0.0018171369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:53.369348+0000","last_change":"2024-03-23T06:22:53.369423+0000","last_active":"2024-03-23T06:22:53.369348+0000","last_peered":"2024-03-23T06:22:53.369348+0000","last_clean":"2024-03-23T06:22:53.369348+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:22:53.369348+0000","last_undegraded":"2024-03-23T06:22:53.369348+0000","last_fullsized":"2024-03-23T06:22:53.369348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:53.369329+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:53.369329+0000","last_clean_scrub_stamp":"2024-03-23T06:22:53.369329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:49:10.218405+0000","scrub_duration":0.0014024619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.674290+0000","last_change":"2024-03-23T06:22:41.674403+0000","last_active":"2024-03-23T06:22:41.674290+0000","last_peered":"2024-03-23T06:22:41.674290+0000","last_clean":"2024-03-23T06:22:41.674290+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:22:41.674290+0000","last_undegraded":"2024-03-23T06:22:41.674290+0000","last_fullsized":"2024-03-23T06:22:41.674290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:41.674268+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:41.674268+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.674268+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:21:40.044887+0000","scrub_duration":0.086211794999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88812204,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2360,"num_write_kb":88570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177624408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2423,"ondisk_log_size":2423,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542300,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1363056,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1325886,"kb_avail":93008784,"statfs":{"total":96636764160,"available":95240994816,"internally_reserved":0,"allocated":38051840,"data_stored":37867372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1357707720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":6.492,"15min":4.7000000000000002},"min":{"1min":0.43099999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":9.6159999999999997,"5min":170.84299999999999,"15min":309.57499999999999},"last":1.2},{"interface":"front","average":{"1min":1.633,"5min":6.1420000000000003,"15min":4.5910000000000002},"min":{"1min":0.54000000000000004,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":7.4489999999999998,"5min":178.934,"15min":300.98500000000001},"last":1.488}]},{"osd":1,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.5190000000000001,"5min":9.6910000000000007,"15min":5.4710000000000001},"min":{"1min":0.51300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":12.593999999999999,"5min":359.48599999999999,"15min":359.48599999999999},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.488,"5min":8.4410000000000007,"15min":5.0999999999999996},"min":{"1min":0.51300000000000001,"5min":0.29899999999999999,"15min":0.28899999999999998},"max":{"1min":4.4580000000000002,"5min":359.20299999999997,"15min":359.20299999999997},"last":1.788}]},{"osd":2,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":7.21,"15min":4.5289999999999999},"min":{"1min":0.60799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":12.273999999999999,"5min":56.805999999999997,"15min":58.277000000000001},"last":1.6100000000000001},{"interface":"front","average":{"1min":2.4809999999999999,"5min":8.4540000000000006,"15min":5.2050000000000001},"min":{"1min":0.65000000000000002,"5min":0.52100000000000002,"15min":0.32900000000000001},"max":{"1min":12.347,"5min":89.454999999999998,"15min":119.176},"last":1.8480000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":1.9930000000000001,"5min":5.835,"15min":3.2509999999999999},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.605,"5min":36.270000000000003,"15min":36.270000000000003},"last":0.879},{"interface":"front","average":{"1min":2.0329999999999999,"5min":6.4989999999999997,"15min":3.9460000000000002},"min":{"1min":0.627,"5min":0.48499999999999999,"15min":0.32800000000000001},"max":{"1min":12.708,"5min":38.718000000000004,"15min":64.325000000000003},"last":1.321}]},{"osd":5,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.2650000000000001,"5min":6.3109999999999999,"15min":3.8700000000000001},"min":{"1min":0.58999999999999997,"5min":0.46100000000000002,"15min":0.36299999999999999},"max":{"1min":12.76,"5min":38.759999999999998,"15min":58.317},"last":1.46},{"interface":"front","average":{"1min":2.2799999999999998,"5min":5.875,"15min":3.6179999999999999},"min":{"1min":0.77200000000000002,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":12.794,"5min":33.854999999999997,"15min":33.854999999999997},"last":1.0609999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":6.1989999999999998,"15min":3.7829999999999999},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.116,"5min":29.777000000000001,"15min":31.623999999999999},"last":1.157},{"interface":"front","average":{"1min":1.645,"5min":5.8620000000000001,"15min":3.2850000000000001},"min":{"1min":0.67000000000000004,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":5.7359999999999998,"5min":37.179000000000002,"15min":37.179000000000002},"last":1.538}]},{"osd":7,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":7.4889999999999999,"15min":4.3090000000000002},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":11.808999999999999,"5min":38.621000000000002,"15min":58.344000000000001},"last":1.234},{"interface":"front","average":{"1min":2.8109999999999999,"5min":6.931,"15min":3.7799999999999998},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":11.846,"5min":38.680999999999997,"15min":38.680999999999997},"last":1.389}]}]},{"osd":2,"up_from":14,"seq":60129542300,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":4.9050000000000002,"15min":3.831},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":5.4939999999999998,"5min":49.142000000000003,"15min":126.152},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.224,"5min":4.2370000000000001,"15min":3.2690000000000001},"min":{"1min":0.40500000000000003,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":5.9589999999999996,"5min":29.206,"15min":143.14099999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":2.387,"5min":6.4160000000000004,"15min":4.4349999999999996},"min":{"1min":0.48999999999999999,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":15.194000000000001,"5min":55.564999999999998,"15min":55.564999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.359,"5min":6.7750000000000004,"15min":3.835},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":6.0049999999999999,"5min":55.354999999999997,"15min":55.354999999999997},"last":0.96799999999999997}]},{"osd":3,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":15.656000000000001,"15min":7.5529999999999999},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.27600000000000002},"max":{"1min":12.198,"5min":529.81799999999998,"15min":529.81799999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":2.1549999999999998,"5min":11.345000000000001,"15min":5.8490000000000002},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":10.757,"5min":528.94200000000001,"15min":528.94200000000001},"last":1.3680000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":6.1520000000000001,"15min":3.4359999999999999},"min":{"1min":0.40899999999999997,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":5.7649999999999997,"5min":49.430999999999997,"15min":49.430999999999997},"last":1.196},{"interface":"front","average":{"1min":1.319,"5min":7.4089999999999998,"15min":4.5410000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.312},"max":{"1min":5.8639999999999999,"5min":60.298000000000002,"15min":83.525999999999996},"last":1.0649999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":5.7759999999999998,"15min":3.988},"min":{"1min":0.52100000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":5.8979999999999997,"5min":35.433999999999997,"15min":82.456000000000003},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.488,"5min":5.8710000000000004,"15min":3.7810000000000001},"min":{"1min":0.51000000000000001,"5min":0.439,"15min":0.35199999999999998},"max":{"1min":5.9290000000000003,"5min":35.472999999999999,"15min":82.971000000000004},"last":1.153}]},{"osd":6,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":5.782,"15min":3.6669999999999998},"min":{"1min":0.60299999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.9539999999999997,"5min":57.420999999999999,"15min":83.007999999999996},"last":1.091},{"interface":"front","average":{"1min":1.6719999999999999,"5min":5.9779999999999998,"15min":3.657},"min":{"1min":0.56799999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.204000000000001,"5min":49.768000000000001,"15min":49.768000000000001},"last":1.286}]},{"osd":7,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":6.3410000000000002,"15min":4.3049999999999997},"min":{"1min":0.63700000000000001,"5min":0.51400000000000001,"15min":0.35099999999999998},"max":{"1min":5.8159999999999998,"5min":43.113,"15min":77.353999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.492,"5min":6.9809999999999999,"15min":4.2759999999999998},"min":{"1min":0.51800000000000002,"5min":0.44900000000000001,"15min":0.38},"max":{"1min":5.8339999999999996,"5min":69.606999999999999,"15min":83.406999999999996},"last":1.024}]}]},{"osd":1,"up_from":14,"seq":60129542302,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":3.5470000000000002,"15min":2.8149999999999999},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.221},"max":{"1min":1.484,"5min":38.363,"15min":70.713999999999999},"last":1.258},{"interface":"front","average":{"1min":1.1379999999999999,"5min":3.9529999999999998,"15min":2.7010000000000001},"min":{"1min":0.48299999999999998,"5min":0.247,"15min":0.247},"max":{"1min":5.7389999999999999,"5min":30.41,"15min":30.41},"last":1.079}]},{"osd":2,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":7.2889999999999997,"15min":4.5990000000000002},"min":{"1min":0.432,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0910000000000002,"5min":127.342,"15min":127.342},"last":1.413},{"interface":"front","average":{"1min":1.3819999999999999,"5min":5.5220000000000002,"15min":4.2629999999999999},"min":{"1min":0.46500000000000002,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":5.1210000000000004,"5min":107.748,"15min":107.748},"last":1.466}]},{"osd":3,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":5.8600000000000003,"15min":4.0119999999999996},"min":{"1min":0.505,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":4.2649999999999997,"5min":31.780000000000001,"15min":31.780000000000001},"last":1.321},{"interface":"front","average":{"1min":1.7070000000000001,"5min":4.5839999999999996,"15min":4.0449999999999999},"min":{"1min":0.45100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.835000000000001,"5min":31.821999999999999,"15min":175.29300000000001},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":4.101,"15min":3.1600000000000001},"min":{"1min":0.56000000000000005,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":4.21,"5min":24.856999999999999,"15min":78.060000000000002},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.361,"5min":4.5519999999999996,"15min":3.1619999999999999},"min":{"1min":0.53200000000000003,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":4.2359999999999998,"5min":26.184999999999999,"15min":80.959999999999994},"last":1.1259999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":4.3460000000000001,"15min":3.262},"min":{"1min":0.52100000000000002,"5min":0.37,"15min":0.35899999999999999},"max":{"1min":3.3450000000000002,"5min":23.234000000000002,"15min":70.670000000000002},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.2010000000000001,"5min":4.0069999999999997,"15min":2.7010000000000001},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":3.1509999999999998,"5min":26.341000000000001,"15min":30.431000000000001},"last":1.169}]},{"osd":6,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":5.4779999999999998,"15min":3.3079999999999998},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.375},"max":{"1min":4.3230000000000004,"5min":40.606999999999999,"15min":40.606999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.4470000000000001,"5min":5.2670000000000003,"15min":3.6230000000000002},"min":{"1min":0.57999999999999996,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.1749999999999998,"5min":36.905999999999999,"15min":68.369},"last":1.3720000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":5.6680000000000001,"15min":3.9870000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":5.6660000000000004,"5min":31.044,"15min":90.965999999999994},"last":1.222},{"interface":"front","average":{"1min":1.7509999999999999,"5min":6.3369999999999997,"15min":4.1520000000000001},"min":{"1min":0.54400000000000004,"5min":0.48099999999999998,"15min":0.38700000000000001},"max":{"1min":5.6970000000000001,"5min":35.256,"15min":84.465000000000003},"last":1.335}]}]},{"osd":0,"up_from":14,"seq":60129542305,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":11.427,"15min":5.3700000000000001},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.773,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.746},{"interface":"front","average":{"1min":1.3879999999999999,"5min":5.3680000000000003,"15min":3.1360000000000001},"min":{"1min":0.47199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":7.1449999999999996,"5min":76.515000000000001,"15min":76.515000000000001},"last":0.623}]},{"osd":2,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":5.766,"15min":3.484},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.33300000000000002},"max":{"1min":10.554,"5min":58.996000000000002,"15min":58.996000000000002},"last":1.133},{"interface":"front","average":{"1min":1.337,"5min":4.2939999999999996,"15min":3.5579999999999998},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.9089999999999998,"5min":50.271000000000001,"15min":62.466000000000001},"last":0.97899999999999998}]},{"osd":3,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":5.1989999999999998,"15min":3.569},"min":{"1min":0.57699999999999996,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.4400000000000004,"5min":44.116999999999997,"15min":44.360999999999997},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.655,"5min":5.3209999999999997,"15min":3.4750000000000001},"min":{"1min":0.55800000000000005,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":9.9160000000000004,"5min":44.212000000000003,"15min":81.251000000000005},"last":0.84699999999999998}]},{"osd":4,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":6.516,"15min":3.258},"min":{"1min":0.71799999999999997,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":2.5190000000000001,"5min":72.588999999999999,"15min":72.588999999999999},"last":0.88},{"interface":"front","average":{"1min":1.3759999999999999,"5min":5.9459999999999997,"15min":3.3570000000000002},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.9660000000000002,"5min":69.566000000000003,"15min":69.566000000000003},"last":1.0700000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":5.9450000000000003,"15min":3.2050000000000001},"min":{"1min":0.755,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":7.1890000000000001,"5min":72.552000000000007,"15min":72.552000000000007},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.6930000000000001,"5min":5.3949999999999996,"15min":3.1070000000000002},"min":{"1min":0.80800000000000005,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":7.2190000000000003,"5min":72.626999999999995,"15min":72.626999999999995},"last":1.1779999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":4.718,"15min":2.923},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":3.2160000000000002,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.4810000000000001,"5min":5.4530000000000003,"15min":3.1440000000000001},"min":{"1min":0.75800000000000001,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":3.8159999999999998,"5min":72.656999999999996,"15min":72.656999999999996},"last":1.3999999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":6.0810000000000004,"15min":3.383},"min":{"1min":0.40699999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.653,"5min":69.662000000000006,"15min":69.662000000000006},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":4.9240000000000004,"15min":2.9620000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.38700000000000001},"max":{"1min":2.6840000000000002,"5min":69.632000000000005,"15min":69.632000000000005},"last":1.2290000000000001}]}]},{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":3.6920000000000002,"15min":2.3029999999999999},"min":{"1min":0.34699999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":4.4470000000000001,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":3.347,"15min":2.0449999999999999},"min":{"1min":0.30199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":2.706,"5min":33.662999999999997,"15min":42.582000000000001},"last":0.86299999999999999}]},{"osd":1,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":6.79,"15min":4.2699999999999996},"min":{"1min":0.38800000000000001,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":2.806,"5min":95.497,"15min":310.09300000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":6.867,"15min":4.3200000000000003},"min":{"1min":0.318,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.8740000000000001,"5min":95.531999999999996,"15min":309.70999999999998},"last":0.75}]},{"osd":2,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":3.8380000000000001,"15min":2.544},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":4.976,"5min":33.454999999999998,"15min":63.014000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.95699999999999996,"5min":4.407,"15min":3.0009999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.9169999999999998,"5min":32.755000000000003,"15min":73.218000000000004},"last":0.63300000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":6.4009999999999998,"15min":3.331},"min":{"1min":0.372,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":5.2249999999999996,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":1.556,"5min":4.617,"15min":2.7970000000000002},"min":{"1min":0.51600000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":8.7590000000000003,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.66000000000000003}]},{"osd":4,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":5.1420000000000003,"15min":2.246},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.46600000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":5.3289999999999997,"15min":2.2480000000000002},"min":{"1min":0.27700000000000002,"5min":0.224,"15min":0.224},"max":{"1min":2.8439999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.35799999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":4.4269999999999996,"15min":1.9219999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":4.5609999999999999,"5min":35.884,"15min":35.884},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":4.8209999999999997,"15min":2.0630000000000002},"min":{"1min":0.26600000000000001,"5min":0.254,"15min":0.24399999999999999},"max":{"1min":2.899,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.377}]},{"osd":6,"last update":"Sat Mar 23 06:22:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":3.6259999999999999,"15min":1.742},"min":{"1min":0.27000000000000002,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":2.6160000000000001,"5min":32.799999999999997,"15min":32.799999999999997},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":3.79,"15min":1.7470000000000001},"min":{"1min":0.308,"5min":0.29699999999999999,"15min":0.28599999999999998},"max":{"1min":2.6579999999999999,"5min":32.853000000000002,"15min":32.853000000000002},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834575008,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":2.4399999999999999,"15min":1.7969999999999999},"min":{"1min":0.372,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":3.4660000000000002,"5min":34.573999999999998,"15min":47.136000000000003},"last":0.504},{"interface":"front","average":{"1min":0.93200000000000005,"5min":3.1960000000000002,"15min":2.1150000000000002},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":4.9619999999999997,"5min":34.573,"15min":43.140000000000001},"last":0.72799999999999998}]},{"osd":1,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":3.016,"15min":2.7829999999999999},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":5.976,"5min":77.959000000000003,"15min":96.375},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":4.5330000000000004,"15min":3.4020000000000001},"min":{"1min":0.308,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.6779999999999999,"5min":96.034000000000006,"15min":96.034000000000006},"last":0.40400000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":3.2320000000000002,"15min":3.3849999999999998},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.95799999999999996,"5min":39.534999999999997,"15min":91.947999999999993},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":3.9249999999999998,"15min":3.202},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.964,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":4.8550000000000004,"15min":3.6829999999999998},"min":{"1min":0.41899999999999998,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":7.7569999999999997,"5min":73.837000000000003,"15min":107.29000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.48,"5min":4.9199999999999999,"15min":3.8149999999999999},"min":{"1min":0.39400000000000002,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":14.351000000000001,"5min":73.692999999999998,"15min":107.27200000000001},"last":0.81000000000000005}]},{"osd":4,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":4.4900000000000002,"15min":2.157},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":5.1139999999999999,"5min":45.302,"15min":45.302},"last":0.314},{"interface":"front","average":{"1min":0.65400000000000003,"5min":4.5609999999999999,"15min":2.2170000000000001},"min":{"1min":0.314,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":5.1369999999999996,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.39400000000000002}]},{"osd":5,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":4.0659999999999998,"15min":1.857},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.8129999999999997,"5min":39.625,"15min":39.625},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.621,"5min":3.2250000000000001,"15min":1.6830000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":5.1609999999999996,"5min":37.686,"15min":37.686},"last":0.35699999999999998}]},{"osd":7,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":3.117,"15min":1.649},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.419,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.38},{"interface":"front","average":{"1min":0.63400000000000001,"5min":3.2170000000000001,"15min":1.5780000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":5.0759999999999996,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.372}]}]},{"osd":5,"up_from":13,"seq":55834575010,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26601250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":2.7730000000000001,"15min":1.663},"min":{"1min":0.28299999999999997,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":2.8959999999999999,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.499},{"interface":"front","average":{"1min":0.755,"5min":3.1499999999999999,"15min":1.7450000000000001},"min":{"1min":0.32200000000000001,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":3.1989999999999998,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.63500000000000001}]},{"osd":1,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":4.5709999999999997,"15min":2.3100000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":3.8879999999999999,"5min":69.873999999999995,"15min":69.873999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0109999999999999,"5min":4.625,"15min":2.4100000000000001},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.30099999999999999},"max":{"1min":9.0440000000000005,"5min":50.758000000000003,"15min":50.758000000000003},"last":0.73499999999999999}]},{"osd":2,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":4.3200000000000003,"15min":2.7309999999999999},"min":{"1min":0.35599999999999998,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":2.9689999999999999,"5min":100.931,"15min":100.931},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":5.9039999999999999,"15min":3.1360000000000001},"min":{"1min":0.34599999999999997,"5min":0.253,"15min":0.253},"max":{"1min":5.7279999999999998,"5min":142.041,"15min":142.041},"last":0.37}]},{"osd":3,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":5.3049999999999997,"15min":2.9359999999999999},"min":{"1min":0.34399999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.6360000000000001,"5min":63.905999999999999,"15min":63.905999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":5.524,"15min":3.0299999999999998},"min":{"1min":0.39800000000000002,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":3.6440000000000001,"5min":61.076000000000001,"15min":61.076000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":3.4700000000000002,"15min":1.603},"min":{"1min":0.248,"5min":0.219,"15min":0.219},"max":{"1min":2.5539999999999998,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":3.8370000000000002,"15min":1.7350000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":3.9540000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.45800000000000002}]},{"osd":6,"last update":"Sat Mar 23 06:22:12 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":4.9969999999999999,"15min":2.1120000000000001},"min":{"1min":0.23400000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":3.0209999999999999,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.378},{"interface":"front","average":{"1min":0.48099999999999998,"5min":5.3150000000000004,"15min":2.3260000000000001},"min":{"1min":0.28100000000000003,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":3.3900000000000001,"5min":40.314,"15min":40.314},"last":0.40699999999999997}]},{"osd":7,"last update":"Sat Mar 23 06:22:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":3.859,"15min":1.819},"min":{"1min":0.26900000000000002,"5min":0.26700000000000002,"15min":0.25700000000000001},"max":{"1min":3.8570000000000002,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":4.7720000000000002,"15min":2.0630000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":4.0019999999999998,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.51900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":2.7229999999999999,"15min":1.752},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":13.686,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":2.8450000000000002,"15min":1.901},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.359,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.377}]},{"osd":1,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":4.0389999999999997,"15min":2.7349999999999999},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":3.3370000000000002,"5min":51.387999999999998,"15min":51.387999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":2.8220000000000001,"15min":2.173},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.351,"5min":29.23,"15min":50.207000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":10.051,"15min":4.7119999999999997},"min":{"1min":0.38800000000000001,"5min":0.28399999999999997,"15min":0.26900000000000002},"max":{"1min":6.3780000000000001,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.495},{"interface":"front","average":{"1min":1.022,"5min":9.0939999999999994,"15min":4.226},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":6.2069999999999999,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.67200000000000004}]},{"osd":3,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":4.1289999999999996,"15min":2.7549999999999999},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.99299999999999999,"5min":38.656999999999996,"15min":53.134999999999998},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":5.0910000000000002,"15min":4.3300000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.694,"5min":51.314,"15min":161.191},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":3.4740000000000002,"15min":1.639},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.0960000000000001,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.252},{"interface":"front","average":{"1min":0.432,"5min":3.5390000000000001,"15min":1.7190000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":1.4790000000000001,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.30099999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":6.2350000000000003,"15min":2.637},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.056,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":5.8010000000000002,"15min":2.552},"min":{"1min":0.28499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.089,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.34699999999999998}]},{"osd":7,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":4.8140000000000001,"15min":2.097},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.24299999999999999},"max":{"1min":1.694,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":4.2460000000000004,"15min":1.919},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28999999999999998},"max":{"1min":1.7190000000000001,"5min":51.997,"15min":51.997},"last":0.39100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:22:55.288 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.289 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.289 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.289 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.289 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.289 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.289 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.290 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.290 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.290 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.290 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.290 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.290 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.291 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.291 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.291 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.291 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.291 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.291 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.292 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.292 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.292 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.292 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.292 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:22:55.292 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T06:23:15.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:23:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.496+0000 7f339d800640 1 Processor -- start 2024-03-23T06:23:15.497 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.496+0000 7f339d800640 1 -- start start 2024-03-23T06:23:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f339d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806fc90 0x7f33981573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f339d800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33980c7580 0x7f33980c6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f339d800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33981583a0 con 0x7f339806f8b0 2024-03-23T06:23:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f339d800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3398157920 con 0x7f33980c7580 2024-03-23T06:23:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f339d800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3398157b00 con 0x7f339806fc90 2024-03-23T06:23:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3396a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f339806f8b0 0x7f339815b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:52464/0 (socket says 172.21.15.73:52464) 2024-03-23T06:23:15.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3396a00640 1 -- 172.21.15.73:0/2539670551 learned_addr learned my addr 172.21.15.73:0/2539670551 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:23:15.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3396000640 1 --2- 172.21.15.73:0/2539670551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806fc90 0x7f33981573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:15.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3397400640 1 --2- 172.21.15.73:0/2539670551 >> v2:172.21.15.110:3300/0 conn(0x7f33980c7580 0x7f33980c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:15.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3395600640 1 -- 172.21.15.73:0/2539670551 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047638981 0 0) 0x7f3388001110 con 0x7f339806f8b0 2024-03-23T06:23:15.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3395600640 1 -- 172.21.15.73:0/2539670551 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c003520 con 0x7f339806f8b0 2024-03-23T06:23:15.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3396000640 1 -- 172.21.15.73:0/2539670551 >> v2:172.21.15.110:3300/0 conn(0x7f33980c7580 msgr2=0x7f33980c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3396000640 1 --2- 172.21.15.73:0/2539670551 >> v2:172.21.15.110:3300/0 conn(0x7f33980c7580 0x7f33980c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3396000640 1 -- 172.21.15.73:0/2539670551 >> v1:172.21.15.110:6789/0 conn(0x7f339806f8b0 legacy=0x7f339815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3396000640 1 -- 172.21.15.73:0/2539670551 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398157de0 con 0x7f339806fc90 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.498+0000 7f3397400640 1 --2- 172.21.15.73:0/2539670551 >> v2:172.21.15.110:3300/0 conn(0x7f33980c7580 0x7f33980c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f3396000640 1 --2- 172.21.15.73:0/2539670551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806fc90 0x7f33981573e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33840097a0 tx=0x7f338402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d2a2e8e6405b671 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f3395600640 1 -- 172.21.15.73:0/2539670551 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384030800 con 0x7f339806fc90 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f3395600640 1 -- 172.21.15.73:0/2539670551 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3384030960 con 0x7f339806fc90 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f3395600640 1 -- 172.21.15.73:0/2539670551 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384030cf0 con 0x7f339806fc90 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f339d800640 1 -- 172.21.15.73:0/2539670551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806fc90 msgr2=0x7f33981573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f339d800640 1 --2- 172.21.15.73:0/2539670551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806fc90 0x7f33981573e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f33840097a0 tx=0x7f338402b940 comp rx=0 tx=0).stop 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f339d800640 1 -- 172.21.15.73:0/2539670551 shutdown_connections 2024-03-23T06:23:15.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f339d800640 1 --2- 172.21.15.73:0/2539670551 >> v2:172.21.15.110:3300/0 conn(0x7f33980c7580 0x7f33980c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f339d800640 1 --2- 172.21.15.73:0/2539670551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806fc90 0x7f33981573e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f339d800640 1 -- 172.21.15.73:0/2539670551 >> 172.21.15.73:0/2539670551 conn(0x7f339806a0a0 msgr2=0x7f3398071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:15.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f339d800640 1 -- 172.21.15.73:0/2539670551 shutdown_connections 2024-03-23T06:23:15.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.500+0000 7f339d800640 1 -- 172.21.15.73:0/2539670551 wait complete. 2024-03-23T06:23:15.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.502+0000 7f339d800640 1 Processor -- start 2024-03-23T06:23:15.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.502+0000 7f339d800640 1 -- start start 2024-03-23T06:23:15.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f339d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806f8b0 0x7f33980c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:15.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f339d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f339806fc90 0x7f33981e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:15.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f339d800640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33980c7580 0x7f33981e4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:15.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f339d800640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398153810 con 0x7f33980c7580 2024-03-23T06:23:15.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f339d800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398155610 con 0x7f339806fc90 2024-03-23T06:23:15.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f339d800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3398154640 con 0x7f339806f8b0 2024-03-23T06:23:15.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f3396000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f339806fc90 0x7f33981e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f3396a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806f8b0 0x7f33980c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f3396000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f339806fc90 0x7f33981e48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:35166/0 (socket says 172.21.15.73:35166) 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f3396000640 1 -- 172.21.15.73:0/3009782825 learned_addr learned my addr 172.21.15.73:0/3009782825 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.503+0000 7f3397400640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33980c7580 0x7f33981e4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f3396000640 1 -- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806f8b0 msgr2=0x7f33980c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f3396000640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806f8b0 0x7f33980c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f3396000640 1 -- 172.21.15.73:0/3009782825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33980c7580 msgr2=0x7f33981e4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f3396000640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33980c7580 0x7f33981e4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f3396000640 1 -- 172.21.15.73:0/3009782825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3390009a70 con 0x7f339806fc90 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f3396a00640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806f8b0 0x7f33980c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f3397400640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33980c7580 0x7f33981e4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:15.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f3396000640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f339806fc90 0x7f33981e48f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f338402bf50 tx=0x7f3384004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:15.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f338ea00640 1 -- 172.21.15.73:0/3009782825 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338403e040 con 0x7f339806fc90 2024-03-23T06:23:15.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f338ea00640 1 -- 172.21.15.73:0/3009782825 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3384039cb0 con 0x7f339806fc90 2024-03-23T06:23:15.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.504+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3384009400 con 0x7f339806fc90 2024-03-23T06:23:15.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.505+0000 7f338ea00640 1 -- 172.21.15.73:0/3009782825 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384044630 con 0x7f339806fc90 2024-03-23T06:23:15.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.505+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3398153d10 con 0x7f339806fc90 2024-03-23T06:23:15.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.506+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339815aaa0 con 0x7f339806fc90 2024-03-23T06:23:15.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.506+0000 7f338ea00640 1 -- 172.21.15.73:0/3009782825 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f338404d3b0 con 0x7f339806fc90 2024-03-23T06:23:15.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.507+0000 7f338ea00640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f337806ac00 0x7f337806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:15.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.507+0000 7f338ea00640 1 -- 172.21.15.73:0/3009782825 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f33840abbe0 con 0x7f339806fc90 2024-03-23T06:23:15.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.508+0000 7f3396a00640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f337806ac00 0x7f337806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:15.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.508+0000 7f3396a00640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f337806ac00 0x7f337806d0c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3388001270 tx=0x7f3388007bb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.511+0000 7f338ea00640 1 -- 172.21.15.73:0/3009782825 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3384076a60 con 0x7f339806fc90 2024-03-23T06:23:15.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.705+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f339815add0 con 0x7f337806ac00 2024-03-23T06:23:15.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.716+0000 7f338ea00640 1 -- 172.21.15.73:0/3009782825 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372581 (secure 0 0 0) 0x7f3388007690 con 0x7f337806ac00 2024-03-23T06:23:15.722 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:23:15.724 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:23:15.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f337806ac00 msgr2=0x7f337806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:15.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f337806ac00 0x7f337806d0c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3388001270 tx=0x7f3388007bb0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f339806fc90 msgr2=0x7f33981e48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f339806fc90 0x7f33981e48f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f338402bf50 tx=0x7f3384004730 comp rx=0 tx=0).stop 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 shutdown_connections 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33980c7580 0x7f33981e4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f339806fc90 0x7f33981e48f0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f338402bf50 tx=0x7f3384004730 comp rx=0 tx=0).stop 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f337806ac00 0x7f337806d0c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 --2- 172.21.15.73:0/3009782825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f339806f8b0 0x7f33980c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.723+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 >> 172.21.15.73:0/3009782825 conn(0x7f339806a0a0 msgr2=0x7f33981505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.724+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 shutdown_connections 2024-03-23T06:23:15.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:15.724+0000 7f339d800640 1 -- 172.21.15.73:0/3009782825 wait complete. 2024-03-23T06:23:15.743 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":425,"stamp":"2024-03-23T06:23:14.836821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402572,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469605,"num_write_kb":34184419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171182,"ondisk_log_size":171182,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10077296,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9900211,"kb_avail":744897424,"statfs":{"total":773094113280,"available":762774962176,"internally_reserved":0,"allocated":181256192,"data_stored":179741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10137816632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"2.1f","version":"27'18","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.234338+0000","last_change":"2024-03-23T06:22:24.234338+0000","last_active":"2024-03-23T06:22:24.234338+0000","last_peered":"2024-03-23T06:22:24.234338+0000","last_clean":"2024-03-23T06:22:24.234338+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:22:24.234338+0000","last_undegraded":"2024-03-23T06:22:24.234338+0000","last_fullsized":"2024-03-23T06:22:24.234338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.234241+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:53.812998+0000","scrub_duration":0.016306496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.301797+0000","last_change":"2024-03-23T06:22:16.301887+0000","last_active":"2024-03-23T06:22:16.301797+0000","last_peered":"2024-03-23T06:22:16.301797+0000","last_clean":"2024-03-23T06:22:16.301797+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:22:16.301797+0000","last_undegraded":"2024-03-23T06:22:16.301797+0000","last_fullsized":"2024-03-23T06:22:16.301797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.301777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:37:55.431944+0000","scrub_duration":0.0022956500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:43.004409+0000","last_change":"2024-03-23T06:22:43.004574+0000","last_active":"2024-03-23T06:22:43.004409+0000","last_peered":"2024-03-23T06:22:43.004409+0000","last_clean":"2024-03-23T06:22:43.004409+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:22:43.004409+0000","last_undegraded":"2024-03-23T06:22:43.004409+0000","last_fullsized":"2024-03-23T06:22:43.004409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4649","last_scrub_stamp":"2024-03-23T06:22:43.004368+0000","last_deep_scrub":"27'4649","last_deep_scrub_stamp":"2024-03-23T06:22:43.004368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:43.004368+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:42:59.644058+0000","scrub_duration":0.043741127999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.340695+0000","last_change":"2024-03-23T06:22:28.340766+0000","last_active":"2024-03-23T06:22:28.340695+0000","last_peered":"2024-03-23T06:22:28.340695+0000","last_clean":"2024-03-23T06:22:28.340695+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:22:28.340695+0000","last_undegraded":"2024-03-23T06:22:28.340695+0000","last_fullsized":"2024-03-23T06:22:28.340695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.340675+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:05:53.500984+0000","scrub_duration":0.0074425539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.402809+0000","last_change":"2024-03-23T06:22:20.402809+0000","last_active":"2024-03-23T06:22:20.402809+0000","last_peered":"2024-03-23T06:22:20.402809+0000","last_clean":"2024-03-23T06:22:20.402809+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:22:20.402809+0000","last_undegraded":"2024-03-23T06:22:20.402809+0000","last_fullsized":"2024-03-23T06:22:20.402809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.402677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:48.099293+0000","scrub_duration":0.064311640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5587,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:38.960781+0000","last_change":"2024-03-23T06:22:38.960973+0000","last_active":"2024-03-23T06:22:38.960781+0000","last_peered":"2024-03-23T06:22:38.960781+0000","last_clean":"2024-03-23T06:22:38.960781+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:22:38.960781+0000","last_undegraded":"2024-03-23T06:22:38.960781+0000","last_fullsized":"2024-03-23T06:22:38.960781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5556","last_scrub_stamp":"2024-03-23T06:22:38.960753+0000","last_deep_scrub":"27'5556","last_deep_scrub_stamp":"2024-03-23T06:22:38.960753+0000","last_clean_scrub_stamp":"2024-03-23T06:22:38.960753+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:01.641630+0000","scrub_duration":0.14834329199999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'165","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.665632+0000","last_change":"2024-03-23T06:22:26.665632+0000","last_active":"2024-03-23T06:22:26.665632+0000","last_peered":"2024-03-23T06:22:26.665632+0000","last_clean":"2024-03-23T06:22:26.665632+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:22:26.665632+0000","last_undegraded":"2024-03-23T06:22:26.665632+0000","last_fullsized":"2024-03-23T06:22:26.665632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.665468+0000","objects_scrubbed":5,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:40:12.950569+0000","scrub_duration":0.059269850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.334167+0000","last_change":"2024-03-23T06:22:41.334291+0000","last_active":"2024-03-23T06:22:41.334167+0000","last_peered":"2024-03-23T06:22:41.334167+0000","last_clean":"2024-03-23T06:22:41.334167+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:22:41.334167+0000","last_undegraded":"2024-03-23T06:22:41.334167+0000","last_fullsized":"2024-03-23T06:22:41.334167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:41.334129+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:41.334129+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.334129+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:09:30.931263+0000","scrub_duration":0.0028427529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5375,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:52.921424+0000","last_change":"2024-03-23T06:22:52.921558+0000","last_active":"2024-03-23T06:22:52.921424+0000","last_peered":"2024-03-23T06:22:52.921424+0000","last_clean":"2024-03-23T06:22:52.921424+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:22:52.921424+0000","last_undegraded":"2024-03-23T06:22:52.921424+0000","last_fullsized":"2024-03-23T06:22:52.921424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5344","last_scrub_stamp":"2024-03-23T06:22:52.921402+0000","last_deep_scrub":"27'5344","last_deep_scrub_stamp":"2024-03-23T06:22:52.921402+0000","last_clean_scrub_stamp":"2024-03-23T06:22:52.921402+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:48.279588+0000","scrub_duration":0.13476870599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:18.622320+0000","last_change":"2024-03-23T06:22:18.622320+0000","last_active":"2024-03-23T06:22:18.622320+0000","last_peered":"2024-03-23T06:22:18.622320+0000","last_clean":"2024-03-23T06:22:18.622320+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:22:18.622320+0000","last_undegraded":"2024-03-23T06:22:18.622320+0000","last_fullsized":"2024-03-23T06:22:18.622320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_clean_scrub_stamp":"2024-03-23T06:22:18.622074+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:17:57.132801+0000","scrub_duration":0.022310751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'29","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.278949+0000","last_change":"2024-03-23T06:22:17.278949+0000","last_active":"2024-03-23T06:22:17.278949+0000","last_peered":"2024-03-23T06:22:17.278949+0000","last_clean":"2024-03-23T06:22:17.278949+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:22:17.278949+0000","last_undegraded":"2024-03-23T06:22:17.278949+0000","last_fullsized":"2024-03-23T06:22:17.278949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.278677+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:35:44.193734+0000","scrub_duration":0.003489125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.904915+0000","last_change":"2024-03-23T06:22:51.905102+0000","last_active":"2024-03-23T06:22:51.904915+0000","last_peered":"2024-03-23T06:22:51.904915+0000","last_clean":"2024-03-23T06:22:51.904915+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:22:51.904915+0000","last_undegraded":"2024-03-23T06:22:51.904915+0000","last_fullsized":"2024-03-23T06:22:51.904915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5087","last_scrub_stamp":"2024-03-23T06:22:51.904869+0000","last_deep_scrub":"27'5087","last_deep_scrub_stamp":"2024-03-23T06:22:51.904869+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.904869+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:40:20.756701+0000","scrub_duration":0.071307104999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.263737+0000","last_change":"2024-03-23T06:22:27.263737+0000","last_active":"2024-03-23T06:22:27.263737+0000","last_peered":"2024-03-23T06:22:27.263737+0000","last_clean":"2024-03-23T06:22:27.263737+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:22:27.263737+0000","last_undegraded":"2024-03-23T06:22:27.263737+0000","last_fullsized":"2024-03-23T06:22:27.263737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.263503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:55:00.258025+0000","scrub_duration":0.0032643260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'400","reported_seq":434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:12.156446+0000","last_change":"2024-03-23T06:23:12.156575+0000","last_active":"2024-03-23T06:23:12.156446+0000","last_peered":"2024-03-23T06:23:12.156446+0000","last_clean":"2024-03-23T06:23:12.156446+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:23:12.156446+0000","last_undegraded":"2024-03-23T06:23:12.156446+0000","last_fullsized":"2024-03-23T06:23:12.156446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'400","last_scrub_stamp":"2024-03-23T06:23:12.156412+0000","last_deep_scrub":"27'400","last_deep_scrub_stamp":"2024-03-23T06:23:12.156412+0000","last_clean_scrub_stamp":"2024-03-23T06:23:12.156412+0000","objects_scrubbed":3,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:26:49.154275+0000","scrub_duration":0.033636777999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.212676+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:21:28.212676+0000","last_peered":"2024-03-23T06:21:28.212676+0000","last_clean":"2024-03-23T06:21:28.212676+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:21:28.212676+0000","last_undegraded":"2024-03-23T06:21:28.212676+0000","last_fullsized":"2024-03-23T06:21:28.212676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.117390+0000","last_change":"2024-03-23T06:22:25.117488+0000","last_active":"2024-03-23T06:22:25.117390+0000","last_peered":"2024-03-23T06:22:25.117390+0000","last_clean":"2024-03-23T06:22:25.117390+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:22:25.117390+0000","last_undegraded":"2024-03-23T06:22:25.117390+0000","last_fullsized":"2024-03-23T06:22:25.117390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.117368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:18:30.718640+0000","scrub_duration":0.020924191000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:13.438725+0000","last_change":"2024-03-23T06:22:13.438725+0000","last_active":"2024-03-23T06:22:13.438725+0000","last_peered":"2024-03-23T06:22:13.438725+0000","last_clean":"2024-03-23T06:22:13.438725+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:22:13.438725+0000","last_undegraded":"2024-03-23T06:22:13.438725+0000","last_fullsized":"2024-03-23T06:22:13.438725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_clean_scrub_stamp":"2024-03-23T06:22:13.438631+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:34:21.050171+0000","scrub_duration":0.001784012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5264,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.647795+0000","last_change":"2024-03-23T06:22:47.647951+0000","last_active":"2024-03-23T06:22:47.647795+0000","last_peered":"2024-03-23T06:22:47.647795+0000","last_clean":"2024-03-23T06:22:47.647795+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:22:47.647795+0000","last_undegraded":"2024-03-23T06:22:47.647795+0000","last_fullsized":"2024-03-23T06:22:47.647795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5233","last_scrub_stamp":"2024-03-23T06:22:47.647769+0000","last_deep_scrub":"27'5233","last_deep_scrub_stamp":"2024-03-23T06:22:47.647769+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.647769+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:17:44.076130+0000","scrub_duration":0.091590610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'19","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.087701+0000","last_change":"2024-03-23T06:22:45.087701+0000","last_active":"2024-03-23T06:22:45.087701+0000","last_peered":"2024-03-23T06:22:45.087701+0000","last_clean":"2024-03-23T06:22:45.087701+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:22:45.087701+0000","last_undegraded":"2024-03-23T06:22:45.087701+0000","last_fullsized":"2024-03-23T06:22:45.087701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:45.087612+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:45.087612+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.087612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:01:32.916486+0000","scrub_duration":0.001285736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.301934+0000","last_change":"2024-03-23T06:22:22.301934+0000","last_active":"2024-03-23T06:22:22.301934+0000","last_peered":"2024-03-23T06:22:22.301934+0000","last_clean":"2024-03-23T06:22:22.301934+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:22:22.301934+0000","last_undegraded":"2024-03-23T06:22:22.301934+0000","last_fullsized":"2024-03-23T06:22:22.301934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.301822+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:51:57.846454+0000","scrub_duration":0.0052301179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6048,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.010347+0000","last_change":"2024-03-23T06:22:41.010512+0000","last_active":"2024-03-23T06:22:41.010347+0000","last_peered":"2024-03-23T06:22:41.010347+0000","last_clean":"2024-03-23T06:22:41.010347+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:22:41.010347+0000","last_undegraded":"2024-03-23T06:22:41.010347+0000","last_fullsized":"2024-03-23T06:22:41.010347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6017","last_scrub_stamp":"2024-03-23T06:22:41.010309+0000","last_deep_scrub":"27'6017","last_deep_scrub_stamp":"2024-03-23T06:22:41.010309+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.010309+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:49:02.530772+0000","scrub_duration":0.049541337999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:34.230582+0000","last_change":"2024-03-23T06:22:34.230582+0000","last_active":"2024-03-23T06:22:34.230582+0000","last_peered":"2024-03-23T06:22:34.230582+0000","last_clean":"2024-03-23T06:22:34.230582+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:22:34.230582+0000","last_undegraded":"2024-03-23T06:22:34.230582+0000","last_fullsized":"2024-03-23T06:22:34.230582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:34.230436+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:34.230436+0000","last_clean_scrub_stamp":"2024-03-23T06:22:34.230436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:09:56.885484+0000","scrub_duration":0.0018145329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.434207+0000","last_change":"2024-03-23T06:22:12.434207+0000","last_active":"2024-03-23T06:22:12.434207+0000","last_peered":"2024-03-23T06:22:12.434207+0000","last_clean":"2024-03-23T06:22:12.434207+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:22:12.434207+0000","last_undegraded":"2024-03-23T06:22:12.434207+0000","last_fullsized":"2024-03-23T06:22:12.434207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_clean_scrub_stamp":"2024-03-23T06:22:12.434048+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:01:00.920036+0000","scrub_duration":0.016801480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.905567+0000","last_change":"2024-03-23T06:22:48.905761+0000","last_active":"2024-03-23T06:22:48.905567+0000","last_peered":"2024-03-23T06:22:48.905567+0000","last_clean":"2024-03-23T06:22:48.905567+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:22:48.905567+0000","last_undegraded":"2024-03-23T06:22:48.905567+0000","last_fullsized":"2024-03-23T06:22:48.905567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4163","last_scrub_stamp":"2024-03-23T06:22:48.905532+0000","last_deep_scrub":"27'4163","last_deep_scrub_stamp":"2024-03-23T06:22:48.905532+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.905532+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:08:02.183029+0000","scrub_duration":0.107138319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.083203+0000","last_change":"2024-03-23T06:22:41.083203+0000","last_active":"2024-03-23T06:22:41.083203+0000","last_peered":"2024-03-23T06:22:41.083203+0000","last_clean":"2024-03-23T06:22:41.083203+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:22:41.083203+0000","last_undegraded":"2024-03-23T06:22:41.083203+0000","last_fullsized":"2024-03-23T06:22:41.083203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:41.083112+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:41.083112+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.083112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:51:20.359506+0000","scrub_duration":0.0017080439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'13","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.081197+0000","last_change":"2024-03-23T06:22:48.081197+0000","last_active":"2024-03-23T06:22:48.081197+0000","last_peered":"2024-03-23T06:22:48.081197+0000","last_clean":"2024-03-23T06:22:48.081197+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:22:48.081197+0000","last_undegraded":"2024-03-23T06:22:48.081197+0000","last_fullsized":"2024-03-23T06:22:48.081197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:48.080936+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:48.080936+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.080936+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:55:08.878167+0000","scrub_duration":0.0060221670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:54.837921+0000","last_change":"2024-03-23T06:22:54.838104+0000","last_active":"2024-03-23T06:22:54.837921+0000","last_peered":"2024-03-23T06:22:54.837921+0000","last_clean":"2024-03-23T06:22:54.837921+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:22:54.837921+0000","last_undegraded":"2024-03-23T06:22:54.837921+0000","last_fullsized":"2024-03-23T06:22:54.837921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6152","last_scrub_stamp":"2024-03-23T06:22:54.837875+0000","last_deep_scrub":"27'6152","last_deep_scrub_stamp":"2024-03-23T06:22:54.837875+0000","last_clean_scrub_stamp":"2024-03-23T06:22:54.837875+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:45:35.567505+0000","scrub_duration":0.079897541000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'17","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.134899+0000","last_change":"2024-03-23T06:22:35.134899+0000","last_active":"2024-03-23T06:22:35.134899+0000","last_peered":"2024-03-23T06:22:35.134899+0000","last_clean":"2024-03-23T06:22:35.134899+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:22:35.134899+0000","last_undegraded":"2024-03-23T06:22:35.134899+0000","last_fullsized":"2024-03-23T06:22:35.134899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:35.134728+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:35.134728+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.134728+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:30.334770+0000","scrub_duration":0.012842018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'99","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.219128+0000","last_change":"2024-03-23T06:22:26.219128+0000","last_active":"2024-03-23T06:22:26.219128+0000","last_peered":"2024-03-23T06:22:26.219128+0000","last_clean":"2024-03-23T06:22:26.219128+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:22:26.219128+0000","last_undegraded":"2024-03-23T06:22:26.219128+0000","last_fullsized":"2024-03-23T06:22:26.219128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_deep_scrub":"27'99","last_deep_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.218984+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:35:47.992609+0000","scrub_duration":0.005800571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4688,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:58.093217+0000","last_change":"2024-03-23T06:22:58.093330+0000","last_active":"2024-03-23T06:22:58.093217+0000","last_peered":"2024-03-23T06:22:58.093217+0000","last_clean":"2024-03-23T06:22:58.093217+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:22:58.093217+0000","last_undegraded":"2024-03-23T06:22:58.093217+0000","last_fullsized":"2024-03-23T06:22:58.093217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4656","last_scrub_stamp":"2024-03-23T06:22:58.093196+0000","last_deep_scrub":"27'4656","last_deep_scrub_stamp":"2024-03-23T06:22:58.093196+0000","last_clean_scrub_stamp":"2024-03-23T06:22:58.093196+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:50:10.092555+0000","scrub_duration":0.041911003000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.408014+0000","last_change":"2024-03-23T06:22:25.408014+0000","last_active":"2024-03-23T06:22:25.408014+0000","last_peered":"2024-03-23T06:22:25.408014+0000","last_clean":"2024-03-23T06:22:25.408014+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:22:25.408014+0000","last_undegraded":"2024-03-23T06:22:25.408014+0000","last_fullsized":"2024-03-23T06:22:25.408014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.407913+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:33:56.177740+0000","scrub_duration":0.0011927579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:04.114557+0000","last_change":"2024-03-23T06:23:04.114785+0000","last_active":"2024-03-23T06:23:04.114557+0000","last_peered":"2024-03-23T06:23:04.114557+0000","last_clean":"2024-03-23T06:23:04.114557+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:23:04.114557+0000","last_undegraded":"2024-03-23T06:23:04.114557+0000","last_fullsized":"2024-03-23T06:23:04.114557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:23:04.114506+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:23:04.114506+0000","last_clean_scrub_stamp":"2024-03-23T06:23:04.114506+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:04.169139+0000","scrub_duration":0.003954384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:38.295151+0000","last_change":"2024-03-23T06:22:38.295151+0000","last_active":"2024-03-23T06:22:38.295151+0000","last_peered":"2024-03-23T06:22:38.295151+0000","last_clean":"2024-03-23T06:22:38.295151+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:22:38.295151+0000","last_undegraded":"2024-03-23T06:22:38.295151+0000","last_fullsized":"2024-03-23T06:22:38.295151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4347","last_scrub_stamp":"2024-03-23T06:22:38.294940+0000","last_deep_scrub":"27'4347","last_deep_scrub_stamp":"2024-03-23T06:22:38.294940+0000","last_clean_scrub_stamp":"2024-03-23T06:22:38.294940+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:07.533511+0000","scrub_duration":0.086332040999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.893219+0000","last_change":"2024-03-23T06:22:24.893219+0000","last_active":"2024-03-23T06:22:24.893219+0000","last_peered":"2024-03-23T06:22:24.893219+0000","last_clean":"2024-03-23T06:22:24.893219+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:22:24.893219+0000","last_undegraded":"2024-03-23T06:22:24.893219+0000","last_fullsized":"2024-03-23T06:22:24.893219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.892857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:06.651897+0000","scrub_duration":0.020052960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.273805+0000","last_change":"2024-03-23T06:22:25.273805+0000","last_active":"2024-03-23T06:22:25.273805+0000","last_peered":"2024-03-23T06:22:25.273805+0000","last_clean":"2024-03-23T06:22:25.273805+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:22:25.273805+0000","last_undegraded":"2024-03-23T06:22:25.273805+0000","last_fullsized":"2024-03-23T06:22:25.273805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.273709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:28:04.429353+0000","scrub_duration":0.001195563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4638,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:39.210898+0000","last_change":"2024-03-23T06:22:39.211048+0000","last_active":"2024-03-23T06:22:39.210898+0000","last_peered":"2024-03-23T06:22:39.210898+0000","last_clean":"2024-03-23T06:22:39.210898+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:22:39.210898+0000","last_undegraded":"2024-03-23T06:22:39.210898+0000","last_fullsized":"2024-03-23T06:22:39.210898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4606","last_scrub_stamp":"2024-03-23T06:22:39.210876+0000","last_deep_scrub":"27'4606","last_deep_scrub_stamp":"2024-03-23T06:22:39.210876+0000","last_clean_scrub_stamp":"2024-03-23T06:22:39.210876+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:47:08.464172+0000","scrub_duration":0.047816294000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:09.438536+0000","last_change":"2024-03-23T06:22:09.438536+0000","last_active":"2024-03-23T06:22:09.438536+0000","last_peered":"2024-03-23T06:22:09.438536+0000","last_clean":"2024-03-23T06:22:09.438536+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:22:09.438536+0000","last_undegraded":"2024-03-23T06:22:09.438536+0000","last_fullsized":"2024-03-23T06:22:09.438536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_clean_scrub_stamp":"2024-03-23T06:22:09.438361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:00:16.089523+0000","scrub_duration":0.017467308000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:55.154933+0000","last_change":"2024-03-23T06:22:55.155049+0000","last_active":"2024-03-23T06:22:55.154933+0000","last_peered":"2024-03-23T06:22:55.154933+0000","last_clean":"2024-03-23T06:22:55.154933+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:22:55.154933+0000","last_undegraded":"2024-03-23T06:22:55.154933+0000","last_fullsized":"2024-03-23T06:22:55.154933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T06:22:55.154898+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T06:22:55.154898+0000","last_clean_scrub_stamp":"2024-03-23T06:22:55.154898+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:21:57.344689+0000","scrub_duration":0.026185948000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5415,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:40.167031+0000","last_change":"2024-03-23T06:22:40.167031+0000","last_active":"2024-03-23T06:22:40.167031+0000","last_peered":"2024-03-23T06:22:40.167031+0000","last_clean":"2024-03-23T06:22:40.167031+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:22:40.167031+0000","last_undegraded":"2024-03-23T06:22:40.167031+0000","last_fullsized":"2024-03-23T06:22:40.167031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5383","last_scrub_stamp":"2024-03-23T06:22:40.166855+0000","last_deep_scrub":"27'5383","last_deep_scrub_stamp":"2024-03-23T06:22:40.166855+0000","last_clean_scrub_stamp":"2024-03-23T06:22:40.166855+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:44:26.975670+0000","scrub_duration":0.050518577000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'22","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.342913+0000","last_change":"2024-03-23T06:22:23.342993+0000","last_active":"2024-03-23T06:22:23.342913+0000","last_peered":"2024-03-23T06:22:23.342913+0000","last_clean":"2024-03-23T06:22:23.342913+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:22:23.342913+0000","last_undegraded":"2024-03-23T06:22:23.342913+0000","last_fullsized":"2024-03-23T06:22:23.342913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.342894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:13:31.019943+0000","scrub_duration":0.001171252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'42","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.117526+0000","last_change":"2024-03-23T06:22:15.117526+0000","last_active":"2024-03-23T06:22:15.117526+0000","last_peered":"2024-03-23T06:22:15.117526+0000","last_clean":"2024-03-23T06:22:15.117526+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:22:15.117526+0000","last_undegraded":"2024-03-23T06:22:15.117526+0000","last_fullsized":"2024-03-23T06:22:15.117526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.117424+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:23:48.285959+0000","scrub_duration":0.003100383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":38,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.348324+0000","last_change":"2024-03-23T06:22:32.348324+0000","last_active":"2024-03-23T06:22:32.348324+0000","last_peered":"2024-03-23T06:22:32.348324+0000","last_clean":"2024-03-23T06:22:32.348324+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:22:32.348324+0000","last_undegraded":"2024-03-23T06:22:32.348324+0000","last_fullsized":"2024-03-23T06:22:32.348324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5513","last_scrub_stamp":"2024-03-23T06:22:32.348185+0000","last_deep_scrub":"27'5513","last_deep_scrub_stamp":"2024-03-23T06:22:32.348185+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.348185+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:49:59.107739+0000","scrub_duration":0.088163792000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.444706+0000","last_change":"2024-03-23T06:22:20.444706+0000","last_active":"2024-03-23T06:22:20.444706+0000","last_peered":"2024-03-23T06:22:20.444706+0000","last_clean":"2024-03-23T06:22:20.444706+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:20.444706+0000","last_undegraded":"2024-03-23T06:22:20.444706+0000","last_fullsized":"2024-03-23T06:22:20.444706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.444597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:38:16.085029+0000","scrub_duration":0.0020820489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'53","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:44.218789+0000","last_change":"2024-03-23T06:22:44.219077+0000","last_active":"2024-03-23T06:22:44.218789+0000","last_peered":"2024-03-23T06:22:44.218789+0000","last_clean":"2024-03-23T06:22:44.218789+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:22:44.218789+0000","last_undegraded":"2024-03-23T06:22:44.218789+0000","last_fullsized":"2024-03-23T06:22:44.218789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-03-23T06:22:44.218735+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-03-23T06:22:44.218735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:44.218735+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:16.319369+0000","scrub_duration":0.032610752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:07.609335+0000","last_change":"2024-03-23T06:23:07.609462+0000","last_active":"2024-03-23T06:23:07.609335+0000","last_peered":"2024-03-23T06:23:07.609335+0000","last_clean":"2024-03-23T06:23:07.609335+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:23:07.609335+0000","last_undegraded":"2024-03-23T06:23:07.609335+0000","last_fullsized":"2024-03-23T06:23:07.609335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5332","last_scrub_stamp":"2024-03-23T06:23:07.609314+0000","last_deep_scrub":"27'5332","last_deep_scrub_stamp":"2024-03-23T06:23:07.609314+0000","last_clean_scrub_stamp":"2024-03-23T06:23:07.609314+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:39.820258+0000","scrub_duration":0.046390492999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'14","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:34.131745+0000","last_change":"2024-03-23T06:22:34.131836+0000","last_active":"2024-03-23T06:22:34.131745+0000","last_peered":"2024-03-23T06:22:34.131745+0000","last_clean":"2024-03-23T06:22:34.131745+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:22:34.131745+0000","last_undegraded":"2024-03-23T06:22:34.131745+0000","last_fullsized":"2024-03-23T06:22:34.131745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:34.131727+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:34.131727+0000","last_clean_scrub_stamp":"2024-03-23T06:22:34.131727+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:21:23.166528+0000","scrub_duration":0.001854968,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:52.135634+0000","last_change":"2024-03-23T06:22:52.135840+0000","last_active":"2024-03-23T06:22:52.135634+0000","last_peered":"2024-03-23T06:22:52.135634+0000","last_clean":"2024-03-23T06:22:52.135634+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:22:52.135634+0000","last_undegraded":"2024-03-23T06:22:52.135634+0000","last_fullsized":"2024-03-23T06:22:52.135634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:52.135580+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:52.135580+0000","last_clean_scrub_stamp":"2024-03-23T06:22:52.135580+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:45.624273+0000","scrub_duration":0.0067533489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.434497+0000","last_change":"2024-03-23T06:22:10.434689+0000","last_active":"2024-03-23T06:22:10.434497+0000","last_peered":"2024-03-23T06:22:10.434497+0000","last_clean":"2024-03-23T06:22:10.434497+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:22:10.434497+0000","last_undegraded":"2024-03-23T06:22:10.434497+0000","last_fullsized":"2024-03-23T06:22:10.434497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.434445+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:53:51.345697+0000","scrub_duration":0.011047585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5856,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.240335+0000","last_change":"2024-03-23T06:10:01.980771+0000","last_active":"2024-03-23T06:22:11.240335+0000","last_peered":"2024-03-23T06:22:11.240335+0000","last_clean":"2024-03-23T06:22:11.240335+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:22:11.240335+0000","last_undegraded":"2024-03-23T06:22:11.240335+0000","last_fullsized":"2024-03-23T06:22:11.240335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.264179+0000","last_change":"2024-03-23T06:22:19.264433+0000","last_active":"2024-03-23T06:22:19.264179+0000","last_peered":"2024-03-23T06:22:19.264179+0000","last_clean":"2024-03-23T06:22:19.264179+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:22:19.264179+0000","last_undegraded":"2024-03-23T06:22:19.264179+0000","last_fullsized":"2024-03-23T06:22:19.264179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.264125+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:41:16.245860+0000","scrub_duration":0.0035297940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'10","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.434033+0000","last_change":"2024-03-23T06:22:16.434139+0000","last_active":"2024-03-23T06:22:16.434033+0000","last_peered":"2024-03-23T06:22:16.434033+0000","last_clean":"2024-03-23T06:22:16.434033+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:22:16.434033+0000","last_undegraded":"2024-03-23T06:22:16.434033+0000","last_fullsized":"2024-03-23T06:22:16.434033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.433996+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:13:36.235706+0000","scrub_duration":0.0057335859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:39.907512+0000","last_change":"2024-03-23T06:22:39.907512+0000","last_active":"2024-03-23T06:22:39.907512+0000","last_peered":"2024-03-23T06:22:39.907512+0000","last_clean":"2024-03-23T06:22:39.907512+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:22:39.907512+0000","last_undegraded":"2024-03-23T06:22:39.907512+0000","last_fullsized":"2024-03-23T06:22:39.907512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5251","last_scrub_stamp":"2024-03-23T06:22:39.907179+0000","last_deep_scrub":"27'5251","last_deep_scrub_stamp":"2024-03-23T06:22:39.907179+0000","last_clean_scrub_stamp":"2024-03-23T06:22:39.907179+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:08:53.331286+0000","scrub_duration":0.13370536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.593784+0000","last_change":"2024-03-23T06:22:27.594039+0000","last_active":"2024-03-23T06:22:27.593784+0000","last_peered":"2024-03-23T06:22:27.593784+0000","last_clean":"2024-03-23T06:22:27.593784+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:22:27.593784+0000","last_undegraded":"2024-03-23T06:22:27.593784+0000","last_fullsized":"2024-03-23T06:22:27.593784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.593735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:10.812412+0000","scrub_duration":0.0028611280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'25","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.313526+0000","last_change":"2024-03-23T06:22:24.313601+0000","last_active":"2024-03-23T06:22:24.313526+0000","last_peered":"2024-03-23T06:22:24.313526+0000","last_clean":"2024-03-23T06:22:24.313526+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:22:24.313526+0000","last_undegraded":"2024-03-23T06:22:24.313526+0000","last_fullsized":"2024-03-23T06:22:24.313526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.313505+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:32:44.992621+0000","scrub_duration":0.020603684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:56.512417+0000","last_change":"2024-03-23T06:22:56.512542+0000","last_active":"2024-03-23T06:22:56.512417+0000","last_peered":"2024-03-23T06:22:56.512417+0000","last_clean":"2024-03-23T06:22:56.512417+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:22:56.512417+0000","last_undegraded":"2024-03-23T06:22:56.512417+0000","last_fullsized":"2024-03-23T06:22:56.512417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4796","last_scrub_stamp":"2024-03-23T06:22:56.512396+0000","last_deep_scrub":"27'4796","last_deep_scrub_stamp":"2024-03-23T06:22:56.512396+0000","last_clean_scrub_stamp":"2024-03-23T06:22:56.512396+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:10:20.674579+0000","scrub_duration":0.063493923999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'19","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.691023+0000","last_change":"2024-03-23T06:22:35.691338+0000","last_active":"2024-03-23T06:22:35.691023+0000","last_peered":"2024-03-23T06:22:35.691023+0000","last_clean":"2024-03-23T06:22:35.691023+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:22:35.691023+0000","last_undegraded":"2024-03-23T06:22:35.691023+0000","last_fullsized":"2024-03-23T06:22:35.691023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:35.690945+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:35.690945+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.690945+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:55.846631+0000","scrub_duration":0.025112247000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.160352+0000","last_change":"2024-03-23T06:22:29.160458+0000","last_active":"2024-03-23T06:22:29.160352+0000","last_peered":"2024-03-23T06:22:29.160352+0000","last_clean":"2024-03-23T06:22:29.160352+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:22:29.160352+0000","last_undegraded":"2024-03-23T06:22:29.160352+0000","last_fullsized":"2024-03-23T06:22:29.160352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.160317+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:53:12.339833+0000","scrub_duration":0.0076372239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5575,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.240335+0000","last_change":"2024-03-23T06:10:01.975876+0000","last_active":"2024-03-23T06:22:11.240335+0000","last_peered":"2024-03-23T06:22:11.240335+0000","last_clean":"2024-03-23T06:22:11.240335+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:22:11.240335+0000","last_undegraded":"2024-03-23T06:22:11.240335+0000","last_fullsized":"2024-03-23T06:22:11.240335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:33.907005+0000","last_change":"2024-03-23T06:22:33.907193+0000","last_active":"2024-03-23T06:22:33.907005+0000","last_peered":"2024-03-23T06:22:33.907005+0000","last_clean":"2024-03-23T06:22:33.907005+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:22:33.907005+0000","last_undegraded":"2024-03-23T06:22:33.907005+0000","last_fullsized":"2024-03-23T06:22:33.907005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:33.906955+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:33.906955+0000","last_clean_scrub_stamp":"2024-03-23T06:22:33.906955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:59:33.711376+0000","scrub_duration":0.0030598840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'54","reported_seq":87,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.584347+0000","last_change":"2024-03-23T06:22:20.584461+0000","last_active":"2024-03-23T06:22:20.584347+0000","last_peered":"2024-03-23T06:22:20.584347+0000","last_clean":"2024-03-23T06:22:20.584347+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:22:20.584347+0000","last_undegraded":"2024-03-23T06:22:20.584347+0000","last_fullsized":"2024-03-23T06:22:20.584347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.584313+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:03:42.668360+0000","scrub_duration":0.010912419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632815,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.362204+0000","last_change":"2024-03-23T06:22:45.362204+0000","last_active":"2024-03-23T06:22:45.362204+0000","last_peered":"2024-03-23T06:22:45.362204+0000","last_clean":"2024-03-23T06:22:45.362204+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:22:45.362204+0000","last_undegraded":"2024-03-23T06:22:45.362204+0000","last_fullsized":"2024-03-23T06:22:45.362204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4566","last_scrub_stamp":"2024-03-23T06:22:45.361824+0000","last_deep_scrub":"27'4566","last_deep_scrub_stamp":"2024-03-23T06:22:45.361824+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.361824+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:05:22.604742+0000","scrub_duration":0.049166682000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.294321+0000","last_change":"2024-03-23T06:22:15.294560+0000","last_active":"2024-03-23T06:22:15.294321+0000","last_peered":"2024-03-23T06:22:15.294321+0000","last_clean":"2024-03-23T06:22:15.294321+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:22:15.294321+0000","last_undegraded":"2024-03-23T06:22:15.294321+0000","last_fullsized":"2024-03-23T06:22:15.294321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.294273+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:05:44.698199+0000","scrub_duration":0.013606521999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.270315+0000","last_change":"2024-03-23T06:22:19.270416+0000","last_active":"2024-03-23T06:22:19.270315+0000","last_peered":"2024-03-23T06:22:19.270315+0000","last_clean":"2024-03-23T06:22:19.270315+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:22:19.270315+0000","last_undegraded":"2024-03-23T06:22:19.270315+0000","last_fullsized":"2024-03-23T06:22:19.270315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.270293+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:42:03.814587+0000","scrub_duration":0.0055263279999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:06.620720+0000","last_change":"2024-03-23T06:23:06.620899+0000","last_active":"2024-03-23T06:23:06.620720+0000","last_peered":"2024-03-23T06:23:06.620720+0000","last_clean":"2024-03-23T06:23:06.620720+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:23:06.620720+0000","last_undegraded":"2024-03-23T06:23:06.620720+0000","last_fullsized":"2024-03-23T06:23:06.620720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5940","last_scrub_stamp":"2024-03-23T06:23:06.620677+0000","last_deep_scrub":"27'5940","last_deep_scrub_stamp":"2024-03-23T06:23:06.620677+0000","last_clean_scrub_stamp":"2024-03-23T06:23:06.620677+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:30:26.608650+0000","scrub_duration":0.078009674000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.311858+0000","last_change":"2024-03-23T06:22:30.312073+0000","last_active":"2024-03-23T06:22:30.311858+0000","last_peered":"2024-03-23T06:22:30.311858+0000","last_clean":"2024-03-23T06:22:30.311858+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:22:30.311858+0000","last_undegraded":"2024-03-23T06:22:30.311858+0000","last_fullsized":"2024-03-23T06:22:30.311858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.311808+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:24:48.713636+0000","scrub_duration":0.0026864620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.567867+0000","last_change":"2024-03-23T06:22:21.568095+0000","last_active":"2024-03-23T06:22:21.567867+0000","last_peered":"2024-03-23T06:22:21.567867+0000","last_clean":"2024-03-23T06:22:21.567867+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:22:21.567867+0000","last_undegraded":"2024-03-23T06:22:21.567867+0000","last_fullsized":"2024-03-23T06:22:21.567867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.567817+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:27.726121+0000","scrub_duration":0.0064138650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:59.578148+0000","last_change":"2024-03-23T06:22:59.578266+0000","last_active":"2024-03-23T06:22:59.578148+0000","last_peered":"2024-03-23T06:22:59.578148+0000","last_clean":"2024-03-23T06:22:59.578148+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:22:59.578148+0000","last_undegraded":"2024-03-23T06:22:59.578148+0000","last_fullsized":"2024-03-23T06:22:59.578148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5309","last_scrub_stamp":"2024-03-23T06:22:59.578129+0000","last_deep_scrub":"27'5309","last_deep_scrub_stamp":"2024-03-23T06:22:59.578129+0000","last_clean_scrub_stamp":"2024-03-23T06:22:59.578129+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:47.720582+0000","scrub_duration":0.053511425000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.408474+0000","last_change":"2024-03-23T06:22:11.408732+0000","last_active":"2024-03-23T06:22:11.408474+0000","last_peered":"2024-03-23T06:22:11.408474+0000","last_clean":"2024-03-23T06:22:11.408474+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:22:11.408474+0000","last_undegraded":"2024-03-23T06:22:11.408474+0000","last_fullsized":"2024-03-23T06:22:11.408474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.408422+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:21:16.861147+0000","scrub_duration":0.0032855250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'6","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:42.835977+0000","last_change":"2024-03-23T06:09:57.474240+0000","last_active":"2024-03-23T06:21:42.835977+0000","last_peered":"2024-03-23T06:21:42.835977+0000","last_clean":"2024-03-23T06:21:42.835977+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:21:42.835977+0000","last_undegraded":"2024-03-23T06:21:42.835977+0000","last_fullsized":"2024-03-23T06:21:42.835977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:46.247751+0000","last_change":"2024-03-23T06:22:46.247864+0000","last_active":"2024-03-23T06:22:46.247751+0000","last_peered":"2024-03-23T06:22:46.247751+0000","last_clean":"2024-03-23T06:22:46.247751+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:22:46.247751+0000","last_undegraded":"2024-03-23T06:22:46.247751+0000","last_fullsized":"2024-03-23T06:22:46.247751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5252","last_scrub_stamp":"2024-03-23T06:22:46.247730+0000","last_deep_scrub":"27'5252","last_deep_scrub_stamp":"2024-03-23T06:22:46.247730+0000","last_clean_scrub_stamp":"2024-03-23T06:22:46.247730+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:58:39.050927+0000","scrub_duration":0.055585051000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.389413+0000","last_change":"2024-03-23T06:22:23.389530+0000","last_active":"2024-03-23T06:22:23.389413+0000","last_peered":"2024-03-23T06:22:23.389413+0000","last_clean":"2024-03-23T06:22:23.389413+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:22:23.389413+0000","last_undegraded":"2024-03-23T06:22:23.389413+0000","last_fullsized":"2024-03-23T06:22:23.389413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.389377+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:57:35.577088+0000","scrub_duration":0.0020420400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'46","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.174186+0000","last_change":"2024-03-23T06:22:17.174270+0000","last_active":"2024-03-23T06:22:17.174186+0000","last_peered":"2024-03-23T06:22:17.174186+0000","last_clean":"2024-03-23T06:22:17.174186+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:22:17.174186+0000","last_undegraded":"2024-03-23T06:22:17.174186+0000","last_fullsized":"2024-03-23T06:22:17.174186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.174166+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:43.279079+0000","scrub_duration":0.036150521999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:02.840502+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:22:02.840502+0000","last_peered":"2024-03-23T06:22:02.840502+0000","last_clean":"2024-03-23T06:22:02.840502+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:22:02.840502+0000","last_undegraded":"2024-03-23T06:22:02.840502+0000","last_fullsized":"2024-03-23T06:22:02.840502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.628830+0000","last_change":"2024-03-23T06:22:28.628962+0000","last_active":"2024-03-23T06:22:28.628830+0000","last_peered":"2024-03-23T06:22:28.628830+0000","last_clean":"2024-03-23T06:22:28.628830+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:22:28.628830+0000","last_undegraded":"2024-03-23T06:22:28.628830+0000","last_fullsized":"2024-03-23T06:22:28.628830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:28.628795+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:28.628795+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.628795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:54:54.770817+0000","scrub_duration":0.0036585469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'235","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.849123+0000","last_change":"2024-03-23T06:22:11.849229+0000","last_active":"2024-03-23T06:22:11.849123+0000","last_peered":"2024-03-23T06:22:11.849123+0000","last_clean":"2024-03-23T06:22:11.849123+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:22:11.849123+0000","last_undegraded":"2024-03-23T06:22:11.849123+0000","last_fullsized":"2024-03-23T06:22:11.849123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'235","last_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_deep_scrub":"27'235","last_deep_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.849094+0000","objects_scrubbed":5,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:39.149866+0000","scrub_duration":0.018805761000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.038075+0000","last_change":"2024-03-23T06:22:51.038220+0000","last_active":"2024-03-23T06:22:51.038075+0000","last_peered":"2024-03-23T06:22:51.038075+0000","last_clean":"2024-03-23T06:22:51.038075+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:22:51.038075+0000","last_undegraded":"2024-03-23T06:22:51.038075+0000","last_fullsized":"2024-03-23T06:22:51.038075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5454","last_scrub_stamp":"2024-03-23T06:22:51.038053+0000","last_deep_scrub":"27'5454","last_deep_scrub_stamp":"2024-03-23T06:22:51.038053+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.038053+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:44:27.997214+0000","scrub_duration":0.040048050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'18","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.296103+0000","last_change":"2024-03-23T06:22:28.296211+0000","last_active":"2024-03-23T06:22:28.296103+0000","last_peered":"2024-03-23T06:22:28.296103+0000","last_clean":"2024-03-23T06:22:28.296103+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:22:28.296103+0000","last_undegraded":"2024-03-23T06:22:28.296103+0000","last_fullsized":"2024-03-23T06:22:28.296103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:28.296069+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:28.296069+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.296069+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:07:55.030356+0000","scrub_duration":0.0028074770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.081823+0000","last_change":"2024-03-23T06:22:24.081903+0000","last_active":"2024-03-23T06:22:24.081823+0000","last_peered":"2024-03-23T06:22:24.081823+0000","last_clean":"2024-03-23T06:22:24.081823+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:22:24.081823+0000","last_undegraded":"2024-03-23T06:22:24.081823+0000","last_fullsized":"2024-03-23T06:22:24.081823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.081802+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:52.223689+0000","scrub_duration":0.0031724399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:46.927300+0000","last_change":"2024-03-23T06:22:46.927435+0000","last_active":"2024-03-23T06:22:46.927300+0000","last_peered":"2024-03-23T06:22:46.927300+0000","last_clean":"2024-03-23T06:22:46.927300+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:22:46.927300+0000","last_undegraded":"2024-03-23T06:22:46.927300+0000","last_fullsized":"2024-03-23T06:22:46.927300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5697","last_scrub_stamp":"2024-03-23T06:22:46.927277+0000","last_deep_scrub":"27'5697","last_deep_scrub_stamp":"2024-03-23T06:22:46.927277+0000","last_clean_scrub_stamp":"2024-03-23T06:22:46.927277+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:21:05.900325+0000","scrub_duration":0.10768414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:42.417823+0000","last_change":"2024-03-23T06:22:42.417958+0000","last_active":"2024-03-23T06:22:42.417823+0000","last_peered":"2024-03-23T06:22:42.417823+0000","last_clean":"2024-03-23T06:22:42.417823+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:22:42.417823+0000","last_undegraded":"2024-03-23T06:22:42.417823+0000","last_fullsized":"2024-03-23T06:22:42.417823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:42.417802+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:42.417802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:42.417802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:45:28.791609+0000","scrub_duration":0.044168832999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.544964+0000","last_change":"2024-03-23T06:22:23.545071+0000","last_active":"2024-03-23T06:22:23.544964+0000","last_peered":"2024-03-23T06:22:23.544964+0000","last_clean":"2024-03-23T06:22:23.544964+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:22:23.544964+0000","last_undegraded":"2024-03-23T06:22:23.544964+0000","last_fullsized":"2024-03-23T06:22:23.544964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.544931+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:19:48.158158+0000","scrub_duration":0.0052986079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5441,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.111027+0000","last_change":"2024-03-23T06:22:35.111149+0000","last_active":"2024-03-23T06:22:35.111027+0000","last_peered":"2024-03-23T06:22:35.111027+0000","last_clean":"2024-03-23T06:22:35.111027+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:22:35.111027+0000","last_undegraded":"2024-03-23T06:22:35.111027+0000","last_fullsized":"2024-03-23T06:22:35.111027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5410","last_scrub_stamp":"2024-03-23T06:22:35.111007+0000","last_deep_scrub":"27'5410","last_deep_scrub_stamp":"2024-03-23T06:22:35.111007+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.111007+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:18:26.289653+0000","scrub_duration":0.081376517999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.789158+0000","last_change":"2024-03-23T06:22:36.789460+0000","last_active":"2024-03-23T06:22:36.789158+0000","last_peered":"2024-03-23T06:22:36.789158+0000","last_clean":"2024-03-23T06:22:36.789158+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:22:36.789158+0000","last_undegraded":"2024-03-23T06:22:36.789158+0000","last_fullsized":"2024-03-23T06:22:36.789158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:36.789091+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:36.789091+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.789091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:20:32.423764+0000","scrub_duration":0.0039367719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.344399+0000","last_change":"2024-03-23T06:22:21.344504+0000","last_active":"2024-03-23T06:22:21.344399+0000","last_peered":"2024-03-23T06:22:21.344399+0000","last_clean":"2024-03-23T06:22:21.344399+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:22:21.344399+0000","last_undegraded":"2024-03-23T06:22:21.344399+0000","last_fullsized":"2024-03-23T06:22:21.344399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.344365+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:36:55.229393+0000","scrub_duration":0.0036549210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5645,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:00.124068+0000","last_change":"2024-03-23T06:23:00.124225+0000","last_active":"2024-03-23T06:23:00.124068+0000","last_peered":"2024-03-23T06:23:00.124068+0000","last_clean":"2024-03-23T06:23:00.124068+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:23:00.124068+0000","last_undegraded":"2024-03-23T06:23:00.124068+0000","last_fullsized":"2024-03-23T06:23:00.124068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5604","last_scrub_stamp":"2024-03-23T06:23:00.124027+0000","last_deep_scrub":"27'5604","last_deep_scrub_stamp":"2024-03-23T06:23:00.124027+0000","last_clean_scrub_stamp":"2024-03-23T06:23:00.124027+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:51:29.007977+0000","scrub_duration":0.065459959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4727,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:57.074048+0000","last_change":"2024-03-23T06:22:57.074229+0000","last_active":"2024-03-23T06:22:57.074048+0000","last_peered":"2024-03-23T06:22:57.074048+0000","last_clean":"2024-03-23T06:22:57.074048+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:22:57.074048+0000","last_undegraded":"2024-03-23T06:22:57.074048+0000","last_fullsized":"2024-03-23T06:22:57.074048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4695","last_scrub_stamp":"2024-03-23T06:22:57.074006+0000","last_deep_scrub":"27'4695","last_deep_scrub_stamp":"2024-03-23T06:22:57.074006+0000","last_clean_scrub_stamp":"2024-03-23T06:22:57.074006+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:01:10.699513+0000","scrub_duration":0.040829837000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.192359+0000","last_change":"2024-03-23T06:22:16.192455+0000","last_active":"2024-03-23T06:22:16.192359+0000","last_peered":"2024-03-23T06:22:16.192359+0000","last_clean":"2024-03-23T06:22:16.192359+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:22:16.192359+0000","last_undegraded":"2024-03-23T06:22:16.192359+0000","last_fullsized":"2024-03-23T06:22:16.192359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.192340+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:36:59.548342+0000","scrub_duration":0.0022608480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'33","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:07.841508+0000","last_change":"2024-03-23T06:09:57.482861+0000","last_active":"2024-03-23T06:22:07.841508+0000","last_peered":"2024-03-23T06:22:07.841508+0000","last_clean":"2024-03-23T06:22:07.841508+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:22:07.841508+0000","last_undegraded":"2024-03-23T06:22:07.841508+0000","last_fullsized":"2024-03-23T06:22:07.841508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:56.413156+0000","last_clean_scrub_stamp":"2024-03-23T06:09:56.413156+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.240426+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:22:11.240426+0000","last_peered":"2024-03-23T06:22:11.240426+0000","last_clean":"2024-03-23T06:22:11.240426+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:22:11.240426+0000","last_undegraded":"2024-03-23T06:22:11.240426+0000","last_fullsized":"2024-03-23T06:22:11.240426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'25","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.394919+0000","last_change":"2024-03-23T06:22:36.395013+0000","last_active":"2024-03-23T06:22:36.394919+0000","last_peered":"2024-03-23T06:22:36.394919+0000","last_clean":"2024-03-23T06:22:36.394919+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:22:36.394919+0000","last_undegraded":"2024-03-23T06:22:36.394919+0000","last_fullsized":"2024-03-23T06:22:36.394919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:36.394897+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:36.394897+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.394897+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:58:46.898461+0000","scrub_duration":0.00127731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'7","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.404159+0000","last_change":"2024-03-23T06:22:17.404227+0000","last_active":"2024-03-23T06:22:17.404159+0000","last_peered":"2024-03-23T06:22:17.404159+0000","last_clean":"2024-03-23T06:22:17.404159+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:22:17.404159+0000","last_undegraded":"2024-03-23T06:22:17.404159+0000","last_fullsized":"2024-03-23T06:22:17.404159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.404138+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:22:05.019725+0000","scrub_duration":0.0043990399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.233394+0000","last_change":"2024-03-23T06:22:41.233488+0000","last_active":"2024-03-23T06:22:41.233394+0000","last_peered":"2024-03-23T06:22:41.233394+0000","last_clean":"2024-03-23T06:22:41.233394+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:22:41.233394+0000","last_undegraded":"2024-03-23T06:22:41.233394+0000","last_fullsized":"2024-03-23T06:22:41.233394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:41.233370+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:41.233370+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.233370+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:56:30.911476+0000","scrub_duration":0.018389154000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:31.156271+0000","last_change":"2024-03-23T06:22:31.156271+0000","last_active":"2024-03-23T06:22:31.156271+0000","last_peered":"2024-03-23T06:22:31.156271+0000","last_clean":"2024-03-23T06:22:31.156271+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:22:31.156271+0000","last_undegraded":"2024-03-23T06:22:31.156271+0000","last_fullsized":"2024-03-23T06:22:31.156271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_clean_scrub_stamp":"2024-03-23T06:22:31.156172+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:36.346305+0000","scrub_duration":0.0027602590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:56.057222+0000","last_change":"2024-03-23T06:22:56.057352+0000","last_active":"2024-03-23T06:22:56.057222+0000","last_peered":"2024-03-23T06:22:56.057222+0000","last_clean":"2024-03-23T06:22:56.057222+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:22:56.057222+0000","last_undegraded":"2024-03-23T06:22:56.057222+0000","last_fullsized":"2024-03-23T06:22:56.057222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5541","last_scrub_stamp":"2024-03-23T06:22:56.057202+0000","last_deep_scrub":"27'5541","last_deep_scrub_stamp":"2024-03-23T06:22:56.057202+0000","last_clean_scrub_stamp":"2024-03-23T06:22:56.057202+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:10:33.574782+0000","scrub_duration":0.033591270999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'987","reported_seq":1020,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.331383+0000","last_change":"2024-03-23T06:22:27.331383+0000","last_active":"2024-03-23T06:22:27.331383+0000","last_peered":"2024-03-23T06:22:27.331383+0000","last_clean":"2024-03-23T06:22:27.331383+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:22:27.331383+0000","last_undegraded":"2024-03-23T06:22:27.331383+0000","last_fullsized":"2024-03-23T06:22:27.331383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'987","last_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_deep_scrub":"27'987","last_deep_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.331273+0000","objects_scrubbed":3,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:32:55.613936+0000","scrub_duration":0.012878013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195273,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":4980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.345944+0000","last_change":"2024-03-23T06:22:23.345944+0000","last_active":"2024-03-23T06:22:23.345944+0000","last_peered":"2024-03-23T06:22:23.345944+0000","last_clean":"2024-03-23T06:22:23.345944+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:22:23.345944+0000","last_undegraded":"2024-03-23T06:22:23.345944+0000","last_fullsized":"2024-03-23T06:22:23.345944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.345675+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:57:48.142305+0000","scrub_duration":0.0030686540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.076006+0000","last_change":"2024-03-23T06:22:37.076006+0000","last_active":"2024-03-23T06:22:37.076006+0000","last_peered":"2024-03-23T06:22:37.076006+0000","last_clean":"2024-03-23T06:22:37.076006+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:22:37.076006+0000","last_undegraded":"2024-03-23T06:22:37.076006+0000","last_fullsized":"2024-03-23T06:22:37.076006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4732","last_scrub_stamp":"2024-03-23T06:22:37.075828+0000","last_deep_scrub":"27'4732","last_deep_scrub_stamp":"2024-03-23T06:22:37.075828+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.075828+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:35:19.836743+0000","scrub_duration":0.084933690000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'23","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.801751+0000","last_change":"2024-03-23T06:22:17.801751+0000","last_active":"2024-03-23T06:22:17.801751+0000","last_peered":"2024-03-23T06:22:17.801751+0000","last_clean":"2024-03-23T06:22:17.801751+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:22:17.801751+0000","last_undegraded":"2024-03-23T06:22:17.801751+0000","last_fullsized":"2024-03-23T06:22:17.801751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.801514+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:07.169700+0000","scrub_duration":0.0027127649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.038128+0000","last_change":"2024-03-23T06:22:30.038128+0000","last_active":"2024-03-23T06:22:30.038128+0000","last_peered":"2024-03-23T06:22:30.038128+0000","last_clean":"2024-03-23T06:22:30.038128+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:22:30.038128+0000","last_undegraded":"2024-03-23T06:22:30.038128+0000","last_fullsized":"2024-03-23T06:22:30.038128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.038036+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:00.263151+0000","scrub_duration":0.0018525620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'22","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.296590+0000","last_change":"2024-03-23T06:22:26.296590+0000","last_active":"2024-03-23T06:22:26.296590+0000","last_peered":"2024-03-23T06:22:26.296590+0000","last_clean":"2024-03-23T06:22:26.296590+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:22:26.296590+0000","last_undegraded":"2024-03-23T06:22:26.296590+0000","last_fullsized":"2024-03-23T06:22:26.296590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.296445+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:27:30.354398+0000","scrub_duration":0.001966677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.430809+0000","last_change":"2024-03-23T06:22:37.430899+0000","last_active":"2024-03-23T06:22:37.430809+0000","last_peered":"2024-03-23T06:22:37.430809+0000","last_clean":"2024-03-23T06:22:37.430809+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:22:37.430809+0000","last_undegraded":"2024-03-23T06:22:37.430809+0000","last_fullsized":"2024-03-23T06:22:37.430809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:37.430790+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:37.430790+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.430790+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:54:12.996368+0000","scrub_duration":0.0069039490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.280994+0000","last_change":"2024-03-23T06:22:30.280994+0000","last_active":"2024-03-23T06:22:30.280994+0000","last_peered":"2024-03-23T06:22:30.280994+0000","last_clean":"2024-03-23T06:22:30.280994+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:22:30.280994+0000","last_undegraded":"2024-03-23T06:22:30.280994+0000","last_fullsized":"2024-03-23T06:22:30.280994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:30.280888+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:30.280888+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.280888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:12:40.399188+0000","scrub_duration":0.002164539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.448141+0000","last_change":"2024-03-23T06:22:21.448141+0000","last_active":"2024-03-23T06:22:21.448141+0000","last_peered":"2024-03-23T06:22:21.448141+0000","last_clean":"2024-03-23T06:22:21.448141+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:22:21.448141+0000","last_undegraded":"2024-03-23T06:22:21.448141+0000","last_fullsized":"2024-03-23T06:22:21.448141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.447969+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:08:29.179604+0000","scrub_duration":0.012766777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.814058+0000","last_change":"2024-03-23T06:22:37.814058+0000","last_active":"2024-03-23T06:22:37.814058+0000","last_peered":"2024-03-23T06:22:37.814058+0000","last_clean":"2024-03-23T06:22:37.814058+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:22:37.814058+0000","last_undegraded":"2024-03-23T06:22:37.814058+0000","last_fullsized":"2024-03-23T06:22:37.814058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:37.813738+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:37.813738+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.813738+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:44.682405+0000","scrub_duration":0.0033203070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.442345+0000","last_change":"2024-03-23T06:22:51.442345+0000","last_active":"2024-03-23T06:22:51.442345+0000","last_peered":"2024-03-23T06:22:51.442345+0000","last_clean":"2024-03-23T06:22:51.442345+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:22:51.442345+0000","last_undegraded":"2024-03-23T06:22:51.442345+0000","last_fullsized":"2024-03-23T06:22:51.442345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:51.442207+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:51.442207+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.442207+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:17:56.327553+0000","scrub_duration":0.029129189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:40.207309+0000","last_change":"2024-03-23T06:22:40.207309+0000","last_active":"2024-03-23T06:22:40.207309+0000","last_peered":"2024-03-23T06:22:40.207309+0000","last_clean":"2024-03-23T06:22:40.207309+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:22:40.207309+0000","last_undegraded":"2024-03-23T06:22:40.207309+0000","last_fullsized":"2024-03-23T06:22:40.207309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:40.207151+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:40.207151+0000","last_clean_scrub_stamp":"2024-03-23T06:22:40.207151+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:14.602763+0000","scrub_duration":0.002043114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.347993+0000","last_change":"2024-03-23T06:22:41.348067+0000","last_active":"2024-03-23T06:22:41.347993+0000","last_peered":"2024-03-23T06:22:41.347993+0000","last_clean":"2024-03-23T06:22:41.347993+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:41.347993+0000","last_undegraded":"2024-03-23T06:22:41.347993+0000","last_fullsized":"2024-03-23T06:22:41.347993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:41.347972+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:41.347972+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.347972+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:56.700950+0000","scrub_duration":0.002267458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.343037+0000","last_change":"2024-03-23T06:22:32.343157+0000","last_active":"2024-03-23T06:22:32.343037+0000","last_peered":"2024-03-23T06:22:32.343037+0000","last_clean":"2024-03-23T06:22:32.343037+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:22:32.343037+0000","last_undegraded":"2024-03-23T06:22:32.343037+0000","last_fullsized":"2024-03-23T06:22:32.343037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:32.343003+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:32.343003+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.343003+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:12:33.068970+0000","scrub_duration":0.0030932540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.023577+0000","last_change":"2024-03-23T06:22:47.023655+0000","last_active":"2024-03-23T06:22:47.023577+0000","last_peered":"2024-03-23T06:22:47.023577+0000","last_clean":"2024-03-23T06:22:47.023577+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:22:47.023577+0000","last_undegraded":"2024-03-23T06:22:47.023577+0000","last_fullsized":"2024-03-23T06:22:47.023577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:47.023557+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:47.023557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.023557+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:04:00.947841+0000","scrub_duration":0.00272047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'18","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.443596+0000","last_change":"2024-03-23T06:22:10.443727+0000","last_active":"2024-03-23T06:22:10.443596+0000","last_peered":"2024-03-23T06:22:10.443596+0000","last_clean":"2024-03-23T06:22:10.443596+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:22:10.443596+0000","last_undegraded":"2024-03-23T06:22:10.443596+0000","last_fullsized":"2024-03-23T06:22:10.443596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.443557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:54:38.092496+0000","scrub_duration":0.002201901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'18","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.104113+0000","last_change":"2024-03-23T06:09:57.941628+0000","last_active":"2024-03-23T06:22:05.104113+0000","last_peered":"2024-03-23T06:22:05.104113+0000","last_clean":"2024-03-23T06:22:05.104113+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:22:05.104113+0000","last_undegraded":"2024-03-23T06:22:05.104113+0000","last_fullsized":"2024-03-23T06:22:05.104113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'30","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.102123+0000","last_change":"2024-03-23T06:22:27.102202+0000","last_active":"2024-03-23T06:22:27.102123+0000","last_peered":"2024-03-23T06:22:27.102123+0000","last_clean":"2024-03-23T06:22:27.102123+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:22:27.102123+0000","last_undegraded":"2024-03-23T06:22:27.102123+0000","last_fullsized":"2024-03-23T06:22:27.102123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.102103+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:44:04.072008+0000","scrub_duration":0.0025710630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.103424+0000","last_change":"2024-03-23T06:09:57.950294+0000","last_active":"2024-03-23T06:22:05.103424+0000","last_peered":"2024-03-23T06:22:05.103424+0000","last_clean":"2024-03-23T06:22:05.103424+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:22:05.103424+0000","last_undegraded":"2024-03-23T06:22:05.103424+0000","last_fullsized":"2024-03-23T06:22:05.103424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'21","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:05.106720+0000","last_change":"2024-03-23T06:09:57.946708+0000","last_active":"2024-03-23T06:22:05.106720+0000","last_peered":"2024-03-23T06:22:05.106720+0000","last_clean":"2024-03-23T06:22:05.106720+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:22:05.106720+0000","last_undegraded":"2024-03-23T06:22:05.106720+0000","last_fullsized":"2024-03-23T06:22:05.106720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:09:57.426266+0000","last_clean_scrub_stamp":"2024-03-23T06:09:57.426266+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.438685+0000","last_change":"2024-03-23T06:22:48.438794+0000","last_active":"2024-03-23T06:22:48.438685+0000","last_peered":"2024-03-23T06:22:48.438685+0000","last_clean":"2024-03-23T06:22:48.438685+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:22:48.438685+0000","last_undegraded":"2024-03-23T06:22:48.438685+0000","last_fullsized":"2024-03-23T06:22:48.438685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:48.438650+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:48.438650+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.438650+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:28:09.247927+0000","scrub_duration":0.0023472229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.386651+0000","last_change":"2024-03-23T06:22:24.386758+0000","last_active":"2024-03-23T06:22:24.386651+0000","last_peered":"2024-03-23T06:22:24.386651+0000","last_clean":"2024-03-23T06:22:24.386651+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:22:24.386651+0000","last_undegraded":"2024-03-23T06:22:24.386651+0000","last_fullsized":"2024-03-23T06:22:24.386651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.386615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:00:08.664042+0000","scrub_duration":0.001409698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.440089+0000","last_change":"2024-03-23T06:22:19.440191+0000","last_active":"2024-03-23T06:22:19.440089+0000","last_peered":"2024-03-23T06:22:19.440089+0000","last_clean":"2024-03-23T06:22:19.440089+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:22:19.440089+0000","last_undegraded":"2024-03-23T06:22:19.440089+0000","last_fullsized":"2024-03-23T06:22:19.440089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.440064+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:38:00.327848+0000","scrub_duration":0.0063548980000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.580201+0000","last_change":"2024-03-23T06:22:32.580405+0000","last_active":"2024-03-23T06:22:32.580201+0000","last_peered":"2024-03-23T06:22:32.580201+0000","last_clean":"2024-03-23T06:22:32.580201+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:22:32.580201+0000","last_undegraded":"2024-03-23T06:22:32.580201+0000","last_fullsized":"2024-03-23T06:22:32.580201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:32.580152+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:32.580152+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.580152+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:40.490005+0000","scrub_duration":0.0034550919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.616396+0000","last_change":"2024-03-23T06:22:29.616594+0000","last_active":"2024-03-23T06:22:29.616396+0000","last_peered":"2024-03-23T06:22:29.616396+0000","last_clean":"2024-03-23T06:22:29.616396+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:22:29.616396+0000","last_undegraded":"2024-03-23T06:22:29.616396+0000","last_fullsized":"2024-03-23T06:22:29.616396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:29.616345+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:29.616345+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.616345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:37:40.215388+0000","scrub_duration":0.0029405429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'28","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.553208+0000","last_change":"2024-03-23T06:22:45.553313+0000","last_active":"2024-03-23T06:22:45.553208+0000","last_peered":"2024-03-23T06:22:45.553208+0000","last_clean":"2024-03-23T06:22:45.553208+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:22:45.553208+0000","last_undegraded":"2024-03-23T06:22:45.553208+0000","last_fullsized":"2024-03-23T06:22:45.553208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T06:22:45.553173+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T06:22:45.553173+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.553173+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:02:25.066585+0000","scrub_duration":0.0023626020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.430836+0000","last_change":"2024-03-23T06:22:36.431118+0000","last_active":"2024-03-23T06:22:36.430836+0000","last_peered":"2024-03-23T06:22:36.430836+0000","last_clean":"2024-03-23T06:22:36.430836+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:22:36.430836+0000","last_undegraded":"2024-03-23T06:22:36.430836+0000","last_fullsized":"2024-03-23T06:22:36.430836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:36.430773+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:36.430773+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.430773+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:30.283889+0000","scrub_duration":0.089320603999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.409452+0000","last_change":"2024-03-23T06:22:47.409530+0000","last_active":"2024-03-23T06:22:47.409452+0000","last_peered":"2024-03-23T06:22:47.409452+0000","last_clean":"2024-03-23T06:22:47.409452+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:22:47.409452+0000","last_undegraded":"2024-03-23T06:22:47.409452+0000","last_fullsized":"2024-03-23T06:22:47.409452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:47.409432+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:47.409432+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.409432+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:48.032843+0000","scrub_duration":0.0021214770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.660512+0000","last_change":"2024-03-23T06:22:36.660657+0000","last_active":"2024-03-23T06:22:36.660512+0000","last_peered":"2024-03-23T06:22:36.660512+0000","last_clean":"2024-03-23T06:22:36.660512+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:22:36.660512+0000","last_undegraded":"2024-03-23T06:22:36.660512+0000","last_fullsized":"2024-03-23T06:22:36.660512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:36.660474+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:36.660474+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.660474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:09:05.409598+0000","scrub_duration":0.0021533379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.918359+0000","last_change":"2024-03-23T06:22:26.918359+0000","last_active":"2024-03-23T06:22:26.918359+0000","last_peered":"2024-03-23T06:22:26.918359+0000","last_clean":"2024-03-23T06:22:26.918359+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:22:26.918359+0000","last_undegraded":"2024-03-23T06:22:26.918359+0000","last_fullsized":"2024-03-23T06:22:26.918359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.918218+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:31:45.597928+0000","scrub_duration":0.0018645039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:42.561975+0000","last_change":"2024-03-23T06:22:42.562121+0000","last_active":"2024-03-23T06:22:42.561975+0000","last_peered":"2024-03-23T06:22:42.561975+0000","last_clean":"2024-03-23T06:22:42.561975+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:22:42.561975+0000","last_undegraded":"2024-03-23T06:22:42.561975+0000","last_fullsized":"2024-03-23T06:22:42.561975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:42.561881+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:42.561881+0000","last_clean_scrub_stamp":"2024-03-23T06:22:42.561881+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:15:32.590635+0000","scrub_duration":0.014718835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.845004+0000","last_change":"2024-03-23T06:22:22.845326+0000","last_active":"2024-03-23T06:22:22.845004+0000","last_peered":"2024-03-23T06:22:22.845004+0000","last_clean":"2024-03-23T06:22:22.845004+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:22:22.845004+0000","last_undegraded":"2024-03-23T06:22:22.845004+0000","last_fullsized":"2024-03-23T06:22:22.845004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.844870+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:07.539336+0000","scrub_duration":0.002224925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'16","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:14.305222+0000","last_change":"2024-03-23T06:22:14.305222+0000","last_active":"2024-03-23T06:22:14.305222+0000","last_peered":"2024-03-23T06:22:14.305222+0000","last_clean":"2024-03-23T06:22:14.305222+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:22:14.305222+0000","last_undegraded":"2024-03-23T06:22:14.305222+0000","last_fullsized":"2024-03-23T06:22:14.305222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_clean_scrub_stamp":"2024-03-23T06:22:14.305062+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:19:26.641546+0000","scrub_duration":0.0018171369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:53.369348+0000","last_change":"2024-03-23T06:22:53.369423+0000","last_active":"2024-03-23T06:22:53.369348+0000","last_peered":"2024-03-23T06:22:53.369348+0000","last_clean":"2024-03-23T06:22:53.369348+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:22:53.369348+0000","last_undegraded":"2024-03-23T06:22:53.369348+0000","last_fullsized":"2024-03-23T06:22:53.369348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:53.369329+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:53.369329+0000","last_clean_scrub_stamp":"2024-03-23T06:22:53.369329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:49:10.218405+0000","scrub_duration":0.0014024619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.674290+0000","last_change":"2024-03-23T06:22:41.674403+0000","last_active":"2024-03-23T06:22:41.674290+0000","last_peered":"2024-03-23T06:22:41.674290+0000","last_clean":"2024-03-23T06:22:41.674290+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:22:41.674290+0000","last_undegraded":"2024-03-23T06:22:41.674290+0000","last_fullsized":"2024-03-23T06:22:41.674290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:41.674268+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:41.674268+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.674268+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:21:40.044887+0000","scrub_duration":0.086211794999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88812204,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2360,"num_write_kb":88570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177624408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2429,"ondisk_log_size":2429,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542304,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1363056,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1325886,"kb_avail":93008784,"statfs":{"total":96636764160,"available":95240994816,"internally_reserved":0,"allocated":38051840,"data_stored":37867372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1357707720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":6.492,"15min":4.7000000000000002},"min":{"1min":0.43099999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":9.6159999999999997,"5min":170.84299999999999,"15min":309.57499999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.633,"5min":6.1420000000000003,"15min":4.5910000000000002},"min":{"1min":0.54000000000000004,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":7.4489999999999998,"5min":178.934,"15min":300.98500000000001},"last":0.78400000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.5190000000000001,"5min":9.6910000000000007,"15min":5.4710000000000001},"min":{"1min":0.51300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":12.593999999999999,"5min":359.48599999999999,"15min":359.48599999999999},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.488,"5min":8.4410000000000007,"15min":5.0999999999999996},"min":{"1min":0.51300000000000001,"5min":0.29899999999999999,"15min":0.28899999999999998},"max":{"1min":4.4580000000000002,"5min":359.20299999999997,"15min":359.20299999999997},"last":1.1950000000000001}]},{"osd":2,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":7.21,"15min":4.5289999999999999},"min":{"1min":0.60799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":12.273999999999999,"5min":56.805999999999997,"15min":58.277000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":2.4809999999999999,"5min":8.4540000000000006,"15min":5.2050000000000001},"min":{"1min":0.65000000000000002,"5min":0.52100000000000002,"15min":0.32900000000000001},"max":{"1min":12.347,"5min":89.454999999999998,"15min":119.176},"last":1.236}]},{"osd":4,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":1.9930000000000001,"5min":5.835,"15min":3.2509999999999999},"min":{"1min":0.39900000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":11.605,"5min":36.270000000000003,"15min":36.270000000000003},"last":1.0229999999999999},{"interface":"front","average":{"1min":2.0329999999999999,"5min":6.4989999999999997,"15min":3.9460000000000002},"min":{"1min":0.627,"5min":0.48499999999999999,"15min":0.32800000000000001},"max":{"1min":12.708,"5min":38.718000000000004,"15min":64.325000000000003},"last":1.048}]},{"osd":5,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.2650000000000001,"5min":6.3109999999999999,"15min":3.8700000000000001},"min":{"1min":0.58999999999999997,"5min":0.46100000000000002,"15min":0.36299999999999999},"max":{"1min":12.76,"5min":38.759999999999998,"15min":58.317},"last":1.1699999999999999},{"interface":"front","average":{"1min":2.2799999999999998,"5min":5.875,"15min":3.6179999999999999},"min":{"1min":0.77200000000000002,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":12.794,"5min":33.854999999999997,"15min":33.854999999999997},"last":1.1359999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":6.1989999999999998,"15min":3.7829999999999999},"min":{"1min":0.44800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":10.116,"5min":29.777000000000001,"15min":31.623999999999999},"last":1.254},{"interface":"front","average":{"1min":1.645,"5min":5.8620000000000001,"15min":3.2850000000000001},"min":{"1min":0.67000000000000004,"5min":0.44600000000000001,"15min":0.35399999999999998},"max":{"1min":5.7359999999999998,"5min":37.179000000000002,"15min":37.179000000000002},"last":1.113}]},{"osd":7,"last update":"Sat Mar 23 06:22:19 2024","interfaces":[{"interface":"back","average":{"1min":2.661,"5min":7.4889999999999999,"15min":4.3090000000000002},"min":{"1min":0.48099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":11.808999999999999,"5min":38.621000000000002,"15min":58.344000000000001},"last":1.22},{"interface":"front","average":{"1min":2.8109999999999999,"5min":6.931,"15min":3.7799999999999998},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":11.846,"5min":38.680999999999997,"15min":38.680999999999997},"last":1.284}]}]},{"osd":2,"up_from":14,"seq":60129542304,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":4.9050000000000002,"15min":3.831},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":5.4939999999999998,"5min":49.142000000000003,"15min":126.152},"last":1.012},{"interface":"front","average":{"1min":1.224,"5min":4.2370000000000001,"15min":3.2690000000000001},"min":{"1min":0.40500000000000003,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":5.9589999999999996,"5min":29.206,"15min":143.14099999999999},"last":1.1899999999999999}]},{"osd":1,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":2.387,"5min":6.4160000000000004,"15min":4.4349999999999996},"min":{"1min":0.48999999999999999,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":15.194000000000001,"5min":55.564999999999998,"15min":55.564999999999998},"last":1.242},{"interface":"front","average":{"1min":1.359,"5min":6.7750000000000004,"15min":3.835},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":6.0049999999999999,"5min":55.354999999999997,"15min":55.354999999999997},"last":0.51800000000000002}]},{"osd":3,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.825,"5min":15.656000000000001,"15min":7.5529999999999999},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.27600000000000002},"max":{"1min":12.198,"5min":529.81799999999998,"15min":529.81799999999998},"last":1.1279999999999999},{"interface":"front","average":{"1min":2.1549999999999998,"5min":11.345000000000001,"15min":5.8490000000000002},"min":{"1min":0.42899999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":10.757,"5min":528.94200000000001,"15min":528.94200000000001},"last":0.755}]},{"osd":4,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":6.1520000000000001,"15min":3.4359999999999999},"min":{"1min":0.40899999999999997,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":5.7649999999999997,"5min":49.430999999999997,"15min":49.430999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.319,"5min":7.4089999999999998,"15min":4.5410000000000004},"min":{"1min":0.39200000000000002,"5min":0.36899999999999999,"15min":0.312},"max":{"1min":5.8639999999999999,"5min":60.298000000000002,"15min":83.525999999999996},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":5.7759999999999998,"15min":3.988},"min":{"1min":0.52100000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":5.8979999999999997,"5min":35.433999999999997,"15min":82.456000000000003},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.488,"5min":5.8710000000000004,"15min":3.7810000000000001},"min":{"1min":0.51000000000000001,"5min":0.439,"15min":0.35199999999999998},"max":{"1min":5.9290000000000003,"5min":35.472999999999999,"15min":82.971000000000004},"last":0.78100000000000003}]},{"osd":6,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":5.782,"15min":3.6669999999999998},"min":{"1min":0.60299999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":5.9539999999999997,"5min":57.420999999999999,"15min":83.007999999999996},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.6719999999999999,"5min":5.9779999999999998,"15min":3.657},"min":{"1min":0.56799999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.204000000000001,"5min":49.768000000000001,"15min":49.768000000000001},"last":1.149}]},{"osd":7,"last update":"Sat Mar 23 06:22:11 2024","interfaces":[{"interface":"back","average":{"1min":1.6040000000000001,"5min":6.3410000000000002,"15min":4.3049999999999997},"min":{"1min":0.63700000000000001,"5min":0.51400000000000001,"15min":0.35099999999999998},"max":{"1min":5.8159999999999998,"5min":43.113,"15min":77.353999999999999},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.492,"5min":6.9809999999999999,"15min":4.2759999999999998},"min":{"1min":0.51800000000000002,"5min":0.44900000000000001,"15min":0.38},"max":{"1min":5.8339999999999996,"5min":69.606999999999999,"15min":83.406999999999996},"last":1.083}]}]},{"osd":1,"up_from":14,"seq":60129542306,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":3.5470000000000002,"15min":2.8149999999999999},"min":{"1min":0.26200000000000001,"5min":0.25700000000000001,"15min":0.221},"max":{"1min":1.484,"5min":38.363,"15min":70.713999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":3.9529999999999998,"15min":2.7010000000000001},"min":{"1min":0.48299999999999998,"5min":0.247,"15min":0.247},"max":{"1min":5.7389999999999999,"5min":30.41,"15min":30.41},"last":0.76500000000000001}]},{"osd":2,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":7.2889999999999997,"15min":4.5990000000000002},"min":{"1min":0.432,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.0910000000000002,"5min":127.342,"15min":127.342},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3819999999999999,"5min":5.5220000000000002,"15min":4.2629999999999999},"min":{"1min":0.46500000000000002,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":5.1210000000000004,"5min":107.748,"15min":107.748},"last":1.1850000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":5.8600000000000003,"15min":4.0119999999999996},"min":{"1min":0.505,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":4.2649999999999997,"5min":31.780000000000001,"15min":31.780000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.7070000000000001,"5min":4.5839999999999996,"15min":4.0449999999999999},"min":{"1min":0.45100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":10.835000000000001,"5min":31.821999999999999,"15min":175.29300000000001},"last":1.123}]},{"osd":4,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":4.101,"15min":3.1600000000000001},"min":{"1min":0.56000000000000005,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":4.21,"5min":24.856999999999999,"15min":78.060000000000002},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.361,"5min":4.5519999999999996,"15min":3.1619999999999999},"min":{"1min":0.53200000000000003,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":4.2359999999999998,"5min":26.184999999999999,"15min":80.959999999999994},"last":0.88700000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":4.3460000000000001,"15min":3.262},"min":{"1min":0.52100000000000002,"5min":0.37,"15min":0.35899999999999999},"max":{"1min":3.3450000000000002,"5min":23.234000000000002,"15min":70.670000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.2010000000000001,"5min":4.0069999999999997,"15min":2.7010000000000001},"min":{"1min":0.56899999999999995,"5min":0.45500000000000002,"15min":0.41999999999999998},"max":{"1min":3.1509999999999998,"5min":26.341000000000001,"15min":30.431000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":5.4779999999999998,"15min":3.3079999999999998},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.375},"max":{"1min":4.3230000000000004,"5min":40.606999999999999,"15min":40.606999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.4470000000000001,"5min":5.2670000000000003,"15min":3.6230000000000002},"min":{"1min":0.57999999999999996,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":4.1749999999999998,"5min":36.905999999999999,"15min":68.369},"last":0.99099999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:22:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":5.6680000000000001,"15min":3.9870000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":5.6660000000000004,"5min":31.044,"15min":90.965999999999994},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.7509999999999999,"5min":6.3369999999999997,"15min":4.1520000000000001},"min":{"1min":0.54400000000000004,"5min":0.48099999999999998,"15min":0.38700000000000001},"max":{"1min":5.6970000000000001,"5min":35.256,"15min":84.465000000000003},"last":1.103}]}]},{"osd":0,"up_from":14,"seq":60129542309,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":11.427,"15min":5.3700000000000001},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":11.773,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":5.3680000000000003,"15min":3.1360000000000001},"min":{"1min":0.47199999999999998,"5min":0.31,"15min":0.31},"max":{"1min":7.1449999999999996,"5min":76.515000000000001,"15min":76.515000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.857,"5min":5.766,"15min":3.484},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.33300000000000002},"max":{"1min":10.554,"5min":58.996000000000002,"15min":58.996000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.337,"5min":4.2939999999999996,"15min":3.5579999999999998},"min":{"1min":0.51900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":5.9089999999999998,"5min":50.271000000000001,"15min":62.466000000000001},"last":0.89600000000000002}]},{"osd":3,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":5.1989999999999998,"15min":3.569},"min":{"1min":0.57699999999999996,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.4400000000000004,"5min":44.116999999999997,"15min":44.360999999999997},"last":1.151},{"interface":"front","average":{"1min":1.655,"5min":5.3209999999999997,"15min":3.4750000000000001},"min":{"1min":0.55800000000000005,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":9.9160000000000004,"5min":44.212000000000003,"15min":81.251000000000005},"last":0.76000000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":6.516,"15min":3.258},"min":{"1min":0.71799999999999997,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":2.5190000000000001,"5min":72.588999999999999,"15min":72.588999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.3759999999999999,"5min":5.9459999999999997,"15min":3.3570000000000002},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":5.9660000000000002,"5min":69.566000000000003,"15min":69.566000000000003},"last":1.012}]},{"osd":5,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.6200000000000001,"5min":5.9450000000000003,"15min":3.2050000000000001},"min":{"1min":0.755,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":7.1890000000000001,"5min":72.552000000000007,"15min":72.552000000000007},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.6930000000000001,"5min":5.3949999999999996,"15min":3.1070000000000002},"min":{"1min":0.80800000000000005,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":7.2190000000000003,"5min":72.626999999999995,"15min":72.626999999999995},"last":1.0600000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":4.718,"15min":2.923},"min":{"1min":0.45600000000000002,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":3.2160000000000002,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.4810000000000001,"5min":5.4530000000000003,"15min":3.1440000000000001},"min":{"1min":0.75800000000000001,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":3.8159999999999998,"5min":72.656999999999996,"15min":72.656999999999996},"last":0.92400000000000004}]},{"osd":7,"last update":"Sat Mar 23 06:22:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":6.0810000000000004,"15min":3.383},"min":{"1min":0.40699999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.653,"5min":69.662000000000006,"15min":69.662000000000006},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":4.9240000000000004,"15min":2.9620000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.38700000000000001},"max":{"1min":2.6840000000000002,"5min":69.632000000000005,"15min":69.632000000000005},"last":1.121}]}]},{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":3.1120000000000001,"15min":2.302},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.90600000000000003,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":2.9129999999999998,"15min":2.0409999999999999},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0740000000000001,"5min":33.662999999999997,"15min":42.582000000000001},"last":0.59499999999999997}]},{"osd":1,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":5.9429999999999996,"15min":4.2629999999999999},"min":{"1min":0.435,"5min":0.36399999999999999,"15min":0.26500000000000001},"max":{"1min":0.91500000000000004,"5min":95.497,"15min":310.09300000000002},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":6.0990000000000002,"15min":4.3150000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.94299999999999995,"5min":95.531999999999996,"15min":309.70999999999998},"last":0.71699999999999997}]},{"osd":2,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":2.8839999999999999,"15min":2.5409999999999999},"min":{"1min":0.36899999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":1.304,"5min":33.079999999999998,"15min":63.014000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":3.4460000000000002,"15min":2.9990000000000001},"min":{"1min":0.435,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.95899999999999996,"5min":28.588999999999999,"15min":73.218000000000004},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":5.8680000000000003,"15min":3.3159999999999998},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":1.2749999999999999,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.37},{"interface":"front","average":{"1min":0.625,"5min":4.016,"15min":2.79},"min":{"1min":0.34499999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.0900000000000001,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.63400000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":4.6749999999999998,"15min":2.238},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.30499999999999999,"5min":4.7140000000000004,"15min":2.238},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.48899999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.27500000000000002}]},{"osd":5,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":3.8759999999999999,"15min":1.9119999999999999},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":35.884,"15min":35.884},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":4.2889999999999997,"15min":2.0550000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.38200000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":3.0550000000000002,"15min":1.732},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53100000000000003,"5min":28.981999999999999,"15min":32.799999999999997},"last":0.307},{"interface":"front","average":{"1min":0.38900000000000001,"5min":3.141,"15min":1.7390000000000001},"min":{"1min":0.30499999999999999,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.60099999999999998,"5min":29.146999999999998,"15min":32.853000000000002},"last":0.34499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":2.4399999999999999,"15min":1.7969999999999999},"min":{"1min":0.372,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":3.4660000000000002,"5min":34.573999999999998,"15min":47.136000000000003},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.93200000000000005,"5min":3.1960000000000002,"15min":2.1150000000000002},"min":{"1min":0.309,"5min":0.28799999999999998,"15min":0.26600000000000001},"max":{"1min":4.9619999999999997,"5min":34.573,"15min":43.140000000000001},"last":0.83299999999999996}]},{"osd":1,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":3.016,"15min":2.7829999999999999},"min":{"1min":0.36899999999999999,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":5.976,"5min":77.959000000000003,"15min":96.375},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":4.5330000000000004,"15min":3.4020000000000001},"min":{"1min":0.308,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":6.6779999999999999,"5min":96.034000000000006,"15min":96.034000000000006},"last":0.35399999999999998}]},{"osd":2,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":3.2320000000000002,"15min":3.3849999999999998},"min":{"1min":0.31900000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.95799999999999996,"5min":39.534999999999997,"15min":91.947999999999993},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":3.9249999999999998,"15min":3.202},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.964,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.71099999999999997}]},{"osd":3,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":4.8550000000000004,"15min":3.6829999999999998},"min":{"1min":0.41899999999999998,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":7.7569999999999997,"5min":73.837000000000003,"15min":107.29000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.48,"5min":4.9199999999999999,"15min":3.8149999999999999},"min":{"1min":0.39400000000000002,"5min":0.308,"15min":0.30199999999999999},"max":{"1min":14.351000000000001,"5min":73.692999999999998,"15min":107.27200000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":4.4900000000000002,"15min":2.157},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":5.1139999999999999,"5min":45.302,"15min":45.302},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":4.5609999999999999,"15min":2.2170000000000001},"min":{"1min":0.314,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":5.1369999999999996,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.36499999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":4.0659999999999998,"15min":1.857},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":7.8129999999999997,"5min":39.625,"15min":39.625},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.621,"5min":3.2250000000000001,"15min":1.6830000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25600000000000001},"max":{"1min":5.1609999999999996,"5min":37.686,"15min":37.686},"last":0.314}]},{"osd":7,"last update":"Sat Mar 23 06:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":3.117,"15min":1.649},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":3.419,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":3.2170000000000001,"15min":1.5780000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":5.0759999999999996,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.38300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575014,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26601250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":2.5449999999999999,"15min":1.6559999999999999},"min":{"1min":0.33200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.84699999999999998,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":2.8370000000000002,"15min":1.7390000000000001},"min":{"1min":0.376,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.89100000000000001,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.76300000000000001}]},{"osd":1,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":2.8809999999999998,"15min":2.3079999999999998},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85599999999999998,"5min":27.151,"15min":69.873999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":3.54,"15min":2.4060000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.80800000000000005,"5min":45.847000000000001,"15min":50.758000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":3.75,"15min":2.7320000000000002},"min":{"1min":0.44700000000000001,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":1.1399999999999999,"5min":100.931,"15min":100.931},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":4.9059999999999997,"15min":3.133},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.253},"max":{"1min":0.80600000000000005,"5min":142.041,"15min":142.041},"last":0.58899999999999997}]},{"osd":3,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":3.7050000000000001,"15min":2.9289999999999998},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93200000000000005,"5min":42.064,"15min":63.905999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59899999999999998,"5min":3.8460000000000001,"15min":3.0190000000000001},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.88500000000000001,"5min":41.557000000000002,"15min":61.076000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":3.2040000000000002,"15min":1.595},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.38,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":3.5539999999999998,"15min":1.7290000000000001},"min":{"1min":0.245,"5min":0.218,"15min":0.218},"max":{"1min":0.45800000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.42799999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":4.4169999999999998,"15min":2.1059999999999999},"min":{"1min":0.25700000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.40400000000000003,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.35599999999999998,"5min":4.9050000000000002,"15min":2.319},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":0.47299999999999998,"5min":40.314,"15min":40.314},"last":0.47299999999999998}]},{"osd":7,"last update":"Sat Mar 23 06:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":3.5550000000000002,"15min":1.8100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.42699999999999999,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":4.577,"15min":2.056},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.51900000000000002,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.48899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":2.7229999999999999,"15min":1.752},"min":{"1min":0.29799999999999999,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":13.686,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":2.8450000000000002,"15min":1.901},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.359,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.621}]},{"osd":1,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":4.0389999999999997,"15min":2.7349999999999999},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":3.3370000000000002,"5min":51.387999999999998,"15min":51.387999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":2.8220000000000001,"15min":2.173},"min":{"1min":0.32400000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":3.351,"5min":29.23,"15min":50.207000000000001},"last":0.52100000000000002}]},{"osd":2,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":10.051,"15min":4.7119999999999997},"min":{"1min":0.38800000000000001,"5min":0.28399999999999997,"15min":0.26900000000000002},"max":{"1min":6.3780000000000001,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.022,"5min":9.0939999999999994,"15min":4.226},"min":{"1min":0.34300000000000003,"5min":0.30099999999999999,"15min":0.28399999999999997},"max":{"1min":6.2069999999999999,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.56699999999999995}]},{"osd":3,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":4.1289999999999996,"15min":2.7549999999999999},"min":{"1min":0.32600000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.99299999999999999,"5min":38.656999999999996,"15min":53.134999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":5.0910000000000002,"15min":4.3300000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":6.694,"5min":51.314,"15min":161.191},"last":0.55900000000000005}]},{"osd":5,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":3.4740000000000002,"15min":1.639},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.0960000000000001,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.246},{"interface":"front","average":{"1min":0.432,"5min":3.5390000000000001,"15min":1.7190000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.22800000000000001},"max":{"1min":1.4790000000000001,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.28599999999999998}]},{"osd":6,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":6.2350000000000003,"15min":2.637},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.056,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":5.8010000000000002,"15min":2.552},"min":{"1min":0.28499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.089,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.33700000000000002}]},{"osd":7,"last update":"Sat Mar 23 06:22:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":4.8140000000000001,"15min":2.097},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.24299999999999999},"max":{"1min":1.694,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":4.2460000000000004,"15min":1.919},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.28999999999999998},"max":{"1min":1.7190000000000001,"5min":51.997,"15min":51.997},"last":0.35899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:23:15.750 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.751 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.751 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.751 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.751 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.751 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-23T06:09:56.413156+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=56, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.752 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.752 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.752 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.752 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-23T06:09:57.426266+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=9, tm_sec=57, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:15.752 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T06:23:35.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:23:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.952+0000 7fb805000640 1 Processor -- start 2024-03-23T06:23:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.952+0000 7fb805000640 1 -- start start 2024-03-23T06:23:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.953+0000 7fb805000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000ced20 0x7fb8000cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb805000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8000caed0 0x7fb800159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb805000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80015a370 con 0x7fb8000cf100 2024-03-23T06:23:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb805000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000cb8d0 con 0x7fb8000caed0 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb805000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000ca330 con 0x7fb8000ced20 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7ff400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000ced20 0x7fb8000cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7ffe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8000caed0 0x7fb800159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7fea00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb8000cf100 0x7fb8000ca7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:50354/0 (socket says 172.21.15.73:50354) 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7fea00640 1 -- 172.21.15.73:0/2957078015 learned_addr learned my addr 172.21.15.73:0/2957078015 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7fe000640 1 -- 172.21.15.73:0/2957078015 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172329197 0 0) 0x7fb7e8001110 con 0x7fb8000cf100 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7fe000640 1 -- 172.21.15.73:0/2957078015 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e4003520 con 0x7fb8000cf100 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7ff400640 1 -- 172.21.15.73:0/2957078015 >> v2:172.21.15.110:3300/0 conn(0x7fb8000caed0 msgr2=0x7fb800159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7ff400640 1 --2- 172.21.15.73:0/2957078015 >> v2:172.21.15.110:3300/0 conn(0x7fb8000caed0 0x7fb800159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7ff400640 1 -- 172.21.15.73:0/2957078015 >> v1:172.21.15.110:6789/0 conn(0x7fb8000cf100 legacy=0x7fb8000ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7ff400640 1 -- 172.21.15.73:0/2957078015 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000cbab0 con 0x7fb8000ced20 2024-03-23T06:23:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.954+0000 7fb7ffe00640 1 --2- 172.21.15.73:0/2957078015 >> v2:172.21.15.110:3300/0 conn(0x7fb8000caed0 0x7fb800159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.955+0000 7fb7ff400640 1 --2- 172.21.15.73:0/2957078015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000ced20 0x7fb8000cb390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00097a0 tx=0x7fb7f002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24dc516465565c03 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb7fe000640 1 -- 172.21.15.73:0/2957078015 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0030800 con 0x7fb8000ced20 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb7fe000640 1 -- 172.21.15.73:0/2957078015 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f0030960 con 0x7fb8000ced20 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb7fe000640 1 -- 172.21.15.73:0/2957078015 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0030cf0 con 0x7fb8000ced20 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb805000640 1 -- 172.21.15.73:0/2957078015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000ced20 msgr2=0x7fb8000cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb805000640 1 --2- 172.21.15.73:0/2957078015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000ced20 0x7fb8000cb390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00097a0 tx=0x7fb7f002b940 comp rx=0 tx=0).stop 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb805000640 1 -- 172.21.15.73:0/2957078015 shutdown_connections 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb805000640 1 --2- 172.21.15.73:0/2957078015 >> v2:172.21.15.110:3300/0 conn(0x7fb8000caed0 0x7fb800159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb805000640 1 --2- 172.21.15.73:0/2957078015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000ced20 0x7fb8000cb390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb805000640 1 -- 172.21.15.73:0/2957078015 >> 172.21.15.73:0/2957078015 conn(0x7fb8000713e0 msgr2=0x7fb8000717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb805000640 1 -- 172.21.15.73:0/2957078015 shutdown_connections 2024-03-23T06:23:35.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.956+0000 7fb805000640 1 -- 172.21.15.73:0/2957078015 wait complete. 2024-03-23T06:23:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.958+0000 7fb805000640 1 Processor -- start 2024-03-23T06:23:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.958+0000 7fb805000640 1 -- start start 2024-03-23T06:23:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb805000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000caed0 0x7fb8001f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb805000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8000ced20 0x7fb800154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb805000640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000cf100 0x7fb800154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb805000640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001541a0 con 0x7fb8000cf100 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb805000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8001f26e0 con 0x7fb8000ced20 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb805000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb800155f40 con 0x7fb8000caed0 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb7fea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8000ced20 0x7fb800154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb7ff400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000caed0 0x7fb8001f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb7fea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8000ced20 0x7fb800154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:47860/0 (socket says 172.21.15.73:47860) 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb7fea00640 1 -- 172.21.15.73:0/3017364368 learned_addr learned my addr 172.21.15.73:0/3017364368 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.959+0000 7fb7ffe00640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000cf100 0x7fb800154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7fea00640 1 -- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000caed0 msgr2=0x7fb8001f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7fea00640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000caed0 0x7fb8001f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7fea00640 1 -- 172.21.15.73:0/3017364368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000cf100 msgr2=0x7fb800154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7fea00640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000cf100 0x7fb800154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7fea00640 1 -- 172.21.15.73:0/3017364368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f8009a70 con 0x7fb8000ced20 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7fea00640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8000ced20 0x7fb800154910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c420 tx=0x7fb7e800c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:35.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7f7400640 1 -- 172.21.15.73:0/3017364368 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8005ce0 con 0x7fb8000ced20 2024-03-23T06:23:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7f7400640 1 -- 172.21.15.73:0/3017364368 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e8005e40 con 0x7fb8000ced20 2024-03-23T06:23:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f0009400 con 0x7fb8000ced20 2024-03-23T06:23:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.960+0000 7fb7f7400640 1 -- 172.21.15.73:0/3017364368 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80072f0 con 0x7fb8000ced20 2024-03-23T06:23:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.961+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8001543f0 con 0x7fb8000ced20 2024-03-23T06:23:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.962+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb800156440 con 0x7fb8000ced20 2024-03-23T06:23:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.962+0000 7fb7f7400640 1 -- 172.21.15.73:0/3017364368 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb7e8007510 con 0x7fb8000ced20 2024-03-23T06:23:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.963+0000 7fb7f7400640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb7dc06ac00 0x7fb7dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.963+0000 7fb7f7400640 1 -- 172.21.15.73:0/3017364368 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fb7e8088b80 con 0x7fb8000ced20 2024-03-23T06:23:35.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.963+0000 7fb7ff400640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb7dc06ac00 0x7fb7dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:35.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.964+0000 7fb7ff400640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb7dc06ac00 0x7fb7dc06d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0036000 tx=0x7fb7f0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:35.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:35.967+0000 7fb7f7400640 1 -- 172.21.15.73:0/3017364368 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb7e8053a00 con 0x7fb8000ced20 2024-03-23T06:23:36.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.180+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8000cc350 con 0x7fb7dc06ac00 2024-03-23T06:23:36.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.190+0000 7fb7f7400640 1 -- 172.21.15.73:0/3017364368 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372740 (secure 0 0 0) 0x7fb7f0030ad0 con 0x7fb7dc06ac00 2024-03-23T06:23:36.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:23:36.198 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb7dc06ac00 msgr2=0x7fb7dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb7dc06ac00 0x7fb7dc06d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0036000 tx=0x7fb7f0008030 comp rx=0 tx=0).stop 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8000ced20 msgr2=0x7fb800154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8000ced20 0x7fb800154910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c420 tx=0x7fb7e800c8e0 comp rx=0 tx=0).stop 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 shutdown_connections 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8000cf100 0x7fb800154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8000ced20 0x7fb800154910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fb7dc06ac00 0x7fb7dc06d0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 --2- 172.21.15.73:0/3017364368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8000caed0 0x7fb8001f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 >> 172.21.15.73:0/3017364368 conn(0x7fb8000713e0 msgr2=0x7fb8000c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 shutdown_connections 2024-03-23T06:23:36.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:36.196+0000 7fb805000640 1 -- 172.21.15.73:0/3017364368 wait complete. 2024-03-23T06:23:36.216 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":435,"stamp":"2024-03-23T06:23:34.841019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402572,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469605,"num_write_kb":34184419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171185,"ondisk_log_size":171185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10060912,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9883827,"kb_avail":744913808,"statfs":{"total":773094113280,"available":762791739392,"internally_reserved":0,"allocated":181256192,"data_stored":179741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10121039416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002544"},"pg_stats":[{"pgid":"2.1f","version":"27'18","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.234338+0000","last_change":"2024-03-23T06:22:24.234338+0000","last_active":"2024-03-23T06:22:24.234338+0000","last_peered":"2024-03-23T06:22:24.234338+0000","last_clean":"2024-03-23T06:22:24.234338+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:22:24.234338+0000","last_undegraded":"2024-03-23T06:22:24.234338+0000","last_fullsized":"2024-03-23T06:22:24.234338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.234241+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:53.812998+0000","scrub_duration":0.016306496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.301797+0000","last_change":"2024-03-23T06:22:16.301887+0000","last_active":"2024-03-23T06:22:16.301797+0000","last_peered":"2024-03-23T06:22:16.301797+0000","last_clean":"2024-03-23T06:22:16.301797+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:22:16.301797+0000","last_undegraded":"2024-03-23T06:22:16.301797+0000","last_fullsized":"2024-03-23T06:22:16.301797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.301777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:37:55.431944+0000","scrub_duration":0.0022956500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:43.004409+0000","last_change":"2024-03-23T06:22:43.004574+0000","last_active":"2024-03-23T06:22:43.004409+0000","last_peered":"2024-03-23T06:22:43.004409+0000","last_clean":"2024-03-23T06:22:43.004409+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:22:43.004409+0000","last_undegraded":"2024-03-23T06:22:43.004409+0000","last_fullsized":"2024-03-23T06:22:43.004409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4649","last_scrub_stamp":"2024-03-23T06:22:43.004368+0000","last_deep_scrub":"27'4649","last_deep_scrub_stamp":"2024-03-23T06:22:43.004368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:43.004368+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:42:59.644058+0000","scrub_duration":0.043741127999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.340695+0000","last_change":"2024-03-23T06:22:28.340766+0000","last_active":"2024-03-23T06:22:28.340695+0000","last_peered":"2024-03-23T06:22:28.340695+0000","last_clean":"2024-03-23T06:22:28.340695+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:22:28.340695+0000","last_undegraded":"2024-03-23T06:22:28.340695+0000","last_fullsized":"2024-03-23T06:22:28.340695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.340675+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:05:53.500984+0000","scrub_duration":0.0074425539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.402809+0000","last_change":"2024-03-23T06:22:20.402809+0000","last_active":"2024-03-23T06:22:20.402809+0000","last_peered":"2024-03-23T06:22:20.402809+0000","last_clean":"2024-03-23T06:22:20.402809+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:22:20.402809+0000","last_undegraded":"2024-03-23T06:22:20.402809+0000","last_fullsized":"2024-03-23T06:22:20.402809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.402677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:48.099293+0000","scrub_duration":0.064311640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5587,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:38.960781+0000","last_change":"2024-03-23T06:22:38.960973+0000","last_active":"2024-03-23T06:22:38.960781+0000","last_peered":"2024-03-23T06:22:38.960781+0000","last_clean":"2024-03-23T06:22:38.960781+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:22:38.960781+0000","last_undegraded":"2024-03-23T06:22:38.960781+0000","last_fullsized":"2024-03-23T06:22:38.960781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5556","last_scrub_stamp":"2024-03-23T06:22:38.960753+0000","last_deep_scrub":"27'5556","last_deep_scrub_stamp":"2024-03-23T06:22:38.960753+0000","last_clean_scrub_stamp":"2024-03-23T06:22:38.960753+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:01.641630+0000","scrub_duration":0.14834329199999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'165","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.665632+0000","last_change":"2024-03-23T06:22:26.665632+0000","last_active":"2024-03-23T06:22:26.665632+0000","last_peered":"2024-03-23T06:22:26.665632+0000","last_clean":"2024-03-23T06:22:26.665632+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:22:26.665632+0000","last_undegraded":"2024-03-23T06:22:26.665632+0000","last_fullsized":"2024-03-23T06:22:26.665632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.665468+0000","objects_scrubbed":5,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:40:12.950569+0000","scrub_duration":0.059269850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.334167+0000","last_change":"2024-03-23T06:22:41.334291+0000","last_active":"2024-03-23T06:22:41.334167+0000","last_peered":"2024-03-23T06:22:41.334167+0000","last_clean":"2024-03-23T06:22:41.334167+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:22:41.334167+0000","last_undegraded":"2024-03-23T06:22:41.334167+0000","last_fullsized":"2024-03-23T06:22:41.334167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:41.334129+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:41.334129+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.334129+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:09:30.931263+0000","scrub_duration":0.0028427529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5375,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:52.921424+0000","last_change":"2024-03-23T06:22:52.921558+0000","last_active":"2024-03-23T06:22:52.921424+0000","last_peered":"2024-03-23T06:22:52.921424+0000","last_clean":"2024-03-23T06:22:52.921424+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:22:52.921424+0000","last_undegraded":"2024-03-23T06:22:52.921424+0000","last_fullsized":"2024-03-23T06:22:52.921424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5344","last_scrub_stamp":"2024-03-23T06:22:52.921402+0000","last_deep_scrub":"27'5344","last_deep_scrub_stamp":"2024-03-23T06:22:52.921402+0000","last_clean_scrub_stamp":"2024-03-23T06:22:52.921402+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:48.279588+0000","scrub_duration":0.13476870599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:18.622320+0000","last_change":"2024-03-23T06:22:18.622320+0000","last_active":"2024-03-23T06:22:18.622320+0000","last_peered":"2024-03-23T06:22:18.622320+0000","last_clean":"2024-03-23T06:22:18.622320+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:22:18.622320+0000","last_undegraded":"2024-03-23T06:22:18.622320+0000","last_fullsized":"2024-03-23T06:22:18.622320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_clean_scrub_stamp":"2024-03-23T06:22:18.622074+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:17:57.132801+0000","scrub_duration":0.022310751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'29","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.278949+0000","last_change":"2024-03-23T06:22:17.278949+0000","last_active":"2024-03-23T06:22:17.278949+0000","last_peered":"2024-03-23T06:22:17.278949+0000","last_clean":"2024-03-23T06:22:17.278949+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:22:17.278949+0000","last_undegraded":"2024-03-23T06:22:17.278949+0000","last_fullsized":"2024-03-23T06:22:17.278949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.278677+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:35:44.193734+0000","scrub_duration":0.003489125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.904915+0000","last_change":"2024-03-23T06:22:51.905102+0000","last_active":"2024-03-23T06:22:51.904915+0000","last_peered":"2024-03-23T06:22:51.904915+0000","last_clean":"2024-03-23T06:22:51.904915+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:22:51.904915+0000","last_undegraded":"2024-03-23T06:22:51.904915+0000","last_fullsized":"2024-03-23T06:22:51.904915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5087","last_scrub_stamp":"2024-03-23T06:22:51.904869+0000","last_deep_scrub":"27'5087","last_deep_scrub_stamp":"2024-03-23T06:22:51.904869+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.904869+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:40:20.756701+0000","scrub_duration":0.071307104999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.263737+0000","last_change":"2024-03-23T06:22:27.263737+0000","last_active":"2024-03-23T06:22:27.263737+0000","last_peered":"2024-03-23T06:22:27.263737+0000","last_clean":"2024-03-23T06:22:27.263737+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:22:27.263737+0000","last_undegraded":"2024-03-23T06:22:27.263737+0000","last_fullsized":"2024-03-23T06:22:27.263737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.263503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:55:00.258025+0000","scrub_duration":0.0032643260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'400","reported_seq":435,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:12.156575+0000","last_change":"2024-03-23T06:23:12.156575+0000","last_active":"2024-03-23T06:23:12.156575+0000","last_peered":"2024-03-23T06:23:12.156575+0000","last_clean":"2024-03-23T06:23:12.156575+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:23:12.156575+0000","last_undegraded":"2024-03-23T06:23:12.156575+0000","last_fullsized":"2024-03-23T06:23:12.156575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'400","last_scrub_stamp":"2024-03-23T06:23:12.156412+0000","last_deep_scrub":"27'400","last_deep_scrub_stamp":"2024-03-23T06:23:12.156412+0000","last_clean_scrub_stamp":"2024-03-23T06:23:12.156412+0000","objects_scrubbed":3,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:26:49.154275+0000","scrub_duration":0.033636777999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5383,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:21:28.212676+0000","last_change":"2024-03-23T06:10:01.968857+0000","last_active":"2024-03-23T06:21:28.212676+0000","last_peered":"2024-03-23T06:21:28.212676+0000","last_clean":"2024-03-23T06:21:28.212676+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:21:28.212676+0000","last_undegraded":"2024-03-23T06:21:28.212676+0000","last_fullsized":"2024-03-23T06:21:28.212676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.117488+0000","last_change":"2024-03-23T06:22:25.117488+0000","last_active":"2024-03-23T06:22:25.117488+0000","last_peered":"2024-03-23T06:22:25.117488+0000","last_clean":"2024-03-23T06:22:25.117488+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:22:25.117488+0000","last_undegraded":"2024-03-23T06:22:25.117488+0000","last_fullsized":"2024-03-23T06:22:25.117488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.117368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:18:30.718640+0000","scrub_duration":0.020924191000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:13.438725+0000","last_change":"2024-03-23T06:22:13.438725+0000","last_active":"2024-03-23T06:22:13.438725+0000","last_peered":"2024-03-23T06:22:13.438725+0000","last_clean":"2024-03-23T06:22:13.438725+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:22:13.438725+0000","last_undegraded":"2024-03-23T06:22:13.438725+0000","last_fullsized":"2024-03-23T06:22:13.438725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_clean_scrub_stamp":"2024-03-23T06:22:13.438631+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:34:21.050171+0000","scrub_duration":0.001784012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5265,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.647951+0000","last_change":"2024-03-23T06:22:47.647951+0000","last_active":"2024-03-23T06:22:47.647951+0000","last_peered":"2024-03-23T06:22:47.647951+0000","last_clean":"2024-03-23T06:22:47.647951+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:22:47.647951+0000","last_undegraded":"2024-03-23T06:22:47.647951+0000","last_fullsized":"2024-03-23T06:22:47.647951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5233","last_scrub_stamp":"2024-03-23T06:22:47.647769+0000","last_deep_scrub":"27'5233","last_deep_scrub_stamp":"2024-03-23T06:22:47.647769+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.647769+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:17:44.076130+0000","scrub_duration":0.091590610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'19","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.087701+0000","last_change":"2024-03-23T06:22:45.087701+0000","last_active":"2024-03-23T06:22:45.087701+0000","last_peered":"2024-03-23T06:22:45.087701+0000","last_clean":"2024-03-23T06:22:45.087701+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:22:45.087701+0000","last_undegraded":"2024-03-23T06:22:45.087701+0000","last_fullsized":"2024-03-23T06:22:45.087701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:45.087612+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:45.087612+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.087612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:01:32.916486+0000","scrub_duration":0.001285736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.301934+0000","last_change":"2024-03-23T06:22:22.301934+0000","last_active":"2024-03-23T06:22:22.301934+0000","last_peered":"2024-03-23T06:22:22.301934+0000","last_clean":"2024-03-23T06:22:22.301934+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:22:22.301934+0000","last_undegraded":"2024-03-23T06:22:22.301934+0000","last_fullsized":"2024-03-23T06:22:22.301934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.301822+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:51:57.846454+0000","scrub_duration":0.0052301179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6048,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.010347+0000","last_change":"2024-03-23T06:22:41.010512+0000","last_active":"2024-03-23T06:22:41.010347+0000","last_peered":"2024-03-23T06:22:41.010347+0000","last_clean":"2024-03-23T06:22:41.010347+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:22:41.010347+0000","last_undegraded":"2024-03-23T06:22:41.010347+0000","last_fullsized":"2024-03-23T06:22:41.010347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6017","last_scrub_stamp":"2024-03-23T06:22:41.010309+0000","last_deep_scrub":"27'6017","last_deep_scrub_stamp":"2024-03-23T06:22:41.010309+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.010309+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:49:02.530772+0000","scrub_duration":0.049541337999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:34.230582+0000","last_change":"2024-03-23T06:22:34.230582+0000","last_active":"2024-03-23T06:22:34.230582+0000","last_peered":"2024-03-23T06:22:34.230582+0000","last_clean":"2024-03-23T06:22:34.230582+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:22:34.230582+0000","last_undegraded":"2024-03-23T06:22:34.230582+0000","last_fullsized":"2024-03-23T06:22:34.230582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:34.230436+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:34.230436+0000","last_clean_scrub_stamp":"2024-03-23T06:22:34.230436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:09:56.885484+0000","scrub_duration":0.0018145329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.434207+0000","last_change":"2024-03-23T06:22:12.434207+0000","last_active":"2024-03-23T06:22:12.434207+0000","last_peered":"2024-03-23T06:22:12.434207+0000","last_clean":"2024-03-23T06:22:12.434207+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:22:12.434207+0000","last_undegraded":"2024-03-23T06:22:12.434207+0000","last_fullsized":"2024-03-23T06:22:12.434207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_clean_scrub_stamp":"2024-03-23T06:22:12.434048+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:01:00.920036+0000","scrub_duration":0.016801480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4194,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.905567+0000","last_change":"2024-03-23T06:22:48.905761+0000","last_active":"2024-03-23T06:22:48.905567+0000","last_peered":"2024-03-23T06:22:48.905567+0000","last_clean":"2024-03-23T06:22:48.905567+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:22:48.905567+0000","last_undegraded":"2024-03-23T06:22:48.905567+0000","last_fullsized":"2024-03-23T06:22:48.905567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4163","last_scrub_stamp":"2024-03-23T06:22:48.905532+0000","last_deep_scrub":"27'4163","last_deep_scrub_stamp":"2024-03-23T06:22:48.905532+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.905532+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:08:02.183029+0000","scrub_duration":0.107138319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.083203+0000","last_change":"2024-03-23T06:22:41.083203+0000","last_active":"2024-03-23T06:22:41.083203+0000","last_peered":"2024-03-23T06:22:41.083203+0000","last_clean":"2024-03-23T06:22:41.083203+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:22:41.083203+0000","last_undegraded":"2024-03-23T06:22:41.083203+0000","last_fullsized":"2024-03-23T06:22:41.083203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:41.083112+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:41.083112+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.083112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:51:20.359506+0000","scrub_duration":0.0017080439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'13","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.081197+0000","last_change":"2024-03-23T06:22:48.081197+0000","last_active":"2024-03-23T06:22:48.081197+0000","last_peered":"2024-03-23T06:22:48.081197+0000","last_clean":"2024-03-23T06:22:48.081197+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:22:48.081197+0000","last_undegraded":"2024-03-23T06:22:48.081197+0000","last_fullsized":"2024-03-23T06:22:48.081197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:48.080936+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:48.080936+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.080936+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:55:08.878167+0000","scrub_duration":0.0060221670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:54.837921+0000","last_change":"2024-03-23T06:22:54.838104+0000","last_active":"2024-03-23T06:22:54.837921+0000","last_peered":"2024-03-23T06:22:54.837921+0000","last_clean":"2024-03-23T06:22:54.837921+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:22:54.837921+0000","last_undegraded":"2024-03-23T06:22:54.837921+0000","last_fullsized":"2024-03-23T06:22:54.837921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6152","last_scrub_stamp":"2024-03-23T06:22:54.837875+0000","last_deep_scrub":"27'6152","last_deep_scrub_stamp":"2024-03-23T06:22:54.837875+0000","last_clean_scrub_stamp":"2024-03-23T06:22:54.837875+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:45:35.567505+0000","scrub_duration":0.079897541000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'17","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.134899+0000","last_change":"2024-03-23T06:22:35.134899+0000","last_active":"2024-03-23T06:22:35.134899+0000","last_peered":"2024-03-23T06:22:35.134899+0000","last_clean":"2024-03-23T06:22:35.134899+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:22:35.134899+0000","last_undegraded":"2024-03-23T06:22:35.134899+0000","last_fullsized":"2024-03-23T06:22:35.134899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:35.134728+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:35.134728+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.134728+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:30.334770+0000","scrub_duration":0.012842018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'99","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.219128+0000","last_change":"2024-03-23T06:22:26.219128+0000","last_active":"2024-03-23T06:22:26.219128+0000","last_peered":"2024-03-23T06:22:26.219128+0000","last_clean":"2024-03-23T06:22:26.219128+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:22:26.219128+0000","last_undegraded":"2024-03-23T06:22:26.219128+0000","last_fullsized":"2024-03-23T06:22:26.219128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_deep_scrub":"27'99","last_deep_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.218984+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:35:47.992609+0000","scrub_duration":0.005800571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4688,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:58.093217+0000","last_change":"2024-03-23T06:22:58.093330+0000","last_active":"2024-03-23T06:22:58.093217+0000","last_peered":"2024-03-23T06:22:58.093217+0000","last_clean":"2024-03-23T06:22:58.093217+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:22:58.093217+0000","last_undegraded":"2024-03-23T06:22:58.093217+0000","last_fullsized":"2024-03-23T06:22:58.093217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4656","last_scrub_stamp":"2024-03-23T06:22:58.093196+0000","last_deep_scrub":"27'4656","last_deep_scrub_stamp":"2024-03-23T06:22:58.093196+0000","last_clean_scrub_stamp":"2024-03-23T06:22:58.093196+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:50:10.092555+0000","scrub_duration":0.041911003000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.408014+0000","last_change":"2024-03-23T06:22:25.408014+0000","last_active":"2024-03-23T06:22:25.408014+0000","last_peered":"2024-03-23T06:22:25.408014+0000","last_clean":"2024-03-23T06:22:25.408014+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:22:25.408014+0000","last_undegraded":"2024-03-23T06:22:25.408014+0000","last_fullsized":"2024-03-23T06:22:25.408014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.407913+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:33:56.177740+0000","scrub_duration":0.0011927579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:04.114557+0000","last_change":"2024-03-23T06:23:04.114785+0000","last_active":"2024-03-23T06:23:04.114557+0000","last_peered":"2024-03-23T06:23:04.114557+0000","last_clean":"2024-03-23T06:23:04.114557+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:23:04.114557+0000","last_undegraded":"2024-03-23T06:23:04.114557+0000","last_fullsized":"2024-03-23T06:23:04.114557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:23:04.114506+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:23:04.114506+0000","last_clean_scrub_stamp":"2024-03-23T06:23:04.114506+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:04.169139+0000","scrub_duration":0.003954384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:38.295151+0000","last_change":"2024-03-23T06:22:38.295151+0000","last_active":"2024-03-23T06:22:38.295151+0000","last_peered":"2024-03-23T06:22:38.295151+0000","last_clean":"2024-03-23T06:22:38.295151+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:22:38.295151+0000","last_undegraded":"2024-03-23T06:22:38.295151+0000","last_fullsized":"2024-03-23T06:22:38.295151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4347","last_scrub_stamp":"2024-03-23T06:22:38.294940+0000","last_deep_scrub":"27'4347","last_deep_scrub_stamp":"2024-03-23T06:22:38.294940+0000","last_clean_scrub_stamp":"2024-03-23T06:22:38.294940+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:07.533511+0000","scrub_duration":0.086332040999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.893219+0000","last_change":"2024-03-23T06:22:24.893219+0000","last_active":"2024-03-23T06:22:24.893219+0000","last_peered":"2024-03-23T06:22:24.893219+0000","last_clean":"2024-03-23T06:22:24.893219+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:22:24.893219+0000","last_undegraded":"2024-03-23T06:22:24.893219+0000","last_fullsized":"2024-03-23T06:22:24.893219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.892857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:06.651897+0000","scrub_duration":0.020052960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.273805+0000","last_change":"2024-03-23T06:22:25.273805+0000","last_active":"2024-03-23T06:22:25.273805+0000","last_peered":"2024-03-23T06:22:25.273805+0000","last_clean":"2024-03-23T06:22:25.273805+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:22:25.273805+0000","last_undegraded":"2024-03-23T06:22:25.273805+0000","last_fullsized":"2024-03-23T06:22:25.273805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.273709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:28:04.429353+0000","scrub_duration":0.001195563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4638,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:39.210898+0000","last_change":"2024-03-23T06:22:39.211048+0000","last_active":"2024-03-23T06:22:39.210898+0000","last_peered":"2024-03-23T06:22:39.210898+0000","last_clean":"2024-03-23T06:22:39.210898+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:22:39.210898+0000","last_undegraded":"2024-03-23T06:22:39.210898+0000","last_fullsized":"2024-03-23T06:22:39.210898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4606","last_scrub_stamp":"2024-03-23T06:22:39.210876+0000","last_deep_scrub":"27'4606","last_deep_scrub_stamp":"2024-03-23T06:22:39.210876+0000","last_clean_scrub_stamp":"2024-03-23T06:22:39.210876+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:47:08.464172+0000","scrub_duration":0.047816294000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:09.438536+0000","last_change":"2024-03-23T06:22:09.438536+0000","last_active":"2024-03-23T06:22:09.438536+0000","last_peered":"2024-03-23T06:22:09.438536+0000","last_clean":"2024-03-23T06:22:09.438536+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:22:09.438536+0000","last_undegraded":"2024-03-23T06:22:09.438536+0000","last_fullsized":"2024-03-23T06:22:09.438536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_clean_scrub_stamp":"2024-03-23T06:22:09.438361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:00:16.089523+0000","scrub_duration":0.017467308000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:55.154933+0000","last_change":"2024-03-23T06:22:55.155049+0000","last_active":"2024-03-23T06:22:55.154933+0000","last_peered":"2024-03-23T06:22:55.154933+0000","last_clean":"2024-03-23T06:22:55.154933+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:22:55.154933+0000","last_undegraded":"2024-03-23T06:22:55.154933+0000","last_fullsized":"2024-03-23T06:22:55.154933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T06:22:55.154898+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T06:22:55.154898+0000","last_clean_scrub_stamp":"2024-03-23T06:22:55.154898+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:21:57.344689+0000","scrub_duration":0.026185948000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5415,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:40.167031+0000","last_change":"2024-03-23T06:22:40.167031+0000","last_active":"2024-03-23T06:22:40.167031+0000","last_peered":"2024-03-23T06:22:40.167031+0000","last_clean":"2024-03-23T06:22:40.167031+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:22:40.167031+0000","last_undegraded":"2024-03-23T06:22:40.167031+0000","last_fullsized":"2024-03-23T06:22:40.167031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5383","last_scrub_stamp":"2024-03-23T06:22:40.166855+0000","last_deep_scrub":"27'5383","last_deep_scrub_stamp":"2024-03-23T06:22:40.166855+0000","last_clean_scrub_stamp":"2024-03-23T06:22:40.166855+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:44:26.975670+0000","scrub_duration":0.050518577000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'22","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.342913+0000","last_change":"2024-03-23T06:22:23.342993+0000","last_active":"2024-03-23T06:22:23.342913+0000","last_peered":"2024-03-23T06:22:23.342913+0000","last_clean":"2024-03-23T06:22:23.342913+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:22:23.342913+0000","last_undegraded":"2024-03-23T06:22:23.342913+0000","last_fullsized":"2024-03-23T06:22:23.342913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.342894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:13:31.019943+0000","scrub_duration":0.001171252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'42","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.117526+0000","last_change":"2024-03-23T06:22:15.117526+0000","last_active":"2024-03-23T06:22:15.117526+0000","last_peered":"2024-03-23T06:22:15.117526+0000","last_clean":"2024-03-23T06:22:15.117526+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:22:15.117526+0000","last_undegraded":"2024-03-23T06:22:15.117526+0000","last_fullsized":"2024-03-23T06:22:15.117526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.117424+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:23:48.285959+0000","scrub_duration":0.003100383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":38,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.348324+0000","last_change":"2024-03-23T06:22:32.348324+0000","last_active":"2024-03-23T06:22:32.348324+0000","last_peered":"2024-03-23T06:22:32.348324+0000","last_clean":"2024-03-23T06:22:32.348324+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:22:32.348324+0000","last_undegraded":"2024-03-23T06:22:32.348324+0000","last_fullsized":"2024-03-23T06:22:32.348324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5513","last_scrub_stamp":"2024-03-23T06:22:32.348185+0000","last_deep_scrub":"27'5513","last_deep_scrub_stamp":"2024-03-23T06:22:32.348185+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.348185+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:49:59.107739+0000","scrub_duration":0.088163792000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.444706+0000","last_change":"2024-03-23T06:22:20.444706+0000","last_active":"2024-03-23T06:22:20.444706+0000","last_peered":"2024-03-23T06:22:20.444706+0000","last_clean":"2024-03-23T06:22:20.444706+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:20.444706+0000","last_undegraded":"2024-03-23T06:22:20.444706+0000","last_fullsized":"2024-03-23T06:22:20.444706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.444597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:38:16.085029+0000","scrub_duration":0.0020820489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'53","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:44.218789+0000","last_change":"2024-03-23T06:22:44.219077+0000","last_active":"2024-03-23T06:22:44.218789+0000","last_peered":"2024-03-23T06:22:44.218789+0000","last_clean":"2024-03-23T06:22:44.218789+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:22:44.218789+0000","last_undegraded":"2024-03-23T06:22:44.218789+0000","last_fullsized":"2024-03-23T06:22:44.218789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-03-23T06:22:44.218735+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-03-23T06:22:44.218735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:44.218735+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:16.319369+0000","scrub_duration":0.032610752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:07.609335+0000","last_change":"2024-03-23T06:23:07.609462+0000","last_active":"2024-03-23T06:23:07.609335+0000","last_peered":"2024-03-23T06:23:07.609335+0000","last_clean":"2024-03-23T06:23:07.609335+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:23:07.609335+0000","last_undegraded":"2024-03-23T06:23:07.609335+0000","last_fullsized":"2024-03-23T06:23:07.609335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5332","last_scrub_stamp":"2024-03-23T06:23:07.609314+0000","last_deep_scrub":"27'5332","last_deep_scrub_stamp":"2024-03-23T06:23:07.609314+0000","last_clean_scrub_stamp":"2024-03-23T06:23:07.609314+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:39.820258+0000","scrub_duration":0.046390492999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'14","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:34.131745+0000","last_change":"2024-03-23T06:22:34.131836+0000","last_active":"2024-03-23T06:22:34.131745+0000","last_peered":"2024-03-23T06:22:34.131745+0000","last_clean":"2024-03-23T06:22:34.131745+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:22:34.131745+0000","last_undegraded":"2024-03-23T06:22:34.131745+0000","last_fullsized":"2024-03-23T06:22:34.131745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:34.131727+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:34.131727+0000","last_clean_scrub_stamp":"2024-03-23T06:22:34.131727+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:21:23.166528+0000","scrub_duration":0.001854968,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:52.135634+0000","last_change":"2024-03-23T06:22:52.135840+0000","last_active":"2024-03-23T06:22:52.135634+0000","last_peered":"2024-03-23T06:22:52.135634+0000","last_clean":"2024-03-23T06:22:52.135634+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:22:52.135634+0000","last_undegraded":"2024-03-23T06:22:52.135634+0000","last_fullsized":"2024-03-23T06:22:52.135634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:52.135580+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:52.135580+0000","last_clean_scrub_stamp":"2024-03-23T06:22:52.135580+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:45.624273+0000","scrub_duration":0.0067533489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.434497+0000","last_change":"2024-03-23T06:22:10.434689+0000","last_active":"2024-03-23T06:22:10.434497+0000","last_peered":"2024-03-23T06:22:10.434497+0000","last_clean":"2024-03-23T06:22:10.434497+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:22:10.434497+0000","last_undegraded":"2024-03-23T06:22:10.434497+0000","last_fullsized":"2024-03-23T06:22:10.434497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.434445+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:53:51.345697+0000","scrub_duration":0.011047585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:31.105004+0000","last_change":"2024-03-23T06:23:31.105190+0000","last_active":"2024-03-23T06:23:31.105004+0000","last_peered":"2024-03-23T06:23:31.105004+0000","last_clean":"2024-03-23T06:23:31.105004+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:23:31.105004+0000","last_undegraded":"2024-03-23T06:23:31.105004+0000","last_fullsized":"2024-03-23T06:23:31.105004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5835","last_scrub_stamp":"2024-03-23T06:23:31.104969+0000","last_deep_scrub":"27'5835","last_deep_scrub_stamp":"2024-03-23T06:23:31.104969+0000","last_clean_scrub_stamp":"2024-03-23T06:23:31.104969+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:30:47.466819+0000","scrub_duration":0.107446976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.264179+0000","last_change":"2024-03-23T06:22:19.264433+0000","last_active":"2024-03-23T06:22:19.264179+0000","last_peered":"2024-03-23T06:22:19.264179+0000","last_clean":"2024-03-23T06:22:19.264179+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:22:19.264179+0000","last_undegraded":"2024-03-23T06:22:19.264179+0000","last_fullsized":"2024-03-23T06:22:19.264179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.264125+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:41:16.245860+0000","scrub_duration":0.0035297940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.434139+0000","last_change":"2024-03-23T06:22:16.434139+0000","last_active":"2024-03-23T06:22:16.434139+0000","last_peered":"2024-03-23T06:22:16.434139+0000","last_clean":"2024-03-23T06:22:16.434139+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:22:16.434139+0000","last_undegraded":"2024-03-23T06:22:16.434139+0000","last_fullsized":"2024-03-23T06:22:16.434139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.433996+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:13:36.235706+0000","scrub_duration":0.0057335859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:39.907512+0000","last_change":"2024-03-23T06:22:39.907512+0000","last_active":"2024-03-23T06:22:39.907512+0000","last_peered":"2024-03-23T06:22:39.907512+0000","last_clean":"2024-03-23T06:22:39.907512+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:22:39.907512+0000","last_undegraded":"2024-03-23T06:22:39.907512+0000","last_fullsized":"2024-03-23T06:22:39.907512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5251","last_scrub_stamp":"2024-03-23T06:22:39.907179+0000","last_deep_scrub":"27'5251","last_deep_scrub_stamp":"2024-03-23T06:22:39.907179+0000","last_clean_scrub_stamp":"2024-03-23T06:22:39.907179+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:08:53.331286+0000","scrub_duration":0.13370536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.594039+0000","last_change":"2024-03-23T06:22:27.594039+0000","last_active":"2024-03-23T06:22:27.594039+0000","last_peered":"2024-03-23T06:22:27.594039+0000","last_clean":"2024-03-23T06:22:27.594039+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:22:27.594039+0000","last_undegraded":"2024-03-23T06:22:27.594039+0000","last_fullsized":"2024-03-23T06:22:27.594039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.593735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:10.812412+0000","scrub_duration":0.0028611280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.313601+0000","last_change":"2024-03-23T06:22:24.313601+0000","last_active":"2024-03-23T06:22:24.313601+0000","last_peered":"2024-03-23T06:22:24.313601+0000","last_clean":"2024-03-23T06:22:24.313601+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:22:24.313601+0000","last_undegraded":"2024-03-23T06:22:24.313601+0000","last_fullsized":"2024-03-23T06:22:24.313601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.313505+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:32:44.992621+0000","scrub_duration":0.020603684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:56.512542+0000","last_change":"2024-03-23T06:22:56.512542+0000","last_active":"2024-03-23T06:22:56.512542+0000","last_peered":"2024-03-23T06:22:56.512542+0000","last_clean":"2024-03-23T06:22:56.512542+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:22:56.512542+0000","last_undegraded":"2024-03-23T06:22:56.512542+0000","last_fullsized":"2024-03-23T06:22:56.512542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4796","last_scrub_stamp":"2024-03-23T06:22:56.512396+0000","last_deep_scrub":"27'4796","last_deep_scrub_stamp":"2024-03-23T06:22:56.512396+0000","last_clean_scrub_stamp":"2024-03-23T06:22:56.512396+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:10:20.674579+0000","scrub_duration":0.063493923999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'19","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.691023+0000","last_change":"2024-03-23T06:22:35.691338+0000","last_active":"2024-03-23T06:22:35.691023+0000","last_peered":"2024-03-23T06:22:35.691023+0000","last_clean":"2024-03-23T06:22:35.691023+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:22:35.691023+0000","last_undegraded":"2024-03-23T06:22:35.691023+0000","last_fullsized":"2024-03-23T06:22:35.691023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:35.690945+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:35.690945+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.690945+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:55.846631+0000","scrub_duration":0.025112247000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.160352+0000","last_change":"2024-03-23T06:22:29.160458+0000","last_active":"2024-03-23T06:22:29.160352+0000","last_peered":"2024-03-23T06:22:29.160352+0000","last_clean":"2024-03-23T06:22:29.160352+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:22:29.160352+0000","last_undegraded":"2024-03-23T06:22:29.160352+0000","last_fullsized":"2024-03-23T06:22:29.160352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.160317+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:53:12.339833+0000","scrub_duration":0.0076372239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5586,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:32.091699+0000","last_change":"2024-03-23T06:23:32.091986+0000","last_active":"2024-03-23T06:23:32.091699+0000","last_peered":"2024-03-23T06:23:32.091699+0000","last_clean":"2024-03-23T06:23:32.091699+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:23:32.091699+0000","last_undegraded":"2024-03-23T06:23:32.091699+0000","last_fullsized":"2024-03-23T06:23:32.091699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5554","last_scrub_stamp":"2024-03-23T06:23:32.091643+0000","last_deep_scrub":"27'5554","last_deep_scrub_stamp":"2024-03-23T06:23:32.091643+0000","last_clean_scrub_stamp":"2024-03-23T06:23:32.091643+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:43:51.581225+0000","scrub_duration":0.079822729999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:33.907005+0000","last_change":"2024-03-23T06:22:33.907193+0000","last_active":"2024-03-23T06:22:33.907005+0000","last_peered":"2024-03-23T06:22:33.907005+0000","last_clean":"2024-03-23T06:22:33.907005+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:22:33.907005+0000","last_undegraded":"2024-03-23T06:22:33.907005+0000","last_fullsized":"2024-03-23T06:22:33.907005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:33.906955+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:33.906955+0000","last_clean_scrub_stamp":"2024-03-23T06:22:33.906955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:59:33.711376+0000","scrub_duration":0.0030598840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'54","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.584461+0000","last_change":"2024-03-23T06:22:20.584461+0000","last_active":"2024-03-23T06:22:20.584461+0000","last_peered":"2024-03-23T06:22:20.584461+0000","last_clean":"2024-03-23T06:22:20.584461+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:22:20.584461+0000","last_undegraded":"2024-03-23T06:22:20.584461+0000","last_fullsized":"2024-03-23T06:22:20.584461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.584313+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:03:42.668360+0000","scrub_duration":0.010912419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632815,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.362204+0000","last_change":"2024-03-23T06:22:45.362204+0000","last_active":"2024-03-23T06:22:45.362204+0000","last_peered":"2024-03-23T06:22:45.362204+0000","last_clean":"2024-03-23T06:22:45.362204+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:22:45.362204+0000","last_undegraded":"2024-03-23T06:22:45.362204+0000","last_fullsized":"2024-03-23T06:22:45.362204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4566","last_scrub_stamp":"2024-03-23T06:22:45.361824+0000","last_deep_scrub":"27'4566","last_deep_scrub_stamp":"2024-03-23T06:22:45.361824+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.361824+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:05:22.604742+0000","scrub_duration":0.049166682000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.294321+0000","last_change":"2024-03-23T06:22:15.294560+0000","last_active":"2024-03-23T06:22:15.294321+0000","last_peered":"2024-03-23T06:22:15.294321+0000","last_clean":"2024-03-23T06:22:15.294321+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:22:15.294321+0000","last_undegraded":"2024-03-23T06:22:15.294321+0000","last_fullsized":"2024-03-23T06:22:15.294321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.294273+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:05:44.698199+0000","scrub_duration":0.013606521999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.270315+0000","last_change":"2024-03-23T06:22:19.270416+0000","last_active":"2024-03-23T06:22:19.270315+0000","last_peered":"2024-03-23T06:22:19.270315+0000","last_clean":"2024-03-23T06:22:19.270315+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:22:19.270315+0000","last_undegraded":"2024-03-23T06:22:19.270315+0000","last_fullsized":"2024-03-23T06:22:19.270315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.270293+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:42:03.814587+0000","scrub_duration":0.0055263279999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:06.620720+0000","last_change":"2024-03-23T06:23:06.620899+0000","last_active":"2024-03-23T06:23:06.620720+0000","last_peered":"2024-03-23T06:23:06.620720+0000","last_clean":"2024-03-23T06:23:06.620720+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:23:06.620720+0000","last_undegraded":"2024-03-23T06:23:06.620720+0000","last_fullsized":"2024-03-23T06:23:06.620720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5940","last_scrub_stamp":"2024-03-23T06:23:06.620677+0000","last_deep_scrub":"27'5940","last_deep_scrub_stamp":"2024-03-23T06:23:06.620677+0000","last_clean_scrub_stamp":"2024-03-23T06:23:06.620677+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:30:26.608650+0000","scrub_duration":0.078009674000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.311858+0000","last_change":"2024-03-23T06:22:30.312073+0000","last_active":"2024-03-23T06:22:30.311858+0000","last_peered":"2024-03-23T06:22:30.311858+0000","last_clean":"2024-03-23T06:22:30.311858+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:22:30.311858+0000","last_undegraded":"2024-03-23T06:22:30.311858+0000","last_fullsized":"2024-03-23T06:22:30.311858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.311808+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:24:48.713636+0000","scrub_duration":0.0026864620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.567867+0000","last_change":"2024-03-23T06:22:21.568095+0000","last_active":"2024-03-23T06:22:21.567867+0000","last_peered":"2024-03-23T06:22:21.567867+0000","last_clean":"2024-03-23T06:22:21.567867+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:22:21.567867+0000","last_undegraded":"2024-03-23T06:22:21.567867+0000","last_fullsized":"2024-03-23T06:22:21.567867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.567817+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:27.726121+0000","scrub_duration":0.0064138650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:59.578148+0000","last_change":"2024-03-23T06:22:59.578266+0000","last_active":"2024-03-23T06:22:59.578148+0000","last_peered":"2024-03-23T06:22:59.578148+0000","last_clean":"2024-03-23T06:22:59.578148+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:22:59.578148+0000","last_undegraded":"2024-03-23T06:22:59.578148+0000","last_fullsized":"2024-03-23T06:22:59.578148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5309","last_scrub_stamp":"2024-03-23T06:22:59.578129+0000","last_deep_scrub":"27'5309","last_deep_scrub_stamp":"2024-03-23T06:22:59.578129+0000","last_clean_scrub_stamp":"2024-03-23T06:22:59.578129+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:47.720582+0000","scrub_duration":0.053511425000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.408474+0000","last_change":"2024-03-23T06:22:11.408732+0000","last_active":"2024-03-23T06:22:11.408474+0000","last_peered":"2024-03-23T06:22:11.408474+0000","last_clean":"2024-03-23T06:22:11.408474+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:22:11.408474+0000","last_undegraded":"2024-03-23T06:22:11.408474+0000","last_fullsized":"2024-03-23T06:22:11.408474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.408422+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:21:16.861147+0000","scrub_duration":0.0032855250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:17.095567+0000","last_change":"2024-03-23T06:23:17.095851+0000","last_active":"2024-03-23T06:23:17.095567+0000","last_peered":"2024-03-23T06:23:17.095567+0000","last_clean":"2024-03-23T06:23:17.095567+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:23:17.095567+0000","last_undegraded":"2024-03-23T06:23:17.095567+0000","last_fullsized":"2024-03-23T06:23:17.095567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-03-23T06:23:17.095468+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-03-23T06:23:17.095468+0000","last_clean_scrub_stamp":"2024-03-23T06:23:17.095468+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:12:07.206922+0000","scrub_duration":0.0054978240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:46.247751+0000","last_change":"2024-03-23T06:22:46.247864+0000","last_active":"2024-03-23T06:22:46.247751+0000","last_peered":"2024-03-23T06:22:46.247751+0000","last_clean":"2024-03-23T06:22:46.247751+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:22:46.247751+0000","last_undegraded":"2024-03-23T06:22:46.247751+0000","last_fullsized":"2024-03-23T06:22:46.247751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5252","last_scrub_stamp":"2024-03-23T06:22:46.247730+0000","last_deep_scrub":"27'5252","last_deep_scrub_stamp":"2024-03-23T06:22:46.247730+0000","last_clean_scrub_stamp":"2024-03-23T06:22:46.247730+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:58:39.050927+0000","scrub_duration":0.055585051000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.389413+0000","last_change":"2024-03-23T06:22:23.389530+0000","last_active":"2024-03-23T06:22:23.389413+0000","last_peered":"2024-03-23T06:22:23.389413+0000","last_clean":"2024-03-23T06:22:23.389413+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:22:23.389413+0000","last_undegraded":"2024-03-23T06:22:23.389413+0000","last_fullsized":"2024-03-23T06:22:23.389413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.389377+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:57:35.577088+0000","scrub_duration":0.0020420400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'46","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.174186+0000","last_change":"2024-03-23T06:22:17.174270+0000","last_active":"2024-03-23T06:22:17.174186+0000","last_peered":"2024-03-23T06:22:17.174186+0000","last_clean":"2024-03-23T06:22:17.174186+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:22:17.174186+0000","last_undegraded":"2024-03-23T06:22:17.174186+0000","last_fullsized":"2024-03-23T06:22:17.174186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.174166+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:43.279079+0000","scrub_duration":0.036150521999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4889,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:02.840502+0000","last_change":"2024-03-23T06:10:01.968114+0000","last_active":"2024-03-23T06:22:02.840502+0000","last_peered":"2024-03-23T06:22:02.840502+0000","last_clean":"2024-03-23T06:22:02.840502+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:22:02.840502+0000","last_undegraded":"2024-03-23T06:22:02.840502+0000","last_fullsized":"2024-03-23T06:22:02.840502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.628830+0000","last_change":"2024-03-23T06:22:28.628962+0000","last_active":"2024-03-23T06:22:28.628830+0000","last_peered":"2024-03-23T06:22:28.628830+0000","last_clean":"2024-03-23T06:22:28.628830+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:22:28.628830+0000","last_undegraded":"2024-03-23T06:22:28.628830+0000","last_fullsized":"2024-03-23T06:22:28.628830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:28.628795+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:28.628795+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.628795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:54:54.770817+0000","scrub_duration":0.0036585469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'235","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.849123+0000","last_change":"2024-03-23T06:22:11.849229+0000","last_active":"2024-03-23T06:22:11.849123+0000","last_peered":"2024-03-23T06:22:11.849123+0000","last_clean":"2024-03-23T06:22:11.849123+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:22:11.849123+0000","last_undegraded":"2024-03-23T06:22:11.849123+0000","last_fullsized":"2024-03-23T06:22:11.849123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'235","last_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_deep_scrub":"27'235","last_deep_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.849094+0000","objects_scrubbed":5,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:39.149866+0000","scrub_duration":0.018805761000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.038075+0000","last_change":"2024-03-23T06:22:51.038220+0000","last_active":"2024-03-23T06:22:51.038075+0000","last_peered":"2024-03-23T06:22:51.038075+0000","last_clean":"2024-03-23T06:22:51.038075+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:22:51.038075+0000","last_undegraded":"2024-03-23T06:22:51.038075+0000","last_fullsized":"2024-03-23T06:22:51.038075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5454","last_scrub_stamp":"2024-03-23T06:22:51.038053+0000","last_deep_scrub":"27'5454","last_deep_scrub_stamp":"2024-03-23T06:22:51.038053+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.038053+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:44:27.997214+0000","scrub_duration":0.040048050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'18","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.296103+0000","last_change":"2024-03-23T06:22:28.296211+0000","last_active":"2024-03-23T06:22:28.296103+0000","last_peered":"2024-03-23T06:22:28.296103+0000","last_clean":"2024-03-23T06:22:28.296103+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:22:28.296103+0000","last_undegraded":"2024-03-23T06:22:28.296103+0000","last_fullsized":"2024-03-23T06:22:28.296103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:28.296069+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:28.296069+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.296069+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:07:55.030356+0000","scrub_duration":0.0028074770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.081823+0000","last_change":"2024-03-23T06:22:24.081903+0000","last_active":"2024-03-23T06:22:24.081823+0000","last_peered":"2024-03-23T06:22:24.081823+0000","last_clean":"2024-03-23T06:22:24.081823+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:22:24.081823+0000","last_undegraded":"2024-03-23T06:22:24.081823+0000","last_fullsized":"2024-03-23T06:22:24.081823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.081802+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:52.223689+0000","scrub_duration":0.0031724399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:46.927300+0000","last_change":"2024-03-23T06:22:46.927435+0000","last_active":"2024-03-23T06:22:46.927300+0000","last_peered":"2024-03-23T06:22:46.927300+0000","last_clean":"2024-03-23T06:22:46.927300+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:22:46.927300+0000","last_undegraded":"2024-03-23T06:22:46.927300+0000","last_fullsized":"2024-03-23T06:22:46.927300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5697","last_scrub_stamp":"2024-03-23T06:22:46.927277+0000","last_deep_scrub":"27'5697","last_deep_scrub_stamp":"2024-03-23T06:22:46.927277+0000","last_clean_scrub_stamp":"2024-03-23T06:22:46.927277+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:21:05.900325+0000","scrub_duration":0.10768414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:42.417823+0000","last_change":"2024-03-23T06:22:42.417958+0000","last_active":"2024-03-23T06:22:42.417823+0000","last_peered":"2024-03-23T06:22:42.417823+0000","last_clean":"2024-03-23T06:22:42.417823+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:22:42.417823+0000","last_undegraded":"2024-03-23T06:22:42.417823+0000","last_fullsized":"2024-03-23T06:22:42.417823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:42.417802+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:42.417802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:42.417802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:45:28.791609+0000","scrub_duration":0.044168832999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.544964+0000","last_change":"2024-03-23T06:22:23.545071+0000","last_active":"2024-03-23T06:22:23.544964+0000","last_peered":"2024-03-23T06:22:23.544964+0000","last_clean":"2024-03-23T06:22:23.544964+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:22:23.544964+0000","last_undegraded":"2024-03-23T06:22:23.544964+0000","last_fullsized":"2024-03-23T06:22:23.544964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.544931+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:19:48.158158+0000","scrub_duration":0.0052986079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5441,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.111027+0000","last_change":"2024-03-23T06:22:35.111149+0000","last_active":"2024-03-23T06:22:35.111027+0000","last_peered":"2024-03-23T06:22:35.111027+0000","last_clean":"2024-03-23T06:22:35.111027+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:22:35.111027+0000","last_undegraded":"2024-03-23T06:22:35.111027+0000","last_fullsized":"2024-03-23T06:22:35.111027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5410","last_scrub_stamp":"2024-03-23T06:22:35.111007+0000","last_deep_scrub":"27'5410","last_deep_scrub_stamp":"2024-03-23T06:22:35.111007+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.111007+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:18:26.289653+0000","scrub_duration":0.081376517999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.789158+0000","last_change":"2024-03-23T06:22:36.789460+0000","last_active":"2024-03-23T06:22:36.789158+0000","last_peered":"2024-03-23T06:22:36.789158+0000","last_clean":"2024-03-23T06:22:36.789158+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:22:36.789158+0000","last_undegraded":"2024-03-23T06:22:36.789158+0000","last_fullsized":"2024-03-23T06:22:36.789158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:36.789091+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:36.789091+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.789091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:20:32.423764+0000","scrub_duration":0.0039367719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.344399+0000","last_change":"2024-03-23T06:22:21.344504+0000","last_active":"2024-03-23T06:22:21.344399+0000","last_peered":"2024-03-23T06:22:21.344399+0000","last_clean":"2024-03-23T06:22:21.344399+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:22:21.344399+0000","last_undegraded":"2024-03-23T06:22:21.344399+0000","last_fullsized":"2024-03-23T06:22:21.344399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.344365+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:36:55.229393+0000","scrub_duration":0.0036549210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5645,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:00.124068+0000","last_change":"2024-03-23T06:23:00.124225+0000","last_active":"2024-03-23T06:23:00.124068+0000","last_peered":"2024-03-23T06:23:00.124068+0000","last_clean":"2024-03-23T06:23:00.124068+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:23:00.124068+0000","last_undegraded":"2024-03-23T06:23:00.124068+0000","last_fullsized":"2024-03-23T06:23:00.124068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5604","last_scrub_stamp":"2024-03-23T06:23:00.124027+0000","last_deep_scrub":"27'5604","last_deep_scrub_stamp":"2024-03-23T06:23:00.124027+0000","last_clean_scrub_stamp":"2024-03-23T06:23:00.124027+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:51:29.007977+0000","scrub_duration":0.065459959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4727,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:57.074048+0000","last_change":"2024-03-23T06:22:57.074229+0000","last_active":"2024-03-23T06:22:57.074048+0000","last_peered":"2024-03-23T06:22:57.074048+0000","last_clean":"2024-03-23T06:22:57.074048+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:22:57.074048+0000","last_undegraded":"2024-03-23T06:22:57.074048+0000","last_fullsized":"2024-03-23T06:22:57.074048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4695","last_scrub_stamp":"2024-03-23T06:22:57.074006+0000","last_deep_scrub":"27'4695","last_deep_scrub_stamp":"2024-03-23T06:22:57.074006+0000","last_clean_scrub_stamp":"2024-03-23T06:22:57.074006+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:01:10.699513+0000","scrub_duration":0.040829837000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.192359+0000","last_change":"2024-03-23T06:22:16.192455+0000","last_active":"2024-03-23T06:22:16.192359+0000","last_peered":"2024-03-23T06:22:16.192359+0000","last_clean":"2024-03-23T06:22:16.192359+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:22:16.192359+0000","last_undegraded":"2024-03-23T06:22:16.192359+0000","last_fullsized":"2024-03-23T06:22:16.192359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.192340+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:36:59.548342+0000","scrub_duration":0.0022608480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'35","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:15.108260+0000","last_change":"2024-03-23T06:23:15.108371+0000","last_active":"2024-03-23T06:23:15.108260+0000","last_peered":"2024-03-23T06:23:15.108260+0000","last_clean":"2024-03-23T06:23:15.108260+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:23:15.108260+0000","last_undegraded":"2024-03-23T06:23:15.108260+0000","last_fullsized":"2024-03-23T06:23:15.108260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-03-23T06:23:15.108225+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-03-23T06:23:15.108225+0000","last_clean_scrub_stamp":"2024-03-23T06:23:15.108225+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:33:26.594910+0000","scrub_duration":0.028690133999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.240426+0000","last_change":"2024-03-23T06:10:01.980871+0000","last_active":"2024-03-23T06:22:11.240426+0000","last_peered":"2024-03-23T06:22:11.240426+0000","last_clean":"2024-03-23T06:22:11.240426+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:22:11.240426+0000","last_undegraded":"2024-03-23T06:22:11.240426+0000","last_fullsized":"2024-03-23T06:22:11.240426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-23T06:10:00.926557+0000","last_clean_scrub_stamp":"2024-03-23T06:10:00.926557+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'25","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.394919+0000","last_change":"2024-03-23T06:22:36.395013+0000","last_active":"2024-03-23T06:22:36.394919+0000","last_peered":"2024-03-23T06:22:36.394919+0000","last_clean":"2024-03-23T06:22:36.394919+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:22:36.394919+0000","last_undegraded":"2024-03-23T06:22:36.394919+0000","last_fullsized":"2024-03-23T06:22:36.394919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:36.394897+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:36.394897+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.394897+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:58:46.898461+0000","scrub_duration":0.00127731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'7","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.404159+0000","last_change":"2024-03-23T06:22:17.404227+0000","last_active":"2024-03-23T06:22:17.404159+0000","last_peered":"2024-03-23T06:22:17.404159+0000","last_clean":"2024-03-23T06:22:17.404159+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:22:17.404159+0000","last_undegraded":"2024-03-23T06:22:17.404159+0000","last_fullsized":"2024-03-23T06:22:17.404159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.404138+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:22:05.019725+0000","scrub_duration":0.0043990399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.233394+0000","last_change":"2024-03-23T06:22:41.233488+0000","last_active":"2024-03-23T06:22:41.233394+0000","last_peered":"2024-03-23T06:22:41.233394+0000","last_clean":"2024-03-23T06:22:41.233394+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:22:41.233394+0000","last_undegraded":"2024-03-23T06:22:41.233394+0000","last_fullsized":"2024-03-23T06:22:41.233394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:41.233370+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:41.233370+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.233370+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:56:30.911476+0000","scrub_duration":0.018389154000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:31.156271+0000","last_change":"2024-03-23T06:22:31.156271+0000","last_active":"2024-03-23T06:22:31.156271+0000","last_peered":"2024-03-23T06:22:31.156271+0000","last_clean":"2024-03-23T06:22:31.156271+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:22:31.156271+0000","last_undegraded":"2024-03-23T06:22:31.156271+0000","last_fullsized":"2024-03-23T06:22:31.156271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_clean_scrub_stamp":"2024-03-23T06:22:31.156172+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:36.346305+0000","scrub_duration":0.0027602590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:56.057222+0000","last_change":"2024-03-23T06:22:56.057352+0000","last_active":"2024-03-23T06:22:56.057222+0000","last_peered":"2024-03-23T06:22:56.057222+0000","last_clean":"2024-03-23T06:22:56.057222+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:22:56.057222+0000","last_undegraded":"2024-03-23T06:22:56.057222+0000","last_fullsized":"2024-03-23T06:22:56.057222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5541","last_scrub_stamp":"2024-03-23T06:22:56.057202+0000","last_deep_scrub":"27'5541","last_deep_scrub_stamp":"2024-03-23T06:22:56.057202+0000","last_clean_scrub_stamp":"2024-03-23T06:22:56.057202+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:10:33.574782+0000","scrub_duration":0.033591270999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'987","reported_seq":1020,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.331383+0000","last_change":"2024-03-23T06:22:27.331383+0000","last_active":"2024-03-23T06:22:27.331383+0000","last_peered":"2024-03-23T06:22:27.331383+0000","last_clean":"2024-03-23T06:22:27.331383+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:22:27.331383+0000","last_undegraded":"2024-03-23T06:22:27.331383+0000","last_fullsized":"2024-03-23T06:22:27.331383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'987","last_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_deep_scrub":"27'987","last_deep_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.331273+0000","objects_scrubbed":3,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:32:55.613936+0000","scrub_duration":0.012878013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195273,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":4980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.345944+0000","last_change":"2024-03-23T06:22:23.345944+0000","last_active":"2024-03-23T06:22:23.345944+0000","last_peered":"2024-03-23T06:22:23.345944+0000","last_clean":"2024-03-23T06:22:23.345944+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:22:23.345944+0000","last_undegraded":"2024-03-23T06:22:23.345944+0000","last_fullsized":"2024-03-23T06:22:23.345944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.345675+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:57:48.142305+0000","scrub_duration":0.0030686540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.076006+0000","last_change":"2024-03-23T06:22:37.076006+0000","last_active":"2024-03-23T06:22:37.076006+0000","last_peered":"2024-03-23T06:22:37.076006+0000","last_clean":"2024-03-23T06:22:37.076006+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:22:37.076006+0000","last_undegraded":"2024-03-23T06:22:37.076006+0000","last_fullsized":"2024-03-23T06:22:37.076006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4732","last_scrub_stamp":"2024-03-23T06:22:37.075828+0000","last_deep_scrub":"27'4732","last_deep_scrub_stamp":"2024-03-23T06:22:37.075828+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.075828+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:35:19.836743+0000","scrub_duration":0.084933690000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'23","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.801751+0000","last_change":"2024-03-23T06:22:17.801751+0000","last_active":"2024-03-23T06:22:17.801751+0000","last_peered":"2024-03-23T06:22:17.801751+0000","last_clean":"2024-03-23T06:22:17.801751+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:22:17.801751+0000","last_undegraded":"2024-03-23T06:22:17.801751+0000","last_fullsized":"2024-03-23T06:22:17.801751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.801514+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:07.169700+0000","scrub_duration":0.0027127649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.038128+0000","last_change":"2024-03-23T06:22:30.038128+0000","last_active":"2024-03-23T06:22:30.038128+0000","last_peered":"2024-03-23T06:22:30.038128+0000","last_clean":"2024-03-23T06:22:30.038128+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:22:30.038128+0000","last_undegraded":"2024-03-23T06:22:30.038128+0000","last_fullsized":"2024-03-23T06:22:30.038128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.038036+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:00.263151+0000","scrub_duration":0.0018525620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'22","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.296590+0000","last_change":"2024-03-23T06:22:26.296590+0000","last_active":"2024-03-23T06:22:26.296590+0000","last_peered":"2024-03-23T06:22:26.296590+0000","last_clean":"2024-03-23T06:22:26.296590+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:22:26.296590+0000","last_undegraded":"2024-03-23T06:22:26.296590+0000","last_fullsized":"2024-03-23T06:22:26.296590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.296445+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:27:30.354398+0000","scrub_duration":0.001966677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.430809+0000","last_change":"2024-03-23T06:22:37.430899+0000","last_active":"2024-03-23T06:22:37.430809+0000","last_peered":"2024-03-23T06:22:37.430809+0000","last_clean":"2024-03-23T06:22:37.430809+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:22:37.430809+0000","last_undegraded":"2024-03-23T06:22:37.430809+0000","last_fullsized":"2024-03-23T06:22:37.430809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:37.430790+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:37.430790+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.430790+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:54:12.996368+0000","scrub_duration":0.0069039490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.280994+0000","last_change":"2024-03-23T06:22:30.280994+0000","last_active":"2024-03-23T06:22:30.280994+0000","last_peered":"2024-03-23T06:22:30.280994+0000","last_clean":"2024-03-23T06:22:30.280994+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:22:30.280994+0000","last_undegraded":"2024-03-23T06:22:30.280994+0000","last_fullsized":"2024-03-23T06:22:30.280994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:30.280888+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:30.280888+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.280888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:12:40.399188+0000","scrub_duration":0.002164539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.448141+0000","last_change":"2024-03-23T06:22:21.448141+0000","last_active":"2024-03-23T06:22:21.448141+0000","last_peered":"2024-03-23T06:22:21.448141+0000","last_clean":"2024-03-23T06:22:21.448141+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:22:21.448141+0000","last_undegraded":"2024-03-23T06:22:21.448141+0000","last_fullsized":"2024-03-23T06:22:21.448141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.447969+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:08:29.179604+0000","scrub_duration":0.012766777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.814058+0000","last_change":"2024-03-23T06:22:37.814058+0000","last_active":"2024-03-23T06:22:37.814058+0000","last_peered":"2024-03-23T06:22:37.814058+0000","last_clean":"2024-03-23T06:22:37.814058+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:22:37.814058+0000","last_undegraded":"2024-03-23T06:22:37.814058+0000","last_fullsized":"2024-03-23T06:22:37.814058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:37.813738+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:37.813738+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.813738+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:44.682405+0000","scrub_duration":0.0033203070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.442345+0000","last_change":"2024-03-23T06:22:51.442345+0000","last_active":"2024-03-23T06:22:51.442345+0000","last_peered":"2024-03-23T06:22:51.442345+0000","last_clean":"2024-03-23T06:22:51.442345+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:22:51.442345+0000","last_undegraded":"2024-03-23T06:22:51.442345+0000","last_fullsized":"2024-03-23T06:22:51.442345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:51.442207+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:51.442207+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.442207+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:17:56.327553+0000","scrub_duration":0.029129189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:40.207309+0000","last_change":"2024-03-23T06:22:40.207309+0000","last_active":"2024-03-23T06:22:40.207309+0000","last_peered":"2024-03-23T06:22:40.207309+0000","last_clean":"2024-03-23T06:22:40.207309+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:22:40.207309+0000","last_undegraded":"2024-03-23T06:22:40.207309+0000","last_fullsized":"2024-03-23T06:22:40.207309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:40.207151+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:40.207151+0000","last_clean_scrub_stamp":"2024-03-23T06:22:40.207151+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:14.602763+0000","scrub_duration":0.002043114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.348067+0000","last_change":"2024-03-23T06:22:41.348067+0000","last_active":"2024-03-23T06:22:41.348067+0000","last_peered":"2024-03-23T06:22:41.348067+0000","last_clean":"2024-03-23T06:22:41.348067+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:41.348067+0000","last_undegraded":"2024-03-23T06:22:41.348067+0000","last_fullsized":"2024-03-23T06:22:41.348067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:41.347972+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:41.347972+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.347972+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:56.700950+0000","scrub_duration":0.002267458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'22","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.343157+0000","last_change":"2024-03-23T06:22:32.343157+0000","last_active":"2024-03-23T06:22:32.343157+0000","last_peered":"2024-03-23T06:22:32.343157+0000","last_clean":"2024-03-23T06:22:32.343157+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:22:32.343157+0000","last_undegraded":"2024-03-23T06:22:32.343157+0000","last_fullsized":"2024-03-23T06:22:32.343157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:32.343003+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:32.343003+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.343003+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:12:33.068970+0000","scrub_duration":0.0030932540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.023577+0000","last_change":"2024-03-23T06:22:47.023655+0000","last_active":"2024-03-23T06:22:47.023577+0000","last_peered":"2024-03-23T06:22:47.023577+0000","last_clean":"2024-03-23T06:22:47.023577+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:22:47.023577+0000","last_undegraded":"2024-03-23T06:22:47.023577+0000","last_fullsized":"2024-03-23T06:22:47.023577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:47.023557+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:47.023557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.023557+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:04:00.947841+0000","scrub_duration":0.00272047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'18","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.443596+0000","last_change":"2024-03-23T06:22:10.443727+0000","last_active":"2024-03-23T06:22:10.443596+0000","last_peered":"2024-03-23T06:22:10.443596+0000","last_clean":"2024-03-23T06:22:10.443596+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:22:10.443596+0000","last_undegraded":"2024-03-23T06:22:10.443596+0000","last_fullsized":"2024-03-23T06:22:10.443596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.443557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:54:38.092496+0000","scrub_duration":0.002201901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'18","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:28.058021+0000","last_change":"2024-03-23T06:23:28.058133+0000","last_active":"2024-03-23T06:23:28.058021+0000","last_peered":"2024-03-23T06:23:28.058021+0000","last_clean":"2024-03-23T06:23:28.058021+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:23:28.058021+0000","last_undegraded":"2024-03-23T06:23:28.058021+0000","last_fullsized":"2024-03-23T06:23:28.058021+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:23:28.057988+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:23:28.057988+0000","last_clean_scrub_stamp":"2024-03-23T06:23:28.057988+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:23.990880+0000","scrub_duration":0.002450519,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'30","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.102123+0000","last_change":"2024-03-23T06:22:27.102202+0000","last_active":"2024-03-23T06:22:27.102123+0000","last_peered":"2024-03-23T06:22:27.102123+0000","last_clean":"2024-03-23T06:22:27.102123+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:22:27.102123+0000","last_undegraded":"2024-03-23T06:22:27.102123+0000","last_fullsized":"2024-03-23T06:22:27.102123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.102103+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:44:04.072008+0000","scrub_duration":0.0025710630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:19.149499+0000","last_change":"2024-03-23T06:23:19.149616+0000","last_active":"2024-03-23T06:23:19.149499+0000","last_peered":"2024-03-23T06:23:19.149499+0000","last_clean":"2024-03-23T06:23:19.149499+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:23:19.149499+0000","last_undegraded":"2024-03-23T06:23:19.149499+0000","last_fullsized":"2024-03-23T06:23:19.149499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:23:19.149475+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:23:19.149475+0000","last_clean_scrub_stamp":"2024-03-23T06:23:19.149475+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:57.930063+0000","scrub_duration":0.086740787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'21","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:25.054128+0000","last_change":"2024-03-23T06:23:25.054408+0000","last_active":"2024-03-23T06:23:25.054128+0000","last_peered":"2024-03-23T06:23:25.054128+0000","last_clean":"2024-03-23T06:23:25.054128+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:23:25.054128+0000","last_undegraded":"2024-03-23T06:23:25.054128+0000","last_fullsized":"2024-03-23T06:23:25.054128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-03-23T06:23:25.054075+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-03-23T06:23:25.054075+0000","last_clean_scrub_stamp":"2024-03-23T06:23:25.054075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:39:29.480018+0000","scrub_duration":0.0033097249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.438685+0000","last_change":"2024-03-23T06:22:48.438794+0000","last_active":"2024-03-23T06:22:48.438685+0000","last_peered":"2024-03-23T06:22:48.438685+0000","last_clean":"2024-03-23T06:22:48.438685+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:22:48.438685+0000","last_undegraded":"2024-03-23T06:22:48.438685+0000","last_fullsized":"2024-03-23T06:22:48.438685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:48.438650+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:48.438650+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.438650+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:28:09.247927+0000","scrub_duration":0.0023472229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.386651+0000","last_change":"2024-03-23T06:22:24.386758+0000","last_active":"2024-03-23T06:22:24.386651+0000","last_peered":"2024-03-23T06:22:24.386651+0000","last_clean":"2024-03-23T06:22:24.386651+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:22:24.386651+0000","last_undegraded":"2024-03-23T06:22:24.386651+0000","last_fullsized":"2024-03-23T06:22:24.386651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.386615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:00:08.664042+0000","scrub_duration":0.001409698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.440089+0000","last_change":"2024-03-23T06:22:19.440191+0000","last_active":"2024-03-23T06:22:19.440089+0000","last_peered":"2024-03-23T06:22:19.440089+0000","last_clean":"2024-03-23T06:22:19.440089+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:22:19.440089+0000","last_undegraded":"2024-03-23T06:22:19.440089+0000","last_fullsized":"2024-03-23T06:22:19.440089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.440064+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:38:00.327848+0000","scrub_duration":0.0063548980000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.580201+0000","last_change":"2024-03-23T06:22:32.580405+0000","last_active":"2024-03-23T06:22:32.580201+0000","last_peered":"2024-03-23T06:22:32.580201+0000","last_clean":"2024-03-23T06:22:32.580201+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:22:32.580201+0000","last_undegraded":"2024-03-23T06:22:32.580201+0000","last_fullsized":"2024-03-23T06:22:32.580201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:32.580152+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:32.580152+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.580152+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:40.490005+0000","scrub_duration":0.0034550919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.616396+0000","last_change":"2024-03-23T06:22:29.616594+0000","last_active":"2024-03-23T06:22:29.616396+0000","last_peered":"2024-03-23T06:22:29.616396+0000","last_clean":"2024-03-23T06:22:29.616396+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:22:29.616396+0000","last_undegraded":"2024-03-23T06:22:29.616396+0000","last_fullsized":"2024-03-23T06:22:29.616396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:29.616345+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:29.616345+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.616345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:37:40.215388+0000","scrub_duration":0.0029405429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'28","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.553208+0000","last_change":"2024-03-23T06:22:45.553313+0000","last_active":"2024-03-23T06:22:45.553208+0000","last_peered":"2024-03-23T06:22:45.553208+0000","last_clean":"2024-03-23T06:22:45.553208+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:22:45.553208+0000","last_undegraded":"2024-03-23T06:22:45.553208+0000","last_fullsized":"2024-03-23T06:22:45.553208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T06:22:45.553173+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T06:22:45.553173+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.553173+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:02:25.066585+0000","scrub_duration":0.0023626020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.430836+0000","last_change":"2024-03-23T06:22:36.431118+0000","last_active":"2024-03-23T06:22:36.430836+0000","last_peered":"2024-03-23T06:22:36.430836+0000","last_clean":"2024-03-23T06:22:36.430836+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:22:36.430836+0000","last_undegraded":"2024-03-23T06:22:36.430836+0000","last_fullsized":"2024-03-23T06:22:36.430836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:36.430773+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:36.430773+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.430773+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:30.283889+0000","scrub_duration":0.089320603999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.409452+0000","last_change":"2024-03-23T06:22:47.409530+0000","last_active":"2024-03-23T06:22:47.409452+0000","last_peered":"2024-03-23T06:22:47.409452+0000","last_clean":"2024-03-23T06:22:47.409452+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:22:47.409452+0000","last_undegraded":"2024-03-23T06:22:47.409452+0000","last_fullsized":"2024-03-23T06:22:47.409452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:47.409432+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:47.409432+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.409432+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:48.032843+0000","scrub_duration":0.0021214770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.660512+0000","last_change":"2024-03-23T06:22:36.660657+0000","last_active":"2024-03-23T06:22:36.660512+0000","last_peered":"2024-03-23T06:22:36.660512+0000","last_clean":"2024-03-23T06:22:36.660512+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:22:36.660512+0000","last_undegraded":"2024-03-23T06:22:36.660512+0000","last_fullsized":"2024-03-23T06:22:36.660512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:36.660474+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:36.660474+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.660474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:09:05.409598+0000","scrub_duration":0.0021533379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.918359+0000","last_change":"2024-03-23T06:22:26.918359+0000","last_active":"2024-03-23T06:22:26.918359+0000","last_peered":"2024-03-23T06:22:26.918359+0000","last_clean":"2024-03-23T06:22:26.918359+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:22:26.918359+0000","last_undegraded":"2024-03-23T06:22:26.918359+0000","last_fullsized":"2024-03-23T06:22:26.918359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.918218+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:31:45.597928+0000","scrub_duration":0.0018645039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:42.561975+0000","last_change":"2024-03-23T06:22:42.562121+0000","last_active":"2024-03-23T06:22:42.561975+0000","last_peered":"2024-03-23T06:22:42.561975+0000","last_clean":"2024-03-23T06:22:42.561975+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:22:42.561975+0000","last_undegraded":"2024-03-23T06:22:42.561975+0000","last_fullsized":"2024-03-23T06:22:42.561975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:42.561881+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:42.561881+0000","last_clean_scrub_stamp":"2024-03-23T06:22:42.561881+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:15:32.590635+0000","scrub_duration":0.014718835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.845004+0000","last_change":"2024-03-23T06:22:22.845326+0000","last_active":"2024-03-23T06:22:22.845004+0000","last_peered":"2024-03-23T06:22:22.845004+0000","last_clean":"2024-03-23T06:22:22.845004+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:22:22.845004+0000","last_undegraded":"2024-03-23T06:22:22.845004+0000","last_fullsized":"2024-03-23T06:22:22.845004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.844870+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:07.539336+0000","scrub_duration":0.002224925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'16","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:14.305222+0000","last_change":"2024-03-23T06:22:14.305222+0000","last_active":"2024-03-23T06:22:14.305222+0000","last_peered":"2024-03-23T06:22:14.305222+0000","last_clean":"2024-03-23T06:22:14.305222+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:22:14.305222+0000","last_undegraded":"2024-03-23T06:22:14.305222+0000","last_fullsized":"2024-03-23T06:22:14.305222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_clean_scrub_stamp":"2024-03-23T06:22:14.305062+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:19:26.641546+0000","scrub_duration":0.0018171369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:53.369348+0000","last_change":"2024-03-23T06:22:53.369423+0000","last_active":"2024-03-23T06:22:53.369348+0000","last_peered":"2024-03-23T06:22:53.369348+0000","last_clean":"2024-03-23T06:22:53.369348+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:22:53.369348+0000","last_undegraded":"2024-03-23T06:22:53.369348+0000","last_fullsized":"2024-03-23T06:22:53.369348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:53.369329+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:53.369329+0000","last_clean_scrub_stamp":"2024-03-23T06:22:53.369329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:49:10.218405+0000","scrub_duration":0.0014024619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.674290+0000","last_change":"2024-03-23T06:22:41.674403+0000","last_active":"2024-03-23T06:22:41.674290+0000","last_peered":"2024-03-23T06:22:41.674290+0000","last_clean":"2024-03-23T06:22:41.674290+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:22:41.674290+0000","last_undegraded":"2024-03-23T06:22:41.674290+0000","last_fullsized":"2024-03-23T06:22:41.674290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:41.674268+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:41.674268+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.674268+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:21:40.044887+0000","scrub_duration":0.086211794999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88812204,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2360,"num_write_kb":88570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177624408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2432,"ondisk_log_size":2432,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542308,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1346672,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1309502,"kb_avail":93025168,"statfs":{"total":96636764160,"available":95257772032,"internally_reserved":0,"allocated":38051840,"data_stored":37867372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1340930504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":4.1559999999999997,"15min":4.6909999999999998},"min":{"1min":0.46500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.2,"5min":26.257999999999999,"15min":309.57499999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.081,"5min":3.7509999999999999,"15min":4.5910000000000002},"min":{"1min":0.56200000000000006,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":1.488,"5min":32.350000000000001,"15min":300.98500000000001},"last":0.754}]},{"osd":1,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":4.8689999999999998,"15min":5.4740000000000002},"min":{"1min":0.64500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6990000000000001,"5min":33.838999999999999,"15min":359.48599999999999},"last":1.115},{"interface":"front","average":{"1min":1.0429999999999999,"5min":3.746,"15min":5.0949999999999998},"min":{"1min":0.52000000000000002,"5min":0.29899999999999999,"15min":0.28899999999999998},"max":{"1min":1.8,"5min":35.130000000000003,"15min":359.20299999999997},"last":1.1519999999999999}]},{"osd":2,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":5.8200000000000003,"15min":4.5209999999999999},"min":{"1min":0.68200000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6100000000000001,"5min":56.805999999999997,"15min":58.277000000000001},"last":0.873},{"interface":"front","average":{"1min":1.238,"5min":7.1669999999999998,"15min":5.1950000000000003},"min":{"1min":0.67700000000000005,"5min":0.55400000000000005,"15min":0.32900000000000001},"max":{"1min":1.8480000000000001,"5min":89.454999999999998,"15min":119.176},"last":0.95199999999999996}]},{"osd":4,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":4.8780000000000001,"15min":3.238},"min":{"1min":0.64100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7809999999999999,"5min":36.270000000000003,"15min":36.270000000000003},"last":1.024},{"interface":"front","average":{"1min":1.0840000000000001,"5min":5.5330000000000004,"15min":3.9359999999999999},"min":{"1min":0.80900000000000005,"5min":0.48499999999999999,"15min":0.32800000000000001},"max":{"1min":1.5369999999999999,"5min":37.673999999999999,"15min":64.325000000000003},"last":1.0549999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":5.1929999999999996,"15min":3.8660000000000001},"min":{"1min":0.878,"5min":0.46100000000000002,"15min":0.36299999999999999},"max":{"1min":1.651,"5min":32.863999999999997,"15min":58.317},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.0329999999999999,"5min":5.0270000000000001,"15min":3.597},"min":{"1min":0.77900000000000003,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":1.865,"5min":33.854999999999997,"15min":33.854999999999997},"last":1.1279999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":5.1859999999999999,"15min":3.766},"min":{"1min":0.873,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.9390000000000001,"5min":26.425999999999998,"15min":31.623999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.268,"5min":4.899,"15min":3.2879999999999998},"min":{"1min":0.91900000000000004,"5min":0.46500000000000002,"15min":0.35399999999999998},"max":{"1min":1.619,"5min":37.179000000000002,"15min":37.179000000000002},"last":1.236}]},{"osd":7,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":6.1550000000000002,"15min":4.3040000000000003},"min":{"1min":0.98199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.0190000000000001,"5min":32.311,"15min":58.344000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":5.6299999999999999,"15min":3.7709999999999999},"min":{"1min":1.0249999999999999,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":2.129,"5min":32.215000000000003,"15min":38.680999999999997},"last":1.363}]}]},{"osd":2,"up_from":14,"seq":60129542308,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":4.2030000000000003,"15min":3.8340000000000001},"min":{"1min":0.55100000000000005,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":1.419,"5min":49.142000000000003,"15min":126.152},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.081,"5min":3.222,"15min":3.282},"min":{"1min":0.63,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":1.6779999999999999,"5min":29.206,"15min":143.14099999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":4.6440000000000001,"15min":4.4489999999999998},"min":{"1min":0.49199999999999999,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":1.8859999999999999,"5min":43.033999999999999,"15min":55.564999999999998},"last":1.008},{"interface":"front","average":{"1min":0.91000000000000003,"5min":4.5670000000000002,"15min":3.8290000000000002},"min":{"1min":0.51800000000000002,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":1.8080000000000001,"5min":49.390999999999998,"15min":55.354999999999997},"last":0.77100000000000002}]},{"osd":3,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":12.243,"15min":7.5499999999999998},"min":{"1min":0.47399999999999998,"5min":0.33900000000000002,"15min":0.27600000000000002},"max":{"1min":1.3120000000000001,"5min":529.81799999999998,"15min":529.81799999999998},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.1679999999999999,"5min":10.244999999999999,"15min":5.8470000000000004},"min":{"1min":0.64700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.9359999999999999,"5min":528.94200000000001,"15min":528.94200000000001},"last":0.70099999999999996}]},{"osd":4,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":5.1340000000000003,"15min":3.427},"min":{"1min":0.629,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":1.2829999999999999,"5min":49.430999999999997,"15min":49.430999999999997},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.032,"5min":6.3799999999999999,"15min":4.5369999999999999},"min":{"1min":0.67300000000000004,"5min":0.39200000000000002,"15min":0.312},"max":{"1min":1.417,"5min":60.298000000000002,"15min":83.525999999999996},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":4.7210000000000001,"15min":3.9860000000000002},"min":{"1min":0.81299999999999994,"5min":0.47999999999999998,"15min":0.36899999999999999},"max":{"1min":1.5229999999999999,"5min":35.433999999999997,"15min":82.456000000000003},"last":1.042},{"interface":"front","average":{"1min":1.1919999999999999,"5min":4.7939999999999996,"15min":3.7829999999999999},"min":{"1min":0.78100000000000003,"5min":0.51000000000000001,"15min":0.35199999999999998},"max":{"1min":1.5740000000000001,"5min":35.472999999999999,"15min":82.971000000000004},"last":1.268}]},{"osd":6,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":4.633,"15min":3.657},"min":{"1min":0.69899999999999995,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.502,"5min":57.420999999999999,"15min":83.007999999999996},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.1459999999999999,"5min":4.593,"15min":3.6499999999999999},"min":{"1min":0.73199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5489999999999999,"5min":49.768000000000001,"15min":49.768000000000001},"last":0.97099999999999997}]},{"osd":7,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":5.1970000000000001,"15min":4.3109999999999999},"min":{"1min":0.83799999999999997,"5min":0.51400000000000001,"15min":0.35099999999999998},"max":{"1min":1.651,"5min":43.113,"15min":77.353999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":5.3490000000000002,"15min":4.2599999999999998},"min":{"1min":0.64500000000000002,"5min":0.51800000000000002,"15min":0.38},"max":{"1min":1.7509999999999999,"5min":44.204000000000001,"15min":83.406999999999996},"last":1.1240000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542310,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":2.8919999999999999,"15min":2.8069999999999999},"min":{"1min":0.55800000000000005,"5min":0.26000000000000001,"15min":0.221},"max":{"1min":1.278,"5min":38.363,"15min":70.713999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.85599999999999998,"5min":3.0950000000000002,"15min":2.6909999999999998},"min":{"1min":0.53800000000000003,"5min":0.28399999999999997,"15min":0.247},"max":{"1min":1.3640000000000001,"5min":17.361000000000001,"15min":30.41},"last":0.505}]},{"osd":2,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":6.3040000000000003,"15min":4.5990000000000002},"min":{"1min":0.66700000000000004,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.413,"5min":127.342,"15min":127.342},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.2370000000000001,"5min":4.6790000000000003,"15min":4.2619999999999996},"min":{"1min":0.70199999999999996,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":1.5089999999999999,"5min":107.748,"15min":107.748},"last":1.3959999999999999}]},{"osd":3,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":4.8819999999999997,"15min":3.9910000000000001},"min":{"1min":0.65900000000000003,"5min":0.46600000000000003,"15min":0.32300000000000001},"max":{"1min":1.4850000000000001,"5min":31.780000000000001,"15min":31.780000000000001},"last":1.206},{"interface":"front","average":{"1min":1.194,"5min":4.0890000000000004,"15min":4.0540000000000003},"min":{"1min":0.63400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.546,"5min":31.821999999999999,"15min":175.29300000000001},"last":0.746}]},{"osd":4,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":3.714,"15min":3.157},"min":{"1min":0.71499999999999997,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":1.349,"5min":24.856999999999999,"15min":78.060000000000002},"last":1.03},{"interface":"front","average":{"1min":1.1060000000000001,"5min":4.1050000000000004,"15min":3.1680000000000001},"min":{"1min":0.69899999999999995,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":1.405,"5min":26.184999999999999,"15min":80.959999999999994},"last":1.1000000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":3.581,"15min":3.2410000000000001},"min":{"1min":0.57899999999999996,"5min":0.37,"15min":0.35899999999999999},"max":{"1min":1.466,"5min":23.234000000000002,"15min":70.670000000000002},"last":0.87},{"interface":"front","average":{"1min":0.97199999999999998,"5min":3.625,"15min":2.6899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.41999999999999998},"max":{"1min":1.5629999999999999,"5min":26.341000000000001,"15min":30.431000000000001},"last":0.96699999999999997}]},{"osd":6,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":5.2030000000000003,"15min":3.3130000000000002},"min":{"1min":0.73799999999999999,"5min":0.39800000000000002,"15min":0.375},"max":{"1min":1.6319999999999999,"5min":40.606999999999999,"15min":40.606999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.276,"5min":4.5519999999999996,"15min":3.625},"min":{"1min":0.99099999999999999,"5min":0.57999999999999996,"15min":0.41799999999999998},"max":{"1min":1.532,"5min":36.905999999999999,"15min":68.369},"last":1.1459999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":5.1289999999999996,"15min":3.9780000000000002},"min":{"1min":0.94099999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.7190000000000001,"5min":28.331,"15min":90.965999999999994},"last":1.121},{"interface":"front","average":{"1min":1.335,"5min":5.6379999999999999,"15min":4.1630000000000003},"min":{"1min":1.1000000000000001,"5min":0.54400000000000004,"15min":0.38700000000000001},"max":{"1min":1.764,"5min":35.256,"15min":84.465000000000003},"last":1.2529999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542313,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":10.826000000000001,"15min":5.351},"min":{"1min":0.495,"5min":0.316,"15min":0.25700000000000001},"max":{"1min":1.254,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.028,"5min":4.4539999999999997,"15min":3.137},"min":{"1min":0.623,"5min":0.33000000000000002,"15min":0.31},"max":{"1min":1.641,"5min":76.515000000000001,"15min":76.515000000000001},"last":0.82499999999999996}]},{"osd":2,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":3.8580000000000001,"15min":3.476},"min":{"1min":0.60599999999999998,"5min":0.378,"15min":0.33300000000000002},"max":{"1min":1.6930000000000001,"5min":33.118000000000002,"15min":58.996000000000002},"last":1.244},{"interface":"front","average":{"1min":1.052,"5min":2.8599999999999999,"15min":3.556},"min":{"1min":0.54500000000000004,"5min":0.371,"15min":0.28799999999999998},"max":{"1min":1.5129999999999999,"5min":20.919,"15min":62.466000000000001},"last":0.93899999999999995}]},{"osd":3,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":3.71,"15min":3.577},"min":{"1min":1.0209999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.669,"5min":30.838999999999999,"15min":44.360999999999997},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.131,"5min":3.7240000000000002,"15min":3.4740000000000002},"min":{"1min":0.495,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":1.4770000000000001,"5min":33.429000000000002,"15min":81.251000000000005},"last":0.76800000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":5.9240000000000004,"15min":3.2639999999999998},"min":{"1min":0.58499999999999996,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":1.498,"5min":72.588999999999999,"15min":72.588999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.093,"5min":5.367,"15min":3.3460000000000001},"min":{"1min":0.60799999999999998,"5min":0.36599999999999999,"15min":0.33000000000000002},"max":{"1min":1.2909999999999999,"5min":69.566000000000003,"15min":69.566000000000003},"last":1.0229999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":5.282,"15min":3.2130000000000001},"min":{"1min":0.79600000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.756,"5min":72.552000000000007,"15min":72.552000000000007},"last":1.149},{"interface":"front","average":{"1min":1.3260000000000001,"5min":4.7119999999999997,"15min":3.1030000000000002},"min":{"1min":0.88,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":1.8360000000000001,"5min":72.626999999999995,"15min":72.626999999999995},"last":1.1970000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":3.7949999999999999,"15min":2.8999999999999999},"min":{"1min":0.55300000000000005,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":1.101,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.236,"5min":4.7060000000000004,"15min":3.1259999999999999},"min":{"1min":0.63,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":1.9370000000000001,"5min":72.656999999999996,"15min":72.656999999999996},"last":0.753}]},{"osd":7,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":5.2880000000000003,"15min":3.3759999999999999},"min":{"1min":0.80700000000000005,"5min":0.40600000000000003,"15min":0.36599999999999999},"max":{"1min":1.7190000000000001,"5min":69.662000000000006,"15min":69.662000000000006},"last":1.075},{"interface":"front","average":{"1min":1.2649999999999999,"5min":4.4379999999999997,"15min":2.9590000000000001},"min":{"1min":0.88100000000000001,"5min":0.437,"15min":0.38700000000000001},"max":{"1min":1.768,"5min":69.632000000000005,"15min":69.632000000000005},"last":0.79600000000000004}]}]},{"osd":7,"up_from":13,"seq":55834575015,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":3.1120000000000001,"15min":2.302},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.90600000000000003,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":2.9129999999999998,"15min":2.0409999999999999},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0740000000000001,"5min":33.662999999999997,"15min":42.582000000000001},"last":0.57599999999999996}]},{"osd":1,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":5.9429999999999996,"15min":4.2629999999999999},"min":{"1min":0.435,"5min":0.36399999999999999,"15min":0.26500000000000001},"max":{"1min":0.91500000000000004,"5min":95.497,"15min":310.09300000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":6.0990000000000002,"15min":4.3150000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.94299999999999995,"5min":95.531999999999996,"15min":309.70999999999998},"last":0.79800000000000004}]},{"osd":2,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":2.8839999999999999,"15min":2.5409999999999999},"min":{"1min":0.36899999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":1.304,"5min":33.079999999999998,"15min":63.014000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":3.4460000000000002,"15min":2.9990000000000001},"min":{"1min":0.435,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.95899999999999996,"5min":28.588999999999999,"15min":73.218000000000004},"last":0.79100000000000004}]},{"osd":3,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":5.8680000000000003,"15min":3.3159999999999998},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":1.2749999999999999,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.625,"5min":4.016,"15min":2.79},"min":{"1min":0.34499999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.0900000000000001,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":4.6749999999999998,"15min":2.238},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.30499999999999999,"5min":4.7140000000000004,"15min":2.238},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.48899999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.35999999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":3.8759999999999999,"15min":1.9119999999999999},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":35.884,"15min":35.884},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":4.2889999999999997,"15min":2.0550000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.27000000000000002}]},{"osd":6,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":3.0550000000000002,"15min":1.732},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53100000000000003,"5min":28.981999999999999,"15min":32.799999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":3.141,"15min":1.7390000000000001},"min":{"1min":0.30499999999999999,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.60099999999999998,"5min":29.146999999999998,"15min":32.853000000000002},"last":0.33900000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575016,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":2.1349999999999998,"15min":1.788},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.77000000000000002,"5min":34.573999999999998,"15min":47.136000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":2.819,"15min":2.1150000000000002},"min":{"1min":0.435,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":0.83299999999999996,"5min":34.573,"15min":43.140000000000001},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.9870000000000001,"15min":2.7770000000000001},"min":{"1min":0.35599999999999998,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":1.0389999999999999,"5min":30.096,"15min":96.375},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":3.202,"15min":3.3929999999999998},"min":{"1min":0.32200000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83799999999999997,"5min":32.222999999999999,"15min":96.034000000000006},"last":0.623}]},{"osd":2,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":2.5569999999999999,"15min":3.3799999999999999},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.29299999999999998},"max":{"1min":0.875,"5min":32.305,"15min":91.947999999999993},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":3.5310000000000001,"15min":3.194},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83799999999999997,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.60799999999999998}]},{"osd":3,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":3.2709999999999999,"15min":3.681},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.32800000000000001},"max":{"1min":0.84899999999999998,"5min":32.194000000000003,"15min":107.29000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":3.3069999999999999,"15min":3.8039999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81000000000000005,"5min":31.829999999999998,"15min":107.27200000000001},"last":0.81799999999999995}]},{"osd":4,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":4.2160000000000002,"15min":2.1499999999999999},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.216},"max":{"1min":0.42599999999999999,"5min":45.302,"15min":45.302},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.374,"5min":4.2880000000000003,"15min":2.2130000000000001},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":0.56699999999999995,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.39300000000000002}]},{"osd":5,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":3.8180000000000001,"15min":1.8500000000000001},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":39.625,"15min":39.625},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":2.9009999999999998,"15min":1.675},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.53900000000000003,"5min":37.686,"15min":37.686},"last":0.34200000000000003}]},{"osd":7,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":2.8479999999999999,"15min":1.637},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51900000000000002,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.374,"5min":2.8959999999999999,"15min":1.5700000000000001},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60299999999999998,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.35699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575018,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26601250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":2.5449999999999999,"15min":1.6559999999999999},"min":{"1min":0.33200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.84699999999999998,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":2.8370000000000002,"15min":1.7390000000000001},"min":{"1min":0.376,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.89100000000000001,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":2.8809999999999998,"15min":2.3079999999999998},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85599999999999998,"5min":27.151,"15min":69.873999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":3.54,"15min":2.4060000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.80800000000000005,"5min":45.847000000000001,"15min":50.758000000000003},"last":0.751}]},{"osd":2,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":3.75,"15min":2.7320000000000002},"min":{"1min":0.44700000000000001,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":1.1399999999999999,"5min":100.931,"15min":100.931},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":4.9059999999999997,"15min":3.133},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.253},"max":{"1min":0.80600000000000005,"5min":142.041,"15min":142.041},"last":0.435}]},{"osd":3,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":3.7050000000000001,"15min":2.9289999999999998},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93200000000000005,"5min":42.064,"15min":63.905999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":3.8460000000000001,"15min":3.0190000000000001},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.88500000000000001,"5min":41.557000000000002,"15min":61.076000000000001},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Mar 23 06:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":3.2040000000000002,"15min":1.595},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.38,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":3.5539999999999998,"15min":1.7290000000000001},"min":{"1min":0.245,"5min":0.218,"15min":0.218},"max":{"1min":0.45800000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.34899999999999998}]},{"osd":6,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":4.4169999999999998,"15min":2.1059999999999999},"min":{"1min":0.25700000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.40400000000000003,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":4.9050000000000002,"15min":2.319},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":0.47299999999999998,"5min":40.314,"15min":40.314},"last":0.314}]},{"osd":7,"last update":"Sat Mar 23 06:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":3.5550000000000002,"15min":1.8100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.42699999999999999,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":4.577,"15min":2.056},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.51900000000000002,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.377}]}]},{"osd":4,"up_from":13,"seq":55834575015,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":2.2250000000000001,"15min":1.7410000000000001},"min":{"1min":0.26100000000000001,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":0.72599999999999998,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":2.3540000000000001,"15min":1.8959999999999999},"min":{"1min":0.30499999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.79800000000000004,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.70599999999999996}]},{"osd":1,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":2.673,"15min":2.7349999999999999},"min":{"1min":0.375,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.91100000000000003,"5min":29.405000000000001,"15min":51.387999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":2.0659999999999998,"15min":2.169},"min":{"1min":0.33300000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.85199999999999998,"5min":29.23,"15min":50.207000000000001},"last":0.91300000000000003}]},{"osd":2,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":9.6120000000000001,"15min":4.7039999999999997},"min":{"1min":0.40699999999999997,"5min":0.28399999999999997,"15min":0.26900000000000002},"max":{"1min":0.77400000000000002,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":8.6910000000000007,"15min":4.2229999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28399999999999997},"max":{"1min":0.90100000000000002,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.59999999999999998}]},{"osd":3,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":2.5049999999999999,"15min":2.75},"min":{"1min":0.36799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.92900000000000005,"5min":37.987000000000002,"15min":53.134999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":2.9889999999999999,"15min":4.3230000000000004},"min":{"1min":0.39000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.84099999999999997,"5min":31.831,"15min":161.191},"last":0.71899999999999997}]},{"osd":5,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":3.234,"15min":1.627},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.40000000000000002,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.313},{"interface":"front","average":{"1min":0.313,"5min":3.2970000000000002,"15min":1.708},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22800000000000001},"max":{"1min":0.47299999999999998,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.379}]},{"osd":6,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":5.4610000000000003,"15min":2.625},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.38400000000000001,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":5.0279999999999996,"15min":2.5430000000000001},"min":{"1min":0.309,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.46200000000000002,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.36199999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":4.6360000000000001,"15min":2.085},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.24299999999999999},"max":{"1min":0.442,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.378,"5min":4.0350000000000001,"15min":1.9119999999999999},"min":{"1min":0.34200000000000003,"5min":0.29999999999999999,"15min":0.28999999999999998},"max":{"1min":0.51400000000000001,"5min":51.997,"15min":51.997},"last":0.40000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:23:36.223 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:36.223 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:36.224 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-23T06:10:00.926557+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=10, tm_sec=0, tm_wday=5, tm_yday=83, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=23, tm_hour=6, tm_min=22, tm_sec=7, tm_wday=5, tm_yday=83, tm_isdst=0) 2024-03-23T06:23:36.224 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-23T06:23:56.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-23T06:23:56.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.422+0000 7f3517600640 1 Processor -- start 2024-03-23T06:23:56.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.422+0000 7f3517600640 1 -- start start 2024-03-23T06:23:56.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f3517600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3510153a80 0x7f35100cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f3517600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35101594f0 0x7f35100cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f3517600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35101599a0 con 0x7f35101536a0 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f3517600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351015a520 con 0x7f35101594f0 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f3517600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3510159c80 con 0x7f3510153a80 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f350fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3510153a80 0x7f35100cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f3514c00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f35101536a0 0x7f35100ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47372/0 (socket says 172.21.15.73:47372) 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f3514c00640 1 -- 172.21.15.73:0/4262078433 learned_addr learned my addr 172.21.15.73:0/4262078433 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.423+0000 7f3515600640 1 --2- 172.21.15.73:0/4262078433 >> v2:172.21.15.73:3300/0 conn(0x7f35101594f0 0x7f35100cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.424+0000 7f350fe00640 1 -- 172.21.15.73:0/4262078433 >> v2:172.21.15.73:3300/0 conn(0x7f35101594f0 msgr2=0x7f35100cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.424+0000 7f350fe00640 1 --2- 172.21.15.73:0/4262078433 >> v2:172.21.15.73:3300/0 conn(0x7f35101594f0 0x7f35100cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.424+0000 7f350fe00640 1 -- 172.21.15.73:0/4262078433 >> v1:172.21.15.110:6789/0 conn(0x7f35101536a0 legacy=0x7f35100ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.424+0000 7f350fe00640 1 -- 172.21.15.73:0/4262078433 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510159f60 con 0x7f3510153a80 2024-03-23T06:23:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.425+0000 7f350fe00640 1 --2- 172.21.15.73:0/4262078433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f35100cbe90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35100b2290 tx=0x7f34fc02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44044bffdc4e595 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.425+0000 7f350f400640 1 -- 172.21.15.73:0/4262078433 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc030710 con 0x7f3510153a80 2024-03-23T06:23:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.425+0000 7f350f400640 1 -- 172.21.15.73:0/4262078433 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc02e050 con 0x7f3510153a80 2024-03-23T06:23:56.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.425+0000 7f350f400640 1 -- 172.21.15.73:0/4262078433 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc030a90 con 0x7f3510153a80 2024-03-23T06:23:56.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.426+0000 7f3517600640 1 -- 172.21.15.73:0/4262078433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 msgr2=0x7f35100cbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.426+0000 7f3517600640 1 --2- 172.21.15.73:0/4262078433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f35100cbe90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35100b2290 tx=0x7f34fc02b710 comp rx=0 tx=0).stop 2024-03-23T06:23:56.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.426+0000 7f3517600640 1 -- 172.21.15.73:0/4262078433 shutdown_connections 2024-03-23T06:23:56.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.426+0000 7f3517600640 1 --2- 172.21.15.73:0/4262078433 >> v2:172.21.15.73:3300/0 conn(0x7f35101594f0 0x7f35100cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.426+0000 7f3517600640 1 --2- 172.21.15.73:0/4262078433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f35100cbe90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.426+0000 7f3517600640 1 -- 172.21.15.73:0/4262078433 >> 172.21.15.73:0/4262078433 conn(0x7f351006a060 msgr2=0x7f351006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:56.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.426+0000 7f3517600640 1 -- 172.21.15.73:0/4262078433 shutdown_connections 2024-03-23T06:23:56.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.426+0000 7f3517600640 1 -- 172.21.15.73:0/4262078433 wait complete. 2024-03-23T06:23:56.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.427+0000 7f3517600640 1 Processor -- start 2024-03-23T06:23:56.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.428+0000 7f3517600640 1 -- start start 2024-03-23T06:23:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.428+0000 7f3517600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101536a0 0x7f351014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.428+0000 7f3517600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f351014cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.428+0000 7f3517600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101594f0 0x7f351014a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.428+0000 7f3517600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35100b34e0 con 0x7f35101594f0 2024-03-23T06:23:56.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.428+0000 7f3517600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101493d0 con 0x7f3510153a80 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.428+0000 7f3517600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35101488c0 con 0x7f35101536a0 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f351014cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f3514c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101536a0 0x7f351014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f3515600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101594f0 0x7f351014a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f351014cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:56564/0 (socket says 172.21.15.73:56564) 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 -- 172.21.15.73:0/1404511226 learned_addr learned my addr 172.21.15.73:0/1404511226 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 -- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101536a0 msgr2=0x7f351014f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101536a0 0x7f351014f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 -- 172.21.15.73:0/1404511226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101594f0 msgr2=0x7f351014a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101594f0 0x7f351014a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 -- 172.21.15.73:0/1404511226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc009400 con 0x7f3510153a80 2024-03-23T06:23:56.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.429+0000 7f350fe00640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f351014cb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000c00 tx=0x7f34fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:56.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.430+0000 7f350cc00640 1 -- 172.21.15.73:0/1404511226 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc03b810 con 0x7f3510153a80 2024-03-23T06:23:56.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.430+0000 7f350cc00640 1 -- 172.21.15.73:0/1404511226 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc03b990 con 0x7f3510153a80 2024-03-23T06:23:56.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.430+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351014c410 con 0x7f3510153a80 2024-03-23T06:23:56.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.430+0000 7f350cc00640 1 -- 172.21.15.73:0/1404511226 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc03bd40 con 0x7f3510153a80 2024-03-23T06:23:56.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.430+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35101495e0 con 0x7f3510153a80 2024-03-23T06:23:56.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.431+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3510152c10 con 0x7f3510153a80 2024-03-23T06:23:56.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.432+0000 7f350cc00640 1 -- 172.21.15.73:0/1404511226 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f34fc039040 con 0x7f3510153a80 2024-03-23T06:23:56.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.432+0000 7f350cc00640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34f006ac00 0x7f34f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.433+0000 7f350cc00640 1 -- 172.21.15.73:0/1404511226 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f34fc0aaf70 con 0x7f3510153a80 2024-03-23T06:23:56.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.433+0000 7f3514c00640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34f006ac00 0x7f34f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.433+0000 7f3514c00640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34f006ac00 0x7f34f006d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3504000f60 tx=0x7f3504007e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:56.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.437+0000 7f350cc00640 1 -- 172.21.15.73:0/1404511226 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f34fc075d60 con 0x7f3510153a80 2024-03-23T06:23:56.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.631+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 --> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35100cb970 con 0x7f34f006ac00 2024-03-23T06:23:56.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.642+0000 7f350cc00640 1 -- 172.21.15.73:0/1404511226 <== mgr.4103 v2:172.21.15.110:6832/37697 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372982 (secure 0 0 0) 0x7f3504004c70 con 0x7f34f006ac00 2024-03-23T06:23:56.647 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:23:56.649 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-23T06:23:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34f006ac00 msgr2=0x7f34f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34f006ac00 0x7f34f006d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3504000f60 tx=0x7f3504007e00 comp rx=0 tx=0).stop 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 msgr2=0x7f351014cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f351014cb40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000c00 tx=0x7f34fc0046c0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 shutdown_connections 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35101594f0 0x7f351014a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3510153a80 0x7f351014cb40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f34f006ac00 0x7f34f006d0c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 --2- 172.21.15.73:0/1404511226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101536a0 0x7f351014f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 >> 172.21.15.73:0/1404511226 conn(0x7f351006a060 msgr2=0x7f35100cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 shutdown_connections 2024-03-23T06:23:56.651 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.648+0000 7f3517600640 1 -- 172.21.15.73:0/1404511226 wait complete. 2024-03-23T06:23:56.667 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-03-23T06:23:54.845369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89402572,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":152,"num_read_kb":223,"num_write":2469605,"num_write_kb":34184419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":171185,"ondisk_log_size":171185,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10060912,"kb_used_data":177008,"kb_used_omap":12,"kb_used_meta":9883827,"kb_avail":744913808,"statfs":{"total":773094113280,"available":762791739392,"internally_reserved":0,"allocated":181256192,"data_stored":179741648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":10121039416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002484"},"pg_stats":[{"pgid":"2.1f","version":"27'18","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.234338+0000","last_change":"2024-03-23T06:22:24.234338+0000","last_active":"2024-03-23T06:22:24.234338+0000","last_peered":"2024-03-23T06:22:24.234338+0000","last_clean":"2024-03-23T06:22:24.234338+0000","last_became_active":"2024-03-23T06:09:57.470518+0000","last_became_peered":"2024-03-23T06:09:57.470518+0000","last_unstale":"2024-03-23T06:22:24.234338+0000","last_undegraded":"2024-03-23T06:22:24.234338+0000","last_fullsized":"2024-03-23T06:22:24.234338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:24.234241+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.234241+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:53.812998+0000","scrub_duration":0.016306496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.301797+0000","last_change":"2024-03-23T06:22:16.301887+0000","last_active":"2024-03-23T06:22:16.301797+0000","last_peered":"2024-03-23T06:22:16.301797+0000","last_clean":"2024-03-23T06:22:16.301797+0000","last_became_active":"2024-03-23T06:09:57.953571+0000","last_became_peered":"2024-03-23T06:09:57.953571+0000","last_unstale":"2024-03-23T06:22:16.301797+0000","last_undegraded":"2024-03-23T06:22:16.301797+0000","last_fullsized":"2024-03-23T06:22:16.301797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:16.301777+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.301777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:37:55.431944+0000","scrub_duration":0.0022956500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'4649","reported_seq":4680,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:43.004409+0000","last_change":"2024-03-23T06:22:43.004574+0000","last_active":"2024-03-23T06:22:43.004409+0000","last_peered":"2024-03-23T06:22:43.004409+0000","last_clean":"2024-03-23T06:22:43.004409+0000","last_became_active":"2024-03-23T06:10:01.958113+0000","last_became_peered":"2024-03-23T06:10:01.958113+0000","last_unstale":"2024-03-23T06:22:43.004409+0000","last_undegraded":"2024-03-23T06:22:43.004409+0000","last_fullsized":"2024-03-23T06:22:43.004409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4649","last_scrub_stamp":"2024-03-23T06:22:43.004368+0000","last_deep_scrub":"27'4649","last_deep_scrub_stamp":"2024-03-23T06:22:43.004368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:43.004368+0000","objects_scrubbed":0,"log_size":4649,"log_dups_size":0,"ondisk_log_size":4649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:42:59.644058+0000","scrub_duration":0.043741127999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68384,"num_write_kb":905630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.340695+0000","last_change":"2024-03-23T06:22:28.340766+0000","last_active":"2024-03-23T06:22:28.340695+0000","last_peered":"2024-03-23T06:22:28.340695+0000","last_clean":"2024-03-23T06:22:28.340695+0000","last_became_active":"2024-03-23T06:09:57.453553+0000","last_became_peered":"2024-03-23T06:09:57.453553+0000","last_unstale":"2024-03-23T06:22:28.340695+0000","last_undegraded":"2024-03-23T06:22:28.340695+0000","last_fullsized":"2024-03-23T06:22:28.340695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:28.340675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.340675+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:05:53.500984+0000","scrub_duration":0.0074425539999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.402809+0000","last_change":"2024-03-23T06:22:20.402809+0000","last_active":"2024-03-23T06:22:20.402809+0000","last_peered":"2024-03-23T06:22:20.402809+0000","last_clean":"2024-03-23T06:22:20.402809+0000","last_became_active":"2024-03-23T06:09:57.946516+0000","last_became_peered":"2024-03-23T06:09:57.946516+0000","last_unstale":"2024-03-23T06:22:20.402809+0000","last_undegraded":"2024-03-23T06:22:20.402809+0000","last_fullsized":"2024-03-23T06:22:20.402809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:20.402677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.402677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:31:48.099293+0000","scrub_duration":0.064311640000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'5556","reported_seq":5587,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:38.960781+0000","last_change":"2024-03-23T06:22:38.960973+0000","last_active":"2024-03-23T06:22:38.960781+0000","last_peered":"2024-03-23T06:22:38.960781+0000","last_clean":"2024-03-23T06:22:38.960781+0000","last_became_active":"2024-03-23T06:10:01.969093+0000","last_became_peered":"2024-03-23T06:10:01.969093+0000","last_unstale":"2024-03-23T06:22:38.960781+0000","last_undegraded":"2024-03-23T06:22:38.960781+0000","last_fullsized":"2024-03-23T06:22:38.960781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5556","last_scrub_stamp":"2024-03-23T06:22:38.960753+0000","last_deep_scrub":"27'5556","last_deep_scrub_stamp":"2024-03-23T06:22:38.960753+0000","last_clean_scrub_stamp":"2024-03-23T06:22:38.960753+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:38:01.641630+0000","scrub_duration":0.14834329199999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81915,"num_write_kb":1146197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'165","reported_seq":198,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.665632+0000","last_change":"2024-03-23T06:22:26.665632+0000","last_active":"2024-03-23T06:22:26.665632+0000","last_peered":"2024-03-23T06:22:26.665632+0000","last_clean":"2024-03-23T06:22:26.665632+0000","last_became_active":"2024-03-23T06:09:57.469100+0000","last_became_peered":"2024-03-23T06:09:57.469100+0000","last_unstale":"2024-03-23T06:22:26.665632+0000","last_undegraded":"2024-03-23T06:22:26.665632+0000","last_fullsized":"2024-03-23T06:22:26.665632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'165","last_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_deep_scrub":"27'165","last_deep_scrub_stamp":"2024-03-23T06:22:26.665468+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.665468+0000","objects_scrubbed":5,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:40:12.950569+0000","scrub_duration":0.059269850999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":12362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'18","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.334167+0000","last_change":"2024-03-23T06:22:41.334291+0000","last_active":"2024-03-23T06:22:41.334167+0000","last_peered":"2024-03-23T06:22:41.334167+0000","last_clean":"2024-03-23T06:22:41.334167+0000","last_became_active":"2024-03-23T06:10:39.673720+0000","last_became_peered":"2024-03-23T06:10:39.673720+0000","last_unstale":"2024-03-23T06:22:41.334167+0000","last_undegraded":"2024-03-23T06:22:41.334167+0000","last_fullsized":"2024-03-23T06:22:41.334167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:41.334129+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:41.334129+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.334129+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:09:30.931263+0000","scrub_duration":0.0028427529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'5344","reported_seq":5375,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:52.921424+0000","last_change":"2024-03-23T06:22:52.921558+0000","last_active":"2024-03-23T06:22:52.921424+0000","last_peered":"2024-03-23T06:22:52.921424+0000","last_clean":"2024-03-23T06:22:52.921424+0000","last_became_active":"2024-03-23T06:10:01.975313+0000","last_became_peered":"2024-03-23T06:10:01.975313+0000","last_unstale":"2024-03-23T06:22:52.921424+0000","last_undegraded":"2024-03-23T06:22:52.921424+0000","last_fullsized":"2024-03-23T06:22:52.921424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5344","last_scrub_stamp":"2024-03-23T06:22:52.921402+0000","last_deep_scrub":"27'5344","last_deep_scrub_stamp":"2024-03-23T06:22:52.921402+0000","last_clean_scrub_stamp":"2024-03-23T06:22:52.921402+0000","objects_scrubbed":0,"log_size":5344,"log_dups_size":0,"ondisk_log_size":5344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:48.279588+0000","scrub_duration":0.13476870599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78781,"num_write_kb":1087299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:18.622320+0000","last_change":"2024-03-23T06:22:18.622320+0000","last_active":"2024-03-23T06:22:18.622320+0000","last_peered":"2024-03-23T06:22:18.622320+0000","last_clean":"2024-03-23T06:22:18.622320+0000","last_became_active":"2024-03-23T06:09:57.474797+0000","last_became_peered":"2024-03-23T06:09:57.474797+0000","last_unstale":"2024-03-23T06:22:18.622320+0000","last_undegraded":"2024-03-23T06:22:18.622320+0000","last_fullsized":"2024-03-23T06:22:18.622320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:18.622074+0000","last_clean_scrub_stamp":"2024-03-23T06:22:18.622074+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:17:57.132801+0000","scrub_duration":0.022310751,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'29","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.278949+0000","last_change":"2024-03-23T06:22:17.278949+0000","last_active":"2024-03-23T06:22:17.278949+0000","last_peered":"2024-03-23T06:22:17.278949+0000","last_clean":"2024-03-23T06:22:17.278949+0000","last_became_active":"2024-03-23T06:09:57.945855+0000","last_became_peered":"2024-03-23T06:09:57.945855+0000","last_unstale":"2024-03-23T06:22:17.278949+0000","last_undegraded":"2024-03-23T06:22:17.278949+0000","last_fullsized":"2024-03-23T06:22:17.278949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:17.278677+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.278677+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:35:44.193734+0000","scrub_duration":0.003489125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'5087","reported_seq":5119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.904915+0000","last_change":"2024-03-23T06:22:51.905102+0000","last_active":"2024-03-23T06:22:51.904915+0000","last_peered":"2024-03-23T06:22:51.904915+0000","last_clean":"2024-03-23T06:22:51.904915+0000","last_became_active":"2024-03-23T06:10:01.978975+0000","last_became_peered":"2024-03-23T06:10:01.978975+0000","last_unstale":"2024-03-23T06:22:51.904915+0000","last_undegraded":"2024-03-23T06:22:51.904915+0000","last_fullsized":"2024-03-23T06:22:51.904915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5087","last_scrub_stamp":"2024-03-23T06:22:51.904869+0000","last_deep_scrub":"27'5087","last_deep_scrub_stamp":"2024-03-23T06:22:51.904869+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.904869+0000","objects_scrubbed":0,"log_size":5087,"log_dups_size":0,"ondisk_log_size":5087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:40:20.756701+0000","scrub_duration":0.071307104999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":74993,"num_write_kb":1047409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.263737+0000","last_change":"2024-03-23T06:22:27.263737+0000","last_active":"2024-03-23T06:22:27.263737+0000","last_peered":"2024-03-23T06:22:27.263737+0000","last_clean":"2024-03-23T06:22:27.263737+0000","last_became_active":"2024-03-23T06:09:57.952672+0000","last_became_peered":"2024-03-23T06:09:57.952672+0000","last_unstale":"2024-03-23T06:22:27.263737+0000","last_undegraded":"2024-03-23T06:22:27.263737+0000","last_fullsized":"2024-03-23T06:22:27.263737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:27.263503+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.263503+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:55:00.258025+0000","scrub_duration":0.0032643260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'400","reported_seq":435,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:12.156575+0000","last_change":"2024-03-23T06:23:12.156575+0000","last_active":"2024-03-23T06:23:12.156575+0000","last_peered":"2024-03-23T06:23:12.156575+0000","last_clean":"2024-03-23T06:23:12.156575+0000","last_became_active":"2024-03-23T06:09:57.479729+0000","last_became_peered":"2024-03-23T06:09:57.479729+0000","last_unstale":"2024-03-23T06:23:12.156575+0000","last_undegraded":"2024-03-23T06:23:12.156575+0000","last_fullsized":"2024-03-23T06:23:12.156575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'400","last_scrub_stamp":"2024-03-23T06:23:12.156412+0000","last_deep_scrub":"27'400","last_deep_scrub_stamp":"2024-03-23T06:23:12.156412+0000","last_clean_scrub_stamp":"2024-03-23T06:23:12.156412+0000","objects_scrubbed":3,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:26:49.154275+0000","scrub_duration":0.033636777999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":388,"num_write_kb":4441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'5363","reported_seq":5395,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:36.158554+0000","last_change":"2024-03-23T06:23:36.158554+0000","last_active":"2024-03-23T06:23:36.158554+0000","last_peered":"2024-03-23T06:23:36.158554+0000","last_clean":"2024-03-23T06:23:36.158554+0000","last_became_active":"2024-03-23T06:10:01.968577+0000","last_became_peered":"2024-03-23T06:10:01.968577+0000","last_unstale":"2024-03-23T06:23:36.158554+0000","last_undegraded":"2024-03-23T06:23:36.158554+0000","last_fullsized":"2024-03-23T06:23:36.158554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5363","last_scrub_stamp":"2024-03-23T06:23:36.158327+0000","last_deep_scrub":"27'5363","last_deep_scrub_stamp":"2024-03-23T06:23:36.158327+0000","last_clean_scrub_stamp":"2024-03-23T06:23:36.158327+0000","objects_scrubbed":0,"log_size":5363,"log_dups_size":0,"ondisk_log_size":5363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:38:46.683651+0000","scrub_duration":0.065352814999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78913,"num_write_kb":1086463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.117488+0000","last_change":"2024-03-23T06:22:25.117488+0000","last_active":"2024-03-23T06:22:25.117488+0000","last_peered":"2024-03-23T06:22:25.117488+0000","last_clean":"2024-03-23T06:22:25.117488+0000","last_became_active":"2024-03-23T06:09:57.939286+0000","last_became_peered":"2024-03-23T06:09:57.939286+0000","last_unstale":"2024-03-23T06:22:25.117488+0000","last_undegraded":"2024-03-23T06:22:25.117488+0000","last_fullsized":"2024-03-23T06:22:25.117488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:25.117368+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.117368+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:18:30.718640+0000","scrub_duration":0.020924191000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:13.438725+0000","last_change":"2024-03-23T06:22:13.438725+0000","last_active":"2024-03-23T06:22:13.438725+0000","last_peered":"2024-03-23T06:22:13.438725+0000","last_clean":"2024-03-23T06:22:13.438725+0000","last_became_active":"2024-03-23T06:09:57.454454+0000","last_became_peered":"2024-03-23T06:09:57.454454+0000","last_unstale":"2024-03-23T06:22:13.438725+0000","last_undegraded":"2024-03-23T06:22:13.438725+0000","last_fullsized":"2024-03-23T06:22:13.438725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:13.438631+0000","last_clean_scrub_stamp":"2024-03-23T06:22:13.438631+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:34:21.050171+0000","scrub_duration":0.001784012,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'5233","reported_seq":5265,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.647951+0000","last_change":"2024-03-23T06:22:47.647951+0000","last_active":"2024-03-23T06:22:47.647951+0000","last_peered":"2024-03-23T06:22:47.647951+0000","last_clean":"2024-03-23T06:22:47.647951+0000","last_became_active":"2024-03-23T06:10:01.968712+0000","last_became_peered":"2024-03-23T06:10:01.968712+0000","last_unstale":"2024-03-23T06:22:47.647951+0000","last_undegraded":"2024-03-23T06:22:47.647951+0000","last_fullsized":"2024-03-23T06:22:47.647951+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5233","last_scrub_stamp":"2024-03-23T06:22:47.647769+0000","last_deep_scrub":"27'5233","last_deep_scrub_stamp":"2024-03-23T06:22:47.647769+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.647769+0000","objects_scrubbed":0,"log_size":5233,"log_dups_size":0,"ondisk_log_size":5233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:17:44.076130+0000","scrub_duration":0.091590610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77166,"num_write_kb":1045058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'19","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.087701+0000","last_change":"2024-03-23T06:22:45.087701+0000","last_active":"2024-03-23T06:22:45.087701+0000","last_peered":"2024-03-23T06:22:45.087701+0000","last_clean":"2024-03-23T06:22:45.087701+0000","last_became_active":"2024-03-23T06:09:57.933597+0000","last_became_peered":"2024-03-23T06:09:57.933597+0000","last_unstale":"2024-03-23T06:22:45.087701+0000","last_undegraded":"2024-03-23T06:22:45.087701+0000","last_fullsized":"2024-03-23T06:22:45.087701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:45.087612+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:45.087612+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.087612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:01:32.916486+0000","scrub_duration":0.001285736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.301934+0000","last_change":"2024-03-23T06:22:22.301934+0000","last_active":"2024-03-23T06:22:22.301934+0000","last_peered":"2024-03-23T06:22:22.301934+0000","last_clean":"2024-03-23T06:22:22.301934+0000","last_became_active":"2024-03-23T06:09:57.458745+0000","last_became_peered":"2024-03-23T06:09:57.458745+0000","last_unstale":"2024-03-23T06:22:22.301934+0000","last_undegraded":"2024-03-23T06:22:22.301934+0000","last_fullsized":"2024-03-23T06:22:22.301934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:22.301822+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.301822+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:51:57.846454+0000","scrub_duration":0.0052301179999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'6017","reported_seq":6049,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.010512+0000","last_change":"2024-03-23T06:22:41.010512+0000","last_active":"2024-03-23T06:22:41.010512+0000","last_peered":"2024-03-23T06:22:41.010512+0000","last_clean":"2024-03-23T06:22:41.010512+0000","last_became_active":"2024-03-23T06:10:01.980057+0000","last_became_peered":"2024-03-23T06:10:01.980057+0000","last_unstale":"2024-03-23T06:22:41.010512+0000","last_undegraded":"2024-03-23T06:22:41.010512+0000","last_fullsized":"2024-03-23T06:22:41.010512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6017","last_scrub_stamp":"2024-03-23T06:22:41.010309+0000","last_deep_scrub":"27'6017","last_deep_scrub_stamp":"2024-03-23T06:22:41.010309+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.010309+0000","objects_scrubbed":0,"log_size":6017,"log_dups_size":0,"ondisk_log_size":6017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:49:02.530772+0000","scrub_duration":0.049541337999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88809,"num_write_kb":1240496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:34.230582+0000","last_change":"2024-03-23T06:22:34.230582+0000","last_active":"2024-03-23T06:22:34.230582+0000","last_peered":"2024-03-23T06:22:34.230582+0000","last_clean":"2024-03-23T06:22:34.230582+0000","last_became_active":"2024-03-23T06:09:57.929684+0000","last_became_peered":"2024-03-23T06:09:57.929684+0000","last_unstale":"2024-03-23T06:22:34.230582+0000","last_undegraded":"2024-03-23T06:22:34.230582+0000","last_fullsized":"2024-03-23T06:22:34.230582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:22:34.230436+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:22:34.230436+0000","last_clean_scrub_stamp":"2024-03-23T06:22:34.230436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:09:56.885484+0000","scrub_duration":0.0018145329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:12.434207+0000","last_change":"2024-03-23T06:22:12.434207+0000","last_active":"2024-03-23T06:22:12.434207+0000","last_peered":"2024-03-23T06:22:12.434207+0000","last_clean":"2024-03-23T06:22:12.434207+0000","last_became_active":"2024-03-23T06:09:57.465475+0000","last_became_peered":"2024-03-23T06:09:57.465475+0000","last_unstale":"2024-03-23T06:22:12.434207+0000","last_undegraded":"2024-03-23T06:22:12.434207+0000","last_fullsized":"2024-03-23T06:22:12.434207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:12.434048+0000","last_clean_scrub_stamp":"2024-03-23T06:22:12.434048+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:01:00.920036+0000","scrub_duration":0.016801480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'4163","reported_seq":4195,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.905761+0000","last_change":"2024-03-23T06:22:48.905761+0000","last_active":"2024-03-23T06:22:48.905761+0000","last_peered":"2024-03-23T06:22:48.905761+0000","last_clean":"2024-03-23T06:22:48.905761+0000","last_became_active":"2024-03-23T06:10:01.974585+0000","last_became_peered":"2024-03-23T06:10:01.974585+0000","last_unstale":"2024-03-23T06:22:48.905761+0000","last_undegraded":"2024-03-23T06:22:48.905761+0000","last_fullsized":"2024-03-23T06:22:48.905761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4163","last_scrub_stamp":"2024-03-23T06:22:48.905532+0000","last_deep_scrub":"27'4163","last_deep_scrub_stamp":"2024-03-23T06:22:48.905532+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.905532+0000","objects_scrubbed":0,"log_size":4163,"log_dups_size":0,"ondisk_log_size":4163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:08:02.183029+0000","scrub_duration":0.107138319,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61204,"num_write_kb":836048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.083203+0000","last_change":"2024-03-23T06:22:41.083203+0000","last_active":"2024-03-23T06:22:41.083203+0000","last_peered":"2024-03-23T06:22:41.083203+0000","last_clean":"2024-03-23T06:22:41.083203+0000","last_became_active":"2024-03-23T06:09:57.933652+0000","last_became_peered":"2024-03-23T06:09:57.933652+0000","last_unstale":"2024-03-23T06:22:41.083203+0000","last_undegraded":"2024-03-23T06:22:41.083203+0000","last_fullsized":"2024-03-23T06:22:41.083203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:41.083112+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:41.083112+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.083112+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:51:20.359506+0000","scrub_duration":0.0017080439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'13","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.081197+0000","last_change":"2024-03-23T06:22:48.081197+0000","last_active":"2024-03-23T06:22:48.081197+0000","last_peered":"2024-03-23T06:22:48.081197+0000","last_clean":"2024-03-23T06:22:48.081197+0000","last_became_active":"2024-03-23T06:09:57.481958+0000","last_became_peered":"2024-03-23T06:09:57.481958+0000","last_unstale":"2024-03-23T06:22:48.081197+0000","last_undegraded":"2024-03-23T06:22:48.081197+0000","last_fullsized":"2024-03-23T06:22:48.081197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:48.080936+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:48.080936+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.080936+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:55:08.878167+0000","scrub_duration":0.0060221670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'6152","reported_seq":6184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:54.837921+0000","last_change":"2024-03-23T06:22:54.838104+0000","last_active":"2024-03-23T06:22:54.837921+0000","last_peered":"2024-03-23T06:22:54.837921+0000","last_clean":"2024-03-23T06:22:54.837921+0000","last_became_active":"2024-03-23T06:10:01.973230+0000","last_became_peered":"2024-03-23T06:10:01.973230+0000","last_unstale":"2024-03-23T06:22:54.837921+0000","last_undegraded":"2024-03-23T06:22:54.837921+0000","last_fullsized":"2024-03-23T06:22:54.837921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6152","last_scrub_stamp":"2024-03-23T06:22:54.837875+0000","last_deep_scrub":"27'6152","last_deep_scrub_stamp":"2024-03-23T06:22:54.837875+0000","last_clean_scrub_stamp":"2024-03-23T06:22:54.837875+0000","objects_scrubbed":0,"log_size":6152,"log_dups_size":0,"ondisk_log_size":6152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:45:35.567505+0000","scrub_duration":0.079897541000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":90873,"num_write_kb":1268839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'17","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.134899+0000","last_change":"2024-03-23T06:22:35.134899+0000","last_active":"2024-03-23T06:22:35.134899+0000","last_peered":"2024-03-23T06:22:35.134899+0000","last_clean":"2024-03-23T06:22:35.134899+0000","last_became_active":"2024-03-23T06:09:57.933671+0000","last_became_peered":"2024-03-23T06:09:57.933671+0000","last_unstale":"2024-03-23T06:22:35.134899+0000","last_undegraded":"2024-03-23T06:22:35.134899+0000","last_fullsized":"2024-03-23T06:22:35.134899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:35.134728+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:35.134728+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.134728+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:30.334770+0000","scrub_duration":0.012842018,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'99","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.219128+0000","last_change":"2024-03-23T06:22:26.219128+0000","last_active":"2024-03-23T06:22:26.219128+0000","last_peered":"2024-03-23T06:22:26.219128+0000","last_clean":"2024-03-23T06:22:26.219128+0000","last_became_active":"2024-03-23T06:09:57.461685+0000","last_became_peered":"2024-03-23T06:09:57.461685+0000","last_unstale":"2024-03-23T06:22:26.219128+0000","last_undegraded":"2024-03-23T06:22:26.219128+0000","last_fullsized":"2024-03-23T06:22:26.219128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'99","last_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_deep_scrub":"27'99","last_deep_scrub_stamp":"2024-03-23T06:22:26.218984+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.218984+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:35:47.992609+0000","scrub_duration":0.005800571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":196,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'4656","reported_seq":4688,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:58.093217+0000","last_change":"2024-03-23T06:22:58.093330+0000","last_active":"2024-03-23T06:22:58.093217+0000","last_peered":"2024-03-23T06:22:58.093217+0000","last_clean":"2024-03-23T06:22:58.093217+0000","last_became_active":"2024-03-23T06:10:01.961604+0000","last_became_peered":"2024-03-23T06:10:01.961604+0000","last_unstale":"2024-03-23T06:22:58.093217+0000","last_undegraded":"2024-03-23T06:22:58.093217+0000","last_fullsized":"2024-03-23T06:22:58.093217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4656","last_scrub_stamp":"2024-03-23T06:22:58.093196+0000","last_deep_scrub":"27'4656","last_deep_scrub_stamp":"2024-03-23T06:22:58.093196+0000","last_clean_scrub_stamp":"2024-03-23T06:22:58.093196+0000","objects_scrubbed":0,"log_size":4656,"log_dups_size":0,"ondisk_log_size":4656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:50:10.092555+0000","scrub_duration":0.041911003000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68433,"num_write_kb":941246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.408014+0000","last_change":"2024-03-23T06:22:25.408014+0000","last_active":"2024-03-23T06:22:25.408014+0000","last_peered":"2024-03-23T06:22:25.408014+0000","last_clean":"2024-03-23T06:22:25.408014+0000","last_became_active":"2024-03-23T06:09:57.939232+0000","last_became_peered":"2024-03-23T06:09:57.939232+0000","last_unstale":"2024-03-23T06:22:25.408014+0000","last_undegraded":"2024-03-23T06:22:25.408014+0000","last_fullsized":"2024-03-23T06:22:25.408014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:25.407913+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.407913+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:33:56.177740+0000","scrub_duration":0.0011927579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:04.114557+0000","last_change":"2024-03-23T06:23:04.114785+0000","last_active":"2024-03-23T06:23:04.114557+0000","last_peered":"2024-03-23T06:23:04.114557+0000","last_clean":"2024-03-23T06:23:04.114557+0000","last_became_active":"2024-03-23T06:09:57.471952+0000","last_became_peered":"2024-03-23T06:09:57.471952+0000","last_unstale":"2024-03-23T06:23:04.114557+0000","last_undegraded":"2024-03-23T06:23:04.114557+0000","last_fullsized":"2024-03-23T06:23:04.114557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-03-23T06:23:04.114506+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-03-23T06:23:04.114506+0000","last_clean_scrub_stamp":"2024-03-23T06:23:04.114506+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:30:04.169139+0000","scrub_duration":0.003954384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'4347","reported_seq":4379,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:38.295151+0000","last_change":"2024-03-23T06:22:38.295151+0000","last_active":"2024-03-23T06:22:38.295151+0000","last_peered":"2024-03-23T06:22:38.295151+0000","last_clean":"2024-03-23T06:22:38.295151+0000","last_became_active":"2024-03-23T06:10:01.977787+0000","last_became_peered":"2024-03-23T06:10:01.977787+0000","last_unstale":"2024-03-23T06:22:38.295151+0000","last_undegraded":"2024-03-23T06:22:38.295151+0000","last_fullsized":"2024-03-23T06:22:38.295151+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4347","last_scrub_stamp":"2024-03-23T06:22:38.294940+0000","last_deep_scrub":"27'4347","last_deep_scrub_stamp":"2024-03-23T06:22:38.294940+0000","last_clean_scrub_stamp":"2024-03-23T06:22:38.294940+0000","objects_scrubbed":0,"log_size":4347,"log_dups_size":0,"ondisk_log_size":4347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:30:07.533511+0000","scrub_duration":0.086332040999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64042,"num_write_kb":880898,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.893219+0000","last_change":"2024-03-23T06:22:24.893219+0000","last_active":"2024-03-23T06:22:24.893219+0000","last_peered":"2024-03-23T06:22:24.893219+0000","last_clean":"2024-03-23T06:22:24.893219+0000","last_became_active":"2024-03-23T06:09:57.949178+0000","last_became_peered":"2024-03-23T06:09:57.949178+0000","last_unstale":"2024-03-23T06:22:24.893219+0000","last_undegraded":"2024-03-23T06:22:24.893219+0000","last_fullsized":"2024-03-23T06:22:24.893219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:24.892857+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.892857+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:06.651897+0000","scrub_duration":0.020052960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:25.273805+0000","last_change":"2024-03-23T06:22:25.273805+0000","last_active":"2024-03-23T06:22:25.273805+0000","last_peered":"2024-03-23T06:22:25.273805+0000","last_clean":"2024-03-23T06:22:25.273805+0000","last_became_active":"2024-03-23T06:09:57.452123+0000","last_became_peered":"2024-03-23T06:09:57.452123+0000","last_unstale":"2024-03-23T06:22:25.273805+0000","last_undegraded":"2024-03-23T06:22:25.273805+0000","last_fullsized":"2024-03-23T06:22:25.273805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-03-23T06:22:25.273709+0000","last_clean_scrub_stamp":"2024-03-23T06:22:25.273709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:28:04.429353+0000","scrub_duration":0.001195563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'4606","reported_seq":4638,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:39.210898+0000","last_change":"2024-03-23T06:22:39.211048+0000","last_active":"2024-03-23T06:22:39.210898+0000","last_peered":"2024-03-23T06:22:39.210898+0000","last_clean":"2024-03-23T06:22:39.210898+0000","last_became_active":"2024-03-23T06:10:01.957361+0000","last_became_peered":"2024-03-23T06:10:01.957361+0000","last_unstale":"2024-03-23T06:22:39.210898+0000","last_undegraded":"2024-03-23T06:22:39.210898+0000","last_fullsized":"2024-03-23T06:22:39.210898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4606","last_scrub_stamp":"2024-03-23T06:22:39.210876+0000","last_deep_scrub":"27'4606","last_deep_scrub_stamp":"2024-03-23T06:22:39.210876+0000","last_clean_scrub_stamp":"2024-03-23T06:22:39.210876+0000","objects_scrubbed":0,"log_size":4606,"log_dups_size":0,"ondisk_log_size":4606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:47:08.464172+0000","scrub_duration":0.047816294000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67785,"num_write_kb":936043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:09.438536+0000","last_change":"2024-03-23T06:22:09.438536+0000","last_active":"2024-03-23T06:22:09.438536+0000","last_peered":"2024-03-23T06:22:09.438536+0000","last_clean":"2024-03-23T06:22:09.438536+0000","last_became_active":"2024-03-23T06:09:57.953656+0000","last_became_peered":"2024-03-23T06:09:57.953656+0000","last_unstale":"2024-03-23T06:22:09.438536+0000","last_undegraded":"2024-03-23T06:22:09.438536+0000","last_fullsized":"2024-03-23T06:22:09.438536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:09.438361+0000","last_clean_scrub_stamp":"2024-03-23T06:22:09.438361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:00:16.089523+0000","scrub_duration":0.017467308000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"27'28","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:55.154933+0000","last_change":"2024-03-23T06:22:55.155049+0000","last_active":"2024-03-23T06:22:55.154933+0000","last_peered":"2024-03-23T06:22:55.154933+0000","last_clean":"2024-03-23T06:22:55.154933+0000","last_became_active":"2024-03-23T06:09:57.473888+0000","last_became_peered":"2024-03-23T06:09:57.473888+0000","last_unstale":"2024-03-23T06:22:55.154933+0000","last_undegraded":"2024-03-23T06:22:55.154933+0000","last_fullsized":"2024-03-23T06:22:55.154933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T06:22:55.154898+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T06:22:55.154898+0000","last_clean_scrub_stamp":"2024-03-23T06:22:55.154898+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:21:57.344689+0000","scrub_duration":0.026185948000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'5383","reported_seq":5415,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:40.167031+0000","last_change":"2024-03-23T06:22:40.167031+0000","last_active":"2024-03-23T06:22:40.167031+0000","last_peered":"2024-03-23T06:22:40.167031+0000","last_clean":"2024-03-23T06:22:40.167031+0000","last_became_active":"2024-03-23T06:10:01.964108+0000","last_became_peered":"2024-03-23T06:10:01.964108+0000","last_unstale":"2024-03-23T06:22:40.167031+0000","last_undegraded":"2024-03-23T06:22:40.167031+0000","last_fullsized":"2024-03-23T06:22:40.167031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5383","last_scrub_stamp":"2024-03-23T06:22:40.166855+0000","last_deep_scrub":"27'5383","last_deep_scrub_stamp":"2024-03-23T06:22:40.166855+0000","last_clean_scrub_stamp":"2024-03-23T06:22:40.166855+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:44:26.975670+0000","scrub_duration":0.050518577000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79451,"num_write_kb":1090302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'22","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.342913+0000","last_change":"2024-03-23T06:22:23.342993+0000","last_active":"2024-03-23T06:22:23.342913+0000","last_peered":"2024-03-23T06:22:23.342913+0000","last_clean":"2024-03-23T06:22:23.342913+0000","last_became_active":"2024-03-23T06:09:57.938339+0000","last_became_peered":"2024-03-23T06:09:57.938339+0000","last_unstale":"2024-03-23T06:22:23.342913+0000","last_undegraded":"2024-03-23T06:22:23.342913+0000","last_fullsized":"2024-03-23T06:22:23.342913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.342894+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.342894+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:13:31.019943+0000","scrub_duration":0.001171252,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'42","reported_seq":109,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.117526+0000","last_change":"2024-03-23T06:22:15.117526+0000","last_active":"2024-03-23T06:22:15.117526+0000","last_peered":"2024-03-23T06:22:15.117526+0000","last_clean":"2024-03-23T06:22:15.117526+0000","last_became_active":"2024-03-23T06:09:57.452489+0000","last_became_peered":"2024-03-23T06:09:57.452489+0000","last_unstale":"2024-03-23T06:22:15.117526+0000","last_undegraded":"2024-03-23T06:22:15.117526+0000","last_fullsized":"2024-03-23T06:22:15.117526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-03-23T06:22:15.117424+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.117424+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:23:48.285959+0000","scrub_duration":0.003100383,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94141,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":38,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'5513","reported_seq":5555,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.348324+0000","last_change":"2024-03-23T06:22:32.348324+0000","last_active":"2024-03-23T06:22:32.348324+0000","last_peered":"2024-03-23T06:22:32.348324+0000","last_clean":"2024-03-23T06:22:32.348324+0000","last_became_active":"2024-03-23T06:10:39.799126+0000","last_became_peered":"2024-03-23T06:10:39.799126+0000","last_unstale":"2024-03-23T06:22:32.348324+0000","last_undegraded":"2024-03-23T06:22:32.348324+0000","last_fullsized":"2024-03-23T06:22:32.348324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5513","last_scrub_stamp":"2024-03-23T06:22:32.348185+0000","last_deep_scrub":"27'5513","last_deep_scrub_stamp":"2024-03-23T06:22:32.348185+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.348185+0000","objects_scrubbed":0,"log_size":5513,"log_dups_size":0,"ondisk_log_size":5513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:49:59.107739+0000","scrub_duration":0.088163792000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81455,"num_write_kb":1142223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.444706+0000","last_change":"2024-03-23T06:22:20.444706+0000","last_active":"2024-03-23T06:22:20.444706+0000","last_peered":"2024-03-23T06:22:20.444706+0000","last_clean":"2024-03-23T06:22:20.444706+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:20.444706+0000","last_undegraded":"2024-03-23T06:22:20.444706+0000","last_fullsized":"2024-03-23T06:22:20.444706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:20.444597+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.444597+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:38:16.085029+0000","scrub_duration":0.0020820489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'53","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:44.218789+0000","last_change":"2024-03-23T06:22:44.219077+0000","last_active":"2024-03-23T06:22:44.218789+0000","last_peered":"2024-03-23T06:22:44.218789+0000","last_clean":"2024-03-23T06:22:44.218789+0000","last_became_active":"2024-03-23T06:09:57.471371+0000","last_became_peered":"2024-03-23T06:09:57.471371+0000","last_unstale":"2024-03-23T06:22:44.218789+0000","last_undegraded":"2024-03-23T06:22:44.218789+0000","last_fullsized":"2024-03-23T06:22:44.218789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'53","last_scrub_stamp":"2024-03-23T06:22:44.218735+0000","last_deep_scrub":"27'53","last_deep_scrub_stamp":"2024-03-23T06:22:44.218735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:44.218735+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:06:16.319369+0000","scrub_duration":0.032610752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'5332","reported_seq":5364,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:07.609335+0000","last_change":"2024-03-23T06:23:07.609462+0000","last_active":"2024-03-23T06:23:07.609335+0000","last_peered":"2024-03-23T06:23:07.609335+0000","last_clean":"2024-03-23T06:23:07.609335+0000","last_became_active":"2024-03-23T06:10:01.959817+0000","last_became_peered":"2024-03-23T06:10:01.959817+0000","last_unstale":"2024-03-23T06:23:07.609335+0000","last_undegraded":"2024-03-23T06:23:07.609335+0000","last_fullsized":"2024-03-23T06:23:07.609335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5332","last_scrub_stamp":"2024-03-23T06:23:07.609314+0000","last_deep_scrub":"27'5332","last_deep_scrub_stamp":"2024-03-23T06:23:07.609314+0000","last_clean_scrub_stamp":"2024-03-23T06:23:07.609314+0000","objects_scrubbed":0,"log_size":5332,"log_dups_size":0,"ondisk_log_size":5332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:00:39.820258+0000","scrub_duration":0.046390492999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77998,"num_write_kb":1097810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'14","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:34.131745+0000","last_change":"2024-03-23T06:22:34.131836+0000","last_active":"2024-03-23T06:22:34.131745+0000","last_peered":"2024-03-23T06:22:34.131745+0000","last_clean":"2024-03-23T06:22:34.131745+0000","last_became_active":"2024-03-23T06:09:57.946207+0000","last_became_peered":"2024-03-23T06:09:57.946207+0000","last_unstale":"2024-03-23T06:22:34.131745+0000","last_undegraded":"2024-03-23T06:22:34.131745+0000","last_fullsized":"2024-03-23T06:22:34.131745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:34.131727+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:34.131727+0000","last_clean_scrub_stamp":"2024-03-23T06:22:34.131727+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:21:23.166528+0000","scrub_duration":0.001854968,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:52.135634+0000","last_change":"2024-03-23T06:22:52.135840+0000","last_active":"2024-03-23T06:22:52.135634+0000","last_peered":"2024-03-23T06:22:52.135634+0000","last_clean":"2024-03-23T06:22:52.135634+0000","last_became_active":"2024-03-23T06:09:57.477193+0000","last_became_peered":"2024-03-23T06:09:57.477193+0000","last_unstale":"2024-03-23T06:22:52.135634+0000","last_undegraded":"2024-03-23T06:22:52.135634+0000","last_fullsized":"2024-03-23T06:22:52.135634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:52.135580+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:52.135580+0000","last_clean_scrub_stamp":"2024-03-23T06:22:52.135580+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:59:45.624273+0000","scrub_duration":0.0067533489999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.434497+0000","last_change":"2024-03-23T06:22:10.434689+0000","last_active":"2024-03-23T06:22:10.434497+0000","last_peered":"2024-03-23T06:22:10.434497+0000","last_clean":"2024-03-23T06:22:10.434497+0000","last_became_active":"2024-03-23T06:09:48.251417+0000","last_became_peered":"2024-03-23T06:09:48.251417+0000","last_unstale":"2024-03-23T06:22:10.434497+0000","last_undegraded":"2024-03-23T06:22:10.434497+0000","last_fullsized":"2024-03-23T06:22:10.434497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-03-23T06:22:10.434445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.434445+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:53:51.345697+0000","scrub_duration":0.011047585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'5835","reported_seq":5867,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:31.105004+0000","last_change":"2024-03-23T06:23:31.105190+0000","last_active":"2024-03-23T06:23:31.105004+0000","last_peered":"2024-03-23T06:23:31.105004+0000","last_clean":"2024-03-23T06:23:31.105004+0000","last_became_active":"2024-03-23T06:10:01.980365+0000","last_became_peered":"2024-03-23T06:10:01.980365+0000","last_unstale":"2024-03-23T06:23:31.105004+0000","last_undegraded":"2024-03-23T06:23:31.105004+0000","last_fullsized":"2024-03-23T06:23:31.105004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5835","last_scrub_stamp":"2024-03-23T06:23:31.104969+0000","last_deep_scrub":"27'5835","last_deep_scrub_stamp":"2024-03-23T06:23:31.104969+0000","last_clean_scrub_stamp":"2024-03-23T06:23:31.104969+0000","objects_scrubbed":0,"log_size":5835,"log_dups_size":0,"ondisk_log_size":5835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:30:47.466819+0000","scrub_duration":0.107446976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86420,"num_write_kb":1198699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'19","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.264433+0000","last_change":"2024-03-23T06:22:19.264433+0000","last_active":"2024-03-23T06:22:19.264433+0000","last_peered":"2024-03-23T06:22:19.264433+0000","last_clean":"2024-03-23T06:22:19.264433+0000","last_became_active":"2024-03-23T06:09:57.955658+0000","last_became_peered":"2024-03-23T06:09:57.955658+0000","last_unstale":"2024-03-23T06:22:19.264433+0000","last_undegraded":"2024-03-23T06:22:19.264433+0000","last_fullsized":"2024-03-23T06:22:19.264433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:19.264125+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.264125+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:41:16.245860+0000","scrub_duration":0.0035297940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.434139+0000","last_change":"2024-03-23T06:22:16.434139+0000","last_active":"2024-03-23T06:22:16.434139+0000","last_peered":"2024-03-23T06:22:16.434139+0000","last_clean":"2024-03-23T06:22:16.434139+0000","last_became_active":"2024-03-23T06:09:57.457725+0000","last_became_peered":"2024-03-23T06:09:57.457725+0000","last_unstale":"2024-03-23T06:22:16.434139+0000","last_undegraded":"2024-03-23T06:22:16.434139+0000","last_fullsized":"2024-03-23T06:22:16.434139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-03-23T06:22:16.433996+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.433996+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:13:36.235706+0000","scrub_duration":0.0057335859999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'5251","reported_seq":5293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:39.907512+0000","last_change":"2024-03-23T06:22:39.907512+0000","last_active":"2024-03-23T06:22:39.907512+0000","last_peered":"2024-03-23T06:22:39.907512+0000","last_clean":"2024-03-23T06:22:39.907512+0000","last_became_active":"2024-03-23T06:10:39.804180+0000","last_became_peered":"2024-03-23T06:10:39.804180+0000","last_unstale":"2024-03-23T06:22:39.907512+0000","last_undegraded":"2024-03-23T06:22:39.907512+0000","last_fullsized":"2024-03-23T06:22:39.907512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5251","last_scrub_stamp":"2024-03-23T06:22:39.907179+0000","last_deep_scrub":"27'5251","last_deep_scrub_stamp":"2024-03-23T06:22:39.907179+0000","last_clean_scrub_stamp":"2024-03-23T06:22:39.907179+0000","objects_scrubbed":0,"log_size":5251,"log_dups_size":0,"ondisk_log_size":5251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:08:53.331286+0000","scrub_duration":0.13370536,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77410,"num_write_kb":1073506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,7,4],"acting":[2,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.594039+0000","last_change":"2024-03-23T06:22:27.594039+0000","last_active":"2024-03-23T06:22:27.594039+0000","last_peered":"2024-03-23T06:22:27.594039+0000","last_clean":"2024-03-23T06:22:27.594039+0000","last_became_active":"2024-03-23T06:09:57.942116+0000","last_became_peered":"2024-03-23T06:09:57.942116+0000","last_unstale":"2024-03-23T06:22:27.594039+0000","last_undegraded":"2024-03-23T06:22:27.594039+0000","last_fullsized":"2024-03-23T06:22:27.594039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:27.593735+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.593735+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:10.812412+0000","scrub_duration":0.0028611280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'25","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.313601+0000","last_change":"2024-03-23T06:22:24.313601+0000","last_active":"2024-03-23T06:22:24.313601+0000","last_peered":"2024-03-23T06:22:24.313601+0000","last_clean":"2024-03-23T06:22:24.313601+0000","last_became_active":"2024-03-23T06:09:57.467434+0000","last_became_peered":"2024-03-23T06:09:57.467434+0000","last_unstale":"2024-03-23T06:22:24.313601+0000","last_undegraded":"2024-03-23T06:22:24.313601+0000","last_fullsized":"2024-03-23T06:22:24.313601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:24.313505+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.313505+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:32:44.992621+0000","scrub_duration":0.020603684000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'4796","reported_seq":4828,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:56.512542+0000","last_change":"2024-03-23T06:22:56.512542+0000","last_active":"2024-03-23T06:22:56.512542+0000","last_peered":"2024-03-23T06:22:56.512542+0000","last_clean":"2024-03-23T06:22:56.512542+0000","last_became_active":"2024-03-23T06:10:01.961230+0000","last_became_peered":"2024-03-23T06:10:01.961230+0000","last_unstale":"2024-03-23T06:22:56.512542+0000","last_undegraded":"2024-03-23T06:22:56.512542+0000","last_fullsized":"2024-03-23T06:22:56.512542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4796","last_scrub_stamp":"2024-03-23T06:22:56.512396+0000","last_deep_scrub":"27'4796","last_deep_scrub_stamp":"2024-03-23T06:22:56.512396+0000","last_clean_scrub_stamp":"2024-03-23T06:22:56.512396+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:10:20.674579+0000","scrub_duration":0.063493923999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70495,"num_write_kb":960778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.691338+0000","last_change":"2024-03-23T06:22:35.691338+0000","last_active":"2024-03-23T06:22:35.691338+0000","last_peered":"2024-03-23T06:22:35.691338+0000","last_clean":"2024-03-23T06:22:35.691338+0000","last_became_active":"2024-03-23T06:09:57.946540+0000","last_became_peered":"2024-03-23T06:09:57.946540+0000","last_unstale":"2024-03-23T06:22:35.691338+0000","last_undegraded":"2024-03-23T06:22:35.691338+0000","last_fullsized":"2024-03-23T06:22:35.691338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:35.690945+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:35.690945+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.690945+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:48:55.846631+0000","scrub_duration":0.025112247000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'25","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.160458+0000","last_change":"2024-03-23T06:22:29.160458+0000","last_active":"2024-03-23T06:22:29.160458+0000","last_peered":"2024-03-23T06:22:29.160458+0000","last_clean":"2024-03-23T06:22:29.160458+0000","last_became_active":"2024-03-23T06:09:57.453417+0000","last_became_peered":"2024-03-23T06:09:57.453417+0000","last_unstale":"2024-03-23T06:22:29.160458+0000","last_undegraded":"2024-03-23T06:22:29.160458+0000","last_fullsized":"2024-03-23T06:22:29.160458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:29.160317+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.160317+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:53:12.339833+0000","scrub_duration":0.0076372239999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'5554","reported_seq":5586,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:32.091699+0000","last_change":"2024-03-23T06:23:32.091986+0000","last_active":"2024-03-23T06:23:32.091699+0000","last_peered":"2024-03-23T06:23:32.091699+0000","last_clean":"2024-03-23T06:23:32.091699+0000","last_became_active":"2024-03-23T06:10:01.973871+0000","last_became_peered":"2024-03-23T06:10:01.973871+0000","last_unstale":"2024-03-23T06:23:32.091699+0000","last_undegraded":"2024-03-23T06:23:32.091699+0000","last_fullsized":"2024-03-23T06:23:32.091699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5554","last_scrub_stamp":"2024-03-23T06:23:32.091643+0000","last_deep_scrub":"27'5554","last_deep_scrub_stamp":"2024-03-23T06:23:32.091643+0000","last_clean_scrub_stamp":"2024-03-23T06:23:32.091643+0000","objects_scrubbed":0,"log_size":5554,"log_dups_size":0,"ondisk_log_size":5554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:43:51.581225+0000","scrub_duration":0.079822729999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82169,"num_write_kb":1157078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:33.907193+0000","last_change":"2024-03-23T06:22:33.907193+0000","last_active":"2024-03-23T06:22:33.907193+0000","last_peered":"2024-03-23T06:22:33.907193+0000","last_clean":"2024-03-23T06:22:33.907193+0000","last_became_active":"2024-03-23T06:09:57.951166+0000","last_became_peered":"2024-03-23T06:09:57.951166+0000","last_unstale":"2024-03-23T06:22:33.907193+0000","last_undegraded":"2024-03-23T06:22:33.907193+0000","last_fullsized":"2024-03-23T06:22:33.907193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:33.906955+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:33.906955+0000","last_clean_scrub_stamp":"2024-03-23T06:22:33.906955+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:59:33.711376+0000","scrub_duration":0.0030598840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'54","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:20.584461+0000","last_change":"2024-03-23T06:22:20.584461+0000","last_active":"2024-03-23T06:22:20.584461+0000","last_peered":"2024-03-23T06:22:20.584461+0000","last_clean":"2024-03-23T06:22:20.584461+0000","last_became_active":"2024-03-23T06:09:57.457756+0000","last_became_peered":"2024-03-23T06:09:57.457756+0000","last_unstale":"2024-03-23T06:22:20.584461+0000","last_undegraded":"2024-03-23T06:22:20.584461+0000","last_fullsized":"2024-03-23T06:22:20.584461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'54","last_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_deep_scrub":"27'54","last_deep_scrub_stamp":"2024-03-23T06:22:20.584313+0000","last_clean_scrub_stamp":"2024-03-23T06:22:20.584313+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:03:42.668360+0000","scrub_duration":0.010912419,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":632815,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'4566","reported_seq":4598,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.362204+0000","last_change":"2024-03-23T06:22:45.362204+0000","last_active":"2024-03-23T06:22:45.362204+0000","last_peered":"2024-03-23T06:22:45.362204+0000","last_clean":"2024-03-23T06:22:45.362204+0000","last_became_active":"2024-03-23T06:10:01.980760+0000","last_became_peered":"2024-03-23T06:10:01.980760+0000","last_unstale":"2024-03-23T06:22:45.362204+0000","last_undegraded":"2024-03-23T06:22:45.362204+0000","last_fullsized":"2024-03-23T06:22:45.362204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4566","last_scrub_stamp":"2024-03-23T06:22:45.361824+0000","last_deep_scrub":"27'4566","last_deep_scrub_stamp":"2024-03-23T06:22:45.361824+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.361824+0000","objects_scrubbed":0,"log_size":4566,"log_dups_size":0,"ondisk_log_size":4566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:05:22.604742+0000","scrub_duration":0.049166682000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67303,"num_write_kb":918425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:15.294321+0000","last_change":"2024-03-23T06:22:15.294560+0000","last_active":"2024-03-23T06:22:15.294321+0000","last_peered":"2024-03-23T06:22:15.294321+0000","last_clean":"2024-03-23T06:22:15.294321+0000","last_became_active":"2024-03-23T06:09:57.953799+0000","last_became_peered":"2024-03-23T06:09:57.953799+0000","last_unstale":"2024-03-23T06:22:15.294321+0000","last_undegraded":"2024-03-23T06:22:15.294321+0000","last_fullsized":"2024-03-23T06:22:15.294321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:15.294273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:15.294273+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:05:44.698199+0000","scrub_duration":0.013606521999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'29","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.270315+0000","last_change":"2024-03-23T06:22:19.270416+0000","last_active":"2024-03-23T06:22:19.270315+0000","last_peered":"2024-03-23T06:22:19.270315+0000","last_clean":"2024-03-23T06:22:19.270315+0000","last_became_active":"2024-03-23T06:09:57.445691+0000","last_became_peered":"2024-03-23T06:09:57.445691+0000","last_unstale":"2024-03-23T06:22:19.270315+0000","last_undegraded":"2024-03-23T06:22:19.270315+0000","last_fullsized":"2024-03-23T06:22:19.270315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'29","last_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_deep_scrub":"27'29","last_deep_scrub_stamp":"2024-03-23T06:22:19.270293+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.270293+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:42:03.814587+0000","scrub_duration":0.0055263279999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'5940","reported_seq":5972,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:06.620720+0000","last_change":"2024-03-23T06:23:06.620899+0000","last_active":"2024-03-23T06:23:06.620720+0000","last_peered":"2024-03-23T06:23:06.620720+0000","last_clean":"2024-03-23T06:23:06.620720+0000","last_became_active":"2024-03-23T06:10:01.961756+0000","last_became_peered":"2024-03-23T06:10:01.961756+0000","last_unstale":"2024-03-23T06:23:06.620720+0000","last_undegraded":"2024-03-23T06:23:06.620720+0000","last_fullsized":"2024-03-23T06:23:06.620720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5940","last_scrub_stamp":"2024-03-23T06:23:06.620677+0000","last_deep_scrub":"27'5940","last_deep_scrub_stamp":"2024-03-23T06:23:06.620677+0000","last_clean_scrub_stamp":"2024-03-23T06:23:06.620677+0000","objects_scrubbed":0,"log_size":5940,"log_dups_size":0,"ondisk_log_size":5940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:30:26.608650+0000","scrub_duration":0.078009674000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":2,"num_write":87253,"num_write_kb":1194618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.311858+0000","last_change":"2024-03-23T06:22:30.312073+0000","last_active":"2024-03-23T06:22:30.311858+0000","last_peered":"2024-03-23T06:22:30.311858+0000","last_clean":"2024-03-23T06:22:30.311858+0000","last_became_active":"2024-03-23T06:09:57.938602+0000","last_became_peered":"2024-03-23T06:09:57.938602+0000","last_unstale":"2024-03-23T06:22:30.311858+0000","last_undegraded":"2024-03-23T06:22:30.311858+0000","last_fullsized":"2024-03-23T06:22:30.311858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:30.311808+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.311808+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:24:48.713636+0000","scrub_duration":0.0026864620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'11","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.567867+0000","last_change":"2024-03-23T06:22:21.568095+0000","last_active":"2024-03-23T06:22:21.567867+0000","last_peered":"2024-03-23T06:22:21.567867+0000","last_clean":"2024-03-23T06:22:21.567867+0000","last_became_active":"2024-03-23T06:09:57.478016+0000","last_became_peered":"2024-03-23T06:09:57.478016+0000","last_unstale":"2024-03-23T06:22:21.567867+0000","last_undegraded":"2024-03-23T06:22:21.567867+0000","last_fullsized":"2024-03-23T06:22:21.567867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-03-23T06:22:21.567817+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.567817+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:28:27.726121+0000","scrub_duration":0.0064138650000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":935,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'5309","reported_seq":5340,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:59.578148+0000","last_change":"2024-03-23T06:22:59.578266+0000","last_active":"2024-03-23T06:22:59.578148+0000","last_peered":"2024-03-23T06:22:59.578148+0000","last_clean":"2024-03-23T06:22:59.578148+0000","last_became_active":"2024-03-23T06:10:01.967464+0000","last_became_peered":"2024-03-23T06:10:01.967464+0000","last_unstale":"2024-03-23T06:22:59.578148+0000","last_undegraded":"2024-03-23T06:22:59.578148+0000","last_fullsized":"2024-03-23T06:22:59.578148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5309","last_scrub_stamp":"2024-03-23T06:22:59.578129+0000","last_deep_scrub":"27'5309","last_deep_scrub_stamp":"2024-03-23T06:22:59.578129+0000","last_clean_scrub_stamp":"2024-03-23T06:22:59.578129+0000","objects_scrubbed":0,"log_size":5309,"log_dups_size":0,"ondisk_log_size":5309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:58:47.720582+0000","scrub_duration":0.053511425000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78228,"num_write_kb":1082301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'27","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.408474+0000","last_change":"2024-03-23T06:22:11.408732+0000","last_active":"2024-03-23T06:22:11.408474+0000","last_peered":"2024-03-23T06:22:11.408474+0000","last_clean":"2024-03-23T06:22:11.408474+0000","last_became_active":"2024-03-23T06:09:57.946663+0000","last_became_peered":"2024-03-23T06:09:57.946663+0000","last_unstale":"2024-03-23T06:22:11.408474+0000","last_undegraded":"2024-03-23T06:22:11.408474+0000","last_fullsized":"2024-03-23T06:22:11.408474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:11.408422+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.408422+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:21:16.861147+0000","scrub_duration":0.0032855250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:17.095567+0000","last_change":"2024-03-23T06:23:17.095851+0000","last_active":"2024-03-23T06:23:17.095567+0000","last_peered":"2024-03-23T06:23:17.095567+0000","last_clean":"2024-03-23T06:23:17.095567+0000","last_became_active":"2024-03-23T06:09:57.472471+0000","last_became_peered":"2024-03-23T06:09:57.472471+0000","last_unstale":"2024-03-23T06:23:17.095567+0000","last_undegraded":"2024-03-23T06:23:17.095567+0000","last_fullsized":"2024-03-23T06:23:17.095567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-03-23T06:23:17.095468+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-03-23T06:23:17.095468+0000","last_clean_scrub_stamp":"2024-03-23T06:23:17.095468+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:12:07.206922+0000","scrub_duration":0.0054978240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'5252","reported_seq":5283,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:46.247751+0000","last_change":"2024-03-23T06:22:46.247864+0000","last_active":"2024-03-23T06:22:46.247751+0000","last_peered":"2024-03-23T06:22:46.247751+0000","last_clean":"2024-03-23T06:22:46.247751+0000","last_became_active":"2024-03-23T06:10:01.959815+0000","last_became_peered":"2024-03-23T06:10:01.959815+0000","last_unstale":"2024-03-23T06:22:46.247751+0000","last_undegraded":"2024-03-23T06:22:46.247751+0000","last_fullsized":"2024-03-23T06:22:46.247751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5252","last_scrub_stamp":"2024-03-23T06:22:46.247730+0000","last_deep_scrub":"27'5252","last_deep_scrub_stamp":"2024-03-23T06:22:46.247730+0000","last_clean_scrub_stamp":"2024-03-23T06:22:46.247730+0000","objects_scrubbed":0,"log_size":5252,"log_dups_size":0,"ondisk_log_size":5252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:58:39.050927+0000","scrub_duration":0.055585051000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77473,"num_write_kb":1074668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.389413+0000","last_change":"2024-03-23T06:22:23.389530+0000","last_active":"2024-03-23T06:22:23.389413+0000","last_peered":"2024-03-23T06:22:23.389413+0000","last_clean":"2024-03-23T06:22:23.389413+0000","last_became_active":"2024-03-23T06:09:57.940040+0000","last_became_peered":"2024-03-23T06:09:57.940040+0000","last_unstale":"2024-03-23T06:22:23.389413+0000","last_undegraded":"2024-03-23T06:22:23.389413+0000","last_fullsized":"2024-03-23T06:22:23.389413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:23.389377+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.389377+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:57:35.577088+0000","scrub_duration":0.0020420400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'46","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.174186+0000","last_change":"2024-03-23T06:22:17.174270+0000","last_active":"2024-03-23T06:22:17.174186+0000","last_peered":"2024-03-23T06:22:17.174186+0000","last_clean":"2024-03-23T06:22:17.174186+0000","last_became_active":"2024-03-23T06:09:57.464430+0000","last_became_peered":"2024-03-23T06:09:57.464430+0000","last_unstale":"2024-03-23T06:22:17.174186+0000","last_undegraded":"2024-03-23T06:22:17.174186+0000","last_fullsized":"2024-03-23T06:22:17.174186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-03-23T06:22:17.174166+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.174166+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:43.279079+0000","scrub_duration":0.036150521999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":8214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'4869","reported_seq":4900,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:38.181077+0000","last_change":"2024-03-23T06:23:38.181278+0000","last_active":"2024-03-23T06:23:38.181077+0000","last_peered":"2024-03-23T06:23:38.181077+0000","last_clean":"2024-03-23T06:23:38.181077+0000","last_became_active":"2024-03-23T06:10:01.967723+0000","last_became_peered":"2024-03-23T06:10:01.967723+0000","last_unstale":"2024-03-23T06:23:38.181077+0000","last_undegraded":"2024-03-23T06:23:38.181077+0000","last_fullsized":"2024-03-23T06:23:38.181077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4869","last_scrub_stamp":"2024-03-23T06:23:38.181046+0000","last_deep_scrub":"27'4869","last_deep_scrub_stamp":"2024-03-23T06:23:38.181046+0000","last_clean_scrub_stamp":"2024-03-23T06:23:38.181046+0000","objects_scrubbed":0,"log_size":4869,"log_dups_size":0,"ondisk_log_size":4869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:14:24.554848+0000","scrub_duration":0.075392043000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72205,"num_write_kb":1015401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'16","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.628830+0000","last_change":"2024-03-23T06:22:28.628962+0000","last_active":"2024-03-23T06:22:28.628830+0000","last_peered":"2024-03-23T06:22:28.628830+0000","last_clean":"2024-03-23T06:22:28.628830+0000","last_became_active":"2024-03-23T06:09:57.942955+0000","last_became_peered":"2024-03-23T06:09:57.942955+0000","last_unstale":"2024-03-23T06:22:28.628830+0000","last_undegraded":"2024-03-23T06:22:28.628830+0000","last_fullsized":"2024-03-23T06:22:28.628830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:28.628795+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:28.628795+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.628795+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:54:54.770817+0000","scrub_duration":0.0036585469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'235","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:11.849123+0000","last_change":"2024-03-23T06:22:11.849229+0000","last_active":"2024-03-23T06:22:11.849123+0000","last_peered":"2024-03-23T06:22:11.849123+0000","last_clean":"2024-03-23T06:22:11.849123+0000","last_became_active":"2024-03-23T06:09:57.449437+0000","last_became_peered":"2024-03-23T06:09:57.449437+0000","last_unstale":"2024-03-23T06:22:11.849123+0000","last_undegraded":"2024-03-23T06:22:11.849123+0000","last_fullsized":"2024-03-23T06:22:11.849123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'235","last_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_deep_scrub":"27'235","last_deep_scrub_stamp":"2024-03-23T06:22:11.849094+0000","last_clean_scrub_stamp":"2024-03-23T06:22:11.849094+0000","objects_scrubbed":5,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:39.149866+0000","scrub_duration":0.018805761000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":227,"num_write_kb":4212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'5454","reported_seq":5486,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.038075+0000","last_change":"2024-03-23T06:22:51.038220+0000","last_active":"2024-03-23T06:22:51.038075+0000","last_peered":"2024-03-23T06:22:51.038075+0000","last_clean":"2024-03-23T06:22:51.038075+0000","last_became_active":"2024-03-23T06:10:01.960414+0000","last_became_peered":"2024-03-23T06:10:01.960414+0000","last_unstale":"2024-03-23T06:22:51.038075+0000","last_undegraded":"2024-03-23T06:22:51.038075+0000","last_fullsized":"2024-03-23T06:22:51.038075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5454","last_scrub_stamp":"2024-03-23T06:22:51.038053+0000","last_deep_scrub":"27'5454","last_deep_scrub_stamp":"2024-03-23T06:22:51.038053+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.038053+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:44:27.997214+0000","scrub_duration":0.040048050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":80035,"num_write_kb":1104767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'18","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:28.296103+0000","last_change":"2024-03-23T06:22:28.296211+0000","last_active":"2024-03-23T06:22:28.296103+0000","last_peered":"2024-03-23T06:22:28.296103+0000","last_clean":"2024-03-23T06:22:28.296103+0000","last_became_active":"2024-03-23T06:09:57.953626+0000","last_became_peered":"2024-03-23T06:09:57.953626+0000","last_unstale":"2024-03-23T06:22:28.296103+0000","last_undegraded":"2024-03-23T06:22:28.296103+0000","last_fullsized":"2024-03-23T06:22:28.296103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:28.296069+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:28.296069+0000","last_clean_scrub_stamp":"2024-03-23T06:22:28.296069+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:07:55.030356+0000","scrub_duration":0.0028074770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.081823+0000","last_change":"2024-03-23T06:22:24.081903+0000","last_active":"2024-03-23T06:22:24.081823+0000","last_peered":"2024-03-23T06:22:24.081823+0000","last_clean":"2024-03-23T06:22:24.081823+0000","last_became_active":"2024-03-23T06:09:57.447678+0000","last_became_peered":"2024-03-23T06:09:57.447678+0000","last_unstale":"2024-03-23T06:22:24.081823+0000","last_undegraded":"2024-03-23T06:22:24.081823+0000","last_fullsized":"2024-03-23T06:22:24.081823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:24.081802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.081802+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:19:52.223689+0000","scrub_duration":0.0031724399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'5697","reported_seq":5729,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:46.927300+0000","last_change":"2024-03-23T06:22:46.927435+0000","last_active":"2024-03-23T06:22:46.927300+0000","last_peered":"2024-03-23T06:22:46.927300+0000","last_clean":"2024-03-23T06:22:46.927300+0000","last_became_active":"2024-03-23T06:10:01.973472+0000","last_became_peered":"2024-03-23T06:10:01.973472+0000","last_unstale":"2024-03-23T06:22:46.927300+0000","last_undegraded":"2024-03-23T06:22:46.927300+0000","last_fullsized":"2024-03-23T06:22:46.927300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5697","last_scrub_stamp":"2024-03-23T06:22:46.927277+0000","last_deep_scrub":"27'5697","last_deep_scrub_stamp":"2024-03-23T06:22:46.927277+0000","last_clean_scrub_stamp":"2024-03-23T06:22:46.927277+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:21:05.900325+0000","scrub_duration":0.10768414,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":7,"num_write":83520,"num_write_kb":1148891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:42.417823+0000","last_change":"2024-03-23T06:22:42.417958+0000","last_active":"2024-03-23T06:22:42.417823+0000","last_peered":"2024-03-23T06:22:42.417823+0000","last_clean":"2024-03-23T06:22:42.417823+0000","last_became_active":"2024-03-23T06:09:57.943428+0000","last_became_peered":"2024-03-23T06:09:57.943428+0000","last_unstale":"2024-03-23T06:22:42.417823+0000","last_undegraded":"2024-03-23T06:22:42.417823+0000","last_fullsized":"2024-03-23T06:22:42.417823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:42.417802+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:42.417802+0000","last_clean_scrub_stamp":"2024-03-23T06:22:42.417802+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:45:28.791609+0000","scrub_duration":0.044168832999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'6","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.544964+0000","last_change":"2024-03-23T06:22:23.545071+0000","last_active":"2024-03-23T06:22:23.544964+0000","last_peered":"2024-03-23T06:22:23.544964+0000","last_clean":"2024-03-23T06:22:23.544964+0000","last_became_active":"2024-03-23T06:09:57.476344+0000","last_became_peered":"2024-03-23T06:09:57.476344+0000","last_unstale":"2024-03-23T06:22:23.544964+0000","last_undegraded":"2024-03-23T06:22:23.544964+0000","last_fullsized":"2024-03-23T06:22:23.544964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-03-23T06:22:23.544931+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.544931+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:19:48.158158+0000","scrub_duration":0.0052986079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'5410","reported_seq":5441,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:35.111027+0000","last_change":"2024-03-23T06:22:35.111149+0000","last_active":"2024-03-23T06:22:35.111027+0000","last_peered":"2024-03-23T06:22:35.111027+0000","last_clean":"2024-03-23T06:22:35.111027+0000","last_became_active":"2024-03-23T06:10:01.973147+0000","last_became_peered":"2024-03-23T06:10:01.973147+0000","last_unstale":"2024-03-23T06:22:35.111027+0000","last_undegraded":"2024-03-23T06:22:35.111027+0000","last_fullsized":"2024-03-23T06:22:35.111027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5410","last_scrub_stamp":"2024-03-23T06:22:35.111007+0000","last_deep_scrub":"27'5410","last_deep_scrub_stamp":"2024-03-23T06:22:35.111007+0000","last_clean_scrub_stamp":"2024-03-23T06:22:35.111007+0000","objects_scrubbed":0,"log_size":5410,"log_dups_size":0,"ondisk_log_size":5410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:18:26.289653+0000","scrub_duration":0.081376517999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79508,"num_write_kb":1115568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'23","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.789158+0000","last_change":"2024-03-23T06:22:36.789460+0000","last_active":"2024-03-23T06:22:36.789158+0000","last_peered":"2024-03-23T06:22:36.789158+0000","last_clean":"2024-03-23T06:22:36.789158+0000","last_became_active":"2024-03-23T06:09:57.955336+0000","last_became_peered":"2024-03-23T06:09:57.955336+0000","last_unstale":"2024-03-23T06:22:36.789158+0000","last_undegraded":"2024-03-23T06:22:36.789158+0000","last_fullsized":"2024-03-23T06:22:36.789158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:36.789091+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:36.789091+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.789091+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:20:32.423764+0000","scrub_duration":0.0039367719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.344399+0000","last_change":"2024-03-23T06:22:21.344504+0000","last_active":"2024-03-23T06:22:21.344399+0000","last_peered":"2024-03-23T06:22:21.344399+0000","last_clean":"2024-03-23T06:22:21.344399+0000","last_became_active":"2024-03-23T06:09:57.467786+0000","last_became_peered":"2024-03-23T06:09:57.467786+0000","last_unstale":"2024-03-23T06:22:21.344399+0000","last_undegraded":"2024-03-23T06:22:21.344399+0000","last_fullsized":"2024-03-23T06:22:21.344399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:21.344365+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.344365+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:36:55.229393+0000","scrub_duration":0.0036549210000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'5604","reported_seq":5645,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:00.124068+0000","last_change":"2024-03-23T06:23:00.124225+0000","last_active":"2024-03-23T06:23:00.124068+0000","last_peered":"2024-03-23T06:23:00.124068+0000","last_clean":"2024-03-23T06:23:00.124068+0000","last_became_active":"2024-03-23T06:10:39.801451+0000","last_became_peered":"2024-03-23T06:10:39.801451+0000","last_unstale":"2024-03-23T06:23:00.124068+0000","last_undegraded":"2024-03-23T06:23:00.124068+0000","last_fullsized":"2024-03-23T06:23:00.124068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5604","last_scrub_stamp":"2024-03-23T06:23:00.124027+0000","last_deep_scrub":"27'5604","last_deep_scrub_stamp":"2024-03-23T06:23:00.124027+0000","last_clean_scrub_stamp":"2024-03-23T06:23:00.124027+0000","objects_scrubbed":0,"log_size":5604,"log_dups_size":0,"ondisk_log_size":5604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:51:29.007977+0000","scrub_duration":0.065459959999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82699,"num_write_kb":1122318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4695","reported_seq":4727,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:57.074048+0000","last_change":"2024-03-23T06:22:57.074229+0000","last_active":"2024-03-23T06:22:57.074048+0000","last_peered":"2024-03-23T06:22:57.074048+0000","last_clean":"2024-03-23T06:22:57.074048+0000","last_became_active":"2024-03-23T06:10:01.961296+0000","last_became_peered":"2024-03-23T06:10:01.961296+0000","last_unstale":"2024-03-23T06:22:57.074048+0000","last_undegraded":"2024-03-23T06:22:57.074048+0000","last_fullsized":"2024-03-23T06:22:57.074048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4695","last_scrub_stamp":"2024-03-23T06:22:57.074006+0000","last_deep_scrub":"27'4695","last_deep_scrub_stamp":"2024-03-23T06:22:57.074006+0000","last_clean_scrub_stamp":"2024-03-23T06:22:57.074006+0000","objects_scrubbed":0,"log_size":4695,"log_dups_size":0,"ondisk_log_size":4695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:01:10.699513+0000","scrub_duration":0.040829837000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69288,"num_write_kb":959182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'19","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:16.192359+0000","last_change":"2024-03-23T06:22:16.192455+0000","last_active":"2024-03-23T06:22:16.192359+0000","last_peered":"2024-03-23T06:22:16.192359+0000","last_clean":"2024-03-23T06:22:16.192359+0000","last_became_active":"2024-03-23T06:09:57.938554+0000","last_became_peered":"2024-03-23T06:09:57.938554+0000","last_unstale":"2024-03-23T06:22:16.192359+0000","last_undegraded":"2024-03-23T06:22:16.192359+0000","last_fullsized":"2024-03-23T06:22:16.192359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2024-03-23T06:22:16.192340+0000","last_clean_scrub_stamp":"2024-03-23T06:22:16.192340+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:36:59.548342+0000","scrub_duration":0.0022608480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"27'35","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:15.108260+0000","last_change":"2024-03-23T06:23:15.108371+0000","last_active":"2024-03-23T06:23:15.108260+0000","last_peered":"2024-03-23T06:23:15.108260+0000","last_clean":"2024-03-23T06:23:15.108260+0000","last_became_active":"2024-03-23T06:09:57.482038+0000","last_became_peered":"2024-03-23T06:09:57.482038+0000","last_unstale":"2024-03-23T06:23:15.108260+0000","last_undegraded":"2024-03-23T06:23:15.108260+0000","last_fullsized":"2024-03-23T06:23:15.108260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'35","last_scrub_stamp":"2024-03-23T06:23:15.108225+0000","last_deep_scrub":"27'35","last_deep_scrub_stamp":"2024-03-23T06:23:15.108225+0000","last_clean_scrub_stamp":"2024-03-23T06:23:15.108225+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:33:26.594910+0000","scrub_duration":0.028690133999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":8206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'5534","reported_seq":5566,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:37.139321+0000","last_change":"2024-03-23T06:23:37.139496+0000","last_active":"2024-03-23T06:23:37.139321+0000","last_peered":"2024-03-23T06:23:37.139321+0000","last_clean":"2024-03-23T06:23:37.139321+0000","last_became_active":"2024-03-23T06:10:01.980390+0000","last_became_peered":"2024-03-23T06:10:01.980390+0000","last_unstale":"2024-03-23T06:23:37.139321+0000","last_undegraded":"2024-03-23T06:23:37.139321+0000","last_fullsized":"2024-03-23T06:23:37.139321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5534","last_scrub_stamp":"2024-03-23T06:23:37.139287+0000","last_deep_scrub":"27'5534","last_deep_scrub_stamp":"2024-03-23T06:23:37.139287+0000","last_clean_scrub_stamp":"2024-03-23T06:23:37.139287+0000","objects_scrubbed":0,"log_size":5534,"log_dups_size":0,"ondisk_log_size":5534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:00:40.363550+0000","scrub_duration":0.082227369999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81628,"num_write_kb":1114589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'25","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.394919+0000","last_change":"2024-03-23T06:22:36.395013+0000","last_active":"2024-03-23T06:22:36.394919+0000","last_peered":"2024-03-23T06:22:36.394919+0000","last_clean":"2024-03-23T06:22:36.394919+0000","last_became_active":"2024-03-23T06:09:57.941709+0000","last_became_peered":"2024-03-23T06:09:57.941709+0000","last_unstale":"2024-03-23T06:22:36.394919+0000","last_undegraded":"2024-03-23T06:22:36.394919+0000","last_fullsized":"2024-03-23T06:22:36.394919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'25","last_scrub_stamp":"2024-03-23T06:22:36.394897+0000","last_deep_scrub":"27'25","last_deep_scrub_stamp":"2024-03-23T06:22:36.394897+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.394897+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:58:46.898461+0000","scrub_duration":0.00127731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'7","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.404159+0000","last_change":"2024-03-23T06:22:17.404227+0000","last_active":"2024-03-23T06:22:17.404159+0000","last_peered":"2024-03-23T06:22:17.404159+0000","last_clean":"2024-03-23T06:22:17.404159+0000","last_became_active":"2024-03-23T06:09:57.460877+0000","last_became_peered":"2024-03-23T06:09:57.460877+0000","last_unstale":"2024-03-23T06:22:17.404159+0000","last_undegraded":"2024-03-23T06:22:17.404159+0000","last_fullsized":"2024-03-23T06:22:17.404159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-03-23T06:22:17.404138+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.404138+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T12:22:05.019725+0000","scrub_duration":0.0043990399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.233394+0000","last_change":"2024-03-23T06:22:41.233488+0000","last_active":"2024-03-23T06:22:41.233394+0000","last_peered":"2024-03-23T06:22:41.233394+0000","last_clean":"2024-03-23T06:22:41.233394+0000","last_became_active":"2024-03-23T06:09:57.482358+0000","last_became_peered":"2024-03-23T06:09:57.482358+0000","last_unstale":"2024-03-23T06:22:41.233394+0000","last_undegraded":"2024-03-23T06:22:41.233394+0000","last_fullsized":"2024-03-23T06:22:41.233394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:41.233370+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:41.233370+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.233370+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:56:30.911476+0000","scrub_duration":0.018389154000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:31.156271+0000","last_change":"2024-03-23T06:22:31.156271+0000","last_active":"2024-03-23T06:22:31.156271+0000","last_peered":"2024-03-23T06:22:31.156271+0000","last_clean":"2024-03-23T06:22:31.156271+0000","last_became_active":"2024-03-23T06:09:57.931593+0000","last_became_peered":"2024-03-23T06:09:57.931593+0000","last_unstale":"2024-03-23T06:22:31.156271+0000","last_undegraded":"2024-03-23T06:22:31.156271+0000","last_fullsized":"2024-03-23T06:22:31.156271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:31.156172+0000","last_clean_scrub_stamp":"2024-03-23T06:22:31.156172+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:16:36.346305+0000","scrub_duration":0.0027602590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'5541","reported_seq":5572,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:56.057222+0000","last_change":"2024-03-23T06:22:56.057352+0000","last_active":"2024-03-23T06:22:56.057222+0000","last_peered":"2024-03-23T06:22:56.057222+0000","last_clean":"2024-03-23T06:22:56.057222+0000","last_became_active":"2024-03-23T06:10:01.948508+0000","last_became_peered":"2024-03-23T06:10:01.948508+0000","last_unstale":"2024-03-23T06:22:56.057222+0000","last_undegraded":"2024-03-23T06:22:56.057222+0000","last_fullsized":"2024-03-23T06:22:56.057222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5541","last_scrub_stamp":"2024-03-23T06:22:56.057202+0000","last_deep_scrub":"27'5541","last_deep_scrub_stamp":"2024-03-23T06:22:56.057202+0000","last_clean_scrub_stamp":"2024-03-23T06:22:56.057202+0000","objects_scrubbed":0,"log_size":5541,"log_dups_size":0,"ondisk_log_size":5541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:10:33.574782+0000","scrub_duration":0.033591270999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":81654,"num_write_kb":1127123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'987","reported_seq":1020,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.331383+0000","last_change":"2024-03-23T06:22:27.331383+0000","last_active":"2024-03-23T06:22:27.331383+0000","last_peered":"2024-03-23T06:22:27.331383+0000","last_clean":"2024-03-23T06:22:27.331383+0000","last_became_active":"2024-03-23T06:09:57.451623+0000","last_became_peered":"2024-03-23T06:09:57.451623+0000","last_unstale":"2024-03-23T06:22:27.331383+0000","last_undegraded":"2024-03-23T06:22:27.331383+0000","last_fullsized":"2024-03-23T06:22:27.331383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'987","last_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_deep_scrub":"27'987","last_deep_scrub_stamp":"2024-03-23T06:22:27.331273+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.331273+0000","objects_scrubbed":3,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:32:55.613936+0000","scrub_duration":0.012878013000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195273,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":978,"num_write_kb":4980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:23.345944+0000","last_change":"2024-03-23T06:22:23.345944+0000","last_active":"2024-03-23T06:22:23.345944+0000","last_peered":"2024-03-23T06:22:23.345944+0000","last_clean":"2024-03-23T06:22:23.345944+0000","last_became_active":"2024-03-23T06:09:57.938805+0000","last_became_peered":"2024-03-23T06:09:57.938805+0000","last_unstale":"2024-03-23T06:22:23.345944+0000","last_undegraded":"2024-03-23T06:22:23.345944+0000","last_fullsized":"2024-03-23T06:22:23.345944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:23.345675+0000","last_clean_scrub_stamp":"2024-03-23T06:22:23.345675+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T14:57:48.142305+0000","scrub_duration":0.0030686540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'4732","reported_seq":4763,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.076006+0000","last_change":"2024-03-23T06:22:37.076006+0000","last_active":"2024-03-23T06:22:37.076006+0000","last_peered":"2024-03-23T06:22:37.076006+0000","last_clean":"2024-03-23T06:22:37.076006+0000","last_became_active":"2024-03-23T06:10:01.966689+0000","last_became_peered":"2024-03-23T06:10:01.966689+0000","last_unstale":"2024-03-23T06:22:37.076006+0000","last_undegraded":"2024-03-23T06:22:37.076006+0000","last_fullsized":"2024-03-23T06:22:37.076006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4732","last_scrub_stamp":"2024-03-23T06:22:37.075828+0000","last_deep_scrub":"27'4732","last_deep_scrub_stamp":"2024-03-23T06:22:37.075828+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.075828+0000","objects_scrubbed":0,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:35:19.836743+0000","scrub_duration":0.084933690000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69596,"num_write_kb":973560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'23","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:17.801751+0000","last_change":"2024-03-23T06:22:17.801751+0000","last_active":"2024-03-23T06:22:17.801751+0000","last_peered":"2024-03-23T06:22:17.801751+0000","last_clean":"2024-03-23T06:22:17.801751+0000","last_became_active":"2024-03-23T06:09:57.947026+0000","last_became_peered":"2024-03-23T06:09:57.947026+0000","last_unstale":"2024-03-23T06:22:17.801751+0000","last_undegraded":"2024-03-23T06:22:17.801751+0000","last_fullsized":"2024-03-23T06:22:17.801751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-03-23T06:22:17.801514+0000","last_clean_scrub_stamp":"2024-03-23T06:22:17.801514+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:07.169700+0000","scrub_duration":0.0027127649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'24","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.038128+0000","last_change":"2024-03-23T06:22:30.038128+0000","last_active":"2024-03-23T06:22:30.038128+0000","last_peered":"2024-03-23T06:22:30.038128+0000","last_clean":"2024-03-23T06:22:30.038128+0000","last_became_active":"2024-03-23T06:09:57.945862+0000","last_became_peered":"2024-03-23T06:09:57.945862+0000","last_unstale":"2024-03-23T06:22:30.038128+0000","last_undegraded":"2024-03-23T06:22:30.038128+0000","last_fullsized":"2024-03-23T06:22:30.038128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-03-23T06:22:30.038036+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.038036+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:56:00.263151+0000","scrub_duration":0.0018525620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'22","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.296590+0000","last_change":"2024-03-23T06:22:26.296590+0000","last_active":"2024-03-23T06:22:26.296590+0000","last_peered":"2024-03-23T06:22:26.296590+0000","last_clean":"2024-03-23T06:22:26.296590+0000","last_became_active":"2024-03-23T06:09:57.943405+0000","last_became_peered":"2024-03-23T06:09:57.943405+0000","last_unstale":"2024-03-23T06:22:26.296590+0000","last_undegraded":"2024-03-23T06:22:26.296590+0000","last_fullsized":"2024-03-23T06:22:26.296590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:26.296445+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.296445+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:27:30.354398+0000","scrub_duration":0.001966677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.430809+0000","last_change":"2024-03-23T06:22:37.430899+0000","last_active":"2024-03-23T06:22:37.430809+0000","last_peered":"2024-03-23T06:22:37.430809+0000","last_clean":"2024-03-23T06:22:37.430809+0000","last_became_active":"2024-03-23T06:09:57.938377+0000","last_became_peered":"2024-03-23T06:09:57.938377+0000","last_unstale":"2024-03-23T06:22:37.430809+0000","last_undegraded":"2024-03-23T06:22:37.430809+0000","last_fullsized":"2024-03-23T06:22:37.430809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:37.430790+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:37.430790+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.430790+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:54:12.996368+0000","scrub_duration":0.0069039490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'14","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:30.280994+0000","last_change":"2024-03-23T06:22:30.280994+0000","last_active":"2024-03-23T06:22:30.280994+0000","last_peered":"2024-03-23T06:22:30.280994+0000","last_clean":"2024-03-23T06:22:30.280994+0000","last_became_active":"2024-03-23T06:09:57.948395+0000","last_became_peered":"2024-03-23T06:09:57.948395+0000","last_unstale":"2024-03-23T06:22:30.280994+0000","last_undegraded":"2024-03-23T06:22:30.280994+0000","last_fullsized":"2024-03-23T06:22:30.280994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:30.280888+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:30.280888+0000","last_clean_scrub_stamp":"2024-03-23T06:22:30.280888+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:12:40.399188+0000","scrub_duration":0.002164539,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:21.448141+0000","last_change":"2024-03-23T06:22:21.448141+0000","last_active":"2024-03-23T06:22:21.448141+0000","last_peered":"2024-03-23T06:22:21.448141+0000","last_clean":"2024-03-23T06:22:21.448141+0000","last_became_active":"2024-03-23T06:09:57.936138+0000","last_became_peered":"2024-03-23T06:09:57.936138+0000","last_unstale":"2024-03-23T06:22:21.448141+0000","last_undegraded":"2024-03-23T06:22:21.448141+0000","last_fullsized":"2024-03-23T06:22:21.448141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:21.447969+0000","last_clean_scrub_stamp":"2024-03-23T06:22:21.447969+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T16:08:29.179604+0000","scrub_duration":0.012766777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'27","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:37.814058+0000","last_change":"2024-03-23T06:22:37.814058+0000","last_active":"2024-03-23T06:22:37.814058+0000","last_peered":"2024-03-23T06:22:37.814058+0000","last_clean":"2024-03-23T06:22:37.814058+0000","last_became_active":"2024-03-23T06:09:57.954987+0000","last_became_peered":"2024-03-23T06:09:57.954987+0000","last_unstale":"2024-03-23T06:22:37.814058+0000","last_undegraded":"2024-03-23T06:22:37.814058+0000","last_fullsized":"2024-03-23T06:22:37.814058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:37.813738+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:37.813738+0000","last_clean_scrub_stamp":"2024-03-23T06:22:37.813738+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:04:44.682405+0000","scrub_duration":0.0033203070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'15","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:51.442345+0000","last_change":"2024-03-23T06:22:51.442345+0000","last_active":"2024-03-23T06:22:51.442345+0000","last_peered":"2024-03-23T06:22:51.442345+0000","last_clean":"2024-03-23T06:22:51.442345+0000","last_became_active":"2024-03-23T06:09:57.946418+0000","last_became_peered":"2024-03-23T06:09:57.946418+0000","last_unstale":"2024-03-23T06:22:51.442345+0000","last_undegraded":"2024-03-23T06:22:51.442345+0000","last_fullsized":"2024-03-23T06:22:51.442345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:51.442207+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:51.442207+0000","last_clean_scrub_stamp":"2024-03-23T06:22:51.442207+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T18:17:56.327553+0000","scrub_duration":0.029129189,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:40.207309+0000","last_change":"2024-03-23T06:22:40.207309+0000","last_active":"2024-03-23T06:22:40.207309+0000","last_peered":"2024-03-23T06:22:40.207309+0000","last_clean":"2024-03-23T06:22:40.207309+0000","last_became_active":"2024-03-23T06:09:57.941235+0000","last_became_peered":"2024-03-23T06:09:57.941235+0000","last_unstale":"2024-03-23T06:22:40.207309+0000","last_undegraded":"2024-03-23T06:22:40.207309+0000","last_fullsized":"2024-03-23T06:22:40.207309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:40.207151+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:40.207151+0000","last_clean_scrub_stamp":"2024-03-23T06:22:40.207151+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:14.602763+0000","scrub_duration":0.002043114,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'20","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.348067+0000","last_change":"2024-03-23T06:22:41.348067+0000","last_active":"2024-03-23T06:22:41.348067+0000","last_peered":"2024-03-23T06:22:41.348067+0000","last_clean":"2024-03-23T06:22:41.348067+0000","last_became_active":"2024-03-23T06:09:57.951307+0000","last_became_peered":"2024-03-23T06:09:57.951307+0000","last_unstale":"2024-03-23T06:22:41.348067+0000","last_undegraded":"2024-03-23T06:22:41.348067+0000","last_fullsized":"2024-03-23T06:22:41.348067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:41.347972+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:41.347972+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.347972+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:31:56.700950+0000","scrub_duration":0.002267458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'22","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.343157+0000","last_change":"2024-03-23T06:22:32.343157+0000","last_active":"2024-03-23T06:22:32.343157+0000","last_peered":"2024-03-23T06:22:32.343157+0000","last_clean":"2024-03-23T06:22:32.343157+0000","last_became_active":"2024-03-23T06:09:57.937561+0000","last_became_peered":"2024-03-23T06:09:57.937561+0000","last_unstale":"2024-03-23T06:22:32.343157+0000","last_undegraded":"2024-03-23T06:22:32.343157+0000","last_fullsized":"2024-03-23T06:22:32.343157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:32.343003+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:32.343003+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.343003+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:12:33.068970+0000","scrub_duration":0.0030932540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'27","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.023655+0000","last_change":"2024-03-23T06:22:47.023655+0000","last_active":"2024-03-23T06:22:47.023655+0000","last_peered":"2024-03-23T06:22:47.023655+0000","last_clean":"2024-03-23T06:22:47.023655+0000","last_became_active":"2024-03-23T06:09:57.945785+0000","last_became_peered":"2024-03-23T06:09:57.945785+0000","last_unstale":"2024-03-23T06:22:47.023655+0000","last_undegraded":"2024-03-23T06:22:47.023655+0000","last_fullsized":"2024-03-23T06:22:47.023655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'27","last_scrub_stamp":"2024-03-23T06:22:47.023557+0000","last_deep_scrub":"27'27","last_deep_scrub_stamp":"2024-03-23T06:22:47.023557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.023557+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T17:04:00.947841+0000","scrub_duration":0.00272047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'18","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:10.443727+0000","last_change":"2024-03-23T06:22:10.443727+0000","last_active":"2024-03-23T06:22:10.443727+0000","last_peered":"2024-03-23T06:22:10.443727+0000","last_clean":"2024-03-23T06:22:10.443727+0000","last_became_active":"2024-03-23T06:09:57.946813+0000","last_became_peered":"2024-03-23T06:09:57.946813+0000","last_unstale":"2024-03-23T06:22:10.443727+0000","last_undegraded":"2024-03-23T06:22:10.443727+0000","last_fullsized":"2024-03-23T06:22:10.443727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:10.443557+0000","last_clean_scrub_stamp":"2024-03-23T06:22:10.443557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:54:38.092496+0000","scrub_duration":0.002201901,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'18","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:28.058133+0000","last_change":"2024-03-23T06:23:28.058133+0000","last_active":"2024-03-23T06:23:28.058133+0000","last_peered":"2024-03-23T06:23:28.058133+0000","last_clean":"2024-03-23T06:23:28.058133+0000","last_became_active":"2024-03-23T06:09:57.941175+0000","last_became_peered":"2024-03-23T06:09:57.941175+0000","last_unstale":"2024-03-23T06:23:28.058133+0000","last_undegraded":"2024-03-23T06:23:28.058133+0000","last_fullsized":"2024-03-23T06:23:28.058133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:23:28.057988+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:23:28.057988+0000","last_clean_scrub_stamp":"2024-03-23T06:23:28.057988+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:45:23.990880+0000","scrub_duration":0.002450519,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'30","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:27.102123+0000","last_change":"2024-03-23T06:22:27.102202+0000","last_active":"2024-03-23T06:22:27.102123+0000","last_peered":"2024-03-23T06:22:27.102123+0000","last_clean":"2024-03-23T06:22:27.102123+0000","last_became_active":"2024-03-23T06:09:57.952898+0000","last_became_peered":"2024-03-23T06:09:57.952898+0000","last_unstale":"2024-03-23T06:22:27.102123+0000","last_undegraded":"2024-03-23T06:22:27.102123+0000","last_fullsized":"2024-03-23T06:22:27.102123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-03-23T06:22:27.102103+0000","last_clean_scrub_stamp":"2024-03-23T06:22:27.102103+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:44:04.072008+0000","scrub_duration":0.0025710630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'18","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:19.149499+0000","last_change":"2024-03-23T06:23:19.149616+0000","last_active":"2024-03-23T06:23:19.149499+0000","last_peered":"2024-03-23T06:23:19.149499+0000","last_clean":"2024-03-23T06:23:19.149499+0000","last_became_active":"2024-03-23T06:09:57.946798+0000","last_became_peered":"2024-03-23T06:09:57.946798+0000","last_unstale":"2024-03-23T06:23:19.149499+0000","last_undegraded":"2024-03-23T06:23:19.149499+0000","last_fullsized":"2024-03-23T06:23:19.149499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:23:19.149475+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:23:19.149475+0000","last_clean_scrub_stamp":"2024-03-23T06:23:19.149475+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:47:57.930063+0000","scrub_duration":0.086740787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'21","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:23:25.054128+0000","last_change":"2024-03-23T06:23:25.054408+0000","last_active":"2024-03-23T06:23:25.054128+0000","last_peered":"2024-03-23T06:23:25.054128+0000","last_clean":"2024-03-23T06:23:25.054128+0000","last_became_active":"2024-03-23T06:09:57.946460+0000","last_became_peered":"2024-03-23T06:09:57.946460+0000","last_unstale":"2024-03-23T06:23:25.054128+0000","last_undegraded":"2024-03-23T06:23:25.054128+0000","last_fullsized":"2024-03-23T06:23:25.054128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-03-23T06:23:25.054075+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-03-23T06:23:25.054075+0000","last_clean_scrub_stamp":"2024-03-23T06:23:25.054075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:39:29.480018+0000","scrub_duration":0.0033097249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'20","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:48.438685+0000","last_change":"2024-03-23T06:22:48.438794+0000","last_active":"2024-03-23T06:22:48.438685+0000","last_peered":"2024-03-23T06:22:48.438685+0000","last_clean":"2024-03-23T06:22:48.438685+0000","last_became_active":"2024-03-23T06:09:57.945663+0000","last_became_peered":"2024-03-23T06:09:57.945663+0000","last_unstale":"2024-03-23T06:22:48.438685+0000","last_undegraded":"2024-03-23T06:22:48.438685+0000","last_fullsized":"2024-03-23T06:22:48.438685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-03-23T06:22:48.438650+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-03-23T06:22:48.438650+0000","last_clean_scrub_stamp":"2024-03-23T06:22:48.438650+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:28:09.247927+0000","scrub_duration":0.0023472229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:24.386651+0000","last_change":"2024-03-23T06:22:24.386758+0000","last_active":"2024-03-23T06:22:24.386651+0000","last_peered":"2024-03-23T06:22:24.386651+0000","last_clean":"2024-03-23T06:22:24.386651+0000","last_became_active":"2024-03-23T06:09:57.934424+0000","last_became_peered":"2024-03-23T06:09:57.934424+0000","last_unstale":"2024-03-23T06:22:24.386651+0000","last_undegraded":"2024-03-23T06:22:24.386651+0000","last_fullsized":"2024-03-23T06:22:24.386651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:24.386615+0000","last_clean_scrub_stamp":"2024-03-23T06:22:24.386615+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T15:00:08.664042+0000","scrub_duration":0.001409698,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'26","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:19.440089+0000","last_change":"2024-03-23T06:22:19.440191+0000","last_active":"2024-03-23T06:22:19.440089+0000","last_peered":"2024-03-23T06:22:19.440089+0000","last_clean":"2024-03-23T06:22:19.440089+0000","last_became_active":"2024-03-23T06:09:57.946269+0000","last_became_peered":"2024-03-23T06:09:57.946269+0000","last_unstale":"2024-03-23T06:22:19.440089+0000","last_undegraded":"2024-03-23T06:22:19.440089+0000","last_fullsized":"2024-03-23T06:22:19.440089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'26","last_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_deep_scrub":"27'26","last_deep_scrub_stamp":"2024-03-23T06:22:19.440064+0000","last_clean_scrub_stamp":"2024-03-23T06:22:19.440064+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:38:00.327848+0000","scrub_duration":0.0063548980000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'17","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:32.580201+0000","last_change":"2024-03-23T06:22:32.580405+0000","last_active":"2024-03-23T06:22:32.580201+0000","last_peered":"2024-03-23T06:22:32.580201+0000","last_clean":"2024-03-23T06:22:32.580201+0000","last_became_active":"2024-03-23T06:09:57.947129+0000","last_became_peered":"2024-03-23T06:09:57.947129+0000","last_unstale":"2024-03-23T06:22:32.580201+0000","last_undegraded":"2024-03-23T06:22:32.580201+0000","last_fullsized":"2024-03-23T06:22:32.580201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:32.580152+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:32.580152+0000","last_clean_scrub_stamp":"2024-03-23T06:22:32.580152+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:43:40.490005+0000","scrub_duration":0.0034550919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'18","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:29.616396+0000","last_change":"2024-03-23T06:22:29.616594+0000","last_active":"2024-03-23T06:22:29.616396+0000","last_peered":"2024-03-23T06:22:29.616396+0000","last_clean":"2024-03-23T06:22:29.616396+0000","last_became_active":"2024-03-23T06:09:57.949124+0000","last_became_peered":"2024-03-23T06:09:57.949124+0000","last_unstale":"2024-03-23T06:22:29.616396+0000","last_undegraded":"2024-03-23T06:22:29.616396+0000","last_fullsized":"2024-03-23T06:22:29.616396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'18","last_scrub_stamp":"2024-03-23T06:22:29.616345+0000","last_deep_scrub":"27'18","last_deep_scrub_stamp":"2024-03-23T06:22:29.616345+0000","last_clean_scrub_stamp":"2024-03-23T06:22:29.616345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:37:40.215388+0000","scrub_duration":0.0029405429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'28","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:45.553208+0000","last_change":"2024-03-23T06:22:45.553313+0000","last_active":"2024-03-23T06:22:45.553208+0000","last_peered":"2024-03-23T06:22:45.553208+0000","last_clean":"2024-03-23T06:22:45.553208+0000","last_became_active":"2024-03-23T06:09:57.954258+0000","last_became_peered":"2024-03-23T06:09:57.954258+0000","last_unstale":"2024-03-23T06:22:45.553208+0000","last_undegraded":"2024-03-23T06:22:45.553208+0000","last_fullsized":"2024-03-23T06:22:45.553208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-03-23T06:22:45.553173+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-03-23T06:22:45.553173+0000","last_clean_scrub_stamp":"2024-03-23T06:22:45.553173+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:02:25.066585+0000","scrub_duration":0.0023626020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'22","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.430836+0000","last_change":"2024-03-23T06:22:36.431118+0000","last_active":"2024-03-23T06:22:36.430836+0000","last_peered":"2024-03-23T06:22:36.430836+0000","last_clean":"2024-03-23T06:22:36.430836+0000","last_became_active":"2024-03-23T06:09:57.943852+0000","last_became_peered":"2024-03-23T06:09:57.943852+0000","last_unstale":"2024-03-23T06:22:36.430836+0000","last_undegraded":"2024-03-23T06:22:36.430836+0000","last_fullsized":"2024-03-23T06:22:36.430836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-03-23T06:22:36.430773+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-03-23T06:22:36.430773+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.430773+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T13:40:30.283889+0000","scrub_duration":0.089320603999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'13","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:47.409452+0000","last_change":"2024-03-23T06:22:47.409530+0000","last_active":"2024-03-23T06:22:47.409452+0000","last_peered":"2024-03-23T06:22:47.409452+0000","last_clean":"2024-03-23T06:22:47.409452+0000","last_became_active":"2024-03-23T06:09:57.948861+0000","last_became_peered":"2024-03-23T06:09:57.948861+0000","last_unstale":"2024-03-23T06:22:47.409452+0000","last_undegraded":"2024-03-23T06:22:47.409452+0000","last_fullsized":"2024-03-23T06:22:47.409452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-03-23T06:22:47.409432+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-03-23T06:22:47.409432+0000","last_clean_scrub_stamp":"2024-03-23T06:22:47.409432+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T11:40:48.032843+0000","scrub_duration":0.0021214770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:36.660512+0000","last_change":"2024-03-23T06:22:36.660657+0000","last_active":"2024-03-23T06:22:36.660512+0000","last_peered":"2024-03-23T06:22:36.660512+0000","last_clean":"2024-03-23T06:22:36.660512+0000","last_became_active":"2024-03-23T06:09:57.936682+0000","last_became_peered":"2024-03-23T06:09:57.936682+0000","last_unstale":"2024-03-23T06:22:36.660512+0000","last_undegraded":"2024-03-23T06:22:36.660512+0000","last_fullsized":"2024-03-23T06:22:36.660512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:36.660474+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:36.660474+0000","last_clean_scrub_stamp":"2024-03-23T06:22:36.660474+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T09:09:05.409598+0000","scrub_duration":0.0021533379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'14","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:26.918359+0000","last_change":"2024-03-23T06:22:26.918359+0000","last_active":"2024-03-23T06:22:26.918359+0000","last_peered":"2024-03-23T06:22:26.918359+0000","last_clean":"2024-03-23T06:22:26.918359+0000","last_became_active":"2024-03-23T06:09:57.943776+0000","last_became_peered":"2024-03-23T06:09:57.943776+0000","last_unstale":"2024-03-23T06:22:26.918359+0000","last_undegraded":"2024-03-23T06:22:26.918359+0000","last_fullsized":"2024-03-23T06:22:26.918359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-03-23T06:22:26.918218+0000","last_clean_scrub_stamp":"2024-03-23T06:22:26.918218+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T06:31:45.597928+0000","scrub_duration":0.0018645039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'15","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:42.561975+0000","last_change":"2024-03-23T06:22:42.562121+0000","last_active":"2024-03-23T06:22:42.561975+0000","last_peered":"2024-03-23T06:22:42.561975+0000","last_clean":"2024-03-23T06:22:42.561975+0000","last_became_active":"2024-03-23T06:09:57.942131+0000","last_became_peered":"2024-03-23T06:09:57.942131+0000","last_unstale":"2024-03-23T06:22:42.561975+0000","last_undegraded":"2024-03-23T06:22:42.561975+0000","last_fullsized":"2024-03-23T06:22:42.561975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-03-23T06:22:42.561881+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-03-23T06:22:42.561881+0000","last_clean_scrub_stamp":"2024-03-23T06:22:42.561881+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:15:32.590635+0000","scrub_duration":0.014718835,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'12","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:22.845004+0000","last_change":"2024-03-23T06:22:22.845326+0000","last_active":"2024-03-23T06:22:22.845004+0000","last_peered":"2024-03-23T06:22:22.845004+0000","last_clean":"2024-03-23T06:22:22.845004+0000","last_became_active":"2024-03-23T06:09:57.945250+0000","last_became_peered":"2024-03-23T06:09:57.945250+0000","last_unstale":"2024-03-23T06:22:22.845004+0000","last_undegraded":"2024-03-23T06:22:22.845004+0000","last_fullsized":"2024-03-23T06:22:22.845004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-03-23T06:22:22.844870+0000","last_clean_scrub_stamp":"2024-03-23T06:22:22.844870+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:03:07.539336+0000","scrub_duration":0.002224925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'16","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:14.305222+0000","last_change":"2024-03-23T06:22:14.305222+0000","last_active":"2024-03-23T06:22:14.305222+0000","last_peered":"2024-03-23T06:22:14.305222+0000","last_clean":"2024-03-23T06:22:14.305222+0000","last_became_active":"2024-03-23T06:09:57.941192+0000","last_became_peered":"2024-03-23T06:09:57.941192+0000","last_unstale":"2024-03-23T06:22:14.305222+0000","last_undegraded":"2024-03-23T06:22:14.305222+0000","last_fullsized":"2024-03-23T06:22:14.305222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-03-23T06:22:14.305062+0000","last_clean_scrub_stamp":"2024-03-23T06:22:14.305062+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T07:19:26.641546+0000","scrub_duration":0.0018171369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:53.369348+0000","last_change":"2024-03-23T06:22:53.369423+0000","last_active":"2024-03-23T06:22:53.369348+0000","last_peered":"2024-03-23T06:22:53.369348+0000","last_clean":"2024-03-23T06:22:53.369348+0000","last_became_active":"2024-03-23T06:09:57.941657+0000","last_became_peered":"2024-03-23T06:09:57.941657+0000","last_unstale":"2024-03-23T06:22:53.369348+0000","last_undegraded":"2024-03-23T06:22:53.369348+0000","last_fullsized":"2024-03-23T06:22:53.369348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-03-23T06:22:53.369329+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-03-23T06:22:53.369329+0000","last_clean_scrub_stamp":"2024-03-23T06:22:53.369329+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T10:49:10.218405+0000","scrub_duration":0.0014024619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'17","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-23T06:22:41.674290+0000","last_change":"2024-03-23T06:22:41.674403+0000","last_active":"2024-03-23T06:22:41.674290+0000","last_peered":"2024-03-23T06:22:41.674290+0000","last_clean":"2024-03-23T06:22:41.674290+0000","last_became_active":"2024-03-23T06:09:57.948592+0000","last_became_peered":"2024-03-23T06:09:57.948592+0000","last_unstale":"2024-03-23T06:22:41.674290+0000","last_undegraded":"2024-03-23T06:22:41.674290+0000","last_fullsized":"2024-03-23T06:22:41.674290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'17","last_scrub_stamp":"2024-03-23T06:22:41.674268+0000","last_deep_scrub":"27'17","last_deep_scrub_stamp":"2024-03-23T06:22:41.674268+0000","last_clean_scrub_stamp":"2024-03-23T06:22:41.674268+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-24T08:21:40.044887+0000","scrub_duration":0.086211794999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":11,"num_write":2467086,"num_write_kb":34093433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167440,"ondisk_log_size":167440,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":88812204,"num_objects":83,"num_object_clones":0,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":32,"num_read_kb":112,"num_write":2360,"num_write_kb":88570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177774592,"data_stored":177624408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2432,"ondisk_log_size":2432,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542312,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1346672,"kb_used_data":37160,"kb_used_omap":1,"kb_used_meta":1309502,"kb_avail":93025168,"statfs":{"total":96636764160,"available":95257772032,"internally_reserved":0,"allocated":38051840,"data_stored":37867372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1340930504},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":4.1559999999999997,"15min":4.6909999999999998},"min":{"1min":0.46500000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.2,"5min":26.257999999999999,"15min":309.57499999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.081,"5min":3.7509999999999999,"15min":4.5910000000000002},"min":{"1min":0.56200000000000006,"5min":0.27900000000000003,"15min":0.255},"max":{"1min":1.488,"5min":32.350000000000001,"15min":300.98500000000001},"last":0.79400000000000004}]},{"osd":1,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":4.8689999999999998,"15min":5.4740000000000002},"min":{"1min":0.64500000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.6990000000000001,"5min":33.838999999999999,"15min":359.48599999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":3.746,"15min":5.0949999999999998},"min":{"1min":0.52000000000000002,"5min":0.29899999999999999,"15min":0.28899999999999998},"max":{"1min":1.8,"5min":35.130000000000003,"15min":359.20299999999997},"last":1.0009999999999999}]},{"osd":2,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":5.8200000000000003,"15min":4.5209999999999999},"min":{"1min":0.68200000000000005,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.6100000000000001,"5min":56.805999999999997,"15min":58.277000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.238,"5min":7.1669999999999998,"15min":5.1950000000000003},"min":{"1min":0.67700000000000005,"5min":0.55400000000000005,"15min":0.32900000000000001},"max":{"1min":1.8480000000000001,"5min":89.454999999999998,"15min":119.176},"last":1.3999999999999999}]},{"osd":4,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":4.8780000000000001,"15min":3.238},"min":{"1min":0.64100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.7809999999999999,"5min":36.270000000000003,"15min":36.270000000000003},"last":1.25},{"interface":"front","average":{"1min":1.0840000000000001,"5min":5.5330000000000004,"15min":3.9359999999999999},"min":{"1min":0.80900000000000005,"5min":0.48499999999999999,"15min":0.32800000000000001},"max":{"1min":1.5369999999999999,"5min":37.673999999999999,"15min":64.325000000000003},"last":1.1990000000000001}]},{"osd":5,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":5.1929999999999996,"15min":3.8660000000000001},"min":{"1min":0.878,"5min":0.46100000000000002,"15min":0.36299999999999999},"max":{"1min":1.651,"5min":32.863999999999997,"15min":58.317},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":5.0270000000000001,"15min":3.597},"min":{"1min":0.77900000000000003,"5min":0.42999999999999999,"15min":0.36799999999999999},"max":{"1min":1.865,"5min":33.854999999999997,"15min":33.854999999999997},"last":1.3440000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":5.1859999999999999,"15min":3.766},"min":{"1min":0.873,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.9390000000000001,"5min":26.425999999999998,"15min":31.623999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.268,"5min":4.899,"15min":3.2879999999999998},"min":{"1min":0.91900000000000004,"5min":0.46500000000000002,"15min":0.35399999999999998},"max":{"1min":1.619,"5min":37.179000000000002,"15min":37.179000000000002},"last":1.4810000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:23:20 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":6.1550000000000002,"15min":4.3040000000000003},"min":{"1min":0.98199999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.0190000000000001,"5min":32.311,"15min":58.344000000000001},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":5.6299999999999999,"15min":3.7709999999999999},"min":{"1min":1.0249999999999999,"5min":0.434,"15min":0.40699999999999997},"max":{"1min":2.129,"5min":32.215000000000003,"15min":38.680999999999997},"last":1.583}]}]},{"osd":2,"up_from":14,"seq":60129542312,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1222060,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1209470,"kb_avail":93149780,"statfs":{"total":96636764160,"available":95385374720,"internally_reserved":0,"allocated":12881920,"data_stored":12700681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1238497734},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":4.2030000000000003,"15min":3.8340000000000001},"min":{"1min":0.55100000000000005,"5min":0.26200000000000001,"15min":0.252},"max":{"1min":1.419,"5min":49.142000000000003,"15min":126.152},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.081,"5min":3.222,"15min":3.282},"min":{"1min":0.63,"5min":0.27900000000000003,"15min":0.26300000000000001},"max":{"1min":1.6779999999999999,"5min":29.206,"15min":143.14099999999999},"last":1.23}]},{"osd":1,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":4.6440000000000001,"15min":4.4489999999999998},"min":{"1min":0.49199999999999999,"5min":0.34799999999999998,"15min":0.28499999999999998},"max":{"1min":1.8859999999999999,"5min":43.033999999999999,"15min":55.564999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":4.5670000000000002,"15min":3.8290000000000002},"min":{"1min":0.51800000000000002,"5min":0.36299999999999999,"15min":0.31900000000000001},"max":{"1min":1.8080000000000001,"5min":49.390999999999998,"15min":55.354999999999997},"last":1.3049999999999999}]},{"osd":3,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":12.243,"15min":7.5499999999999998},"min":{"1min":0.47399999999999998,"5min":0.33900000000000002,"15min":0.27600000000000002},"max":{"1min":1.3120000000000001,"5min":529.81799999999998,"15min":529.81799999999998},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.1679999999999999,"5min":10.244999999999999,"15min":5.8470000000000004},"min":{"1min":0.64700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.9359999999999999,"5min":528.94200000000001,"15min":528.94200000000001},"last":1.363}]},{"osd":4,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":5.1340000000000003,"15min":3.427},"min":{"1min":0.629,"5min":0.37,"15min":0.33300000000000002},"max":{"1min":1.2829999999999999,"5min":49.430999999999997,"15min":49.430999999999997},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.032,"5min":6.3799999999999999,"15min":4.5369999999999999},"min":{"1min":0.67300000000000004,"5min":0.39200000000000002,"15min":0.312},"max":{"1min":1.417,"5min":60.298000000000002,"15min":83.525999999999996},"last":1.0269999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":4.7210000000000001,"15min":3.9860000000000002},"min":{"1min":0.81299999999999994,"5min":0.47999999999999998,"15min":0.36899999999999999},"max":{"1min":1.5229999999999999,"5min":35.433999999999997,"15min":82.456000000000003},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1919999999999999,"5min":4.7939999999999996,"15min":3.7829999999999999},"min":{"1min":0.78100000000000003,"5min":0.51000000000000001,"15min":0.35199999999999998},"max":{"1min":1.5740000000000001,"5min":35.472999999999999,"15min":82.971000000000004},"last":1.3899999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":4.633,"15min":3.657},"min":{"1min":0.69899999999999995,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.502,"5min":57.420999999999999,"15min":83.007999999999996},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":4.593,"15min":3.6499999999999999},"min":{"1min":0.73199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5489999999999999,"5min":49.768000000000001,"15min":49.768000000000001},"last":1.4179999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":5.1970000000000001,"15min":4.3109999999999999},"min":{"1min":0.83799999999999997,"5min":0.51400000000000001,"15min":0.35099999999999998},"max":{"1min":1.651,"5min":43.113,"15min":77.353999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":5.3490000000000002,"15min":4.2599999999999998},"min":{"1min":0.64500000000000002,"5min":0.51800000000000002,"15min":0.38},"max":{"1min":1.7509999999999999,"5min":44.204000000000001,"15min":83.406999999999996},"last":1.0649999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542314,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1437868,"kb_used_data":29540,"kb_used_omap":1,"kb_used_meta":1408318,"kb_avail":92933972,"statfs":{"total":96636764160,"available":95164387328,"internally_reserved":0,"allocated":30248960,"data_stored":30067719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1442118086},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":2.8919999999999999,"15min":2.8069999999999999},"min":{"1min":0.55800000000000005,"5min":0.26000000000000001,"15min":0.221},"max":{"1min":1.278,"5min":38.363,"15min":70.713999999999999},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":3.0950000000000002,"15min":2.6909999999999998},"min":{"1min":0.53800000000000003,"5min":0.28399999999999997,"15min":0.247},"max":{"1min":1.3640000000000001,"5min":17.361000000000001,"15min":30.41},"last":1.0940000000000001}]},{"osd":2,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":6.3040000000000003,"15min":4.5990000000000002},"min":{"1min":0.66700000000000004,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.413,"5min":127.342,"15min":127.342},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.2370000000000001,"5min":4.6790000000000003,"15min":4.2619999999999996},"min":{"1min":0.70199999999999996,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":1.5089999999999999,"5min":107.748,"15min":107.748},"last":0.82499999999999996}]},{"osd":3,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":4.8819999999999997,"15min":3.9910000000000001},"min":{"1min":0.65900000000000003,"5min":0.46600000000000003,"15min":0.32300000000000001},"max":{"1min":1.4850000000000001,"5min":31.780000000000001,"15min":31.780000000000001},"last":1.03},{"interface":"front","average":{"1min":1.194,"5min":4.0890000000000004,"15min":4.0540000000000003},"min":{"1min":0.63400000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.546,"5min":31.821999999999999,"15min":175.29300000000001},"last":1.115}]},{"osd":4,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":3.714,"15min":3.157},"min":{"1min":0.71499999999999997,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":1.349,"5min":24.856999999999999,"15min":78.060000000000002},"last":0.878},{"interface":"front","average":{"1min":1.1060000000000001,"5min":4.1050000000000004,"15min":3.1680000000000001},"min":{"1min":0.69899999999999995,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":1.405,"5min":26.184999999999999,"15min":80.959999999999994},"last":0.97499999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":3.581,"15min":3.2410000000000001},"min":{"1min":0.57899999999999996,"5min":0.37,"15min":0.35899999999999999},"max":{"1min":1.466,"5min":23.234000000000002,"15min":70.670000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.97199999999999998,"5min":3.625,"15min":2.6899999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.41999999999999998},"max":{"1min":1.5629999999999999,"5min":26.341000000000001,"15min":30.431000000000001},"last":0.76000000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":5.2030000000000003,"15min":3.3130000000000002},"min":{"1min":0.73799999999999999,"5min":0.39800000000000002,"15min":0.375},"max":{"1min":1.6319999999999999,"5min":40.606999999999999,"15min":40.606999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.276,"5min":4.5519999999999996,"15min":3.625},"min":{"1min":0.99099999999999999,"5min":0.57999999999999996,"15min":0.41799999999999998},"max":{"1min":1.532,"5min":36.905999999999999,"15min":68.369},"last":1.3839999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:23:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":5.1289999999999996,"15min":3.9780000000000002},"min":{"1min":0.94099999999999995,"5min":0.439,"15min":0.439},"max":{"1min":1.7190000000000001,"5min":28.331,"15min":90.965999999999994},"last":1.002},{"interface":"front","average":{"1min":1.335,"5min":5.6379999999999999,"15min":4.1630000000000003},"min":{"1min":1.1000000000000001,"5min":0.54400000000000004,"15min":0.38700000000000001},"max":{"1min":1.764,"5min":35.256,"15min":84.465000000000003},"last":1.046}]}]},{"osd":0,"up_from":14,"seq":60129542317,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":879072,"kb_used_data":33688,"kb_used_omap":1,"kb_used_meta":845374,"kb_avail":93492768,"statfs":{"total":96636764160,"available":95736594432,"internally_reserved":0,"allocated":34496512,"data_stored":34305951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":865663430},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":10.826000000000001,"15min":5.351},"min":{"1min":0.495,"5min":0.316,"15min":0.25700000000000001},"max":{"1min":1.254,"5min":520.90899999999999,"15min":520.90899999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.028,"5min":4.4539999999999997,"15min":3.137},"min":{"1min":0.623,"5min":0.33000000000000002,"15min":0.31},"max":{"1min":1.641,"5min":76.515000000000001,"15min":76.515000000000001},"last":1.016}]},{"osd":2,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":3.8580000000000001,"15min":3.476},"min":{"1min":0.60599999999999998,"5min":0.378,"15min":0.33300000000000002},"max":{"1min":1.6930000000000001,"5min":33.118000000000002,"15min":58.996000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.052,"5min":2.8599999999999999,"15min":3.556},"min":{"1min":0.54500000000000004,"5min":0.371,"15min":0.28799999999999998},"max":{"1min":1.5129999999999999,"5min":20.919,"15min":62.466000000000001},"last":0.92100000000000004}]},{"osd":3,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":3.71,"15min":3.577},"min":{"1min":1.0209999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.669,"5min":30.838999999999999,"15min":44.360999999999997},"last":1.163},{"interface":"front","average":{"1min":1.131,"5min":3.7240000000000002,"15min":3.4740000000000002},"min":{"1min":0.495,"5min":0.41299999999999998,"15min":0.30399999999999999},"max":{"1min":1.4770000000000001,"5min":33.429000000000002,"15min":81.251000000000005},"last":1.1220000000000001}]},{"osd":4,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":5.9240000000000004,"15min":3.2639999999999998},"min":{"1min":0.58499999999999996,"5min":0.46899999999999997,"15min":0.41999999999999998},"max":{"1min":1.498,"5min":72.588999999999999,"15min":72.588999999999999},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.093,"5min":5.367,"15min":3.3460000000000001},"min":{"1min":0.60799999999999998,"5min":0.36599999999999999,"15min":0.33000000000000002},"max":{"1min":1.2909999999999999,"5min":69.566000000000003,"15min":69.566000000000003},"last":0.74399999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":5.282,"15min":3.2130000000000001},"min":{"1min":0.79600000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.756,"5min":72.552000000000007,"15min":72.552000000000007},"last":1.369},{"interface":"front","average":{"1min":1.3260000000000001,"5min":4.7119999999999997,"15min":3.1030000000000002},"min":{"1min":0.88,"5min":0.50700000000000001,"15min":0.371},"max":{"1min":1.8360000000000001,"5min":72.626999999999995,"15min":72.626999999999995},"last":1.4510000000000001}]},{"osd":6,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":3.7949999999999999,"15min":2.8999999999999999},"min":{"1min":0.55300000000000005,"5min":0.39700000000000002,"15min":0.36599999999999999},"max":{"1min":1.101,"5min":72.471000000000004,"15min":72.471000000000004},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.236,"5min":4.7060000000000004,"15min":3.1259999999999999},"min":{"1min":0.63,"5min":0.53900000000000003,"15min":0.51000000000000001},"max":{"1min":1.9370000000000001,"5min":72.656999999999996,"15min":72.656999999999996},"last":0.86399999999999999}]},{"osd":7,"last update":"Sat Mar 23 06:23:15 2024","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":5.2880000000000003,"15min":3.3759999999999999},"min":{"1min":0.80700000000000005,"5min":0.40600000000000003,"15min":0.36599999999999999},"max":{"1min":1.7190000000000001,"5min":69.662000000000006,"15min":69.662000000000006},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.2649999999999999,"5min":4.4379999999999997,"15min":2.9590000000000001},"min":{"1min":0.88100000000000001,"5min":0.437,"15min":0.38700000000000001},"max":{"1min":1.768,"5min":69.632000000000005,"15min":69.632000000000005},"last":1.1879999999999999}]}]},{"osd":7,"up_from":13,"seq":55834575019,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1389204,"kb_used_data":12684,"kb_used_omap":1,"kb_used_meta":1376510,"kb_avail":92982636,"statfs":{"total":96636764160,"available":95214219264,"internally_reserved":0,"allocated":12988416,"data_stored":12794934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":1409546699},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":3.1120000000000001,"15min":2.302},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.90600000000000003,"5min":33.524000000000001,"15min":34.747999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":2.9129999999999998,"15min":2.0409999999999999},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0740000000000001,"5min":33.662999999999997,"15min":42.582000000000001},"last":0.61099999999999999}]},{"osd":1,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":5.9429999999999996,"15min":4.2629999999999999},"min":{"1min":0.435,"5min":0.36399999999999999,"15min":0.26500000000000001},"max":{"1min":0.91500000000000004,"5min":95.497,"15min":310.09300000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":6.0990000000000002,"15min":4.3150000000000004},"min":{"1min":0.45600000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.94299999999999995,"5min":95.531999999999996,"15min":309.70999999999998},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":2.8839999999999999,"15min":2.5409999999999999},"min":{"1min":0.36899999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":1.304,"5min":33.079999999999998,"15min":63.014000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":3.4460000000000002,"15min":2.9990000000000001},"min":{"1min":0.435,"5min":0.311,"15min":0.27400000000000002},"max":{"1min":0.95899999999999996,"5min":28.588999999999999,"15min":73.218000000000004},"last":0.501}]},{"osd":3,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":5.8680000000000003,"15min":3.3159999999999998},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.30399999999999999},"max":{"1min":1.2749999999999999,"5min":95.831000000000003,"15min":95.831000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.625,"5min":4.016,"15min":2.79},"min":{"1min":0.34499999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.0900000000000001,"5min":94.646000000000001,"15min":94.646000000000001},"last":0.64800000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":4.6749999999999998,"15min":2.238},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.46800000000000003,"5min":35.838000000000001,"15min":35.838000000000001},"last":0.255},{"interface":"front","average":{"1min":0.30499999999999999,"5min":4.7140000000000004,"15min":2.238},"min":{"1min":0.245,"5min":0.245,"15min":0.224},"max":{"1min":0.48899999999999999,"5min":55.401000000000003,"15min":55.401000000000003},"last":0.28699999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":3.8759999999999999,"15min":1.9119999999999999},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":35.884,"15min":35.884},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":4.2889999999999997,"15min":2.0550000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":51.209000000000003,"15min":51.209000000000003},"last":0.36699999999999999}]},{"osd":6,"last update":"Sat Mar 23 06:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":3.0550000000000002,"15min":1.732},"min":{"1min":0.27300000000000002,"5min":0.23999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53100000000000003,"5min":28.981999999999999,"15min":32.799999999999997},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":3.141,"15min":1.7390000000000001},"min":{"1min":0.30499999999999999,"5min":0.29999999999999999,"15min":0.28599999999999998},"max":{"1min":0.60099999999999998,"5min":29.146999999999998,"15min":32.853000000000002},"last":0.34200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575020,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1348396,"kb_used_data":12580,"kb_used_omap":1,"kb_used_meta":1335806,"kb_avail":93023444,"statfs":{"total":96636764160,"available":95256006656,"internally_reserved":0,"allocated":12881920,"data_stored":12701526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1367865799},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":2.1349999999999998,"15min":1.788},"min":{"1min":0.27900000000000003,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.77000000000000002,"5min":34.573999999999998,"15min":47.136000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":2.819,"15min":2.1150000000000002},"min":{"1min":0.435,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":0.83299999999999996,"5min":34.573,"15min":43.140000000000001},"last":0.67800000000000005}]},{"osd":1,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":1.9870000000000001,"15min":2.7770000000000001},"min":{"1min":0.35599999999999998,"5min":0.26800000000000002,"15min":0.26200000000000001},"max":{"1min":1.0389999999999999,"5min":30.096,"15min":96.375},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":3.202,"15min":3.3929999999999998},"min":{"1min":0.32200000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83799999999999997,"5min":32.222999999999999,"15min":96.034000000000006},"last":0.38400000000000001}]},{"osd":2,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":2.5569999999999999,"15min":3.3799999999999999},"min":{"1min":0.35099999999999998,"5min":0.31900000000000001,"15min":0.29299999999999998},"max":{"1min":0.875,"5min":32.305,"15min":91.947999999999993},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":3.5310000000000001,"15min":3.194},"min":{"1min":0.41399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.83799999999999997,"5min":59.905000000000001,"15min":96.772999999999996},"last":0.624}]},{"osd":3,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":3.2709999999999999,"15min":3.681},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.32800000000000001},"max":{"1min":0.84899999999999998,"5min":32.194000000000003,"15min":107.29000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":3.3069999999999999,"15min":3.8039999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.81000000000000005,"5min":31.829999999999998,"15min":107.27200000000001},"last":0.64800000000000002}]},{"osd":4,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":4.2160000000000002,"15min":2.1499999999999999},"min":{"1min":0.23300000000000001,"5min":0.217,"15min":0.216},"max":{"1min":0.42599999999999999,"5min":45.302,"15min":45.302},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.374,"5min":4.2880000000000003,"15min":2.2130000000000001},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":0.56699999999999995,"5min":45.408000000000001,"15min":45.408000000000001},"last":0.36899999999999999}]},{"osd":5,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":3.8180000000000001,"15min":1.8500000000000001},"min":{"1min":0.29699999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.50800000000000001,"5min":39.625,"15min":39.625},"last":0.434},{"interface":"front","average":{"1min":0.32900000000000001,"5min":2.9009999999999998,"15min":1.675},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.53900000000000003,"5min":37.686,"15min":37.686},"last":0.26700000000000002}]},{"osd":7,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":2.8479999999999999,"15min":1.637},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.51900000000000002,"5min":33.689999999999998,"15min":33.689999999999998},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.374,"5min":2.8959999999999999,"15min":1.5700000000000001},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60299999999999998,"5min":33.728999999999999,"15min":33.728999999999999},"last":0.39800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575022,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1220032,"kb_used_data":26168,"kb_used_omap":1,"kb_used_meta":1193854,"kb_avail":93151808,"statfs":{"total":96636764160,"available":95387451392,"internally_reserved":0,"allocated":26796032,"data_stored":26601250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1222506950},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":2.5449999999999999,"15min":1.6559999999999999},"min":{"1min":0.33200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.84699999999999998,"5min":41.886000000000003,"15min":41.886000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":2.8370000000000002,"15min":1.7390000000000001},"min":{"1min":0.376,"5min":0.311,"15min":0.30099999999999999},"max":{"1min":0.89100000000000001,"5min":40.073999999999998,"15min":40.073999999999998},"last":0.753}]},{"osd":1,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":2.8809999999999998,"15min":2.3079999999999998},"min":{"1min":0.34100000000000003,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.85599999999999998,"5min":27.151,"15min":69.873999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":3.54,"15min":2.4060000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.30099999999999999},"max":{"1min":0.80800000000000005,"5min":45.847000000000001,"15min":50.758000000000003},"last":0.36899999999999999}]},{"osd":2,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":3.75,"15min":2.7320000000000002},"min":{"1min":0.44700000000000001,"5min":0.32500000000000001,"15min":0.28299999999999997},"max":{"1min":1.1399999999999999,"5min":100.931,"15min":100.931},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":4.9059999999999997,"15min":3.133},"min":{"1min":0.37,"5min":0.34200000000000003,"15min":0.253},"max":{"1min":0.80600000000000005,"5min":142.041,"15min":142.041},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":3.7050000000000001,"15min":2.9289999999999998},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.93200000000000005,"5min":42.064,"15min":63.905999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":3.8460000000000001,"15min":3.0190000000000001},"min":{"1min":0.36899999999999999,"5min":0.35299999999999998,"15min":0.34899999999999998},"max":{"1min":0.88500000000000001,"5min":41.557000000000002,"15min":61.076000000000001},"last":0.80600000000000005}]},{"osd":4,"last update":"Sat Mar 23 06:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":3.2040000000000002,"15min":1.595},"min":{"1min":0.23799999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.38,"5min":32.716000000000001,"15min":32.716000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":3.5539999999999998,"15min":1.7290000000000001},"min":{"1min":0.245,"5min":0.218,"15min":0.218},"max":{"1min":0.45800000000000002,"5min":32.554000000000002,"15min":32.554000000000002},"last":0.29199999999999998}]},{"osd":6,"last update":"Sat Mar 23 06:23:14 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":4.4169999999999998,"15min":2.1059999999999999},"min":{"1min":0.25700000000000001,"5min":0.23200000000000001,"15min":0.222},"max":{"1min":0.40400000000000003,"5min":40.134999999999998,"15min":40.134999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":4.9050000000000002,"15min":2.319},"min":{"1min":0.26700000000000002,"5min":0.251,"15min":0.24399999999999999},"max":{"1min":0.47299999999999998,"5min":40.314,"15min":40.314},"last":0.25800000000000001}]},{"osd":7,"last update":"Sat Mar 23 06:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":3.5550000000000002,"15min":1.8100000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.42699999999999999,"5min":32.890000000000001,"15min":32.890000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":4.577,"15min":2.056},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.51900000000000002,"5min":50.880000000000003,"15min":50.880000000000003},"last":0.31900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575019,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1217608,"kb_used_data":12608,"kb_used_omap":1,"kb_used_meta":1204990,"kb_avail":93154232,"statfs":{"total":96636764160,"available":95389933568,"internally_reserved":0,"allocated":12910592,"data_stored":12702215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1233910214},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":2.2250000000000001,"15min":1.7410000000000001},"min":{"1min":0.26100000000000001,"5min":0.25800000000000001,"15min":0.23400000000000001},"max":{"1min":0.72599999999999998,"5min":38.500999999999998,"15min":45.804000000000002},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":2.3540000000000001,"15min":1.8959999999999999},"min":{"1min":0.30499999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.79800000000000004,"5min":38.558999999999997,"15min":44.079999999999998},"last":0.69199999999999995}]},{"osd":1,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":2.673,"15min":2.7349999999999999},"min":{"1min":0.375,"5min":0.314,"15min":0.27400000000000002},"max":{"1min":0.91100000000000003,"5min":29.405000000000001,"15min":51.387999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":2.0659999999999998,"15min":2.169},"min":{"1min":0.33300000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.85199999999999998,"5min":29.23,"15min":50.207000000000001},"last":0.502}]},{"osd":2,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":9.6120000000000001,"15min":4.7039999999999997},"min":{"1min":0.40699999999999997,"5min":0.28399999999999997,"15min":0.26900000000000002},"max":{"1min":0.77400000000000002,"5min":529.65700000000004,"15min":529.65700000000004},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":8.6910000000000007,"15min":4.2229999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.28399999999999997},"max":{"1min":0.90100000000000002,"5min":489.54700000000003,"15min":489.54700000000003},"last":0.749}]},{"osd":3,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":2.5049999999999999,"15min":2.75},"min":{"1min":0.36799999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.92900000000000005,"5min":37.987000000000002,"15min":53.134999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":2.9889999999999999,"15min":4.3230000000000004},"min":{"1min":0.39000000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.84099999999999997,"5min":31.831,"15min":161.191},"last":0.47499999999999998}]},{"osd":5,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.27700000000000002,"5min":3.234,"15min":1.627},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.40000000000000002,"5min":43.524000000000001,"15min":43.524000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.313,"5min":3.2970000000000002,"15min":1.708},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.22800000000000001},"max":{"1min":0.47299999999999998,"5min":43.847999999999999,"15min":43.847999999999999},"last":0.33100000000000002}]},{"osd":6,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":5.4610000000000003,"15min":2.625},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.38400000000000001,"5min":66.572999999999993,"15min":66.572999999999993},"last":0.25},{"interface":"front","average":{"1min":0.35399999999999998,"5min":5.0279999999999996,"15min":2.5430000000000001},"min":{"1min":0.309,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.46200000000000002,"5min":66.081999999999994,"15min":66.081999999999994},"last":0.315}]},{"osd":7,"last update":"Sat Mar 23 06:23:26 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":4.6360000000000001,"15min":2.085},"min":{"1min":0.28999999999999998,"5min":0.25600000000000001,"15min":0.24299999999999999},"max":{"1min":0.442,"5min":51.975999999999999,"15min":51.975999999999999},"last":0.308},{"interface":"front","average":{"1min":0.378,"5min":4.0350000000000001,"15min":1.9119999999999999},"min":{"1min":0.34200000000000003,"5min":0.29999999999999999,"15min":0.28999999999999998},"max":{"1min":0.51400000000000001,"5min":51.997,"15min":51.997},"last":0.34899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34209792,"data_stored":34188888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29368320,"data_stored":29360288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12583618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37765120,"data_stored":37750309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12585152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25915392,"data_stored":25893819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12595200,"data_stored":12584463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12701696,"data_stored":12677871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-23T06:23:56.674 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-23T06:23:56.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.901+0000 7f99b9400640 1 Processor -- start 2024-03-23T06:23:56.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.901+0000 7f99b9400640 1 -- start start 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99b9400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99b40c5530 0x7f99b406ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99b9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b40c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99b9400640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b4070450 con 0x7f99b4065de0 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99b9400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b406b180 con 0x7f99b40c5530 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99b9400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b415e3a0 con 0x7f99b406b5a0 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99b3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99b40c5530 0x7f99b406ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99abe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b40c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99b3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99b40c5530 0x7f99b406ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:56570/0 (socket says 172.21.15.73:56570) 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.903+0000 7f99b3e00640 1 -- 172.21.15.73:0/616470100 learned_addr learned my addr 172.21.15.73:0/616470100 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.904+0000 7f99b3e00640 1 -- 172.21.15.73:0/616470100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 msgr2=0x7f99b40c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.904+0000 7f99b3e00640 1 --2- 172.21.15.73:0/616470100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b40c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.904+0000 7f99b3e00640 1 -- 172.21.15.73:0/616470100 >> v1:172.21.15.73:6789/0 conn(0x7f99b4065de0 legacy=0x7f99b4160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.904+0000 7f99b3e00640 1 -- 172.21.15.73:0/616470100 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b406a7e0 con 0x7f99b40c5530 2024-03-23T06:23:56.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.904+0000 7f99abe00640 1 --2- 172.21.15.73:0/616470100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b40c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.905+0000 7f99b3e00640 1 --2- 172.21.15.73:0/616470100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 0x7f99b406ff10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009870 tx=0x7f99a402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b8b1777835e372 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.905+0000 7f99b3400640 1 -- 172.21.15.73:0/616470100 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4031640 con 0x7f99b40c5530 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.905+0000 7f99b3400640 1 -- 172.21.15.73:0/616470100 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40317a0 con 0x7f99b40c5530 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.905+0000 7f99b3400640 1 -- 172.21.15.73:0/616470100 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4031b30 con 0x7f99b40c5530 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.905+0000 7f99b9400640 1 -- 172.21.15.73:0/616470100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 msgr2=0x7f99b406ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.905+0000 7f99b9400640 1 --2- 172.21.15.73:0/616470100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 0x7f99b406ff10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009870 tx=0x7f99a402b8f0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.906+0000 7f99b9400640 1 -- 172.21.15.73:0/616470100 shutdown_connections 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.906+0000 7f99b9400640 1 --2- 172.21.15.73:0/616470100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b40c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.906+0000 7f99b9400640 1 --2- 172.21.15.73:0/616470100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 0x7f99b406ff10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.906+0000 7f99b9400640 1 -- 172.21.15.73:0/616470100 >> 172.21.15.73:0/616470100 conn(0x7f99b406d910 msgr2=0x7f99b406dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.906+0000 7f99b9400640 1 -- 172.21.15.73:0/616470100 shutdown_connections 2024-03-23T06:23:56.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.906+0000 7f99b9400640 1 -- 172.21.15.73:0/616470100 wait complete. 2024-03-23T06:23:56.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.907+0000 7f99b9400640 1 Processor -- start 2024-03-23T06:23:56.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.907+0000 7f99b9400640 1 -- start start 2024-03-23T06:23:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.908+0000 7f99b9400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4065de0 0x7f99b41f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.908+0000 7f99b9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b4155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.908+0000 7f99b9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 0x7f99b4158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.908+0000 7f99b9400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b415a620 con 0x7f99b4065de0 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.908+0000 7f99b9400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4159920 con 0x7f99b40c5530 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.908+0000 7f99b9400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b41583e0 con 0x7f99b406b5a0 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b4155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.908+0000 7f99b3e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4065de0 0x7f99b41f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b4155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41674/0 (socket says 172.21.15.73:41674) 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 -- 172.21.15.73:0/4247832472 learned_addr learned my addr 172.21.15.73:0/4247832472 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99b8a00640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 0x7f99b4158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 -- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 msgr2=0x7f99b4158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 0x7f99b4158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 -- 172.21.15.73:0/4247832472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4065de0 msgr2=0x7f99b41f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4065de0 0x7f99b41f3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:56.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 -- 172.21.15.73:0/4247832472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c009400 con 0x7f99b406b5a0 2024-03-23T06:23:56.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99abe00640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b4155860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ec40 tx=0x7f999c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:56.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99b0c00640 1 -- 172.21.15.73:0/4247832472 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c009760 con 0x7f99b406b5a0 2024-03-23T06:23:56.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99b0c00640 1 -- 172.21.15.73:0/4247832472 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c00cc30 con 0x7f99b406b5a0 2024-03-23T06:23:56.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a40094d0 con 0x7f99b406b5a0 2024-03-23T06:23:56.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.909+0000 7f99b0c00640 1 -- 172.21.15.73:0/4247832472 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c013470 con 0x7f99b406b5a0 2024-03-23T06:23:56.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.910+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b4159e50 con 0x7f99b406b5a0 2024-03-23T06:23:56.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.911+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b404e030 con 0x7f99b406b5a0 2024-03-23T06:23:56.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.911+0000 7f99b0c00640 1 -- 172.21.15.73:0/4247832472 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f999c0135d0 con 0x7f99b406b5a0 2024-03-23T06:23:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.912+0000 7f99b0c00640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f999006ac30 0x7f999006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.912+0000 7f99b0c00640 1 -- 172.21.15.73:0/4247832472 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f999c089c50 con 0x7f99b406b5a0 2024-03-23T06:23:56.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.912+0000 7f99b3e00640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f999006ac30 0x7f999006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:56.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.913+0000 7f99b3e00640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f999006ac30 0x7f999006d0f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f99a4036000 tx=0x7f99a403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:56.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:56.916+0000 7f99b0c00640 1 -- 172.21.15.73:0/4247832472 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f999c08f020 con 0x7f99b406b5a0 2024-03-23T06:23:57.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.111+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f99b4158520 con 0x7f99b406b5a0 2024-03-23T06:23:57.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.116+0000 7f99b0c00640 1 -- 172.21.15.73:0/4247832472 <== mon.2 v2:172.21.15.110:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f999c054b70 con 0x7f99b406b5a0 2024-03-23T06:23:57.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.119+0000 7f99b0c00640 1 -- 172.21.15.73:0/4247832472 <== mon.2 v2:172.21.15.110:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f999c0170c0 con 0x7f99b406b5a0 2024-03-23T06:23:57.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f999006ac30 msgr2=0x7f999006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f999006ac30 0x7f999006d0f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f99a4036000 tx=0x7f99a403c040 comp rx=0 tx=0).stop 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 msgr2=0x7f99b4155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b4155860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ec40 tx=0x7f999c00c520 comp rx=0 tx=0).stop 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 shutdown_connections 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99b40c5530 0x7f99b4158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f999006ac30 0x7f999006d0f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99b406b5a0 0x7f99b4155860 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 --2- 172.21.15.73:0/4247832472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99b4065de0 0x7f99b41f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 >> 172.21.15.73:0/4247832472 conn(0x7f99b406d910 msgr2=0x7f99b40ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 shutdown_connections 2024-03-23T06:23:57.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.121+0000 7f99b9400640 1 -- 172.21.15.73:0/4247832472 wait complete. 2024-03-23T06:23:57.140 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-23T06:23:57.140 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:23:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.341+0000 7fe633e00640 1 Processor -- start 2024-03-23T06:23:57.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.342+0000 7fe633e00640 1 -- start start 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe633e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6340ced20 0x7fe6340cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe633e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe634159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe633e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63415a370 con 0x7fe6340ca7c0 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe633e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6340cb8d0 con 0x7fe6340ced20 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe633e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340ca330 con 0x7fe6340cf100 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe632000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe634159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe633400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe6340ca7c0 0x7fe634153150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47386/0 (socket says 172.21.15.73:47386) 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe632a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6340ced20 0x7fe6340cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.343+0000 7fe633400640 1 -- 172.21.15.73:0/1767891009 learned_addr learned my addr 172.21.15.73:0/1767891009 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.344+0000 7fe631600640 1 -- 172.21.15.73:0/1767891009 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824329285 0 0) 0x7fe62c001490 con 0x7fe6340ca7c0 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.344+0000 7fe631600640 1 -- 172.21.15.73:0/1767891009 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe618003520 con 0x7fe6340ca7c0 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.344+0000 7fe632a00640 1 -- 172.21.15.73:0/1767891009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 msgr2=0x7fe634159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:57.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.344+0000 7fe632a00640 1 --2- 172.21.15.73:0/1767891009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe634159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.344+0000 7fe632a00640 1 -- 172.21.15.73:0/1767891009 >> v1:172.21.15.110:6789/0 conn(0x7fe6340ca7c0 legacy=0x7fe634153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.344+0000 7fe632a00640 1 -- 172.21.15.73:0/1767891009 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340cbab0 con 0x7fe6340ced20 2024-03-23T06:23:57.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.344+0000 7fe632000640 1 --2- 172.21.15.73:0/1767891009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe634159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:57.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.345+0000 7fe632a00640 1 --2- 172.21.15.73:0/1767891009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 0x7fe6340cb390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6240097a0 tx=0x7fe62402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1208248d610f4d8d server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:57.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.345+0000 7fe631600640 1 -- 172.21.15.73:0/1767891009 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624030800 con 0x7fe6340ced20 2024-03-23T06:23:57.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.345+0000 7fe631600640 1 -- 172.21.15.73:0/1767891009 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe624030960 con 0x7fe6340ced20 2024-03-23T06:23:57.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.345+0000 7fe631600640 1 -- 172.21.15.73:0/1767891009 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624030d10 con 0x7fe6340ced20 2024-03-23T06:23:57.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.345+0000 7fe633e00640 1 -- 172.21.15.73:0/1767891009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 msgr2=0x7fe6340cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.345+0000 7fe633e00640 1 --2- 172.21.15.73:0/1767891009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 0x7fe6340cb390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6240097a0 tx=0x7fe62402b940 comp rx=0 tx=0).stop 2024-03-23T06:23:57.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.346+0000 7fe633e00640 1 -- 172.21.15.73:0/1767891009 shutdown_connections 2024-03-23T06:23:57.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.346+0000 7fe633e00640 1 --2- 172.21.15.73:0/1767891009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe634159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.346+0000 7fe633e00640 1 --2- 172.21.15.73:0/1767891009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 0x7fe6340cb390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.346+0000 7fe633e00640 1 -- 172.21.15.73:0/1767891009 >> 172.21.15.73:0/1767891009 conn(0x7fe6340713e0 msgr2=0x7fe6340717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:57.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.346+0000 7fe633e00640 1 -- 172.21.15.73:0/1767891009 shutdown_connections 2024-03-23T06:23:57.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.346+0000 7fe633e00640 1 -- 172.21.15.73:0/1767891009 wait complete. 2024-03-23T06:23:57.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.347+0000 7fe633e00640 1 Processor -- start 2024-03-23T06:23:57.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.347+0000 7fe633e00640 1 -- start start 2024-03-23T06:23:57.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.348+0000 7fe633e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6340ca7c0 0x7fe6340ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.348+0000 7fe633e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 0x7fe6340c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.348+0000 7fe633e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe6341efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.348+0000 7fe633e00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6341ef970 con 0x7fe6340ca7c0 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.348+0000 7fe633e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe634156c60 con 0x7fe6340ced20 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.348+0000 7fe633e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340aac50 con 0x7fe6340cf100 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe6341efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe632000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 0x7fe6340c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe632a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6340ca7c0 0x7fe6340ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe6341efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41688/0 (socket says 172.21.15.73:41688) 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 -- 172.21.15.73:0/321024859 learned_addr learned my addr 172.21.15.73:0/321024859 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 -- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 msgr2=0x7fe6340c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 0x7fe6340c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 -- 172.21.15.73:0/321024859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6340ca7c0 msgr2=0x7fe6340ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6340ca7c0 0x7fe6340ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 -- 172.21.15.73:0/321024859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620009400 con 0x7fe6340cf100 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe632000640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 0x7fe6340c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe633400640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe6341efe00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00cb40 tx=0x7fe62c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.349+0000 7fe62b400640 1 -- 172.21.15.73:0/321024859 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c00aca0 con 0x7fe6340cf100 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.350+0000 7fe62b400640 1 -- 172.21.15.73:0/321024859 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe62c00ae00 con 0x7fe6340cf100 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.350+0000 7fe62b400640 1 -- 172.21.15.73:0/321024859 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c012640 con 0x7fe6340cf100 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.350+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe624009400 con 0x7fe6340cf100 2024-03-23T06:23:57.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.350+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6340ab210 con 0x7fe6340cf100 2024-03-23T06:23:57.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.351+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6341ef740 con 0x7fe6340cf100 2024-03-23T06:23:57.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.352+0000 7fe62b400640 1 -- 172.21.15.73:0/321024859 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe62c007070 con 0x7fe6340cf100 2024-03-23T06:23:57.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.352+0000 7fe62b400640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe61406ac30 0x7fe61406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.352+0000 7fe62b400640 1 -- 172.21.15.73:0/321024859 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fe62c089470 con 0x7fe6340cf100 2024-03-23T06:23:57.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.353+0000 7fe632a00640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe61406ac30 0x7fe61406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.353+0000 7fe632a00640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe61406ac30 0x7fe61406d0f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe624036000 tx=0x7fe624008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:57.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.357+0000 7fe62b400640 1 -- 172.21.15.73:0/321024859 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe6341ef740 con 0x7fe6340cf100 2024-03-23T06:23:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.588+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe63415a370 con 0x7fe6340cf100 2024-03-23T06:23:57.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.589+0000 7fe62b400640 1 -- 172.21.15.73:0/321024859 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6280 (secure 0 0 0) 0x7fe63415a370 con 0x7fe6340cf100 2024-03-23T06:23:57.589 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:23:57.589 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:39.659193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4256,"mds_2":4253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4256":{"gid":4256,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:23:57.590 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.591+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe61406ac30 msgr2=0x7fe61406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.591+0000 7fe633e00640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe61406ac30 0x7fe61406d0f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe624036000 tx=0x7fe624008030 comp rx=0 tx=0).stop 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.591+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 msgr2=0x7fe6341efe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.591+0000 7fe633e00640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe6341efe00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00cb40 tx=0x7fe62c00a060 comp rx=0 tx=0).stop 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.592+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 shutdown_connections 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.592+0000 7fe633e00640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fe61406ac30 0x7fe61406d0f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.592+0000 7fe633e00640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6340cf100 0x7fe6341efe00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.592+0000 7fe633e00640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6340ced20 0x7fe6340c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.592+0000 7fe633e00640 1 --2- 172.21.15.73:0/321024859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe6340ca7c0 0x7fe6340ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.592+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 >> 172.21.15.73:0/321024859 conn(0x7fe6340713e0 msgr2=0x7fe634157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.592+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 shutdown_connections 2024-03-23T06:23:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.592+0000 7fe633e00640 1 -- 172.21.15.73:0/321024859 wait complete. 2024-03-23T06:23:57.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-23T06:23:57.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.802+0000 7f81d1600640 1 Processor -- start 2024-03-23T06:23:57.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.803+0000 7f81d1600640 1 -- start start 2024-03-23T06:23:57.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81d1600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0cf100 0x7f81cc0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81d1600640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f81cc0caed0 0x7f81cc159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81d1600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc15a370 con 0x7f81cc0ced20 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81d1600640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc0cb8d0 con 0x7f81cc0caed0 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81d1600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0ca330 con 0x7f81cc0cf100 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81c3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0cf100 0x7f81cc0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81cbe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f81cc0ced20 0x7f81cc0ca7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:47394/0 (socket says 172.21.15.73:47394) 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81cbe00640 1 -- 172.21.15.73:0/3572609750 learned_addr learned my addr 172.21.15.73:0/3572609750 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.804+0000 7f81d0c00640 1 --2- 172.21.15.73:0/3572609750 >> v2:172.21.15.73:3300/0 conn(0x7f81cc0caed0 0x7f81cc159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.805+0000 7f81cb400640 1 -- 172.21.15.73:0/3572609750 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194088234 0 0) 0x7f81bc001110 con 0x7f81cc0ced20 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.805+0000 7f81cb400640 1 -- 172.21.15.73:0/3572609750 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b0003520 con 0x7f81cc0ced20 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.805+0000 7f81c3e00640 1 -- 172.21.15.73:0/3572609750 >> v2:172.21.15.73:3300/0 conn(0x7f81cc0caed0 msgr2=0x7f81cc159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.805+0000 7f81c3e00640 1 --2- 172.21.15.73:0/3572609750 >> v2:172.21.15.73:3300/0 conn(0x7f81cc0caed0 0x7f81cc159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.805+0000 7f81c3e00640 1 -- 172.21.15.73:0/3572609750 >> v1:172.21.15.110:6789/0 conn(0x7f81cc0ced20 legacy=0x7f81cc0ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.805+0000 7f81c3e00640 1 -- 172.21.15.73:0/3572609750 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc0cbab0 con 0x7f81cc0cf100 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.806+0000 7f81c3e00640 1 --2- 172.21.15.73:0/3572609750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0cf100 0x7f81cc0cb390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93c57b60453a6e84 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.806+0000 7f81cb400640 1 -- 172.21.15.73:0/3572609750 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4030610 con 0x7f81cc0cf100 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.806+0000 7f81cb400640 1 -- 172.21.15.73:0/3572609750 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f81b4030770 con 0x7f81cc0cf100 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.806+0000 7f81cb400640 1 -- 172.21.15.73:0/3572609750 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4030ae0 con 0x7f81cc0cf100 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.807+0000 7f81d1600640 1 -- 172.21.15.73:0/3572609750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0cf100 msgr2=0x7f81cc0cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.807+0000 7f81d1600640 1 --2- 172.21.15.73:0/3572609750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0cf100 0x7f81cc0cb390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f81b40097a0 tx=0x7f81b402b960 comp rx=0 tx=0).stop 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.807+0000 7f81d1600640 1 -- 172.21.15.73:0/3572609750 shutdown_connections 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.807+0000 7f81d1600640 1 --2- 172.21.15.73:0/3572609750 >> v2:172.21.15.73:3300/0 conn(0x7f81cc0caed0 0x7f81cc159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.807+0000 7f81d1600640 1 --2- 172.21.15.73:0/3572609750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0cf100 0x7f81cc0cb390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.807+0000 7f81d1600640 1 -- 172.21.15.73:0/3572609750 >> 172.21.15.73:0/3572609750 conn(0x7f81cc0713e0 msgr2=0x7f81cc0717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.807+0000 7f81d1600640 1 -- 172.21.15.73:0/3572609750 shutdown_connections 2024-03-23T06:23:57.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.807+0000 7f81d1600640 1 -- 172.21.15.73:0/3572609750 wait complete. 2024-03-23T06:23:57.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.809+0000 7f81d1600640 1 Processor -- start 2024-03-23T06:23:57.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.810+0000 7f81d1600640 1 -- start start 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81d1600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81cc0caed0 0x7f81cc0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81d1600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0ced20 0x7f81cc0c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81d1600640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81cc0cf100 0x7f81cc1eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81d1600640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0c4920 con 0x7f81cc0cf100 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81d1600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1f2100 con 0x7f81cc0caed0 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81d1600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc0c57d0 con 0x7f81cc0ced20 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81c3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0ced20 0x7f81cc0c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81d0c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81cc0cf100 0x7f81cc1eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81cc0caed0 0x7f81cc0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81c3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0ced20 0x7f81cc0c6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41698/0 (socket says 172.21.15.73:41698) 2024-03-23T06:23:57.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.811+0000 7f81c3e00640 1 -- 172.21.15.73:0/4158880948 learned_addr learned my addr 172.21.15.73:0/4158880948 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81cbe00640 1 -- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0ced20 msgr2=0x7f81cc0c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81cbe00640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0ced20 0x7f81cc0c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81cbe00640 1 -- 172.21.15.73:0/4158880948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81cc0cf100 msgr2=0x7f81cc1eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81cbe00640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81cc0cf100 0x7f81cc1eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81cbe00640 1 -- 172.21.15.73:0/4158880948 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4009400 con 0x7f81cc0caed0 2024-03-23T06:23:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81c3e00640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0ced20 0x7f81cc0c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81d0c00640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81cc0cf100 0x7f81cc1eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:57.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81cbe00640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81cc0caed0 0x7f81cc0c4f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c760 tx=0x7f81bc00cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81c8c00640 1 -- 172.21.15.73:0/4158880948 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc005ab0 con 0x7f81cc0caed0 2024-03-23T06:23:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81c8c00640 1 -- 172.21.15.73:0/4158880948 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f81bc005c10 con 0x7f81cc0caed0 2024-03-23T06:23:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81c8c00640 1 -- 172.21.15.73:0/4158880948 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc001d30 con 0x7f81cc0caed0 2024-03-23T06:23:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81cc1f2350 con 0x7f81cc0caed0 2024-03-23T06:23:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.812+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc1f2910 con 0x7f81cc0caed0 2024-03-23T06:23:57.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.813+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc04e030 con 0x7f81cc0caed0 2024-03-23T06:23:57.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.815+0000 7f81c8c00640 1 -- 172.21.15.73:0/4158880948 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f81bc007070 con 0x7f81cc0caed0 2024-03-23T06:23:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.816+0000 7f81c8c00640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f81a806ac00 0x7f81a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.816+0000 7f81c8c00640 1 -- 172.21.15.73:0/4158880948 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f81bc088700 con 0x7f81cc0caed0 2024-03-23T06:23:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.816+0000 7f81c3e00640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f81a806ac00 0x7f81a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:57.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.817+0000 7f81c3e00640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f81a806ac00 0x7f81a806d0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0c1720 tx=0x7f81b403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:57.820+0000 7f81c8c00640 1 -- 172.21.15.73:0/4158880948 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f81bc053590 con 0x7f81cc0caed0 2024-03-23T06:23:58.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.056+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81cc15a370 con 0x7f81cc0caed0 2024-03-23T06:23:58.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.057+0000 7f81c8c00640 1 -- 172.21.15.73:0/4158880948 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6280 (secure 0 0 0) 0x7f81cc15a370 con 0x7f81cc0caed0 2024-03-23T06:23:58.057 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:23:58.057 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6838/2460207601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2460207601},{"type":"v1","addr":"172.21.15.110:6838","nonce":2460207601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6839/3947035656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":3947035656},{"type":"v1","addr":"172.21.15.110:6839","nonce":3947035656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/266610215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":266610215},{"type":"v1","addr":"172.21.15.73:6833","nonce":266610215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-23T06:09:57.917296+0000","modified":"2024-03-23T06:10:39.659193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4282,"mds_1":4256,"mds_2":4253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4253":{"gid":4253,"name":"c","rank":2,"incarnation":14,"state":"up:active","state_seq":13,"addr":"172.21.15.73:6835/3116000384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3116000384},{"type":"v1","addr":"172.21.15.73:6835","nonce":3116000384}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4256":{"gid":4256,"name":"e","rank":1,"incarnation":10,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6837/712461133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":712461133},{"type":"v1","addr":"172.21.15.73:6837","nonce":712461133}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4282":{"gid":4282,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.110:6837/3132183330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3132183330},{"type":"v1","addr":"172.21.15.110:6837","nonce":3132183330}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-23T06:23:58.058 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-23T06:23:58.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f81a806ac00 msgr2=0x7f81a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f81a806ac00 0x7f81a806d0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0c1720 tx=0x7f81b403b040 comp rx=0 tx=0).stop 2024-03-23T06:23:58.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81cc0caed0 msgr2=0x7f81cc0c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81cc0caed0 0x7f81cc0c4f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c760 tx=0x7f81bc00cc20 comp rx=0 tx=0).stop 2024-03-23T06:23:58.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 shutdown_connections 2024-03-23T06:23:58.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81cc0cf100 0x7f81cc1eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f81a806ac00 0x7f81a806d0c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81cc0ced20 0x7f81cc0c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 --2- 172.21.15.73:0/4158880948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81cc0caed0 0x7f81cc0c4f70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 >> 172.21.15.73:0/4158880948 conn(0x7f81cc0713e0 msgr2=0x7f81cc0717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 shutdown_connections 2024-03-23T06:23:58.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.060+0000 7f81d1600640 1 -- 172.21.15.73:0/4158880948 wait complete. 2024-03-23T06:23:58.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-23T06:23:58.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.273+0000 7fdb54c00640 1 Processor -- start 2024-03-23T06:23:58.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.273+0000 7fdb54c00640 1 -- start start 2024-03-23T06:23:58.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.275+0000 7fdb54c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb5015d7c0 0x7fdb500700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.275+0000 7fdb54c00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb50153bf0 con 0x7fdb50153810 2024-03-23T06:23:58.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.275+0000 7fdb54c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5015a460 con 0x7fdb50159490 2024-03-23T06:23:58.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.275+0000 7fdb54c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50159920 con 0x7fdb5015d7c0 2024-03-23T06:23:58.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.275+0000 7fdb4de00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdb50153810 0x7fdb5006ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:55822/0 (socket says 172.21.15.73:55822) 2024-03-23T06:23:58.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.275+0000 7fdb4de00640 1 -- 172.21.15.73:0/3910346936 learned_addr learned my addr 172.21.15.73:0/3910346936 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:23:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.275+0000 7fdb4e800640 1 --2- 172.21.15.73:0/3910346936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb5015d7c0 0x7fdb500700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.276+0000 7fdb4d400640 1 -- 172.21.15.73:0/3910346936 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791098916 0 0) 0x7fdb5015a460 con 0x7fdb50159490 2024-03-23T06:23:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.276+0000 7fdb4e800640 1 -- 172.21.15.73:0/3910346936 >> v1:172.21.15.110:6789/0 conn(0x7fdb50159490 legacy=0x7fdb5015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.276+0000 7fdb4e800640 1 -- 172.21.15.73:0/3910346936 >> v1:172.21.15.73:6789/0 conn(0x7fdb50153810 legacy=0x7fdb5006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.276+0000 7fdb4e800640 1 -- 172.21.15.73:0/3910346936 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50159bc0 con 0x7fdb5015d7c0 2024-03-23T06:23:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.277+0000 7fdb4e800640 1 --2- 172.21.15.73:0/3910346936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb5015d7c0 0x7fdb500700c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009dc0 tx=0x7fdb4802bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c6b58182551b65 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.277+0000 7fdb4d400640 1 -- 172.21.15.73:0/3910346936 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4802c9f0 con 0x7fdb5015d7c0 2024-03-23T06:23:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.277+0000 7fdb4d400640 1 -- 172.21.15.73:0/3910346936 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdb4802cb50 con 0x7fdb5015d7c0 2024-03-23T06:23:58.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.277+0000 7fdb4d400640 1 -- 172.21.15.73:0/3910346936 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48034440 con 0x7fdb5015d7c0 2024-03-23T06:23:58.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.277+0000 7fdb54c00640 1 -- 172.21.15.73:0/3910346936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb5015d7c0 msgr2=0x7fdb500700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.277+0000 7fdb54c00640 1 --2- 172.21.15.73:0/3910346936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb5015d7c0 0x7fdb500700c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009dc0 tx=0x7fdb4802bcc0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.278+0000 7fdb54c00640 1 -- 172.21.15.73:0/3910346936 shutdown_connections 2024-03-23T06:23:58.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.278+0000 7fdb54c00640 1 --2- 172.21.15.73:0/3910346936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb5015d7c0 0x7fdb500700c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.278+0000 7fdb54c00640 1 -- 172.21.15.73:0/3910346936 >> 172.21.15.73:0/3910346936 conn(0x7fdb500cb6a0 msgr2=0x7fdb500cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:58.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.278+0000 7fdb54c00640 1 -- 172.21.15.73:0/3910346936 shutdown_connections 2024-03-23T06:23:58.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.278+0000 7fdb54c00640 1 -- 172.21.15.73:0/3910346936 wait complete. 2024-03-23T06:23:58.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.279+0000 7fdb54c00640 1 Processor -- start 2024-03-23T06:23:58.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.279+0000 7fdb54c00640 1 -- start start 2024-03-23T06:23:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.280+0000 7fdb54c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb50153810 0x7fdb500ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.280+0000 7fdb54c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb5015d7c0 0x7fdb5015bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.280+0000 7fdb54c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5015c760 0x7fdb501ef730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.280+0000 7fdb54c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500c83d0 con 0x7fdb5015c760 2024-03-23T06:23:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.280+0000 7fdb54c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500c2d20 con 0x7fdb5015d7c0 2024-03-23T06:23:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.280+0000 7fdb54c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500c85e0 con 0x7fdb50153810 2024-03-23T06:23:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb5015d7c0 0x7fdb5015bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb5015d7c0 0x7fdb5015bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:56608/0 (socket says 172.21.15.73:56608) 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb4de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb50153810 0x7fdb500ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 -- 172.21.15.73:0/2965580046 learned_addr learned my addr 172.21.15.73:0/2965580046 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb4e800640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5015c760 0x7fdb501ef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 -- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb50153810 msgr2=0x7fdb500ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb50153810 0x7fdb500ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 -- 172.21.15.73:0/2965580046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5015c760 msgr2=0x7fdb501ef730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5015c760 0x7fdb501ef730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 -- 172.21.15.73:0/2965580046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48009a70 con 0x7fdb5015d7c0 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.281+0000 7fdb47e00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb5015d7c0 0x7fdb5015bd10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c450 tx=0x7fdb3800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.282+0000 7fdb46000640 1 -- 172.21.15.73:0/2965580046 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38005480 con 0x7fdb5015d7c0 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.282+0000 7fdb46000640 1 -- 172.21.15.73:0/2965580046 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdb380035f0 con 0x7fdb5015d7c0 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.282+0000 7fdb46000640 1 -- 172.21.15.73:0/2965580046 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb380039e0 con 0x7fdb5015d7c0 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.282+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb500c88c0 con 0x7fdb5015d7c0 2024-03-23T06:23:58.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.282+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb501eeec0 con 0x7fdb5015d7c0 2024-03-23T06:23:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.283+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5004e110 con 0x7fdb5015d7c0 2024-03-23T06:23:58.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.284+0000 7fdb46000640 1 -- 172.21.15.73:0/2965580046 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdb38003b40 con 0x7fdb5015d7c0 2024-03-23T06:23:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.285+0000 7fdb46000640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb2c06ac00 0x7fdb2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.285+0000 7fdb46000640 1 -- 172.21.15.73:0/2965580046 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7fdb38089130 con 0x7fdb5015d7c0 2024-03-23T06:23:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.285+0000 7fdb4de00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb2c06ac00 0x7fdb2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.285+0000 7fdb4de00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb2c06ac00 0x7fdb2c06d0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdb40000f60 tx=0x7fdb40007e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:58.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.289+0000 7fdb46000640 1 -- 172.21.15.73:0/2965580046 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fdb38053ff0 con 0x7fdb5015d7c0 2024-03-23T06:23:58.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.483+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb5015a180 con 0x7fdb5015d7c0 2024-03-23T06:23:58.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.484+0000 7fdb46000640 1 -- 172.21.15.73:0/2965580046 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18088 (secure 0 0 0) 0x7fdb38057610 con 0x7fdb5015d7c0 2024-03-23T06:23:58.485 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-23T06:23:58.485 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":27,"fsid":"4707007f-1ceb-450e-b69b-d09789f75edc","created":"2024-03-23T06:09:34.439829+0000","modified":"2024-03-23T06:10:39.659625+0000","last_up_change":"2024-03-23T06:09:46.015034+0000","last_in_change":"2024-03-23T06:09:37.112749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-23T06:09:46.691191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-23T06:09:56.066381+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-23T06:09:56.917187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-23T06:09:59.981596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"45968980-05a3-4f43-b2b6-d1012f1f958e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6817","nonce":36879},{"type":"v1","addr":"172.21.15.73:6819","nonce":36879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6821","nonce":36879},{"type":"v1","addr":"172.21.15.73:6823","nonce":36879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36879},{"type":"v1","addr":"172.21.15.73:6830","nonce":36879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6825","nonce":36879},{"type":"v1","addr":"172.21.15.73:6827","nonce":36879}]},"public_addr":"172.21.15.73:6819/36879","cluster_addr":"172.21.15.73:6823/36879","heartbeat_back_addr":"172.21.15.73:6830/36879","heartbeat_front_addr":"172.21.15.73:6827/36879","state":["exists","up"]},{"osd":1,"uuid":"cf996b30-6d88-4e2d-8942-34761d57502d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36878},{"type":"v1","addr":"172.21.15.73:6807","nonce":36878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36878},{"type":"v1","addr":"172.21.15.73:6810","nonce":36878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36878},{"type":"v1","addr":"172.21.15.73:6820","nonce":36878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36878},{"type":"v1","addr":"172.21.15.73:6814","nonce":36878}]},"public_addr":"172.21.15.73:6807/36878","cluster_addr":"172.21.15.73:6810/36878","heartbeat_back_addr":"172.21.15.73:6820/36878","heartbeat_front_addr":"172.21.15.73:6814/36878","state":["exists","up"]},{"osd":2,"uuid":"46605b4f-b7af-4e34-912f-9c21f0905078","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36881},{"type":"v1","addr":"172.21.15.73:6801","nonce":36881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36881},{"type":"v1","addr":"172.21.15.73:6803","nonce":36881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36881},{"type":"v1","addr":"172.21.15.73:6811","nonce":36881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36881},{"type":"v1","addr":"172.21.15.73:6806","nonce":36881}]},"public_addr":"172.21.15.73:6801/36881","cluster_addr":"172.21.15.73:6803/36881","heartbeat_back_addr":"172.21.15.73:6811/36881","heartbeat_front_addr":"172.21.15.73:6806/36881","state":["exists","up"]},{"osd":3,"uuid":"fe6e559c-a95b-49d2-b790-d22bf54d1188","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":36880},{"type":"v1","addr":"172.21.15.73:6815","nonce":36880}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36880},{"type":"v1","addr":"172.21.15.73:6822","nonce":36880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6829","nonce":36880},{"type":"v1","addr":"172.21.15.73:6831","nonce":36880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36880},{"type":"v1","addr":"172.21.15.73:6826","nonce":36880}]},"public_addr":"172.21.15.73:6815/36880","cluster_addr":"172.21.15.73:6822/36880","heartbeat_back_addr":"172.21.15.73:6831/36880","heartbeat_front_addr":"172.21.15.73:6826/36880","state":["exists","up"]},{"osd":4,"uuid":"c1e45bfa-e59c-410f-ae99-725ce8354bb5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":38266},{"type":"v1","addr":"172.21.15.110:6801","nonce":38266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6803","nonce":38266},{"type":"v1","addr":"172.21.15.110:6805","nonce":38266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6811","nonce":38266},{"type":"v1","addr":"172.21.15.110:6813","nonce":38266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6807","nonce":38266},{"type":"v1","addr":"172.21.15.110:6809","nonce":38266}]},"public_addr":"172.21.15.110:6801/38266","cluster_addr":"172.21.15.110:6805/38266","heartbeat_back_addr":"172.21.15.110:6813/38266","heartbeat_front_addr":"172.21.15.110:6809/38266","state":["exists","up"]},{"osd":5,"uuid":"fec41108-00f1-4cfc-8cdd-8e87195f0936","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":38268},{"type":"v1","addr":"172.21.15.110:6817","nonce":38268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":38268},{"type":"v1","addr":"172.21.15.110:6819","nonce":38268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":38268},{"type":"v1","addr":"172.21.15.110:6823","nonce":38268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":38268},{"type":"v1","addr":"172.21.15.110:6821","nonce":38268}]},"public_addr":"172.21.15.110:6817/38268","cluster_addr":"172.21.15.110:6819/38268","heartbeat_back_addr":"172.21.15.110:6823/38268","heartbeat_front_addr":"172.21.15.110:6821/38268","state":["exists","up"]},{"osd":6,"uuid":"dd9fcf25-f670-44ce-a393-b86c2dffaea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":38267},{"type":"v1","addr":"172.21.15.110:6804","nonce":38267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":38267},{"type":"v1","addr":"172.21.15.110:6808","nonce":38267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":38267},{"type":"v1","addr":"172.21.15.110:6815","nonce":38267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":38267},{"type":"v1","addr":"172.21.15.110:6812","nonce":38267}]},"public_addr":"172.21.15.110:6804/38267","cluster_addr":"172.21.15.110:6808/38267","heartbeat_back_addr":"172.21.15.110:6815/38267","heartbeat_front_addr":"172.21.15.110:6812/38267","state":["exists","up"]},{"osd":7,"uuid":"eccb2f2f-e4ba-4073-9437-fe24ff5cf7d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":38285},{"type":"v1","addr":"172.21.15.110:6825","nonce":38285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":38285},{"type":"v1","addr":"172.21.15.110:6827","nonce":38285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":38285},{"type":"v1","addr":"172.21.15.110:6831","nonce":38285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":38285},{"type":"v1","addr":"172.21.15.110:6829","nonce":38285}]},"public_addr":"172.21.15.110:6825/38285","cluster_addr":"172.21.15.110:6827/38285","heartbeat_back_addr":"172.21.15.110:6831/38285","heartbeat_front_addr":"172.21.15.110:6829/38285","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.469287+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.456653+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.484633+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.491571+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.165309+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.245242+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.295461+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-23T06:09:42.276656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":0,"to":7}]},{"pgid":"4.7","mappings":[{"from":1,"to":4}]},{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2},{"from":7,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-23T06:23:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.486+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb2c06ac00 msgr2=0x7fdb2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.486+0000 7fdb54c00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb2c06ac00 0x7fdb2c06d0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdb40000f60 tx=0x7fdb40007e00 comp rx=0 tx=0).stop 2024-03-23T06:23:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.486+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb5015d7c0 msgr2=0x7fdb5015bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.486+0000 7fdb54c00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb5015d7c0 0x7fdb5015bd10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c450 tx=0x7fdb3800c910 comp rx=0 tx=0).stop 2024-03-23T06:23:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.487+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 shutdown_connections 2024-03-23T06:23:58.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.487+0000 7fdb54c00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb5015c760 0x7fdb501ef730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.487+0000 7fdb54c00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb5015d7c0 0x7fdb5015bd10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.487+0000 7fdb54c00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fdb2c06ac00 0x7fdb2c06d0c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.487+0000 7fdb54c00640 1 --2- 172.21.15.73:0/2965580046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb50153810 0x7fdb500ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.487+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 >> 172.21.15.73:0/2965580046 conn(0x7fdb500cb6a0 msgr2=0x7fdb500cba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:58.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.487+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 shutdown_connections 2024-03-23T06:23:58.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.487+0000 7fdb54c00640 1 -- 172.21.15.73:0/2965580046 wait complete. 2024-03-23T06:23:58.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-23T06:23:58.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.703+0000 7f919dc00640 1 Processor -- start 2024-03-23T06:23:58.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.703+0000 7f919dc00640 1 -- start start 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.704+0000 7f919dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f919815af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.704+0000 7f919dc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f91980c3e80 0x7f9198071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.704+0000 7f919dc00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9198072490 0x7f91980c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.704+0000 7f919dc00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91980c43e0 con 0x7f9198072490 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.704+0000 7f919dc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91980c46c0 con 0x7f91980c3e80 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.704+0000 7f919dc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91980c49a0 con 0x7f9198151310 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f91980c3e80 0x7f9198071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f919815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f919d200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9198072490 0x7f91980c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f91980c3e80 0x7f9198071f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:56616/0 (socket says 172.21.15.73:56616) 2024-03-23T06:23:58.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197400640 1 -- 172.21.15.73:0/4106849088 learned_addr learned my addr 172.21.15.73:0/4106849088 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:58.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197400640 1 -- 172.21.15.73:0/4106849088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 msgr2=0x7f919815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:58.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197400640 1 --2- 172.21.15.73:0/4106849088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f919815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197400640 1 -- 172.21.15.73:0/4106849088 >> v2:172.21.15.73:3300/0 conn(0x7f9198072490 msgr2=0x7f91980c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:58.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197400640 1 --2- 172.21.15.73:0/4106849088 >> v2:172.21.15.73:3300/0 conn(0x7f9198072490 0x7f91980c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197400640 1 -- 172.21.15.73:0/4106849088 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980c4c80 con 0x7f91980c3e80 2024-03-23T06:23:58.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.705+0000 7f9197e00640 1 --2- 172.21.15.73:0/4106849088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f919815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:58.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.706+0000 7f9197400640 1 --2- 172.21.15.73:0/4106849088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 0x7f9198071f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9198070340 tx=0x7f918402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae1832ce3500d950 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:58.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.706+0000 7f9196a00640 1 -- 172.21.15.73:0/4106849088 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184031870 con 0x7f91980c3e80 2024-03-23T06:23:58.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f9196a00640 1 -- 172.21.15.73:0/4106849088 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f91840319d0 con 0x7f91980c3e80 2024-03-23T06:23:58.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f9196a00640 1 -- 172.21.15.73:0/4106849088 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184031d80 con 0x7f91980c3e80 2024-03-23T06:23:58.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 -- 172.21.15.73:0/4106849088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 msgr2=0x7f9198071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 --2- 172.21.15.73:0/4106849088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 0x7f9198071f50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9198070340 tx=0x7f918402b910 comp rx=0 tx=0).stop 2024-03-23T06:23:58.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 -- 172.21.15.73:0/4106849088 shutdown_connections 2024-03-23T06:23:58.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 --2- 172.21.15.73:0/4106849088 >> v2:172.21.15.73:3300/0 conn(0x7f9198072490 0x7f91980c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 --2- 172.21.15.73:0/4106849088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 0x7f9198071f50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 --2- 172.21.15.73:0/4106849088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f919815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 -- 172.21.15.73:0/4106849088 >> 172.21.15.73:0/4106849088 conn(0x7f9198065a50 msgr2=0x7f9198065e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:58.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 -- 172.21.15.73:0/4106849088 shutdown_connections 2024-03-23T06:23:58.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.707+0000 7f919dc00640 1 -- 172.21.15.73:0/4106849088 wait complete. 2024-03-23T06:23:58.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.709+0000 7f919dc00640 1 Processor -- start 2024-03-23T06:23:58.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.710+0000 7f919dc00640 1 -- start start 2024-03-23T06:23:58.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f919dc00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9198072490 0x7f9198144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f919dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 0x7f91981eed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f919dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f91981ef270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f919dc00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91981547c0 con 0x7f9198072490 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f919dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91981e01d0 con 0x7f91980c3e80 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f919dc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91981e04b0 con 0x7f9198151310 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9198072490 0x7f9198144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 0x7f91981eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197e00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9198072490 0x7f9198144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:60500/0 (socket says 172.21.15.73:60500) 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197e00640 1 -- 172.21.15.73:0/691912962 learned_addr learned my addr 172.21.15.73:0/691912962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f919d200640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f91981ef270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197e00640 1 -- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 msgr2=0x7f91981ef270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197e00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f91981ef270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197e00640 1 -- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 msgr2=0x7f91981eed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197e00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 0x7f91981eed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:58.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197e00640 1 -- 172.21.15.73:0/691912962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009400 con 0x7f9198072490 2024-03-23T06:23:58.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.711+0000 7f9197400640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 0x7f91981eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:23:58.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.712+0000 7f9197e00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9198072490 0x7f9198144570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f918800ebe0 tx=0x7f918800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:58.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.712+0000 7f918fe00640 1 -- 172.21.15.73:0/691912962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188009760 con 0x7f9198072490 2024-03-23T06:23:58.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.712+0000 7f918fe00640 1 -- 172.21.15.73:0/691912962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f918800cc30 con 0x7f9198072490 2024-03-23T06:23:58.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.712+0000 7f918fe00640 1 -- 172.21.15.73:0/691912962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800eee0 con 0x7f9198072490 2024-03-23T06:23:58.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.712+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91840094d0 con 0x7f9198072490 2024-03-23T06:23:58.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.712+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91981ee810 con 0x7f9198072490 2024-03-23T06:23:58.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.713+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919804e030 con 0x7f9198072490 2024-03-23T06:23:58.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.715+0000 7f918fe00640 1 -- 172.21.15.73:0/691912962 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9188013470 con 0x7f9198072490 2024-03-23T06:23:58.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.716+0000 7f918fe00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f917806ac00 0x7f917806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:58.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.716+0000 7f918fe00640 1 -- 172.21.15.73:0/691912962 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6584+0+0 (secure 0 0 0) 0x7f9188089d60 con 0x7f9198072490 2024-03-23T06:23:58.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.716+0000 7f9197400640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f917806ac00 0x7f917806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:58.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.717+0000 7f9197400640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f917806ac00 0x7f917806d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9184036000 tx=0x7f918403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:58.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.721+0000 7f918fe00640 1 -- 172.21.15.73:0/691912962 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9188054be0 con 0x7f9198072490 2024-03-23T06:23:58.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:58.955+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f91980c3470 con 0x7f9198072490 2024-03-23T06:23:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.034+0000 7f918fe00640 1 -- 172.21.15.73:0/691912962 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9188017090 con 0x7f9198072490 2024-03-23T06:23:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-23T06:23:59.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.037+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f917806ac00 msgr2=0x7f917806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:59.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.037+0000 7f919dc00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f917806ac00 0x7f917806d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9184036000 tx=0x7f918403c040 comp rx=0 tx=0).stop 2024-03-23T06:23:59.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.037+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9198072490 msgr2=0x7f9198144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:59.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.037+0000 7f919dc00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9198072490 0x7f9198144570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f918800ebe0 tx=0x7f918800c520 comp rx=0 tx=0).stop 2024-03-23T06:23:59.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.038+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 shutdown_connections 2024-03-23T06:23:59.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.038+0000 7f919dc00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f917806ac00 0x7f917806d0c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.038+0000 7f919dc00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9198151310 0x7f91981ef270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.038+0000 7f919dc00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91980c3e80 0x7f91981eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.038+0000 7f919dc00640 1 --2- 172.21.15.73:0/691912962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9198072490 0x7f9198144570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.038+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 >> 172.21.15.73:0/691912962 conn(0x7f9198065a50 msgr2=0x7f9198154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:59.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.038+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 shutdown_connections 2024-03-23T06:23:59.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.038+0000 7f919dc00640 1 -- 172.21.15.73:0/691912962 wait complete. 2024-03-23T06:23:59.060 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-23T06:23:59.129 INFO:tasks.ceph.mds.f.smithi110.stdout:starting mds.f at 2024-03-23T06:23:59.177 INFO:tasks.ceph.mds.e.smithi073.stdout:starting mds.e at 2024-03-23T06:23:59.179 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-03-23T06:23:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.241+0000 7f4a14c00640 1 Processor -- start 2024-03-23T06:23:59.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.241+0000 7f4a14c00640 1 -- start start 2024-03-23T06:23:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a14c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a10153760 0x7f4a10159420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a14c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4a100c9740 0x7f4a100cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a14c00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a100cbd10 0x7f4a100ca940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a14c00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1006a2d0 con 0x7f4a100cbd10 2024-03-23T06:23:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a14c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1006a5b0 con 0x7f4a100c9740 2024-03-23T06:23:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a14c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1006a890 con 0x7f4a10153760 2024-03-23T06:23:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a0d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4a100c9740 0x7f4a100cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:59.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a0de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a10153760 0x7f4a10159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a0d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4a100c9740 0x7f4a100cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.73:56648/0 (socket says 172.21.15.73:56648) 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.242+0000 7f4a0d400640 1 -- 172.21.15.73:0/1303042174 learned_addr learned my addr 172.21.15.73:0/1303042174 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.243+0000 7f4a0e800640 1 --2- 172.21.15.73:0/1303042174 >> v2:172.21.15.73:3300/0 conn(0x7f4a100cbd10 0x7f4a100ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.243+0000 7f4a0d400640 1 -- 172.21.15.73:0/1303042174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a10153760 msgr2=0x7f4a10159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.243+0000 7f4a0d400640 1 --2- 172.21.15.73:0/1303042174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a10153760 0x7f4a10159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.243+0000 7f4a0d400640 1 -- 172.21.15.73:0/1303042174 >> v2:172.21.15.73:3300/0 conn(0x7f4a100cbd10 msgr2=0x7f4a100ca940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.243+0000 7f4a0d400640 1 --2- 172.21.15.73:0/1303042174 >> v2:172.21.15.73:3300/0 conn(0x7f4a100cbd10 0x7f4a100ca940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.243+0000 7f4a0d400640 1 -- 172.21.15.73:0/1303042174 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1006ab70 con 0x7f4a100c9740 2024-03-23T06:23:59.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.243+0000 7f4a0e800640 1 --2- 172.21.15.73:0/1303042174 >> v2:172.21.15.73:3300/0 conn(0x7f4a100cbd10 0x7f4a100ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-23T06:23:59.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.244+0000 7f4a0d400640 1 --2- 172.21.15.73:0/1303042174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a100c9740 0x7f4a100cb7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009870 tx=0x7f49fc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4d74e2f53426374 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:59.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.244+0000 7f4a0ca00640 1 -- 172.21.15.73:0/1303042174 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc031640 con 0x7f4a100c9740 2024-03-23T06:23:59.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.244+0000 7f4a0ca00640 1 -- 172.21.15.73:0/1303042174 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f49fc0317a0 con 0x7f4a100c9740 2024-03-23T06:23:59.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.244+0000 7f4a0ca00640 1 -- 172.21.15.73:0/1303042174 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc031b50 con 0x7f4a100c9740 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 -- 172.21.15.73:0/1303042174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a100c9740 msgr2=0x7f4a100cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 --2- 172.21.15.73:0/1303042174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a100c9740 0x7f4a100cb7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009870 tx=0x7f49fc02b8f0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 -- 172.21.15.73:0/1303042174 shutdown_connections 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 --2- 172.21.15.73:0/1303042174 >> v2:172.21.15.73:3300/0 conn(0x7f4a100cbd10 0x7f4a100ca940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 --2- 172.21.15.73:0/1303042174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a100c9740 0x7f4a100cb7d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 --2- 172.21.15.73:0/1303042174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a10153760 0x7f4a10159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 -- 172.21.15.73:0/1303042174 >> 172.21.15.73:0/1303042174 conn(0x7f4a1006c310 msgr2=0x7f4a100713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 -- 172.21.15.73:0/1303042174 shutdown_connections 2024-03-23T06:23:59.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.245+0000 7f4a14c00640 1 -- 172.21.15.73:0/1303042174 wait complete. 2024-03-23T06:23:59.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.246+0000 7f4a14c00640 1 Processor -- start 2024-03-23T06:23:59.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.247+0000 7f4a14c00640 1 -- start start 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.247+0000 7f4a14c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a100c9740 0x7f4a1014e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.247+0000 7f4a14c00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a100cbd10 0x7f4a1014c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.247+0000 7f4a14c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a10153760 0x7f4a101f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.247+0000 7f4a14c00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a10150030 con 0x7f4a100cbd10 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.247+0000 7f4a14c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1014dca0 con 0x7f4a10153760 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.247+0000 7f4a14c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1014d010 con 0x7f4a100c9740 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a100c9740 0x7f4a1014e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0d400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a100cbd10 0x7f4a1014c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:59.248 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a100c9740 0x7f4a1014e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:41784/0 (socket says 172.21.15.73:41784) 2024-03-23T06:23:59.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 -- 172.21.15.73:0/2449230953 learned_addr learned my addr 172.21.15.73:0/2449230953 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:23:59.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0e800640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a10153760 0x7f4a101f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:59.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 -- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a10153760 msgr2=0x7f4a101f0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:59.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a10153760 0x7f4a101f0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 -- 172.21.15.73:0/2449230953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a100cbd10 msgr2=0x7f4a1014c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:23:59.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a100cbd10 0x7f4a1014c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:23:59.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 -- 172.21.15.73:0/2449230953 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc0094d0 con 0x7f4a100c9740 2024-03-23T06:23:59.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a0de00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a100c9740 0x7f4a1014e9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000e870 tx=0x7f4a0000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:59.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.248+0000 7f4a06000640 1 -- 172.21.15.73:0/2449230953 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a000094f0 con 0x7f4a100c9740 2024-03-23T06:23:59.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.249+0000 7f4a06000640 1 -- 172.21.15.73:0/2449230953 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4a0000c940 con 0x7f4a100c9740 2024-03-23T06:23:59.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.249+0000 7f4a06000640 1 -- 172.21.15.73:0/2449230953 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0000cd10 con 0x7f4a100c9740 2024-03-23T06:23:59.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.249+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1014d2f0 con 0x7f4a100c9740 2024-03-23T06:23:59.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.249+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1014e1d0 con 0x7f4a100c9740 2024-03-23T06:23:59.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.250+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1004e110 con 0x7f4a100c9740 2024-03-23T06:23:59.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.251+0000 7f4a06000640 1 -- 172.21.15.73:0/2449230953 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4a00013470 con 0x7f4a100c9740 2024-03-23T06:23:59.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.252+0000 7f4a06000640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f49f006ac00 0x7f49f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:23:59.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.252+0000 7f4a06000640 1 -- 172.21.15.73:0/2449230953 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6842+0+0 (secure 0 0 0) 0x7f4a00089990 con 0x7f4a100c9740 2024-03-23T06:23:59.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.252+0000 7f4a0d400640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f49f006ac00 0x7f49f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:23:59.253 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.253+0000 7f4a0d400640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f49f006ac00 0x7f49f006d0c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f49fc036000 tx=0x7f49fc03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:23:59.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.256+0000 7f4a06000640 1 -- 172.21.15.73:0/2449230953 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4a00054680 con 0x7f4a100c9740 2024-03-23T06:23:59.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:23:59.479+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a100cc2d0 con 0x7f4a100c9740 2024-03-23T06:24:00.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.132+0000 7f4a06000640 1 -- 172.21.15.73:0/2449230953 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a00057ca0 con 0x7f4a100c9740 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f49f006ac00 msgr2=0x7f49f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f49f006ac00 0x7f49f006d0c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f49fc036000 tx=0x7f49fc03c040 comp rx=0 tx=0).stop 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a100c9740 msgr2=0x7f4a1014e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a100c9740 0x7f4a1014e9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a0000e870 tx=0x7f4a0000ed30 comp rx=0 tx=0).stop 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 shutdown_connections 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a10153760 0x7f4a101f0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a100cbd10 0x7f4a1014c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f49f006ac00 0x7f49f006d0c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 --2- 172.21.15.73:0/2449230953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a100c9740 0x7f4a1014e9d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.135+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 >> 172.21.15.73:0/2449230953 conn(0x7f4a1006c310 msgr2=0x7f4a101522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.136+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 shutdown_connections 2024-03-23T06:24:00.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.136+0000 7f4a14c00640 1 -- 172.21.15.73:0/2449230953 wait complete. 2024-03-23T06:24:00.153 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-23T06:24:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.343+0000 7fa388400640 1 Processor -- start 2024-03-23T06:24:00.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.343+0000 7fa388400640 1 -- start start 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa388400640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa380153800 0x7fa3800c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa388400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa3800cc040 0x7fa380159480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa388400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3800c4620 con 0x7fa38015c9f0 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa388400640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3800b2430 con 0x7fa380153800 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa388400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa380153be0 con 0x7fa3800cc040 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa385a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa380153800 0x7fa3800c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa385000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa3800cc040 0x7fa380159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa385a00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa380153800 0x7fa3800c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48076/0 (socket says 172.21.15.73:48076) 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa385a00640 1 -- 172.21.15.73:0/890667635 learned_addr learned my addr 172.21.15.73:0/890667635 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa386400640 1 --1- 172.21.15.73:0/890667635 >> v1:172.21.15.110:6789/0 conn(0x7fa38015c9f0 0x7fa3800c9d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:37126/0 (socket says 172.21.15.73:37126) 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa37fe00640 1 -- 172.21.15.73:0/890667635 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869694775 0 0) 0x7fa3800c4620 con 0x7fa38015c9f0 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.345+0000 7fa37fe00640 1 -- 172.21.15.73:0/890667635 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa364003520 con 0x7fa38015c9f0 2024-03-23T06:24:00.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.346+0000 7fa385000640 1 -- 172.21.15.73:0/890667635 >> v2:172.21.15.73:3300/0 conn(0x7fa380153800 msgr2=0x7fa3800c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:24:00.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.346+0000 7fa385000640 1 --2- 172.21.15.73:0/890667635 >> v2:172.21.15.73:3300/0 conn(0x7fa380153800 0x7fa3800c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.346+0000 7fa385000640 1 -- 172.21.15.73:0/890667635 >> v1:172.21.15.110:6789/0 conn(0x7fa38015c9f0 legacy=0x7fa3800c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:00.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.346+0000 7fa385000640 1 -- 172.21.15.73:0/890667635 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380159d50 con 0x7fa3800cc040 2024-03-23T06:24:00.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.346+0000 7fa385a00640 1 --2- 172.21.15.73:0/890667635 >> v2:172.21.15.73:3300/0 conn(0x7fa380153800 0x7fa3800c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa385000640 1 --2- 172.21.15.73:0/890667635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3800cc040 0x7fa380159480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa38006bbb0 tx=0x7fa36c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aeeaea7ec62aaa server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa37fe00640 1 -- 172.21.15.73:0/890667635 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c031830 con 0x7fa3800cc040 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa37fe00640 1 -- 172.21.15.73:0/890667635 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa36c031990 con 0x7fa3800cc040 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa37fe00640 1 -- 172.21.15.73:0/890667635 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c031d00 con 0x7fa3800cc040 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa388400640 1 -- 172.21.15.73:0/890667635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3800cc040 msgr2=0x7fa380159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa388400640 1 --2- 172.21.15.73:0/890667635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3800cc040 0x7fa380159480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa38006bbb0 tx=0x7fa36c02b8d0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa388400640 1 -- 172.21.15.73:0/890667635 shutdown_connections 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa388400640 1 --2- 172.21.15.73:0/890667635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3800cc040 0x7fa380159480 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.347+0000 7fa388400640 1 --2- 172.21.15.73:0/890667635 >> v2:172.21.15.73:3300/0 conn(0x7fa380153800 0x7fa3800c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.348+0000 7fa388400640 1 -- 172.21.15.73:0/890667635 >> 172.21.15.73:0/890667635 conn(0x7fa38006a9f0 msgr2=0x7fa38006be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:24:00.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.348+0000 7fa388400640 1 -- 172.21.15.73:0/890667635 shutdown_connections 2024-03-23T06:24:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.348+0000 7fa388400640 1 -- 172.21.15.73:0/890667635 wait complete. 2024-03-23T06:24:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.349+0000 7fa388400640 1 Processor -- start 2024-03-23T06:24:00.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.349+0000 7fa388400640 1 -- start start 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.350+0000 7fa388400640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3800cc040 0x7fa380158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.350+0000 7fa388400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa380153800 0x7fa3801496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.350+0000 7fa388400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38015c9f0 0x7fa380149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.350+0000 7fa388400640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3801f1bf0 con 0x7fa3800cc040 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.350+0000 7fa388400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38014a650 con 0x7fa38015c9f0 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.350+0000 7fa388400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38014a930 con 0x7fa380153800 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.350+0000 7fa385a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3800cc040 0x7fa380158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa380153800 0x7fa3801496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3800cc040 0x7fa380158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48084/0 (socket says 172.21.15.73:48084) 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385a00640 1 -- 172.21.15.73:0/2150070750 learned_addr learned my addr 172.21.15.73:0/2150070750 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa380153800 0x7fa3801496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:58274/0 (socket says 172.21.15.73:58274) 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa386400640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38015c9f0 0x7fa380149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385a00640 1 -- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa380153800 msgr2=0x7fa3801496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:00.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385a00640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa380153800 0x7fa3801496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385a00640 1 -- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38015c9f0 msgr2=0x7fa380149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385a00640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38015c9f0 0x7fa380149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385a00640 1 -- 172.21.15.73:0/2150070750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370009b30 con 0x7fa3800cc040 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385000640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa380153800 0x7fa3801496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa386400640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38015c9f0 0x7fa380149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.351+0000 7fa385a00640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3800cc040 0x7fa380158580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa37000efc0 tx=0x7fa37000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.352+0000 7fa37d600640 1 -- 172.21.15.73:0/2150070750 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370014480 con 0x7fa3800cc040 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.352+0000 7fa37d600640 1 -- 172.21.15.73:0/2150070750 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa37000f040 con 0x7fa3800cc040 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.352+0000 7fa37d600640 1 -- 172.21.15.73:0/2150070750 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370014800 con 0x7fa3800cc040 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.352+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c009400 con 0x7fa3800cc040 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.352+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38014aef0 con 0x7fa3800cc040 2024-03-23T06:24:00.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.353+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa380067560 con 0x7fa3800cc040 2024-03-23T06:24:00.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.355+0000 7fa37d600640 1 -- 172.21.15.73:0/2150070750 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa370014960 con 0x7fa3800cc040 2024-03-23T06:24:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.356+0000 7fa37d600640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa36006ac00 0x7fa36006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.356+0000 7fa37d600640 1 -- 172.21.15.73:0/2150070750 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6842+0+0 (secure 0 0 0) 0x7fa370089f90 con 0x7fa3800cc040 2024-03-23T06:24:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.356+0000 7fa385000640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa36006ac00 0x7fa36006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:00.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.357+0000 7fa385000640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa36006ac00 0x7fa36006d0c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa36c036000 tx=0x7fa36c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:00.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.361+0000 7fa37d600640 1 -- 172.21.15.73:0/2150070750 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa3700bd580 con 0x7fa3800cc040 2024-03-23T06:24:00.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:00.548+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa38014dc40 con 0x7fa3800cc040 2024-03-23T06:24:01.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.142+0000 7fa37d600640 1 -- 172.21.15.73:0/2150070750 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa370054e40 con 0x7fa3800cc040 2024-03-23T06:24:01.142 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-03-23T06:24:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.146+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa36006ac00 msgr2=0x7fa36006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.146+0000 7fa388400640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa36006ac00 0x7fa36006d0c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa36c036000 tx=0x7fa36c03c040 comp rx=0 tx=0).stop 2024-03-23T06:24:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.146+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3800cc040 msgr2=0x7fa380158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:01.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.146+0000 7fa388400640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3800cc040 0x7fa380158580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa37000efc0 tx=0x7fa37000c490 comp rx=0 tx=0).stop 2024-03-23T06:24:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.147+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 shutdown_connections 2024-03-23T06:24:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.147+0000 7fa388400640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa38015c9f0 0x7fa380149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.147+0000 7fa388400640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7fa36006ac00 0x7fa36006d0c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.147+0000 7fa388400640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa380153800 0x7fa3801496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.147+0000 7fa388400640 1 --2- 172.21.15.73:0/2150070750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3800cc040 0x7fa380158580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.147+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 >> 172.21.15.73:0/2150070750 conn(0x7fa38006a9f0 msgr2=0x7fa38014e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:24:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.147+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 shutdown_connections 2024-03-23T06:24:01.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.147+0000 7fa388400640 1 -- 172.21.15.73:0/2150070750 wait complete. 2024-03-23T06:24:01.166 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-23T06:24:01.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.361+0000 7f708f200640 1 Processor -- start 2024-03-23T06:24:01.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.361+0000 7f708f200640 1 -- start start 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f708f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f709015a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f708f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70900b3310 0x7f70900b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f708f200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70900cf8b0 con 0x7f7090153790 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f708f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709015a590 con 0x7f70900b3310 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f708f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70900ca2f0 con 0x7f70900c9e90 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f7087e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f709015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f708de00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7090153790 0x7f70900cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:37142/0 (socket says 172.21.15.73:37142) 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f708de00640 1 -- 172.21.15.73:0/1155326308 learned_addr learned my addr 172.21.15.73:0/1155326308 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.363+0000 7f708e800640 1 --2- 172.21.15.73:0/1155326308 >> v2:172.21.15.110:3300/0 conn(0x7f70900b3310 0x7f70900b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.364+0000 7f708d400640 1 -- 172.21.15.73:0/1155326308 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729541116 0 0) 0x7f70900cf8b0 con 0x7f7090153790 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.364+0000 7f708d400640 1 -- 172.21.15.73:0/1155326308 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7074003520 con 0x7f7090153790 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.364+0000 7f7087e00640 1 -- 172.21.15.73:0/1155326308 >> v2:172.21.15.110:3300/0 conn(0x7f70900b3310 msgr2=0x7f70900b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.364+0000 7f7087e00640 1 --2- 172.21.15.73:0/1155326308 >> v2:172.21.15.110:3300/0 conn(0x7f70900b3310 0x7f70900b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.364 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.364+0000 7f7087e00640 1 -- 172.21.15.73:0/1155326308 >> v1:172.21.15.110:6789/0 conn(0x7f7090153790 legacy=0x7f70900cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.364+0000 7f7087e00640 1 -- 172.21.15.73:0/1155326308 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900b3cc0 con 0x7f70900c9e90 2024-03-23T06:24:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.365+0000 7f7087e00640 1 --2- 172.21.15.73:0/1155326308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f709015a050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f70780097a0 tx=0x7f707802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f67786bde883fbdf server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.365+0000 7f708d400640 1 -- 172.21.15.73:0/1155326308 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707802e070 con 0x7f70900c9e90 2024-03-23T06:24:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.365+0000 7f708d400640 1 -- 172.21.15.73:0/1155326308 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f70780315a0 con 0x7f70900c9e90 2024-03-23T06:24:01.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.365+0000 7f708d400640 1 -- 172.21.15.73:0/1155326308 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078031950 con 0x7f70900c9e90 2024-03-23T06:24:01.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.366+0000 7f708f200640 1 -- 172.21.15.73:0/1155326308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 msgr2=0x7f709015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:01.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.366+0000 7f708f200640 1 --2- 172.21.15.73:0/1155326308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f709015a050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f70780097a0 tx=0x7f707802b840 comp rx=0 tx=0).stop 2024-03-23T06:24:01.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.366+0000 7f708f200640 1 -- 172.21.15.73:0/1155326308 shutdown_connections 2024-03-23T06:24:01.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.366+0000 7f708f200640 1 --2- 172.21.15.73:0/1155326308 >> v2:172.21.15.110:3300/0 conn(0x7f70900b3310 0x7f70900b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.366+0000 7f708f200640 1 --2- 172.21.15.73:0/1155326308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f709015a050 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.366+0000 7f708f200640 1 -- 172.21.15.73:0/1155326308 >> 172.21.15.73:0/1155326308 conn(0x7f709006c050 msgr2=0x7f709006c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:24:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.366+0000 7f708f200640 1 -- 172.21.15.73:0/1155326308 shutdown_connections 2024-03-23T06:24:01.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.366+0000 7f708f200640 1 -- 172.21.15.73:0/1155326308 wait complete. 2024-03-23T06:24:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.368+0000 7f708f200640 1 Processor -- start 2024-03-23T06:24:01.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.368+0000 7f708f200640 1 -- start start 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f708f200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70900b3310 0x7f70901e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f708f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f70901e5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f708f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090153790 0x7f70901e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f708f200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70901e3570 con 0x7f70900b3310 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f708f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70901e4b40 con 0x7f7090153790 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f708f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70901ef670 con 0x7f70900c9e90 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f7087e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f70901e5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f7087e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f70901e5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.73:58294/0 (socket says 172.21.15.73:58294) 2024-03-23T06:24:01.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f7087e00640 1 -- 172.21.15.73:0/947325638 learned_addr learned my addr 172.21.15.73:0/947325638 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f708e800640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090153790 0x7f70901e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f708de00640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70900b3310 0x7f70901e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f7087e00640 1 -- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090153790 msgr2=0x7f70901e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f7087e00640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090153790 0x7f70901e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f7087e00640 1 -- 172.21.15.73:0/947325638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70900b3310 msgr2=0x7f70901e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f7087e00640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70900b3310 0x7f70901e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.369+0000 7f7087e00640 1 -- 172.21.15.73:0/947325638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009400 con 0x7f70900c9e90 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.370+0000 7f7087e00640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f70901e5f30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7078034040 tx=0x7f70780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.370+0000 7f7086000640 1 -- 172.21.15.73:0/947325638 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078031f10 con 0x7f70900c9e90 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.370+0000 7f7086000640 1 -- 172.21.15.73:0/947325638 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7078032860 con 0x7f70900c9e90 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.370+0000 7f7086000640 1 -- 172.21.15.73:0/947325638 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078032c30 con 0x7f70900c9e90 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.370+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70901e3be0 con 0x7f70900c9e90 2024-03-23T06:24:01.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.370+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70901e2fb0 con 0x7f70900c9e90 2024-03-23T06:24:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.371+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70901e3d70 con 0x7f70900c9e90 2024-03-23T06:24:01.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.372+0000 7f7086000640 1 -- 172.21.15.73:0/947325638 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f707804e430 con 0x7f70900c9e90 2024-03-23T06:24:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.373+0000 7f7086000640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f706c06ac00 0x7f706c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.373+0000 7f7086000640 1 -- 172.21.15.73:0/947325638 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6404+0+0 (secure 0 0 0) 0x7f70780ab640 con 0x7f70900c9e90 2024-03-23T06:24:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.373+0000 7f708de00640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f706c06ac00 0x7f706c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:01.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.373+0000 7f708de00640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f706c06ac00 0x7f706c06d0c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f70800011e0 tx=0x7f7080007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:01.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.377+0000 7f7086000640 1 -- 172.21.15.73:0/947325638 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f70780764d0 con 0x7f70900c9e90 2024-03-23T06:24:01.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:01.569+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f70900c9c50 con 0x7f70900c9e90 2024-03-23T06:24:02.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.151+0000 7f7086000640 1 -- 172.21.15.73:0/947325638 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7078078400 con 0x7f70900c9e90 2024-03-23T06:24:02.151 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-03-23T06:24:02.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.155+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f706c06ac00 msgr2=0x7f706c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.155+0000 7f708f200640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f706c06ac00 0x7f706c06d0c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f70800011e0 tx=0x7f7080007d30 comp rx=0 tx=0).stop 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.155+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 msgr2=0x7f70901e5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.155+0000 7f708f200640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f70901e5f30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7078034040 tx=0x7f70780046c0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.156+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 shutdown_connections 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.156+0000 7f708f200640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7090153790 0x7f70901e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.156+0000 7f708f200640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f706c06ac00 0x7f706c06d0c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.156+0000 7f708f200640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70900c9e90 0x7f70901e5f30 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7078034040 tx=0x7f70780046c0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.156+0000 7f708f200640 1 --2- 172.21.15.73:0/947325638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70900b3310 0x7f70901e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.156+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 >> 172.21.15.73:0/947325638 conn(0x7f709006c050 msgr2=0x7f70901521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.156+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 shutdown_connections 2024-03-23T06:24:02.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.157+0000 7f708f200640 1 -- 172.21.15.73:0/947325638 wait complete. 2024-03-23T06:24:02.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-23T06:24:02.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.372+0000 7f8260200640 1 Processor -- start 2024-03-23T06:24:02.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.372+0000 7f8260200640 1 -- start start 2024-03-23T06:24:02.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.373+0000 7f8260200640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f825815b170 0x7f82580cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:02.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.373+0000 7f8260200640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8258153cc0 con 0x7f82580ca840 2024-03-23T06:24:02.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.373+0000 7f8260200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825815cc00 con 0x7f82581538e0 2024-03-23T06:24:02.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.373+0000 7f8260200640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825815a4d0 con 0x7f825815b170 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f825ce00640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f82580ca840 0x7f825815aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:45304/0 (socket says 172.21.15.73:45304) 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f825d800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f82581538e0 0x7f82580713e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.73:37156/0 (socket says 172.21.15.73:37156) 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f825ce00640 1 -- 172.21.15.73:0/1096453757 learned_addr learned my addr 172.21.15.73:0/1096453757 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f825e200640 1 --2- 172.21.15.73:0/1096453757 >> v2:172.21.15.73:3300/0 conn(0x7f825815b170 0x7f82580cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f8257e00640 1 -- 172.21.15.73:0/1096453757 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411673562 0 0) 0x7f825815cc00 con 0x7f82581538e0 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f8257e00640 1 -- 172.21.15.73:0/1096453757 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8240003520 con 0x7f82581538e0 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f8257e00640 1 -- 172.21.15.73:0/1096453757 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929583200 0 0) 0x7f8244001110 con 0x7f82580ca840 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f8257e00640 1 -- 172.21.15.73:0/1096453757 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f825815cc00 con 0x7f82580ca840 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f825e200640 1 -- 172.21.15.73:0/1096453757 >> v1:172.21.15.110:6789/0 conn(0x7f82581538e0 legacy=0x7f82580713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f825e200640 1 -- 172.21.15.73:0/1096453757 >> v1:172.21.15.73:6789/0 conn(0x7f82580ca840 legacy=0x7f825815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:02.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.374+0000 7f825e200640 1 -- 172.21.15.73:0/1096453757 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825815cea0 con 0x7f825815b170 2024-03-23T06:24:02.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.375+0000 7f825e200640 1 --2- 172.21.15.73:0/1096453757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580cf580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8250009d90 tx=0x7f825002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab37072c26965388 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:02.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8257e00640 1 -- 172.21.15.73:0/1096453757 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825002cd80 con 0x7f825815b170 2024-03-23T06:24:02.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8257e00640 1 -- 172.21.15.73:0/1096453757 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8250034440 con 0x7f825815b170 2024-03-23T06:24:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8257e00640 1 -- 172.21.15.73:0/1096453757 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500347f0 con 0x7f825815b170 2024-03-23T06:24:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8260200640 1 -- 172.21.15.73:0/1096453757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 msgr2=0x7f82580cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8260200640 1 --2- 172.21.15.73:0/1096453757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580cf580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8250009d90 tx=0x7f825002bfd0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8260200640 1 -- 172.21.15.73:0/1096453757 shutdown_connections 2024-03-23T06:24:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8260200640 1 --2- 172.21.15.73:0/1096453757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580cf580 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8260200640 1 -- 172.21.15.73:0/1096453757 >> 172.21.15.73:0/1096453757 conn(0x7f825806c200 msgr2=0x7f825806c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:24:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8260200640 1 -- 172.21.15.73:0/1096453757 shutdown_connections 2024-03-23T06:24:02.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.376+0000 7f8260200640 1 -- 172.21.15.73:0/1096453757 wait complete. 2024-03-23T06:24:02.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.378+0000 7f8260200640 1 Processor -- start 2024-03-23T06:24:02.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.378+0000 7f8260200640 1 -- start start 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f8260200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82580ca840 0x7f8258158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f8260200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82581538e0 0x7f82580ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f8260200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f8260200640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82581e54a0 con 0x7f825815b170 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f8260200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82580cdca0 con 0x7f82581538e0 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f8260200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82581e56f0 con 0x7f82580ca840 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f825e200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f825d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82580ca840 0x7f8258158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f825e200640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:48110/0 (socket says 172.21.15.73:48110) 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f825e200640 1 -- 172.21.15.73:0/1587874162 learned_addr learned my addr 172.21.15.73:0/1587874162 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.379+0000 7f825ce00640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82581538e0 0x7f82580ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:02.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f825e200640 1 -- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82580ca840 msgr2=0x7f8258158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f825e200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82580ca840 0x7f8258158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f825e200640 1 -- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82581538e0 msgr2=0x7f82580ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f825e200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82581538e0 0x7f82580ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f825e200640 1 -- 172.21.15.73:0/1587874162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250009a70 con 0x7f825815b170 2024-03-23T06:24:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f825e200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580ce6c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8250037040 tx=0x7f8250004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:02.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f8255600640 1 -- 172.21.15.73:0/1587874162 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250040450 con 0x7f825815b170 2024-03-23T06:24:02.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f8255600640 1 -- 172.21.15.73:0/1587874162 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f82500405f0 con 0x7f825815b170 2024-03-23T06:24:02.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f8255600640 1 -- 172.21.15.73:0/1587874162 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82500409c0 con 0x7f825815b170 2024-03-23T06:24:02.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.380+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82581efd40 con 0x7f825815b170 2024-03-23T06:24:02.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.381+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82581f0020 con 0x7f825815b170 2024-03-23T06:24:02.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.381+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82581efba0 con 0x7f825815b170 2024-03-23T06:24:02.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.382+0000 7f8255600640 1 -- 172.21.15.73:0/1587874162 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8250040b20 con 0x7f825815b170 2024-03-23T06:24:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.384+0000 7f8255600640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f823806ac00 0x7f823806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-23T06:24:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.384+0000 7f8255600640 1 -- 172.21.15.73:0/1587874162 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f82500ac140 con 0x7f825815b170 2024-03-23T06:24:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.384+0000 7f825d800640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f823806ac00 0x7f823806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-23T06:24:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.385+0000 7f825d800640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f823806ac00 0x7f823806d0c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f824c000f60 tx=0x7f824c007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-23T06:24:02.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.390+0000 7f8255600640 1 -- 172.21.15.73:0/1587874162 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f82581efba0 con 0x7f825815b170 2024-03-23T06:24:02.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:02.582+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f82581efba0 con 0x7f825815b170 2024-03-23T06:24:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.440+0000 7f8255600640 1 -- 172.21.15.73:0/1587874162 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f82581efba0 con 0x7f825815b170 2024-03-23T06:24:03.441 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data_ec' removed 2024-03-23T06:24:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.444+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f823806ac00 msgr2=0x7f823806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.444+0000 7f8260200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f823806ac00 0x7f823806d0c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f824c000f60 tx=0x7f824c007d50 comp rx=0 tx=0).stop 2024-03-23T06:24:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.444+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 msgr2=0x7f82580ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-23T06:24:03.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.444+0000 7f8260200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580ce6c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8250037040 tx=0x7f8250004a40 comp rx=0 tx=0).stop 2024-03-23T06:24:03.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.445+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 shutdown_connections 2024-03-23T06:24:03.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.445+0000 7f8260200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f825815b170 0x7f82580ce6c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:03.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.445+0000 7f8260200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82581538e0 0x7f82580ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:03.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.445+0000 7f8260200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:6832/37697,v1:172.21.15.110:6833/37697] conn(0x7f823806ac00 0x7f823806d0c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:03.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.445+0000 7f8260200640 1 --2- 172.21.15.73:0/1587874162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82580ca840 0x7f8258158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-23T06:24:03.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.445+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 >> 172.21.15.73:0/1587874162 conn(0x7f825806c200 msgr2=0x7f82580cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-23T06:24:03.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.446+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 shutdown_connections 2024-03-23T06:24:03.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-23T06:24:03.446+0000 7f8260200640 1 -- 172.21.15.73:0/1587874162 wait complete. 2024-03-23T06:24:03.472 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-23T06:24:03.472 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-23T06:24:03.472 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:03.511 INFO:tasks.ceph.mds.a:Stopped 2024-03-23T06:24:03.511 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-23T06:24:03.511 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:03.571 INFO:tasks.ceph.mds.c:Stopped 2024-03-23T06:24:03.571 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-23T06:24:03.571 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:03.632 INFO:tasks.ceph.mds.e:Stopped 2024-03-23T06:24:03.633 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-23T06:24:03.633 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:03.646 INFO:tasks.ceph.mds.b:Stopped 2024-03-23T06:24:03.646 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-23T06:24:03.646 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:03.698 INFO:tasks.ceph.mds.d:Stopped 2024-03-23T06:24:03.698 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-03-23T06:24:03.698 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:03.749 INFO:tasks.ceph.mds.f:Stopped 2024-03-23T06:24:03.749 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-23T06:24:03.749 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-23T06:24:03.749 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:09.852 INFO:tasks.ceph.osd.0:Stopped 2024-03-23T06:24:09.852 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-23T06:24:09.852 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:10.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-23T06:24:15.954 INFO:tasks.ceph.osd.1:Stopped 2024-03-23T06:24:15.954 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-23T06:24:15.954 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:16.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-23T06:24:16.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-23T06:24:22.056 INFO:tasks.ceph.osd.2:Stopped 2024-03-23T06:24:22.057 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-23T06:24:22.057 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:22.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-23T06:24:22.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-23T06:24:28.158 INFO:tasks.ceph.osd.3:Stopped 2024-03-23T06:24:28.159 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-23T06:24:28.159 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:28.216 INFO:tasks.ceph.osd.4:Stopped 2024-03-23T06:24:28.217 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-23T06:24:28.217 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:28.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-23T06:24:28.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-23T06:24:28.296 INFO:tasks.ceph.osd.5:Stopped 2024-03-23T06:24:28.296 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-23T06:24:28.296 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:28.367 INFO:tasks.ceph.osd.6:Stopped 2024-03-23T06:24:28.367 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-23T06:24:28.367 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:28.421 INFO:tasks.ceph.osd.7:Stopped 2024-03-23T06:24:28.421 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-23T06:24:28.421 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-23T06:24:28.421 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:33.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-03-23T06:24:33.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-23T06:24:34.523 INFO:tasks.ceph.mgr.y:Stopped 2024-03-23T06:24:34.523 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-23T06:24:34.523 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:34.562 INFO:tasks.ceph.mgr.x:Stopped 2024-03-23T06:24:34.562 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-23T06:24:34.563 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-23T06:24:34.563 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:34.609 INFO:tasks.ceph.mon.a:Stopped 2024-03-23T06:24:34.609 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-23T06:24:34.610 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:34.619 INFO:tasks.ceph.mon.b:Stopped 2024-03-23T06:24:34.620 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-23T06:24:34.620 INFO:teuthology.orchestra.run:waiting for 300 2024-03-23T06:24:34.671 INFO:tasks.ceph.mon.c:Stopped 2024-03-23T06:24:34.671 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-23T06:24:34.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-23T06:24:34.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:24:34.901 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-23T06:24:36.133 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:24:36.133 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-23T06:24:36.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:24:36.461 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-23T06:24:36.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:24:36.710 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-23T06:24:36.985 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:24:36.985 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-23T06:24:38.234 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:24:38.234 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-23T06:24:38.400 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:24:38.400 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-23T06:24:38.544 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:24:38.544 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-23T06:24:38.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-03-23T06:24:38.696 INFO:tasks.ceph:Archiving mon data... 2024-03-23T06:24:38.697 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/data/mon.a.tgz 2024-03-23T06:24:38.697 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-23T06:24:38.762 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.fRR5jBkr6d 2024-03-23T06:24:38.762 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.fRR5jBkr6d 2024-03-23T06:24:38.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.fRR5jBkr6d 2024-03-23T06:24:39.120 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.fRR5jBkr6d is 311KB 2024-03-23T06:24:39.217 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.fRR5jBkr6d 2024-03-23T06:24:39.266 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/data/mon.b.tgz 2024-03-23T06:24:39.266 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-03-23T06:24:39.302 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.nxULgTKFj4 2024-03-23T06:24:39.302 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nxULgTKFj4 2024-03-23T06:24:39.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.nxULgTKFj4 2024-03-23T06:24:39.589 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.nxULgTKFj4 is 311KB 2024-03-23T06:24:39.653 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.nxULgTKFj4 2024-03-23T06:24:39.667 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/data/mon.c.tgz 2024-03-23T06:24:39.667 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-03-23T06:24:39.721 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.PopstxCZO7 2024-03-23T06:24:39.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PopstxCZO7 2024-03-23T06:24:39.839 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.PopstxCZO7 2024-03-23T06:24:39.922 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.PopstxCZO7 is 311KB 2024-03-23T06:24:39.987 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.PopstxCZO7 2024-03-23T06:24:40.001 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-23T06:24:40.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-23T06:24:40.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-23T06:24:40.134 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-03-23T06:24:40.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-23T06:24:40.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-23T06:24:40.167 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-23T06:24:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-23T06:24:40.243 INFO:tasks.ceph:Archiving crash dumps... 2024-03-23T06:24:40.244 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/remote/smithi073/crash 2024-03-23T06:24:40.245 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-23T06:24:40.309 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/remote/smithi110/crash 2024-03-23T06:24:40.310 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-23T06:24:40.336 INFO:tasks.ceph:Shutting down logrotate 2024-03-23T06:28:21.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-23T06:28:21.679 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-23T06:28:21.780 INFO:tasks.ceph:Compressing logs... 2024-03-23T06:28:21.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-23T06:28:21.788 DEBUG:teuthology.orchestra.run.smithi110:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-23T06:37:24.288 INFO:tasks.ceph:Archiving logs... 2024-03-23T06:37:24.289 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/remote/smithi073/log 2024-03-23T06:37:24.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-23T06:38:48.398 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/remote/smithi110/log 2024-03-23T06:38:48.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-23T06:40:22.818 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-23T06:40:22.828 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-23T06:40:22.829 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-23T06:40:22.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-23T06:40:22.986 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-23T06:40:22.996 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-23T06:40:22.996 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T06:40:23.004 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-23T06:40:23.017 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-03-23T06:40:23.051 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-03-23T06:40:23.114 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-23T06:40:23.114 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-03-23T06:40:23.114 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 -393us[ -393us] +/- 87ms 2024-03-23T06:40:23.114 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 +62us[ +91us] +/- 64ms 2024-03-23T06:40:23.114 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +391us[ +391us] +/- 84ms 2024-03-23T06:40:23.114 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:40:23.151 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-23T06:40:23.151 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-03-23T06:40:23.151 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 28 -401us[ -388us] +/- 87ms 2024-03-23T06:40:23.151 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv02.front.sepia.ceph.com 3 6 377 27 +66us[ +79us] +/- 64ms 2024-03-23T06:40:23.151 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +380us[ +380us] +/- 84ms 2024-03-23T06:40:23.152 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-23T06:40:23.155 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-23T06:40:23.164 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-23T06:40:23.165 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-23T06:40:23.182 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-23T06:40:23.457 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-23T06:40:23.553 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-23T06:40:23.651 INFO:teuthology.orchestra.run.smithi073.stdout:type=AVC msg=audit(1711173504.861:198): avc: denied { checkpoint_restore } for pid=1158 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-03-23T06:40:23.652 DEBUG:teuthology.task.selinux:ubuntu@smithi073.front.sepia.ceph.com has 1 denials 2024-03-23T06:40:23.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-23T06:40:23.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T06:40:23.682 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi073.front.sepia.ceph.com: ['type=AVC msg=audit(1711173504.861:198): avc: denied { checkpoint_restore } for pid=1158 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-23T06:40:23.683 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-23T06:40:23.693 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-23T06:40:23.742 INFO:teuthology.task.internal:Duration was 2520.253275 seconds 2024-03-23T06:40:23.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-23T06:40:23.757 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-23T06:40:23.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-23T06:40:23.765 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-23T06:40:23.840 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-23T06:40:23.973 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-23T06:40:24.372 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-23T06:40:24.372 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-03-23T06:40:24.372 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-23T06:40:24.437 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-03-23T06:40:24.437 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-23T06:40:24.461 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-23T06:40:24.461 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-23T06:40:24.466 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-23T06:40:24.551 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-23T06:40:24.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-23T06:40:24.556 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-23T06:40:24.783 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-23T06:40:24.794 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-23T06:40:24.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-23T06:40:24.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-23T06:40:24.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-23T06:40:24.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-23T06:40:24.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-23T06:40:25.027 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-03-23T06:40:25.076 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-03-23T06:40:25.132 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-23T06:40:25.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T06:40:25.179 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-23T06:40:25.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-23T06:40:25.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-23T06:40:25.204 INFO:teuthology.task.internal:Transferring archived files... 2024-03-23T06:40:25.205 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/remote/smithi073 2024-03-23T06:40:25.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-23T06:40:25.327 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300/remote/smithi110 2024-03-23T06:40:25.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-23T06:40:25.363 INFO:teuthology.task.internal:Removing archive directory... 2024-03-23T06:40:25.363 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-23T06:40:25.371 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-23T06:40:25.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-23T06:40:25.429 INFO:teuthology.task.internal:Not uploading archives. 2024-03-23T06:40:25.429 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-23T06:40:25.458 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-23T06:40:25.458 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-23T06:40:25.466 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-23T06:40:25.480 INFO:teuthology.orchestra.run.smithi110.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 23 06:40 /home/ubuntu/cephtest 2024-03-23T06:40:25.515 INFO:teuthology.orchestra.run.smithi073.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 23 06:40 /home/ubuntu/cephtest 2024-03-23T06:40:25.518 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-23T06:40:25.531 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-23T06:40:25.552 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi073.front.sepia.ceph.com: ['type=AVC msg=audit(1711173504.861:198): avc: denied { checkpoint_restore } for pid=1158 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-23T06:40:25.552 INFO:teuthology.nuke:Checking targets against current locks 2024-03-23T06:40:25.579 DEBUG:teuthology.nuke:shortname: smithi073 2024-03-23T06:40:25.579 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-23T06:40:25.602 DEBUG:teuthology.nuke:shortname: smithi110 2024-03-23T06:40:25.602 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-23T06:40:25.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 05:49:31.952763', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJOIE+m5d5gJ9ejXRmMtymx5RlzM4GAGsrptPn422giAu2p9TfTzdvquQoKNZuiutzQhnKdfbOqpaQnwYPpSpKk='} 2024-03-23T06:40:25.625 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-22_13:15:24-fs-wip-yuri11-testing-2024-03-21-0851-reef-distro-default-smithi/7617300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-23 05:49:31.950968', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG6EUeBXM2SHebB8vY03X2DvVg1ilhcdNVWA+XcY3VpE765bfRcatHeM5kCe/R6uYTqUT1Tqao/GjgcmwT6wd5k='} 2024-03-23T06:40:25.654 INFO:teuthology.orchestra.console.smithi073:Power off 2024-03-23T06:40:25.654 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-23T06:40:25.678 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-03-23T06:40:25.678 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T06:40:25.693 INFO:teuthology.orchestra.console.smithi110:Power off 2024-03-23T06:40:25.693 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-23T06:40:25.704 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-23T06:40:25.716 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-03-23T06:40:25.716 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T06:40:25.739 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-23T06:40:29.705 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T06:40:29.740 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T06:40:29.815 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-23T06:40:29.850 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-23T06:40:33.821 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T06:40:33.852 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T06:40:33.931 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-23T06:40:33.961 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-03-23T06:40:37.934 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T06:40:37.961 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T06:40:38.045 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-03-23T06:40:38.070 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-03-23T06:40:38.147 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-03-23T06:40:38.171 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-03-23T06:40:38.277 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 5ec3e6e88b2e2783e09498588bb1f433ae9c8986 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} duration: 2520.2532753944397 failure_reason: 'SELinux denials found on ubuntu@smithi073.front.sepia.ceph.com: [''type=AVC msg=audit(1711173504.861:198): avc: denied { checkpoint_restore } for pid=1158 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'']' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-03-23T06:40:38.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T06:40:38.441 INFO:teuthology.run:FAIL